[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:58:09.804016   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:35023
I20260709 12:58:09.805773   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:58:09.807093   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:09.828146   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:09.828138   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:09.829015   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:11.108299   439 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 12:58:11.108482   431 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:58:11.113247   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:11.113555   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:11.113762   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601891113733 us; error 0 us; skew 500 ppm
I20260709 12:58:11.114619   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:11.120311   431 webserver.cc:533] Webserver started at http://127.0.107.254:42121/ using document root <none> and password file <none>
I20260709 12:58:11.121284   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:11.121551   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:11.122206   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:11.129485   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/master-0-root/instance:
uuid: "96a49216662549f3906d69dc702ef77b"
format_stamp: "Formatted at 2026-07-09 12:58:11 on dist-test-slave-c08m"
I20260709 12:58:11.138526   431 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:58:11.145110   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:11.146706   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:58:11.147161   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/master-0-root
uuid: "96a49216662549f3906d69dc702ef77b"
format_stamp: "Formatted at 2026-07-09 12:58:11 on dist-test-slave-c08m"
I20260709 12:58:11.147534   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:11.206602   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:11.208859   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:58:11.209522   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:11.307693   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:35023
I20260709 12:58:11.307834   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:35023 every 8 connection(s)
I20260709 12:58:11.317237   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:11.343777   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b: Bootstrap starting.
I20260709 12:58:11.350771   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:11.353350   498 log.cc:826] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b: Log is configured to *not* fsync() on all Append() calls
I20260709 12:58:11.358372   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b: No bootstrap required, opened a new log
I20260709 12:58:11.381407   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a49216662549f3906d69dc702ef77b" member_type: VOTER }
I20260709 12:58:11.382005   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:11.382211   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a49216662549f3906d69dc702ef77b, State: Initialized, Role: FOLLOWER
I20260709 12:58:11.383183   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a49216662549f3906d69dc702ef77b" member_type: VOTER }
I20260709 12:58:11.383685   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:11.383939   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:11.384238   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:11.389030   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a49216662549f3906d69dc702ef77b" member_type: VOTER }
I20260709 12:58:11.389899   498 leader_election.cc:304] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96a49216662549f3906d69dc702ef77b; no voters: 
I20260709 12:58:11.391923   498 leader_election.cc:290] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:11.392400   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:11.396065   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [term 1 LEADER]: Becoming Leader. State: Replica: 96a49216662549f3906d69dc702ef77b, State: Running, Role: LEADER
I20260709 12:58:11.397135   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a49216662549f3906d69dc702ef77b" member_type: VOTER }
I20260709 12:58:11.398339   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:11.411944   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96a49216662549f3906d69dc702ef77b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a49216662549f3906d69dc702ef77b" member_type: VOTER } }
I20260709 12:58:11.413442   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:11.413244   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96a49216662549f3906d69dc702ef77b. Latest consensus state: current_term: 1 leader_uuid: "96a49216662549f3906d69dc702ef77b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a49216662549f3906d69dc702ef77b" member_type: VOTER } }
I20260709 12:58:11.414173   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:11.417479   511 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:11.431414   511 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:11.434113   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:11.451567   511 catalog_manager.cc:1383] Generated new cluster ID: 9ad81e26ab90494ebac3847e4229b66a
I20260709 12:58:11.452010   511 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:11.482124   511 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:11.483744   511 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:11.500823   511 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b: Generated new TSK 0
I20260709 12:58:11.501864   511 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:11.567231   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:11.577602   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:11.579205   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:11.590613   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:11.591085   431 server_base.cc:1061] running on GCE node
I20260709 12:58:11.591952   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:11.592329   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:11.592566   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601891592540 us; error 0 us; skew 500 ppm
I20260709 12:58:11.593555   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:11.598824   431 webserver.cc:533] Webserver started at http://127.0.107.193:33361/ using document root <none> and password file <none>
I20260709 12:58:11.599447   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:11.599720   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:11.600047   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:11.601786   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-0-root/instance:
uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
format_stamp: "Formatted at 2026-07-09 12:58:11 on dist-test-slave-c08m"
I20260709 12:58:11.608294   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:58:11.613852   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:11.614868   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:58:11.615218   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-0-root
uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
format_stamp: "Formatted at 2026-07-09 12:58:11 on dist-test-slave-c08m"
I20260709 12:58:11.615540   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:11.651409   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:11.653045   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:11.656272   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:11.661636   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:11.661903   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:11.662261   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:11.662473   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:11.786957   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:37571
I20260709 12:58:11.787151   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:37571 every 8 connection(s)
I20260709 12:58:11.796746   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:11.808884   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:11.815573   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:11.834718   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35023
I20260709 12:58:11.834863   431 server_base.cc:1061] running on GCE node
I20260709 12:58:11.835681   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:11.837030   591 heartbeater.cc:507] Master 127.0.107.254:35023 requested a full tablet report, sending...
W20260709 12:58:11.837288   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:11.838604   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:11.838966   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:11.839174   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601891839153 us; error 0 us; skew 500 ppm
I20260709 12:58:11.839943   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:11.840286   463 ts_manager.cc:194] Registered new tserver with Master: 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571)
I20260709 12:58:11.843189   431 webserver.cc:533] Webserver started at http://127.0.107.194:35113/ using document root <none> and password file <none>
I20260709 12:58:11.843336   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48796
I20260709 12:58:11.843895   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:11.844172   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:11.844516   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:11.846071   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-1-root/instance:
uuid: "fda989108897478fb1e3be4f6025e904"
format_stamp: "Formatted at 2026-07-09 12:58:11 on dist-test-slave-c08m"
I20260709 12:58:11.853178   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:58:11.857771   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:11.858795   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:58:11.859138   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-1-root
uuid: "fda989108897478fb1e3be4f6025e904"
format_stamp: "Formatted at 2026-07-09 12:58:11 on dist-test-slave-c08m"
I20260709 12:58:11.859498   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:11.906945   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:11.908977   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:11.912570   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:11.916059   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:11.916378   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:11.916757   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:11.916987   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:12.019368   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39569
I20260709 12:58:12.019459   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39569 every 8 connection(s)
I20260709 12:58:12.027271   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:12.036375   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:12.038496   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:12.048077   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35023
I20260709 12:58:12.048556   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:12.049975   666 heartbeater.cc:507] Master 127.0.107.254:35023 requested a full tablet report, sending...
W20260709 12:58:12.051987   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:12.052260   431 server_base.cc:1061] running on GCE node
I20260709 12:58:12.052826   463 ts_manager.cc:194] Registered new tserver with Master: fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569)
I20260709 12:58:12.053346   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:12.053586   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:12.053764   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601892053747 us; error 0 us; skew 500 ppm
I20260709 12:58:12.054309   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:12.054628   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48804
I20260709 12:58:12.061178   431 webserver.cc:533] Webserver started at http://127.0.107.195:39459/ using document root <none> and password file <none>
I20260709 12:58:12.061736   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:12.061932   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:12.062201   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:12.063305   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-2-root/instance:
uuid: "161772e939c14b909e60e121f5bb7d61"
format_stamp: "Formatted at 2026-07-09 12:58:12 on dist-test-slave-c08m"
I20260709 12:58:12.068300   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 12:58:12.071969   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:12.072974   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:58:12.073318   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-2-root
uuid: "161772e939c14b909e60e121f5bb7d61"
format_stamp: "Formatted at 2026-07-09 12:58:12 on dist-test-slave-c08m"
I20260709 12:58:12.073637   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601889622018-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:12.116895   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:12.118434   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:12.119853   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:12.123696   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:12.123939   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:12.124179   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:12.124351   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:12.238785   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:35059
I20260709 12:58:12.238958   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:35059 every 8 connection(s)
I20260709 12:58:12.260869   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35023
I20260709 12:58:12.261314   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:12.262727   740 heartbeater.cc:507] Master 127.0.107.254:35023 requested a full tablet report, sending...
I20260709 12:58:12.265579   463 ts_manager.cc:194] Registered new tserver with Master: 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:12.265765   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.021090932s
I20260709 12:58:12.267092   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48812
I20260709 12:58:12.327257   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48824:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:12.331477   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 12:58:12.421288   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:12.484124   703 tablet_service.cc:1511] Processing CreateTablet for tablet 578c09d582dc4509a57497a3e8c55b49 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:12.482661   705 tablet_service.cc:1511] Processing CreateTablet for tablet 971370e0477944d8996e319be2e1c092 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:12.483136   704 tablet_service.cc:1511] Processing CreateTablet for tablet f5efa7edf6e8422f935f10bde32ff068 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:12.489019   556 tablet_service.cc:1511] Processing CreateTablet for tablet 971370e0477944d8996e319be2e1c092 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:12.488904   555 tablet_service.cc:1511] Processing CreateTablet for tablet f5efa7edf6e8422f935f10bde32ff068 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:12.492040   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 971370e0477944d8996e319be2e1c092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.491952   554 tablet_service.cc:1511] Processing CreateTablet for tablet 578c09d582dc4509a57497a3e8c55b49 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:12.493481   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5efa7edf6e8422f935f10bde32ff068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.495882   553 tablet_service.cc:1511] Processing CreateTablet for tablet 0f777b1f911549f68f4cc4aec116480c (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:58:12.498206   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5efa7edf6e8422f935f10bde32ff068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.501746   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f777b1f911549f68f4cc4aec116480c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.501946   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 971370e0477944d8996e319be2e1c092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.502032   702 tablet_service.cc:1511] Processing CreateTablet for tablet 0f777b1f911549f68f4cc4aec116480c (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:58:12.508090   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 578c09d582dc4509a57497a3e8c55b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.506024   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 578c09d582dc4509a57497a3e8c55b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.509377   552 tablet_service.cc:1511] Processing CreateTablet for tablet c14010b70425440e909875bf25f4eebf (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:12.512481   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f777b1f911549f68f4cc4aec116480c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.515924   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c14010b70425440e909875bf25f4eebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.528342   701 tablet_service.cc:1511] Processing CreateTablet for tablet c14010b70425440e909875bf25f4eebf (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:12.530426   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c14010b70425440e909875bf25f4eebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.562719   551 tablet_service.cc:1511] Processing CreateTablet for tablet dbc77d4426ed495fb2ba29a6ed637f46 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:12.567418   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc77d4426ed495fb2ba29a6ed637f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.588277   700 tablet_service.cc:1511] Processing CreateTablet for tablet dbc77d4426ed495fb2ba29a6ed637f46 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:12.592473   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc77d4426ed495fb2ba29a6ed637f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.636936   699 tablet_service.cc:1511] Processing CreateTablet for tablet 9ba3b88fda0a4b43914839e64faeb702 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:12.640769   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ba3b88fda0a4b43914839e64faeb702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.645047   758 tablet_bootstrap.cc:492] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7: Bootstrap starting.
I20260709 12:58:12.656752   629 tablet_service.cc:1511] Processing CreateTablet for tablet 578c09d582dc4509a57497a3e8c55b49 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:12.655885   556 tablet_service.cc:1511] Processing CreateTablet for tablet 9ba3b88fda0a4b43914839e64faeb702 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:12.659557   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ba3b88fda0a4b43914839e64faeb702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.660473   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 578c09d582dc4509a57497a3e8c55b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.652956   631 tablet_service.cc:1511] Processing CreateTablet for tablet 971370e0477944d8996e319be2e1c092 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:12.654374   630 tablet_service.cc:1511] Processing CreateTablet for tablet f5efa7edf6e8422f935f10bde32ff068 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:12.671375   627 tablet_service.cc:1511] Processing CreateTablet for tablet c14010b70425440e909875bf25f4eebf (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:12.671232   628 tablet_service.cc:1511] Processing CreateTablet for tablet 0f777b1f911549f68f4cc4aec116480c (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:58:12.676744   759 tablet_bootstrap.cc:492] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61: Bootstrap starting.
I20260709 12:58:12.678996   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 971370e0477944d8996e319be2e1c092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.681093   626 tablet_service.cc:1511] Processing CreateTablet for tablet dbc77d4426ed495fb2ba29a6ed637f46 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:12.682260   625 tablet_service.cc:1511] Processing CreateTablet for tablet 9ba3b88fda0a4b43914839e64faeb702 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:12.686918   553 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0df8f6ad8d46ddb59f729ea0fe63eb (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:12.689067   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0df8f6ad8d46ddb59f729ea0fe63eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.691201   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5efa7edf6e8422f935f10bde32ff068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.692406   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ba3b88fda0a4b43914839e64faeb702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.693984   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc77d4426ed495fb2ba29a6ed637f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.698771   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f777b1f911549f68f4cc4aec116480c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.698895   624 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0df8f6ad8d46ddb59f729ea0fe63eb (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:12.701493   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c14010b70425440e909875bf25f4eebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.703092   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0df8f6ad8d46ddb59f729ea0fe63eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.767726   552 tablet_service.cc:1511] Processing CreateTablet for tablet e549157c45c640c68cc0fa9640e0dab2 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:58:12.771498   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e549157c45c640c68cc0fa9640e0dab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.768898   623 tablet_service.cc:1511] Processing CreateTablet for tablet e549157c45c640c68cc0fa9640e0dab2 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:58:12.777201   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e549157c45c640c68cc0fa9640e0dab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.813126   758 tablet_bootstrap.cc:654] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.819686   699 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0df8f6ad8d46ddb59f729ea0fe63eb (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:12.820894   759 tablet_bootstrap.cc:654] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.842307   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0df8f6ad8d46ddb59f729ea0fe63eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.845232   760 tablet_bootstrap.cc:492] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904: Bootstrap starting.
I20260709 12:58:12.846680   591 heartbeater.cc:499] Master 127.0.107.254:35023 was elected leader, sending a full tablet report...
I20260709 12:58:12.845279   700 tablet_service.cc:1511] Processing CreateTablet for tablet e549157c45c640c68cc0fa9640e0dab2 (DEFAULT_TABLE table=test-workload [id=b60772ef35004c48985093d5de6cab0a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:58:12.853044   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e549157c45c640c68cc0fa9640e0dab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:12.862334   758 tablet_bootstrap.cc:492] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7: No bootstrap required, opened a new log
I20260709 12:58:12.863018   758 ts_tablet_manager.cc:1403] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent bootstrapping tablet: real 0.226s	user 0.015s	sys 0.009s
I20260709 12:58:12.870092   760 tablet_bootstrap.cc:654] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.876641   759 tablet_bootstrap.cc:492] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61: No bootstrap required, opened a new log
I20260709 12:58:12.877238   759 ts_tablet_manager.cc:1403] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61: Time spent bootstrapping tablet: real 0.221s	user 0.003s	sys 0.020s
I20260709 12:58:12.878400   758 raft_consensus.cc:359] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:12.879454   758 raft_consensus.cc:385] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.879792   758 raft_consensus.cc:740] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.882170   759 raft_consensus.cc:359] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:12.882926   759 raft_consensus.cc:385] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.883399   759 raft_consensus.cc:740] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.884297   759 consensus_queue.cc:260] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:12.893708   759 ts_tablet_manager.cc:1434] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61: Time spent starting tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:58:12.894708   740 heartbeater.cc:499] Master 127.0.107.254:35023 was elected leader, sending a full tablet report...
I20260709 12:58:12.895001   758 consensus_queue.cc:260] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:12.901592   759 tablet_bootstrap.cc:492] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61: Bootstrap starting.
I20260709 12:58:12.915201   760 tablet_bootstrap.cc:492] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904: No bootstrap required, opened a new log
I20260709 12:58:12.915869   760 ts_tablet_manager.cc:1403] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.000s
I20260709 12:58:12.918876   758 ts_tablet_manager.cc:1434] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.012s
I20260709 12:58:12.920176   758 tablet_bootstrap.cc:492] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7: Bootstrap starting.
I20260709 12:58:12.922961   760 raft_consensus.cc:359] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:12.923691   759 tablet_bootstrap.cc:654] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.924059   760 raft_consensus.cc:385] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.930675   758 tablet_bootstrap.cc:654] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.924508   760 raft_consensus.cc:740] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.932134   760 consensus_queue.cc:260] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:12.937758   666 heartbeater.cc:499] Master 127.0.107.254:35023 was elected leader, sending a full tablet report...
I20260709 12:58:12.939369   760 ts_tablet_manager.cc:1434] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 12:58:12.940840   760 tablet_bootstrap.cc:492] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904: Bootstrap starting.
I20260709 12:58:12.949540   760 tablet_bootstrap.cc:654] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.954855   758 tablet_bootstrap.cc:492] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7: No bootstrap required, opened a new log
I20260709 12:58:12.955394   758 ts_tablet_manager.cc:1403] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.014s
I20260709 12:58:12.957267   759 tablet_bootstrap.cc:492] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61: No bootstrap required, opened a new log
I20260709 12:58:12.957425   763 raft_consensus.cc:493] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.958148   759 ts_tablet_manager.cc:1403] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.002s
I20260709 12:58:12.957995   763 raft_consensus.cc:515] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:12.961768   763 leader_election.cc:290] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569)
I20260709 12:58:12.964362   758 raft_consensus.cc:359] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:12.965191   758 raft_consensus.cc:385] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.965503   758 raft_consensus.cc:740] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.966243   758 consensus_queue.cc:260] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:12.968587   758 ts_tablet_manager.cc:1434] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:58:12.969538   758 tablet_bootstrap.cc:492] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7: Bootstrap starting.
I20260709 12:58:12.972009   760 tablet_bootstrap.cc:492] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904: No bootstrap required, opened a new log
I20260709 12:58:12.972708   760 ts_tablet_manager.cc:1403] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.014s
I20260709 12:58:12.976652   758 tablet_bootstrap.cc:654] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:12.980410   760 raft_consensus.cc:359] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:12.981281   760 raft_consensus.cc:385] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.981700   759 raft_consensus.cc:359] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:12.984812   759 raft_consensus.cc:385] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:12.985255   759 raft_consensus.cc:740] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.988183   759 consensus_queue.cc:260] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:12.981786   760 raft_consensus.cc:740] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Initialized, Role: FOLLOWER
I20260709 12:58:12.992188   760 consensus_queue.cc:260] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:12.997756   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5efa7edf6e8422f935f10bde32ff068" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" is_pre_election: true
I20260709 12:58:12.998636   566 raft_consensus.cc:2468] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 0.
I20260709 12:58:12.998836   760 ts_tablet_manager.cc:1434] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:58:13.000474   680 leader_election.cc:304] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7; no voters: 
I20260709 12:58:13.001335   763 raft_consensus.cc:2804] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:58:13.001746   741 tablet.cc:2406] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:58:13.001955   763 raft_consensus.cc:493] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.005395   763 raft_consensus.cc:3060] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.001966   760 tablet_bootstrap.cc:492] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904: Bootstrap starting.
I20260709 12:58:13.011780   767 raft_consensus.cc:493] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.012006   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5efa7edf6e8422f935f10bde32ff068" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904" is_pre_election: true
I20260709 12:58:13.012485   767 raft_consensus.cc:515] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.015538   765 raft_consensus.cc:493] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:13.016004   679 leader_election.cc:343] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.016618   765 raft_consensus.cc:515] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:13.031138   765 leader_election.cc:290] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059), fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569)
I20260709 12:58:13.029754   767 leader_election.cc:290] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.036166   763 raft_consensus.cc:515] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.033954   759 ts_tablet_manager.cc:1434] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.000s
I20260709 12:58:13.044430   759 tablet_bootstrap.cc:492] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61: Bootstrap starting.
I20260709 12:58:13.048266   758 tablet_bootstrap.cc:492] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7: No bootstrap required, opened a new log
I20260709 12:58:13.049986   758 ts_tablet_manager.cc:1403] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.022s
I20260709 12:58:13.051926   763 leader_election.cc:290] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569)
I20260709 12:58:13.053521   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5efa7edf6e8422f935f10bde32ff068" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904"
W20260709 12:58:13.055797   679 leader_election.cc:343] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.054687   758 raft_consensus.cc:359] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.057318   758 raft_consensus.cc:385] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.057634   760 tablet_bootstrap.cc:654] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.057729   758 raft_consensus.cc:740] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.059096   758 consensus_queue.cc:260] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.062003   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5efa7edf6e8422f935f10bde32ff068" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:13.062583   566 raft_consensus.cc:3060] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.062752   758 ts_tablet_manager.cc:1434] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:58:13.063859   758 tablet_bootstrap.cc:492] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7: Bootstrap starting.
I20260709 12:58:13.080355   759 tablet_bootstrap.cc:654] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.099929   760 tablet_bootstrap.cc:492] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904: No bootstrap required, opened a new log
I20260709 12:58:13.102279   760 ts_tablet_manager.cc:1403] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.021s
I20260709 12:58:13.107611   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971370e0477944d8996e319be2e1c092" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61" is_pre_election: true
W20260709 12:58:13.111052   531 leader_election.cc:343] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.112134   566 raft_consensus.cc:2468] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 1.
I20260709 12:58:13.112354   760 raft_consensus.cc:359] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.113483   760 raft_consensus.cc:385] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.113907   760 raft_consensus.cc:740] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.115097   760 consensus_queue.cc:260] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.118263   760 ts_tablet_manager.cc:1434] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:58:13.120848   760 tablet_bootstrap.cc:492] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904: Bootstrap starting.
I20260709 12:58:13.123238   758 tablet_bootstrap.cc:654] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.124684   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971370e0477944d8996e319be2e1c092" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904" is_pre_election: true
W20260709 12:58:13.126785   530 leader_election.cc:343] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.128185   530 leader_election.cc:304] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7; no voters: 161772e939c14b909e60e121f5bb7d61, fda989108897478fb1e3be4f6025e904
I20260709 12:58:13.129585   765 raft_consensus.cc:2749] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.131124   680 leader_election.cc:304] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7; no voters: fda989108897478fb1e3be4f6025e904
I20260709 12:58:13.136277   763 raft_consensus.cc:2804] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.153905   760 tablet_bootstrap.cc:654] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.154307   763 raft_consensus.cc:697] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Becoming Leader. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Running, Role: LEADER
I20260709 12:58:13.155809   763 consensus_queue.cc:237] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.158146   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" is_pre_election: true
I20260709 12:58:13.158807   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61" is_pre_election: true
I20260709 12:58:13.159899   758 tablet_bootstrap.cc:492] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7: No bootstrap required, opened a new log
W20260709 12:58:13.160526   606 leader_election.cc:343] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.161423   758 ts_tablet_manager.cc:1403] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent bootstrapping tablet: real 0.098s	user 0.008s	sys 0.013s
W20260709 12:58:13.161782   606 leader_election.cc:343] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.162289   606 leader_election.cc:304] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fda989108897478fb1e3be4f6025e904; no voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7
I20260709 12:58:13.163568   767 raft_consensus.cc:2749] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.154309   759 tablet_bootstrap.cc:492] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61: No bootstrap required, opened a new log
I20260709 12:58:13.165235   759 ts_tablet_manager.cc:1403] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61: Time spent bootstrapping tablet: real 0.121s	user 0.015s	sys 0.017s
I20260709 12:58:13.165830   758 raft_consensus.cc:359] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.167534   758 raft_consensus.cc:385] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.167937   758 raft_consensus.cc:740] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.168648   759 raft_consensus.cc:359] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.169387   759 raft_consensus.cc:385] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.169021   758 consensus_queue.cc:260] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.169697   759 raft_consensus.cc:740] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.171947   758 ts_tablet_manager.cc:1434] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.008s
I20260709 12:58:13.173599   760 tablet_bootstrap.cc:492] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904: No bootstrap required, opened a new log
I20260709 12:58:13.177172   760 ts_tablet_manager.cc:1403] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.001s
I20260709 12:58:13.180850   760 raft_consensus.cc:359] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.173986   759 consensus_queue.cc:260] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.184017   759 ts_tablet_manager.cc:1434] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:58:13.173471   758 tablet_bootstrap.cc:492] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7: Bootstrap starting.
I20260709 12:58:13.185211   759 tablet_bootstrap.cc:492] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61: Bootstrap starting.
I20260709 12:58:13.185710   461 catalog_manager.cc:5697] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 161772e939c14b909e60e121f5bb7d61 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "161772e939c14b909e60e121f5bb7d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.193761   758 tablet_bootstrap.cc:654] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.193907   760 raft_consensus.cc:385] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.194301   760 raft_consensus.cc:740] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.195879   760 consensus_queue.cc:260] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.198429   760 ts_tablet_manager.cc:1434] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:58:13.199628   760 tablet_bootstrap.cc:492] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904: Bootstrap starting.
I20260709 12:58:13.207160   767 raft_consensus.cc:493] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.207858   767 raft_consensus.cc:515] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.193763   759 tablet_bootstrap.cc:654] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.218181   767 leader_election.cc:290] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.220873   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc77d4426ed495fb2ba29a6ed637f46" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61" is_pre_election: true
I20260709 12:58:13.220638   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc77d4426ed495fb2ba29a6ed637f46" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" is_pre_election: true
W20260709 12:58:13.222275   606 leader_election.cc:343] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:13.223209   606 leader_election.cc:343] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.223773   606 leader_election.cc:304] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fda989108897478fb1e3be4f6025e904; no voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7
I20260709 12:58:13.225167   767 raft_consensus.cc:2749] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.229095   758 tablet_bootstrap.cc:492] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7: No bootstrap required, opened a new log
I20260709 12:58:13.230721   760 tablet_bootstrap.cc:654] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.230074   758 ts_tablet_manager.cc:1403] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.009s
I20260709 12:58:13.240356   758 raft_consensus.cc:359] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.242280   758 raft_consensus.cc:385] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.242952   758 raft_consensus.cc:740] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.244096   758 consensus_queue.cc:260] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.247175   758 ts_tablet_manager.cc:1434] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:58:13.249090   758 tablet_bootstrap.cc:492] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7: Bootstrap starting.
I20260709 12:58:13.266652   759 tablet_bootstrap.cc:492] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61: No bootstrap required, opened a new log
I20260709 12:58:13.267313   759 ts_tablet_manager.cc:1403] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.012s
I20260709 12:58:13.268081   760 tablet_bootstrap.cc:492] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904: No bootstrap required, opened a new log
I20260709 12:58:13.268564   760 ts_tablet_manager.cc:1403] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.012s
I20260709 12:58:13.268813   758 tablet_bootstrap.cc:654] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.274425   759 raft_consensus.cc:359] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:13.275383   759 raft_consensus.cc:385] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.275774   759 raft_consensus.cc:740] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.275478   760 raft_consensus.cc:359] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.276957   760 raft_consensus.cc:385] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.276790   759 consensus_queue.cc:260] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:13.277313   760 raft_consensus.cc:740] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.278208   760 consensus_queue.cc:260] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.279102   758 tablet_bootstrap.cc:492] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7: No bootstrap required, opened a new log
I20260709 12:58:13.279557   758 ts_tablet_manager.cc:1403] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.007s
I20260709 12:58:13.281373   760 ts_tablet_manager.cc:1434] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:58:13.282348   760 tablet_bootstrap.cc:492] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904: Bootstrap starting.
I20260709 12:58:13.282830   758 raft_consensus.cc:359] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.283552   758 raft_consensus.cc:385] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.283856   758 raft_consensus.cc:740] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.283900   767 raft_consensus.cc:493] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.283970   763 raft_consensus.cc:493] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.284449   767 raft_consensus.cc:515] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.284704   758 consensus_queue.cc:260] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.284613   763 raft_consensus.cc:515] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.286542   767 leader_election.cc:290] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.287474   758 ts_tablet_manager.cc:1434] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:58:13.288013   763 leader_election.cc:290] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569)
I20260709 12:58:13.288462   758 tablet_bootstrap.cc:492] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7: Bootstrap starting.
I20260709 12:58:13.288920   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5efa7edf6e8422f935f10bde32ff068" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61" is_pre_election: true
I20260709 12:58:13.289156   759 ts_tablet_manager.cc:1434] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 12:58:13.289518   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5efa7edf6e8422f935f10bde32ff068" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" is_pre_election: true
I20260709 12:58:13.290938   759 tablet_bootstrap.cc:492] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61: Bootstrap starting.
I20260709 12:58:13.291095   566 raft_consensus.cc:2393] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fda989108897478fb1e3be4f6025e904 in current term 1: Already voted for candidate 161772e939c14b909e60e121f5bb7d61 in this term.
I20260709 12:58:13.291128   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904" is_pre_election: true
I20260709 12:58:13.291676   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" is_pre_election: true
I20260709 12:58:13.293735   565 raft_consensus.cc:2468] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 0.
I20260709 12:58:13.295643   606 leader_election.cc:304] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fda989108897478fb1e3be4f6025e904; no voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7
I20260709 12:58:13.299823   680 leader_election.cc:304] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7; no voters: 
I20260709 12:58:13.301630   763 raft_consensus.cc:2804] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.304877   763 raft_consensus.cc:493] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.305285   763 raft_consensus.cc:3060] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:13.302173   679 leader_election.cc:343] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.300697   767 raft_consensus.cc:3060] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.322208   758 tablet_bootstrap.cc:654] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.317554   767 raft_consensus.cc:2749] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.324785   760 tablet_bootstrap.cc:654] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.323709   763 raft_consensus.cc:515] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.326581   767 raft_consensus.cc:493] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.328135   765 raft_consensus.cc:493] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.328658   765 raft_consensus.cc:515] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.330633   765 leader_election.cc:290] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.331837   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61" is_pre_election: true
I20260709 12:58:13.333395   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:13.334089   565 raft_consensus.cc:3060] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.328030   767 raft_consensus.cc:515] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.334282   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904" is_pre_election: true
I20260709 12:58:13.335721   759 tablet_bootstrap.cc:654] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:13.337210   531 leader_election.cc:343] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.339113   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904"
W20260709 12:58:13.342324   679 leader_election.cc:343] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.337474   763 leader_election.cc:290] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569)
W20260709 12:58:13.340016   530 leader_election.cc:343] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.346093   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3b88fda0a4b43914839e64faeb702" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" is_pre_election: true
I20260709 12:58:13.347544   566 raft_consensus.cc:2468] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 0.
I20260709 12:58:13.347707   767 leader_election.cc:290] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.349486   530 leader_election.cc:304] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7; no voters: 161772e939c14b909e60e121f5bb7d61, fda989108897478fb1e3be4f6025e904
I20260709 12:58:13.350546   765 raft_consensus.cc:2749] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.358938   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3b88fda0a4b43914839e64faeb702" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61" is_pre_election: true
I20260709 12:58:13.360247   760 tablet_bootstrap.cc:492] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904: No bootstrap required, opened a new log
I20260709 12:58:13.360916   760 ts_tablet_manager.cc:1403] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.012s
I20260709 12:58:13.358569   606 leader_election.cc:304] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:13.363226   767 raft_consensus.cc:2804] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.363797   767 raft_consensus.cc:493] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.364281   767 raft_consensus.cc:3060] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.365154   760 raft_consensus.cc:359] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:13.365934   760 raft_consensus.cc:385] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.366307   760 raft_consensus.cc:740] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.368963   760 consensus_queue.cc:260] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:13.370620   565 raft_consensus.cc:2468] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 1.
I20260709 12:58:13.373368   760 ts_tablet_manager.cc:1434] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:58:13.373777   680 leader_election.cc:304] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7; no voters: fda989108897478fb1e3be4f6025e904
I20260709 12:58:13.376014   758 tablet_bootstrap.cc:492] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7: No bootstrap required, opened a new log
I20260709 12:58:13.376199   763 raft_consensus.cc:2804] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:58:13.376008   606 leader_election.cc:343] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.377787   763 raft_consensus.cc:697] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Becoming Leader. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Running, Role: LEADER
I20260709 12:58:13.379577   763 consensus_queue.cc:237] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.380726   767 raft_consensus.cc:515] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.382928   767 leader_election.cc:290] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.384093   760 tablet_bootstrap.cc:492] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904: Bootstrap starting.
I20260709 12:58:13.385504   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3b88fda0a4b43914839e64faeb702" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:13.386996   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3b88fda0a4b43914839e64faeb702" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:13.387639   759 tablet_bootstrap.cc:492] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61: No bootstrap required, opened a new log
I20260709 12:58:13.387609   565 raft_consensus.cc:3060] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.377509   758 ts_tablet_manager.cc:1403] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.007s
I20260709 12:58:13.388257   759 ts_tablet_manager.cc:1403] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61: Time spent bootstrapping tablet: real 0.098s	user 0.018s	sys 0.006s
W20260709 12:58:13.390244   606 leader_election.cc:343] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.393034   758 raft_consensus.cc:359] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.393818   758 raft_consensus.cc:385] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.393738   759 raft_consensus.cc:359] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.394642   759 raft_consensus.cc:385] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.394292   758 raft_consensus.cc:740] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.394994   759 raft_consensus.cc:740] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.395838   759 consensus_queue.cc:260] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.397063   565 raft_consensus.cc:2468] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 1.
I20260709 12:58:13.395944   758 consensus_queue.cc:260] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.398480   606 leader_election.cc:304] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 161772e939c14b909e60e121f5bb7d61
I20260709 12:58:13.399507   760 tablet_bootstrap.cc:654] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.399814   767 raft_consensus.cc:2804] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.401269   767 raft_consensus.cc:697] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 1 LEADER]: Becoming Leader. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:13.402249   767 consensus_queue.cc:237] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.405990   759 ts_tablet_manager.cc:1434] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:58:13.407757   759 tablet_bootstrap.cc:492] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61: Bootstrap starting.
I20260709 12:58:13.418159   758 ts_tablet_manager.cc:1434] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.002s
I20260709 12:58:13.421484   758 tablet_bootstrap.cc:492] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7: Bootstrap starting.
I20260709 12:58:13.422049   760 tablet_bootstrap.cc:492] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904: No bootstrap required, opened a new log
I20260709 12:58:13.422518   760 ts_tablet_manager.cc:1403] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.008s
I20260709 12:58:13.414696   463 catalog_manager.cc:5697] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 161772e939c14b909e60e121f5bb7d61 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "161772e939c14b909e60e121f5bb7d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.423842   461 catalog_manager.cc:5697] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 reported cstate change: term changed from 0 to 1, leader changed from <none> to fda989108897478fb1e3be4f6025e904 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fda989108897478fb1e3be4f6025e904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:13.426209   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:13.430015   760 raft_consensus.cc:359] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.430763   760 raft_consensus.cc:385] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.431046   760 raft_consensus.cc:740] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.431754   760 consensus_queue.cc:260] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.434432   760 ts_tablet_manager.cc:1434] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:58:13.434518   758 tablet_bootstrap.cc:654] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.435487   760 tablet_bootstrap.cc:492] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904: Bootstrap starting.
I20260709 12:58:13.442658   759 tablet_bootstrap.cc:654] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.453771   760 tablet_bootstrap.cc:654] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.474006   767 raft_consensus.cc:493] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.474741   767 raft_consensus.cc:515] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.479528   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e549157c45c640c68cc0fa9640e0dab2" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" is_pre_election: true
W20260709 12:58:13.481612   606 leader_election.cc:343] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.482657   767 leader_election.cc:290] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.483443   758 tablet_bootstrap.cc:492] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7: No bootstrap required, opened a new log
I20260709 12:58:13.483985   758 ts_tablet_manager.cc:1403] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.020s
I20260709 12:58:13.484300   759 tablet_bootstrap.cc:492] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61: No bootstrap required, opened a new log
I20260709 12:58:13.484368   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e549157c45c640c68cc0fa9640e0dab2" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61" is_pre_election: true
I20260709 12:58:13.485133   759 ts_tablet_manager.cc:1403] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.027s
W20260709 12:58:13.486599   606 leader_election.cc:343] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:13.487054   606 leader_election.cc:304] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fda989108897478fb1e3be4f6025e904; no voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7
I20260709 12:58:13.488555   767 raft_consensus.cc:2749] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.488511   758 raft_consensus.cc:359] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.489496   758 raft_consensus.cc:385] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.489853   758 raft_consensus.cc:740] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.490649   758 consensus_queue.cc:260] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.492162   758 ts_tablet_manager.cc:1434] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:58:13.493448   758 tablet_bootstrap.cc:492] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7: Bootstrap starting.
I20260709 12:58:13.493960   763 raft_consensus.cc:493] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.494453   763 raft_consensus.cc:515] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:13.494136   759 raft_consensus.cc:359] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.495321   759 raft_consensus.cc:385] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.495693   759 raft_consensus.cc:740] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.496551   763 leader_election.cc:290] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571)
I20260709 12:58:13.497889   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971370e0477944d8996e319be2e1c092" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904" is_pre_election: true
I20260709 12:58:13.498522   641 raft_consensus.cc:2468] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 0.
I20260709 12:58:13.498721   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971370e0477944d8996e319be2e1c092" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" is_pre_election: true
I20260709 12:58:13.499363   565 raft_consensus.cc:2468] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 0.
I20260709 12:58:13.500001   679 leader_election.cc:304] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:13.500995   767 raft_consensus.cc:493] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.501458   767 raft_consensus.cc:515] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.502243   759 consensus_queue.cc:260] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.505359   782 raft_consensus.cc:2804] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.505769   782 raft_consensus.cc:493] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.505941   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61" is_pre_election: true
I20260709 12:58:13.506132   782 raft_consensus.cc:3060] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.503765   767 leader_election.cc:290] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.507164   760 tablet_bootstrap.cc:492] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904: No bootstrap required, opened a new log
I20260709 12:58:13.507339   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" is_pre_election: true
I20260709 12:58:13.507766   715 raft_consensus.cc:2468] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 0.
I20260709 12:58:13.508494   759 ts_tablet_manager.cc:1434] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.003s
I20260709 12:58:13.509562   760 ts_tablet_manager.cc:1403] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904: Time spent bootstrapping tablet: real 0.074s	user 0.025s	sys 0.005s
I20260709 12:58:13.512823   759 tablet_bootstrap.cc:492] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61: Bootstrap starting.
I20260709 12:58:13.508565   565 raft_consensus.cc:2468] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 0.
I20260709 12:58:13.512849   606 leader_election.cc:304] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:13.514523   760 raft_consensus.cc:359] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.515170   760 raft_consensus.cc:385] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.515177   767 raft_consensus.cc:2804] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.515561   760 raft_consensus.cc:740] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.515780   767 raft_consensus.cc:493] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.511832   758 tablet_bootstrap.cc:654] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.516121   767 raft_consensus.cc:3060] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.517545   760 consensus_queue.cc:260] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.520555   760 ts_tablet_manager.cc:1434] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:58:13.521625   760 tablet_bootstrap.cc:492] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904: Bootstrap starting.
I20260709 12:58:13.528404   759 tablet_bootstrap.cc:654] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.533272   792 raft_consensus.cc:493] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.533982   792 raft_consensus.cc:515] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.534497   782 raft_consensus.cc:515] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:13.537569   782 leader_election.cc:290] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 election: Requested vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571)
I20260709 12:58:13.537818   792 leader_election.cc:290] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.541047   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14010b70425440e909875bf25f4eebf" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61" is_pre_election: true
I20260709 12:58:13.541814   715 raft_consensus.cc:2468] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 0.
I20260709 12:58:13.543126   760 tablet_bootstrap.cc:654] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.542891   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971370e0477944d8996e319be2e1c092" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:13.543681   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14010b70425440e909875bf25f4eebf" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" is_pre_election: true
I20260709 12:58:13.536525   767 raft_consensus.cc:515] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.545466   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971370e0477944d8996e319be2e1c092" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:13.545936   565 raft_consensus.cc:2468] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 0.
I20260709 12:58:13.546525   641 raft_consensus.cc:3060] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.544930   606 leader_election.cc:304] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:13.547775   767 leader_election.cc:290] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.550081   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:13.550993   792 raft_consensus.cc:2804] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.551362   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:13.551581   792 raft_consensus.cc:493] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.552008   565 raft_consensus.cc:3060] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.552107   792 raft_consensus.cc:3060] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.550701   566 raft_consensus.cc:3060] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.551010   715 raft_consensus.cc:3060] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.560151   565 raft_consensus.cc:2468] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 1.
I20260709 12:58:13.564563   606 leader_election.cc:304] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:13.568029   767 raft_consensus.cc:2804] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.572947   759 tablet_bootstrap.cc:492] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61: No bootstrap required, opened a new log
I20260709 12:58:13.573519   759 ts_tablet_manager.cc:1403] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.004s
I20260709 12:58:13.576660   767 raft_consensus.cc:697] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 1 LEADER]: Becoming Leader. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:13.577693   767 consensus_queue.cc:237] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.582785   758 tablet_bootstrap.cc:492] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7: No bootstrap required, opened a new log
I20260709 12:58:13.583338   758 ts_tablet_manager.cc:1403] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent bootstrapping tablet: real 0.090s	user 0.005s	sys 0.034s
I20260709 12:58:13.584896   641 raft_consensus.cc:2468] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 1.
I20260709 12:58:13.585913   566 raft_consensus.cc:2468] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 1.
I20260709 12:58:13.585733   759 raft_consensus.cc:359] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.587657   759 raft_consensus.cc:385] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.588438   759 raft_consensus.cc:740] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.586313   679 leader_election.cc:304] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:13.586793   758 raft_consensus.cc:359] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.590220   759 consensus_queue.cc:260] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.590926   782 raft_consensus.cc:2804] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.589919   758 raft_consensus.cc:385] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.591964   758 raft_consensus.cc:740] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.593207   782 raft_consensus.cc:697] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Becoming Leader. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Running, Role: LEADER
I20260709 12:58:13.594389   758 consensus_queue.cc:260] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.595351   760 tablet_bootstrap.cc:492] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904: No bootstrap required, opened a new log
I20260709 12:58:13.594141   782 consensus_queue.cc:237] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:13.602308   760 ts_tablet_manager.cc:1403] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.020s
I20260709 12:58:13.599169   715 raft_consensus.cc:2468] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 1.
I20260709 12:58:13.618860   763 consensus_queue.cc:1048] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:13.623075   758 ts_tablet_manager.cc:1434] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.004s
I20260709 12:58:13.624404   760 raft_consensus.cc:359] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.625240   760 raft_consensus.cc:385] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.625514   760 raft_consensus.cc:740] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.626288   760 consensus_queue.cc:260] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.629102   760 ts_tablet_manager.cc:1434] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.012s
I20260709 12:58:13.628713   792 raft_consensus.cc:515] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.630431   763 consensus_queue.cc:1048] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:13.634001   759 ts_tablet_manager.cc:1434] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.002s
I20260709 12:58:13.634737   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14010b70425440e909875bf25f4eebf" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:13.635332   566 raft_consensus.cc:3060] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.635491   759 tablet_bootstrap.cc:492] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61: Bootstrap starting.
I20260709 12:58:13.637812   792 leader_election.cc:290] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.638981   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14010b70425440e909875bf25f4eebf" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:13.639577   715 raft_consensus.cc:3060] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.644405   566 raft_consensus.cc:2468] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 1.
I20260709 12:58:13.646420   606 leader_election.cc:304] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:13.647367   792 raft_consensus.cc:2804] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.649689   715 raft_consensus.cc:2468] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 1.
I20260709 12:58:13.650002   759 tablet_bootstrap.cc:654] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.652238   792 raft_consensus.cc:697] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [term 1 LEADER]: Becoming Leader. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:13.656917   462 catalog_manager.cc:5697] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 161772e939c14b909e60e121f5bb7d61 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "161772e939c14b909e60e121f5bb7d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:13.664659   461 catalog_manager.cc:5697] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 reported cstate change: term changed from 0 to 1, leader changed from <none> to fda989108897478fb1e3be4f6025e904 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fda989108897478fb1e3be4f6025e904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:13.659251   792 consensus_queue.cc:237] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.715018   808 raft_consensus.cc:493] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.716073   808 raft_consensus.cc:515] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.723382   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3b88fda0a4b43914839e64faeb702" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" is_pre_election: true
I20260709 12:58:13.724570   565 raft_consensus.cc:2393] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161772e939c14b909e60e121f5bb7d61 in current term 1: Already voted for candidate fda989108897478fb1e3be4f6025e904 in this term.
I20260709 12:58:13.728307   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3b88fda0a4b43914839e64faeb702" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904" is_pre_election: true
I20260709 12:58:13.726200   808 leader_election.cc:290] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569)
I20260709 12:58:13.730345   679 leader_election.cc:304] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61; no voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904
I20260709 12:58:13.731125   808 raft_consensus.cc:3060] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.732836   759 tablet_bootstrap.cc:492] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61: No bootstrap required, opened a new log
I20260709 12:58:13.733345   759 ts_tablet_manager.cc:1403] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61: Time spent bootstrapping tablet: real 0.098s	user 0.019s	sys 0.013s
I20260709 12:58:13.736876   765 raft_consensus.cc:493] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.737339   765 raft_consensus.cc:515] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.739329   808 raft_consensus.cc:2749] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:13.741458   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc77d4426ed495fb2ba29a6ed637f46" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904" is_pre_election: true
I20260709 12:58:13.741701   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc77d4426ed495fb2ba29a6ed637f46" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61" is_pre_election: true
I20260709 12:58:13.742113   641 raft_consensus.cc:2468] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 0.
I20260709 12:58:13.742255   715 raft_consensus.cc:2468] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 0.
I20260709 12:58:13.743317   530 leader_election.cc:304] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:13.739398   765 leader_election.cc:290] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.744537   765 raft_consensus.cc:2804] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.744923   765 raft_consensus.cc:493] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.745265   765 raft_consensus.cc:3060] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.736447   759 raft_consensus.cc:359] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.752051   759 raft_consensus.cc:385] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.752362   759 raft_consensus.cc:740] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.753324   759 consensus_queue.cc:260] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.762970   759 ts_tablet_manager.cc:1434] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:58:13.763957   759 tablet_bootstrap.cc:492] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61: Bootstrap starting.
I20260709 12:58:13.763463   462 catalog_manager.cc:5697] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 reported cstate change: term changed from 0 to 1, leader changed from <none> to fda989108897478fb1e3be4f6025e904 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "fda989108897478fb1e3be4f6025e904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:13.771134   765 raft_consensus.cc:515] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.779033   765 leader_election.cc:290] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 election: Requested vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.777271   759 tablet_bootstrap.cc:654] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.780779   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc77d4426ed495fb2ba29a6ed637f46" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:13.781454   641 raft_consensus.cc:3060] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.784150   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc77d4426ed495fb2ba29a6ed637f46" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:13.785156   715 raft_consensus.cc:3060] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.789027   641 raft_consensus.cc:2468] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 1.
I20260709 12:58:13.790323   530 leader_election.cc:304] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:13.791172   765 raft_consensus.cc:2804] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.791676   765 raft_consensus.cc:697] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:13.792464   765 consensus_queue.cc:237] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.799224   715 raft_consensus.cc:2468] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 1.
I20260709 12:58:13.802773   782 consensus_queue.cc:1048] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:13.811440   759 tablet_bootstrap.cc:492] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61: No bootstrap required, opened a new log
I20260709 12:58:13.811914   759 ts_tablet_manager.cc:1403] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61: Time spent bootstrapping tablet: real 0.048s	user 0.028s	sys 0.008s
I20260709 12:58:13.815037   759 raft_consensus.cc:359] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.816130   759 raft_consensus.cc:385] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.816413   759 raft_consensus.cc:740] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.817101   759 consensus_queue.cc:260] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.818830   759 ts_tablet_manager.cc:1434] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:58:13.820566   765 raft_consensus.cc:493] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.821185   765 raft_consensus.cc:515] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.823737   765 leader_election.cc:290] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.824887   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904" is_pre_election: true
I20260709 12:58:13.825201   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61" is_pre_election: true
I20260709 12:58:13.825662   641 raft_consensus.cc:2468] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 0.
I20260709 12:58:13.825903   715 raft_consensus.cc:2468] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 0.
I20260709 12:58:13.827509   531 leader_election.cc:304] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7; no voters: 
I20260709 12:58:13.828368   765 raft_consensus.cc:2804] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.828775   765 raft_consensus.cc:493] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.829095   765 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.819085   462 catalog_manager.cc:5697] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:13.836340   765 raft_consensus.cc:515] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.838569   765 leader_election.cc:290] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 election: Requested vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.839298   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:13.839744   641 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.845449   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:13.846050   715 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.844450   641 raft_consensus.cc:2468] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 1.
I20260709 12:58:13.849951   530 leader_election.cc:304] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:13.851928   815 raft_consensus.cc:2804] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.855479   715 raft_consensus.cc:2468] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 1.
I20260709 12:58:13.857342   641 raft_consensus.cc:3060] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.867444   815 raft_consensus.cc:697] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:13.868906   763 consensus_queue.cc:1048] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:13.868649   815 consensus_queue.cc:237] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.872825   767 consensus_queue.cc:1048] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:13.893766   815 raft_consensus.cc:493] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.894330   815 raft_consensus.cc:515] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.895066   462 catalog_manager.cc:5697] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:13.898245   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e549157c45c640c68cc0fa9640e0dab2" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904" is_pre_election: true
I20260709 12:58:13.898998   640 raft_consensus.cc:2468] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 0.
I20260709 12:58:13.904783   815 leader_election.cc:290] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.905902   530 leader_election.cc:304] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:13.908035   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e549157c45c640c68cc0fa9640e0dab2" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61" is_pre_election: true
I20260709 12:58:13.908784   715 raft_consensus.cc:2468] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 0.
I20260709 12:58:13.907401   815 raft_consensus.cc:2804] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:13.912361   815 raft_consensus.cc:493] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.912791   815 raft_consensus.cc:3060] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.920720   815 raft_consensus.cc:515] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.923844   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e549157c45c640c68cc0fa9640e0dab2" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:13.924433   641 raft_consensus.cc:3060] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.924508   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e549157c45c640c68cc0fa9640e0dab2" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:13.925086   715 raft_consensus.cc:3060] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.928867   792 consensus_queue.cc:1048] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:13.933128   815 leader_election.cc:290] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 election: Requested vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:13.931854   715 raft_consensus.cc:2468] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 1.
I20260709 12:58:13.935369   531 leader_election.cc:304] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7; no voters: 
I20260709 12:58:13.936491   815 raft_consensus.cc:2804] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.937265   641 raft_consensus.cc:2468] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 1.
I20260709 12:58:13.938071   815 raft_consensus.cc:697] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:13.939007   815 consensus_queue.cc:237] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:13.956082   462 catalog_manager.cc:5697] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:14.039894   763 consensus_queue.cc:1048] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:14.045449   792 consensus_queue.cc:1048] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:14.054388   763 consensus_queue.cc:1048] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:14.087544   830 consensus_queue.cc:1048] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:14.147889   830 consensus_queue.cc:1048] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:14.160085   830 consensus_queue.cc:1048] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:14.211635   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "971370e0477944d8996e319be2e1c092"
dest_uuid: "161772e939c14b909e60e121f5bb7d61"
mode: GRACEFUL
new_leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
 from {username='slave'} at 127.0.0.1:58458
I20260709 12:58:14.212357   715 raft_consensus.cc:606] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Received request to transfer leadership to TS 3f3cc729867f49e0b0f93c48b60c13f7
I20260709 12:58:14.218199   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5efa7edf6e8422f935f10bde32ff068"
dest_uuid: "161772e939c14b909e60e121f5bb7d61"
mode: GRACEFUL
new_leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
 from {username='slave'} at 127.0.0.1:58458
I20260709 12:58:14.218709   715 raft_consensus.cc:606] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Received request to transfer leadership to TS 3f3cc729867f49e0b0f93c48b60c13f7
I20260709 12:58:14.223758   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49"
dest_uuid: "161772e939c14b909e60e121f5bb7d61"
mode: GRACEFUL
new_leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
 from {username='slave'} at 127.0.0.1:58458
I20260709 12:58:14.224380   715 raft_consensus.cc:606] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Received request to transfer leadership to TS 3f3cc729867f49e0b0f93c48b60c13f7
I20260709 12:58:14.241251   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c"
dest_uuid: "fda989108897478fb1e3be4f6025e904"
mode: GRACEFUL
new_leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
 from {username='slave'} at 127.0.0.1:37254
I20260709 12:58:14.241887   641 raft_consensus.cc:606] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 1 LEADER]: Received request to transfer leadership to TS 3f3cc729867f49e0b0f93c48b60c13f7
I20260709 12:58:14.261819   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbc77d4426ed495fb2ba29a6ed637f46"
dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
mode: GRACEFUL
new_leader_uuid: "fda989108897478fb1e3be4f6025e904"
 from {username='slave'} at 127.0.0.1:42238
I20260709 12:58:14.262862   565 raft_consensus.cc:606] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Received request to transfer leadership to TS fda989108897478fb1e3be4f6025e904
I20260709 12:58:14.271315   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb"
dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
mode: GRACEFUL
new_leader_uuid: "fda989108897478fb1e3be4f6025e904"
 from {username='slave'} at 127.0.0.1:42238
I20260709 12:58:14.271947   565 raft_consensus.cc:606] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Received request to transfer leadership to TS fda989108897478fb1e3be4f6025e904
I20260709 12:58:14.279031   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e549157c45c640c68cc0fa9640e0dab2"
dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
mode: GRACEFUL
new_leader_uuid: "161772e939c14b909e60e121f5bb7d61"
 from {username='slave'} at 127.0.0.1:42238
I20260709 12:58:14.279973   565 raft_consensus.cc:606] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Received request to transfer leadership to TS 161772e939c14b909e60e121f5bb7d61
I20260709 12:58:14.302145   763 raft_consensus.cc:993] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61: : Instructing follower 3f3cc729867f49e0b0f93c48b60c13f7 to start an election
I20260709 12:58:14.302690   782 raft_consensus.cc:1081] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Signalling peer 3f3cc729867f49e0b0f93c48b60c13f7 to start an election
I20260709 12:58:14.304637   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5efa7edf6e8422f935f10bde32ff068"
dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:58:14.305186   565 raft_consensus.cc:493] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:14.305510   565 raft_consensus.cc:3060] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.313063   565 raft_consensus.cc:515] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.315785   565 leader_election.cc:290] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 2 election: Requested vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:14.317186   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5efa7edf6e8422f935f10bde32ff068" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:14.317792   641 raft_consensus.cc:3060] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.318185   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5efa7edf6e8422f935f10bde32ff068" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:14.318754   715 raft_consensus.cc:3055] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:14.319065   715 raft_consensus.cc:740] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Running, Role: LEADER
I20260709 12:58:14.320938   815 consensus_queue.cc:1048] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:14.319921   715 consensus_queue.cc:260] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.326154   715 raft_consensus.cc:3060] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.328905   641 raft_consensus.cc:2468] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 2.
I20260709 12:58:14.331030   530 leader_election.cc:304] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:14.331921   815 raft_consensus.cc:2804] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:14.332388   815 raft_consensus.cc:697] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:14.333242   815 consensus_queue.cc:237] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.347765   460 catalog_manager.cc:5697] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 reported cstate change: term changed from 1 to 2, leader changed from 161772e939c14b909e60e121f5bb7d61 (127.0.107.195) to 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:14.362748   815 consensus_queue.cc:1048] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:14.363615   715 raft_consensus.cc:2468] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 2.
I20260709 12:58:14.372728   815 raft_consensus.cc:993] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7: : Instructing follower fda989108897478fb1e3be4f6025e904 to start an election
I20260709 12:58:14.373281   821 raft_consensus.cc:1081] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Signalling peer fda989108897478fb1e3be4f6025e904 to start an election
I20260709 12:58:14.375051   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb"
dest_uuid: "fda989108897478fb1e3be4f6025e904"
 from {username='slave'} at 127.0.0.1:37242
I20260709 12:58:14.375612   641 raft_consensus.cc:493] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:14.376083   641 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.382808   821 consensus_queue.cc:1048] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:14.382701   641 raft_consensus.cc:515] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.386267   641 leader_election.cc:290] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 2 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:14.388827   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:14.389539   714 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.389405   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:14.392843   565 raft_consensus.cc:3055] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:14.393280   565 raft_consensus.cc:740] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:14.394075   565 consensus_queue.cc:260] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.395375   565 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.403481   815 consensus_queue.cc:1048] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:14.411887   808 raft_consensus.cc:993] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61: : Instructing follower 3f3cc729867f49e0b0f93c48b60c13f7 to start an election
I20260709 12:58:14.412424   808 raft_consensus.cc:1081] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Signalling peer 3f3cc729867f49e0b0f93c48b60c13f7 to start an election
I20260709 12:58:14.415059   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49"
dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:58:14.415853   566 raft_consensus.cc:493] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:14.416374   566 raft_consensus.cc:3060] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.426373   565 raft_consensus.cc:2468] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 2.
I20260709 12:58:14.427819   606 leader_election.cc:304] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:14.428804   830 raft_consensus.cc:2804] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:14.429296   830 raft_consensus.cc:697] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 2 LEADER]: Becoming Leader. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:14.430106   830 consensus_queue.cc:237] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.423420   714 raft_consensus.cc:2468] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 2.
I20260709 12:58:14.439324   566 raft_consensus.cc:515] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.442579   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:14.443255   640 raft_consensus.cc:3060] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.451874   640 raft_consensus.cc:2468] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 2.
I20260709 12:58:14.453183   530 leader_election.cc:304] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:14.454146   815 raft_consensus.cc:2804] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:14.454671   815 raft_consensus.cc:697] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:14.455555   815 consensus_queue.cc:237] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.460439   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:14.460196   461 catalog_manager.cc:5697] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 reported cstate change: term changed from 1 to 2, leader changed from 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193) to fda989108897478fb1e3be4f6025e904 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "fda989108897478fb1e3be4f6025e904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:14.461592   714 raft_consensus.cc:3055] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:14.461997   714 raft_consensus.cc:740] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Running, Role: LEADER
I20260709 12:58:14.462805   714 consensus_queue.cc:260] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.463980   714 raft_consensus.cc:3060] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.466463   460 catalog_manager.cc:5697] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 reported cstate change: term changed from 1 to 2, leader changed from 161772e939c14b909e60e121f5bb7d61 (127.0.107.195) to 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:14.468978   765 raft_consensus.cc:993] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7: : Instructing follower fda989108897478fb1e3be4f6025e904 to start an election
I20260709 12:58:14.469434   765 raft_consensus.cc:1081] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Signalling peer fda989108897478fb1e3be4f6025e904 to start an election
I20260709 12:58:14.471302   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbc77d4426ed495fb2ba29a6ed637f46"
dest_uuid: "fda989108897478fb1e3be4f6025e904"
 from {username='slave'} at 127.0.0.1:37242
I20260709 12:58:14.471936   641 raft_consensus.cc:493] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:14.472394   641 raft_consensus.cc:3060] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.473666   566 leader_election.cc:290] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 2 election: Requested vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:14.480422   714 raft_consensus.cc:2468] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 2.
I20260709 12:58:14.482291   641 raft_consensus.cc:515] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.484282   641 leader_election.cc:290] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 2 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:14.485517   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc77d4426ed495fb2ba29a6ed637f46" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:14.485687   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc77d4426ed495fb2ba29a6ed637f46" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:14.486117   566 raft_consensus.cc:3055] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:14.486358   714 raft_consensus.cc:3060] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.486500   566 raft_consensus.cc:740] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:14.487375   566 consensus_queue.cc:260] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.488658   566 raft_consensus.cc:3060] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.492036   714 raft_consensus.cc:2468] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 2.
I20260709 12:58:14.493223   606 leader_election.cc:304] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:14.493928   830 raft_consensus.cc:2804] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:14.494375   830 raft_consensus.cc:697] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 2 LEADER]: Becoming Leader. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:14.495148   830 consensus_queue.cc:237] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.496747   566 raft_consensus.cc:2468] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 2.
I20260709 12:58:14.503090   461 catalog_manager.cc:5697] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 reported cstate change: term changed from 1 to 2, leader changed from 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193) to fda989108897478fb1e3be4f6025e904 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "fda989108897478fb1e3be4f6025e904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:14.515156   815 consensus_queue.cc:1048] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:14.529693   808 raft_consensus.cc:993] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61: : Instructing follower 3f3cc729867f49e0b0f93c48b60c13f7 to start an election
I20260709 12:58:14.530220   808 raft_consensus.cc:1081] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Signalling peer 3f3cc729867f49e0b0f93c48b60c13f7 to start an election
I20260709 12:58:14.533887   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "971370e0477944d8996e319be2e1c092"
dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
 from {username='slave'} at 127.0.0.1:42226
I20260709 12:58:14.534873   566 raft_consensus.cc:493] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:14.535389   566 raft_consensus.cc:3060] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.539376   830 raft_consensus.cc:993] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904: : Instructing follower 3f3cc729867f49e0b0f93c48b60c13f7 to start an election
I20260709 12:58:14.539896   830 raft_consensus.cc:1081] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 1 LEADER]: Signalling peer 3f3cc729867f49e0b0f93c48b60c13f7 to start an election
I20260709 12:58:14.543001   566 raft_consensus.cc:515] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:14.544940   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c"
dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
 from {username='slave'} at 127.0.0.1:42232
I20260709 12:58:14.545569   565 raft_consensus.cc:493] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:14.545997   565 raft_consensus.cc:3060] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.546288   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971370e0477944d8996e319be2e1c092" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:14.546849   641 raft_consensus.cc:3060] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.553831   641 raft_consensus.cc:2468] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 2.
I20260709 12:58:14.555083   530 leader_election.cc:304] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:14.556326   815 raft_consensus.cc:2804] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:14.557005   815 raft_consensus.cc:697] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:14.557862   765 consensus_queue.cc:1048] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:14.557790   815 consensus_queue.cc:237] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:14.556242   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971370e0477944d8996e319be2e1c092" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:14.559607   714 raft_consensus.cc:3055] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:14.560006   714 raft_consensus.cc:740] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Running, Role: LEADER
I20260709 12:58:14.560953   566 leader_election.cc:290] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 2 election: Requested vote from peers 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059), fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569)
I20260709 12:58:14.560962   714 consensus_queue.cc:260] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:14.570015   815 raft_consensus.cc:993] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7: : Instructing follower 161772e939c14b909e60e121f5bb7d61 to start an election
I20260709 12:58:14.571172   815 raft_consensus.cc:1081] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Signalling peer 161772e939c14b909e60e121f5bb7d61 to start an election
I20260709 12:58:14.570694   461 catalog_manager.cc:5697] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 reported cstate change: term changed from 1 to 2, leader changed from 161772e939c14b909e60e121f5bb7d61 (127.0.107.195) to 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:14.572857   714 raft_consensus.cc:3060] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.573400   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e549157c45c640c68cc0fa9640e0dab2"
dest_uuid: "161772e939c14b909e60e121f5bb7d61"
 from {username='slave'} at 127.0.0.1:58454
I20260709 12:58:14.578421   715 raft_consensus.cc:493] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:14.578876   715 raft_consensus.cc:3060] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.583297   565 raft_consensus.cc:515] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.583993   714 raft_consensus.cc:2468] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 2.
I20260709 12:58:14.587064   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:14.587347   565 leader_election.cc:290] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 2 election: Requested vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:14.587728   641 raft_consensus.cc:3055] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:14.588151   641 raft_consensus.cc:740] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:14.588984   641 consensus_queue.cc:260] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.589622   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:14.590342   641 raft_consensus.cc:3060] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.590392   714 raft_consensus.cc:3060] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.593416   715 raft_consensus.cc:515] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.595949   715 leader_election.cc:290] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 2 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569)
I20260709 12:58:14.597277   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e549157c45c640c68cc0fa9640e0dab2" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:14.597281   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e549157c45c640c68cc0fa9640e0dab2" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:14.598062   565 raft_consensus.cc:3055] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:14.598120   640 raft_consensus.cc:3060] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.598503   565 raft_consensus.cc:740] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:14.599462   565 consensus_queue.cc:260] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.600745   565 raft_consensus.cc:3060] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:14.605271   640 raft_consensus.cc:2468] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 2.
I20260709 12:58:14.606487   679 leader_election.cc:304] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:14.606503   714 raft_consensus.cc:2468] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 2.
I20260709 12:58:14.607867   763 raft_consensus.cc:2804] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:14.608503   763 raft_consensus.cc:697] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [term 2 LEADER]: Becoming Leader. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Running, Role: LEADER
I20260709 12:58:14.609023   641 raft_consensus.cc:2468] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 2.
I20260709 12:58:14.609526   763 consensus_queue.cc:237] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.610421   530 leader_election.cc:304] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:14.611251   815 raft_consensus.cc:2804] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:14.611784   815 raft_consensus.cc:697] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:14.612668   815 consensus_queue.cc:237] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:14.619436   565 raft_consensus.cc:2468] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 2.
I20260709 12:58:14.620536   461 catalog_manager.cc:5697] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 reported cstate change: term changed from 1 to 2, leader changed from 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193) to 161772e939c14b909e60e121f5bb7d61 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "161772e939c14b909e60e121f5bb7d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:14.622421   460 catalog_manager.cc:5697] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 reported cstate change: term changed from 1 to 2, leader changed from fda989108897478fb1e3be4f6025e904 (127.0.107.194) to 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:14.762108   641 raft_consensus.cc:1275] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Refusing update from remote peer 3f3cc729867f49e0b0f93c48b60c13f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:14.763437   815 consensus_queue.cc:1048] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:14.773711   714 raft_consensus.cc:1275] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Refusing update from remote peer 3f3cc729867f49e0b0f93c48b60c13f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:14.775249   821 consensus_queue.cc:1048] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:14.837746   565 raft_consensus.cc:1275] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Refusing update from remote peer fda989108897478fb1e3be4f6025e904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:14.839195   830 consensus_queue.cc:1048] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:14.857038   715 raft_consensus.cc:1275] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Refusing update from remote peer fda989108897478fb1e3be4f6025e904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:14.858791   846 consensus_queue.cc:1048] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:14.957917   715 raft_consensus.cc:1275] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Refusing update from remote peer 3f3cc729867f49e0b0f93c48b60c13f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:14.959257   821 consensus_queue.cc:1048] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:14.967034   641 raft_consensus.cc:1275] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Refusing update from remote peer 3f3cc729867f49e0b0f93c48b60c13f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:14.968515   765 consensus_queue.cc:1048] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:14.982636   715 raft_consensus.cc:1275] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Refusing update from remote peer 3f3cc729867f49e0b0f93c48b60c13f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:14.984127   765 consensus_queue.cc:1048] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:14.994886   641 raft_consensus.cc:1275] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Refusing update from remote peer 3f3cc729867f49e0b0f93c48b60c13f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:14.996723   765 consensus_queue.cc:1048] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:15.056399   641 raft_consensus.cc:1275] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Refusing update from remote peer 161772e939c14b909e60e121f5bb7d61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:15.057988   763 consensus_queue.cc:1048] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:15.067742   565 raft_consensus.cc:1275] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Refusing update from remote peer 161772e939c14b909e60e121f5bb7d61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:15.069700   850 consensus_queue.cc:1048] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:15.073217   565 raft_consensus.cc:1275] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Refusing update from remote peer fda989108897478fb1e3be4f6025e904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:15.075918   846 consensus_queue.cc:1048] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:15.084918   715 raft_consensus.cc:1275] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Refusing update from remote peer fda989108897478fb1e3be4f6025e904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:15.087510   830 consensus_queue.cc:1048] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:15.183218   641 raft_consensus.cc:1275] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Refusing update from remote peer 3f3cc729867f49e0b0f93c48b60c13f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:15.183374   715 raft_consensus.cc:1275] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Refusing update from remote peer 3f3cc729867f49e0b0f93c48b60c13f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:15.184779   815 consensus_queue.cc:1048] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:15.185391   765 consensus_queue.cc:1048] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:17.323123   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:58:17.324321   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:17.347954   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb"
dest_uuid: "fda989108897478fb1e3be4f6025e904"
mode: GRACEFUL
new_leader_uuid: "161772e939c14b909e60e121f5bb7d61"
 from {username='slave'} at 127.0.0.1:37262
I20260709 12:58:17.348505   641 raft_consensus.cc:606] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 2 LEADER]: Received request to transfer leadership to TS 161772e939c14b909e60e121f5bb7d61
I20260709 12:58:17.359910   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c"
dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
mode: GRACEFUL
new_leader_uuid: "161772e939c14b909e60e121f5bb7d61"
 from {username='slave'} at 127.0.0.1:42250
I20260709 12:58:17.360414   565 raft_consensus.cc:606] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Received request to transfer leadership to TS 161772e939c14b909e60e121f5bb7d61
I20260709 12:58:17.362033   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:58:17.362583   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:17.376438   858 raft_consensus.cc:993] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904: : Instructing follower 161772e939c14b909e60e121f5bb7d61 to start an election
I20260709 12:58:17.377017   858 raft_consensus.cc:1081] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 2 LEADER]: Signalling peer 161772e939c14b909e60e121f5bb7d61 to start an election
I20260709 12:58:17.378860   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb"
dest_uuid: "161772e939c14b909e60e121f5bb7d61"
 from {username='slave'} at 127.0.0.1:58456
I20260709 12:58:17.379364   714 raft_consensus.cc:493] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:17.379698   714 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:17.384245   714 raft_consensus.cc:515] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:17.386206   714 leader_election.cc:290] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 3 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569)
I20260709 12:58:17.387099   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:17.387300   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:17.387756   641 raft_consensus.cc:3055] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:17.387754   565 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:17.388278   641 raft_consensus.cc:740] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:17.389153   641 consensus_queue.cc:260] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:17.390386   641 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:17.395249   565 raft_consensus.cc:2468] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 3.
I20260709 12:58:17.396912   680 leader_election.cc:304] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7; no voters: 
I20260709 12:58:17.397287   641 raft_consensus.cc:2468] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 3.
I20260709 12:58:17.397763   854 raft_consensus.cc:2804] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:17.399158   854 raft_consensus.cc:697] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 3 LEADER]: Becoming Leader. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Running, Role: LEADER
I20260709 12:58:17.399920   854 consensus_queue.cc:237] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:17.410791   461 catalog_manager.cc:5697] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 reported cstate change: term changed from 2 to 3, leader changed from fda989108897478fb1e3be4f6025e904 (127.0.107.194) to 161772e939c14b909e60e121f5bb7d61 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "161772e939c14b909e60e121f5bb7d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:17.599689   848 raft_consensus.cc:993] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7: : Instructing follower 161772e939c14b909e60e121f5bb7d61 to start an election
I20260709 12:58:17.600108   865 raft_consensus.cc:1081] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Signalling peer 161772e939c14b909e60e121f5bb7d61 to start an election
I20260709 12:58:17.601871   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c"
dest_uuid: "161772e939c14b909e60e121f5bb7d61"
 from {username='slave'} at 127.0.0.1:58454
I20260709 12:58:17.602365   714 raft_consensus.cc:493] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:17.602654   714 raft_consensus.cc:3060] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:17.607195   714 raft_consensus.cc:515] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:17.609529   714 leader_election.cc:290] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 3 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569)
I20260709 12:58:17.610476   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:17.610606   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:17.611208   565 raft_consensus.cc:3055] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:17.611312   641 raft_consensus.cc:3060] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:17.611514   565 raft_consensus.cc:740] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:17.613052   565 consensus_queue.cc:260] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:17.614432   565 raft_consensus.cc:3060] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:17.616238   641 raft_consensus.cc:2468] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 3.
I20260709 12:58:17.617635   679 leader_election.cc:304] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:17.618481   854 raft_consensus.cc:2804] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:17.619043   854 raft_consensus.cc:697] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 3 LEADER]: Becoming Leader. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Running, Role: LEADER
I20260709 12:58:17.619977   854 consensus_queue.cc:237] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:17.621732   565 raft_consensus.cc:2468] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 3.
I20260709 12:58:17.627751   461 catalog_manager.cc:5697] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 reported cstate change: term changed from 2 to 3, leader changed from 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193) to 161772e939c14b909e60e121f5bb7d61 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "161772e939c14b909e60e121f5bb7d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:17.808740   565 raft_consensus.cc:1275] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Refusing update from remote peer 161772e939c14b909e60e121f5bb7d61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:17.810056   854 consensus_queue.cc:1048] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:17.820837   641 raft_consensus.cc:1275] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Refusing update from remote peer 161772e939c14b909e60e121f5bb7d61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:17.822546   854 consensus_queue.cc:1048] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:18.054867   641 raft_consensus.cc:1275] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Refusing update from remote peer 161772e939c14b909e60e121f5bb7d61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:18.056046   859 consensus_queue.cc:1048] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:18.065935   565 raft_consensus.cc:1275] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Refusing update from remote peer 161772e939c14b909e60e121f5bb7d61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:18.067771   869 consensus_queue.cc:1048] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:18.363459   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:18.373802   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "971370e0477944d8996e319be2e1c092"
dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
mode: GRACEFUL
new_leader_uuid: "fda989108897478fb1e3be4f6025e904"
 from {username='slave'} at 127.0.0.1:42238
I20260709 12:58:18.374492   565 raft_consensus.cc:606] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Received request to transfer leadership to TS fda989108897478fb1e3be4f6025e904
I20260709 12:58:18.379972   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5efa7edf6e8422f935f10bde32ff068"
dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
mode: GRACEFUL
new_leader_uuid: "fda989108897478fb1e3be4f6025e904"
 from {username='slave'} at 127.0.0.1:42238
I20260709 12:58:18.380393   565 raft_consensus.cc:606] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Received request to transfer leadership to TS fda989108897478fb1e3be4f6025e904
I20260709 12:58:18.386037   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49"
dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
mode: GRACEFUL
new_leader_uuid: "fda989108897478fb1e3be4f6025e904"
 from {username='slave'} at 127.0.0.1:42238
I20260709 12:58:18.386587   565 raft_consensus.cc:606] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Received request to transfer leadership to TS fda989108897478fb1e3be4f6025e904
I20260709 12:58:18.387830   865 raft_consensus.cc:993] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7: : Instructing follower fda989108897478fb1e3be4f6025e904 to start an election
I20260709 12:58:18.388298   848 raft_consensus.cc:1081] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Signalling peer fda989108897478fb1e3be4f6025e904 to start an election
I20260709 12:58:18.389946   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49"
dest_uuid: "fda989108897478fb1e3be4f6025e904"
 from {username='slave'} at 127.0.0.1:37242
I20260709 12:58:18.390504   641 raft_consensus.cc:493] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:18.390887   641 raft_consensus.cc:3060] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:18.392143   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c"
dest_uuid: "161772e939c14b909e60e121f5bb7d61"
mode: GRACEFUL
new_leader_uuid: "fda989108897478fb1e3be4f6025e904"
 from {username='slave'} at 127.0.0.1:58458
I20260709 12:58:18.392784   714 raft_consensus.cc:606] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 3 LEADER]: Received request to transfer leadership to TS fda989108897478fb1e3be4f6025e904
I20260709 12:58:18.396755   641 raft_consensus.cc:515] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:18.399314   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:18.399924   565 raft_consensus.cc:3055] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:18.400300   565 raft_consensus.cc:740] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:18.400179   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:18.400480   641 leader_election.cc:290] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 3 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:18.400976   715 raft_consensus.cc:3060] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:18.401228   565 consensus_queue.cc:260] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:18.402684   565 raft_consensus.cc:3060] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:18.407840   715 raft_consensus.cc:2468] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 3.
I20260709 12:58:18.408106   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb"
dest_uuid: "161772e939c14b909e60e121f5bb7d61"
mode: GRACEFUL
new_leader_uuid: "fda989108897478fb1e3be4f6025e904"
 from {username='slave'} at 127.0.0.1:58458
I20260709 12:58:18.408828   714 raft_consensus.cc:606] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 3 LEADER]: Received request to transfer leadership to TS fda989108897478fb1e3be4f6025e904
I20260709 12:58:18.408897   565 raft_consensus.cc:2468] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 3.
I20260709 12:58:18.409070   606 leader_election.cc:304] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:18.409951   858 raft_consensus.cc:2804] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:18.411084   858 raft_consensus.cc:697] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 3 LEADER]: Becoming Leader. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:18.411826   858 consensus_queue.cc:237] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:18.419184   461 catalog_manager.cc:5697] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 reported cstate change: term changed from 2 to 3, leader changed from 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193) to fda989108897478fb1e3be4f6025e904 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "fda989108897478fb1e3be4f6025e904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:18.482409   865 raft_consensus.cc:993] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7: : Instructing follower fda989108897478fb1e3be4f6025e904 to start an election
I20260709 12:58:18.482956   865 raft_consensus.cc:1081] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Signalling peer fda989108897478fb1e3be4f6025e904 to start an election
I20260709 12:58:18.484647   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "971370e0477944d8996e319be2e1c092"
dest_uuid: "fda989108897478fb1e3be4f6025e904"
 from {username='slave'} at 127.0.0.1:37242
I20260709 12:58:18.485194   641 raft_consensus.cc:493] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:18.485500   641 raft_consensus.cc:3060] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:18.490051   641 raft_consensus.cc:515] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:18.491957   641 leader_election.cc:290] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 3 election: Requested vote from peers 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059), 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571)
I20260709 12:58:18.492849   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971370e0477944d8996e319be2e1c092" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:18.493530   714 raft_consensus.cc:3060] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:18.493602   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971370e0477944d8996e319be2e1c092" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:18.494199   565 raft_consensus.cc:3055] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:18.494450   565 raft_consensus.cc:740] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:18.495065   565 consensus_queue.cc:260] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:18.496400   565 raft_consensus.cc:3060] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:18.498850   714 raft_consensus.cc:2468] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 3.
I20260709 12:58:18.500164   606 leader_election.cc:304] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:18.501327   858 raft_consensus.cc:2804] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:18.501917   858 raft_consensus.cc:697] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 3 LEADER]: Becoming Leader. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:18.502710   858 consensus_queue.cc:237] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:18.503139   565 raft_consensus.cc:2468] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 3.
I20260709 12:58:18.511560   461 catalog_manager.cc:5697] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 reported cstate change: term changed from 2 to 3, leader changed from 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193) to fda989108897478fb1e3be4f6025e904 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "fda989108897478fb1e3be4f6025e904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:18.600739   859 raft_consensus.cc:993] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61: : Instructing follower fda989108897478fb1e3be4f6025e904 to start an election
I20260709 12:58:18.601327   869 raft_consensus.cc:1081] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 3 LEADER]: Signalling peer fda989108897478fb1e3be4f6025e904 to start an election
I20260709 12:58:18.603070   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c"
dest_uuid: "fda989108897478fb1e3be4f6025e904"
 from {username='slave'} at 127.0.0.1:37236
I20260709 12:58:18.603626   641 raft_consensus.cc:493] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:18.603963   641 raft_consensus.cc:3060] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:18.608253   641 raft_consensus.cc:515] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:18.610342   641 leader_election.cc:290] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 4 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:18.611171   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:18.611357   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f777b1f911549f68f4cc4aec116480c" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:18.611768   565 raft_consensus.cc:3060] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:18.611830   714 raft_consensus.cc:3055] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:18.612212   714 raft_consensus.cc:740] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Running, Role: LEADER
I20260709 12:58:18.613173   714 consensus_queue.cc:260] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:18.614490   714 raft_consensus.cc:3060] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:18.618620   565 raft_consensus.cc:2468] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 4.
I20260709 12:58:18.619923   606 leader_election.cc:304] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:18.620704   714 raft_consensus.cc:2468] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 4.
I20260709 12:58:18.620858   858 raft_consensus.cc:2804] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:18.621456   858 raft_consensus.cc:697] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 4 LEADER]: Becoming Leader. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:18.622316   858 consensus_queue.cc:237] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:18.630239   859 raft_consensus.cc:993] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61: : Instructing follower fda989108897478fb1e3be4f6025e904 to start an election
I20260709 12:58:18.629946   461 catalog_manager.cc:5697] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 reported cstate change: term changed from 3 to 4, leader changed from 161772e939c14b909e60e121f5bb7d61 (127.0.107.195) to fda989108897478fb1e3be4f6025e904 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "fda989108897478fb1e3be4f6025e904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:18.630699   869 raft_consensus.cc:1081] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 3 LEADER]: Signalling peer fda989108897478fb1e3be4f6025e904 to start an election
I20260709 12:58:18.632355   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb"
dest_uuid: "fda989108897478fb1e3be4f6025e904"
 from {username='slave'} at 127.0.0.1:37236
I20260709 12:58:18.632797   641 raft_consensus.cc:493] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:18.633054   641 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:18.637756   641 raft_consensus.cc:515] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:18.639401   641 leader_election.cc:290] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 4 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:18.640262   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:18.640462   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:18.640897   565 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:18.641059   714 raft_consensus.cc:3055] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:18.641443   714 raft_consensus.cc:740] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Running, Role: LEADER
I20260709 12:58:18.642114   714 consensus_queue.cc:260] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:18.643005   714 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:18.645491   565 raft_consensus.cc:2468] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 4.
I20260709 12:58:18.646557   606 leader_election.cc:304] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:18.647318   858 raft_consensus.cc:2804] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:18.647897   858 raft_consensus.cc:697] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 4 LEADER]: Becoming Leader. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:18.649209   714 raft_consensus.cc:2468] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 4.
I20260709 12:58:18.648825   858 consensus_queue.cc:237] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:18.655124   461 catalog_manager.cc:5697] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 reported cstate change: term changed from 3 to 4, leader changed from 161772e939c14b909e60e121f5bb7d61 (127.0.107.195) to fda989108897478fb1e3be4f6025e904 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "fda989108897478fb1e3be4f6025e904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:18.720826   848 raft_consensus.cc:993] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7: : Instructing follower fda989108897478fb1e3be4f6025e904 to start an election
I20260709 12:58:18.721274   865 raft_consensus.cc:1081] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Signalling peer fda989108897478fb1e3be4f6025e904 to start an election
I20260709 12:58:18.722589   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5efa7edf6e8422f935f10bde32ff068"
dest_uuid: "fda989108897478fb1e3be4f6025e904"
 from {username='slave'} at 127.0.0.1:37242
I20260709 12:58:18.722991   641 raft_consensus.cc:493] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:18.723212   641 raft_consensus.cc:3060] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:18.727172   641 raft_consensus.cc:515] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:18.728752   641 leader_election.cc:290] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 3 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:18.729501   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5efa7edf6e8422f935f10bde32ff068" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:18.729974   565 raft_consensus.cc:3055] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:18.730233   565 raft_consensus.cc:740] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:18.729887   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5efa7edf6e8422f935f10bde32ff068" candidate_uuid: "fda989108897478fb1e3be4f6025e904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:18.730906   714 raft_consensus.cc:3060] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:18.730820   565 consensus_queue.cc:260] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:18.731639   565 raft_consensus.cc:3060] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:18.735759   565 raft_consensus.cc:2468] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 3.
I20260709 12:58:18.735790   714 raft_consensus.cc:2468] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda989108897478fb1e3be4f6025e904 in term 3.
I20260709 12:58:18.736824   606 leader_election.cc:304] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3cc729867f49e0b0f93c48b60c13f7, fda989108897478fb1e3be4f6025e904; no voters: 
I20260709 12:58:18.737560   858 raft_consensus.cc:2804] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:18.738121   858 raft_consensus.cc:697] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 3 LEADER]: Becoming Leader. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:18.738884   858 consensus_queue.cc:237] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:18.745239   461 catalog_manager.cc:5697] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 reported cstate change: term changed from 2 to 3, leader changed from 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193) to fda989108897478fb1e3be4f6025e904 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "fda989108897478fb1e3be4f6025e904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:18.830279   714 raft_consensus.cc:1275] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Refusing update from remote peer fda989108897478fb1e3be4f6025e904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:18.831542   858 consensus_queue.cc:1048] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:18.839444   565 raft_consensus.cc:1275] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Refusing update from remote peer fda989108897478fb1e3be4f6025e904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:18.842489   883 consensus_queue.cc:1048] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:19.001798   565 raft_consensus.cc:1275] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Refusing update from remote peer fda989108897478fb1e3be4f6025e904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:19.003103   883 consensus_queue.cc:1048] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:19.012567   714 raft_consensus.cc:1275] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Refusing update from remote peer fda989108897478fb1e3be4f6025e904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:19.014293   883 consensus_queue.cc:1048] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:19.097505   565 raft_consensus.cc:1275] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Refusing update from remote peer fda989108897478fb1e3be4f6025e904: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:19.098995   883 consensus_queue.cc:1048] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:19.107959   714 raft_consensus.cc:1275] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 4 FOLLOWER]: Refusing update from remote peer fda989108897478fb1e3be4f6025e904: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:19.109381   883 consensus_queue.cc:1048] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:19.118968   714 raft_consensus.cc:1275] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Refusing update from remote peer fda989108897478fb1e3be4f6025e904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:19.120267   883 consensus_queue.cc:1048] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:19.129045   565 raft_consensus.cc:1275] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Refusing update from remote peer fda989108897478fb1e3be4f6025e904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:19.130430   858 consensus_queue.cc:1048] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:19.163435   565 raft_consensus.cc:1275] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Refusing update from remote peer fda989108897478fb1e3be4f6025e904: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:19.164902   875 consensus_queue.cc:1048] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:19.173569   714 raft_consensus.cc:1275] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 4 FOLLOWER]: Refusing update from remote peer fda989108897478fb1e3be4f6025e904: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:19.175995   883 consensus_queue.cc:1048] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:21.415741   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:21.424383   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb"
dest_uuid: "fda989108897478fb1e3be4f6025e904"
mode: GRACEFUL
new_leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
 from {username='slave'} at 127.0.0.1:37262
I20260709 12:58:21.425168   641 raft_consensus.cc:606] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 4 LEADER]: Received request to transfer leadership to TS 3f3cc729867f49e0b0f93c48b60c13f7
I20260709 12:58:21.428050   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49"
dest_uuid: "fda989108897478fb1e3be4f6025e904"
mode: GRACEFUL
new_leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
 from {username='slave'} at 127.0.0.1:37262
I20260709 12:58:21.428557   641 raft_consensus.cc:606] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 3 LEADER]: Received request to transfer leadership to TS 3f3cc729867f49e0b0f93c48b60c13f7
I20260709 12:58:21.431001   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "971370e0477944d8996e319be2e1c092"
dest_uuid: "fda989108897478fb1e3be4f6025e904"
mode: GRACEFUL
new_leader_uuid: "161772e939c14b909e60e121f5bb7d61"
 from {username='slave'} at 127.0.0.1:37262
I20260709 12:58:21.431576   641 raft_consensus.cc:606] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 3 LEADER]: Received request to transfer leadership to TS 161772e939c14b909e60e121f5bb7d61
I20260709 12:58:21.434167   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ba3b88fda0a4b43914839e64faeb702"
dest_uuid: "fda989108897478fb1e3be4f6025e904"
mode: GRACEFUL
new_leader_uuid: "161772e939c14b909e60e121f5bb7d61"
 from {username='slave'} at 127.0.0.1:37262
I20260709 12:58:21.434628   641 raft_consensus.cc:606] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 1 LEADER]: Received request to transfer leadership to TS 161772e939c14b909e60e121f5bb7d61
I20260709 12:58:21.436800   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbc77d4426ed495fb2ba29a6ed637f46"
dest_uuid: "fda989108897478fb1e3be4f6025e904"
mode: GRACEFUL
new_leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
 from {username='slave'} at 127.0.0.1:37262
I20260709 12:58:21.437282   641 raft_consensus.cc:606] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 2 LEADER]: Received request to transfer leadership to TS 3f3cc729867f49e0b0f93c48b60c13f7
I20260709 12:58:21.438274   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:21.438750   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:21.456172   897 raft_consensus.cc:993] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904: : Instructing follower 161772e939c14b909e60e121f5bb7d61 to start an election
I20260709 12:58:21.456564   897 raft_consensus.cc:1081] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 1 LEADER]: Signalling peer 161772e939c14b909e60e121f5bb7d61 to start an election
I20260709 12:58:21.458420   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ba3b88fda0a4b43914839e64faeb702"
dest_uuid: "161772e939c14b909e60e121f5bb7d61"
 from {username='slave'} at 127.0.0.1:58456
I20260709 12:58:21.458863   714 raft_consensus.cc:493] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:21.459254   714 raft_consensus.cc:3060] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:21.464866   714 raft_consensus.cc:515] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:21.467228   714 leader_election.cc:290] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 2 election: Requested vote from peers 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571), fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569)
I20260709 12:58:21.468410   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3b88fda0a4b43914839e64faeb702" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:21.468397   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba3b88fda0a4b43914839e64faeb702" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:21.469408   565 raft_consensus.cc:3060] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:21.469408   641 raft_consensus.cc:3055] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:21.469902   641 raft_consensus.cc:740] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:21.470904   641 consensus_queue.cc:260] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:21.472245   641 raft_consensus.cc:3060] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:21.476912   565 raft_consensus.cc:2468] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 2.
I20260709 12:58:21.478374   680 leader_election.cc:304] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7; no voters: 
I20260709 12:58:21.479045   641 raft_consensus.cc:2468] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 2.
I20260709 12:58:21.479295   869 raft_consensus.cc:2804] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:21.480402   869 raft_consensus.cc:697] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [term 2 LEADER]: Becoming Leader. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Running, Role: LEADER
I20260709 12:58:21.481343   869 consensus_queue.cc:237] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:21.489420   461 catalog_manager.cc:5697] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 reported cstate change: term changed from 1 to 2, leader changed from fda989108897478fb1e3be4f6025e904 (127.0.107.194) to 161772e939c14b909e60e121f5bb7d61 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "161772e939c14b909e60e121f5bb7d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:21.581895   875 raft_consensus.cc:993] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904: : Instructing follower 3f3cc729867f49e0b0f93c48b60c13f7 to start an election
I20260709 12:58:21.582435   897 raft_consensus.cc:1081] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 2 LEADER]: Signalling peer 3f3cc729867f49e0b0f93c48b60c13f7 to start an election
I20260709 12:58:21.584118   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbc77d4426ed495fb2ba29a6ed637f46"
dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
 from {username='slave'} at 127.0.0.1:42232
I20260709 12:58:21.584734   564 raft_consensus.cc:493] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:21.585157   564 raft_consensus.cc:3060] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:21.590196   564 raft_consensus.cc:515] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:21.591964   564 leader_election.cc:290] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 3 election: Requested vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:21.592851   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc77d4426ed495fb2ba29a6ed637f46" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:21.593086   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc77d4426ed495fb2ba29a6ed637f46" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:21.593415   641 raft_consensus.cc:3055] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:21.593600   714 raft_consensus.cc:3060] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:21.593778   641 raft_consensus.cc:740] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:21.594591   641 consensus_queue.cc:260] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:21.595667   641 raft_consensus.cc:3060] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:21.599685   714 raft_consensus.cc:2468] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 3.
I20260709 12:58:21.601222   531 leader_election.cc:304] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7; no voters: 
I20260709 12:58:21.601246   641 raft_consensus.cc:2468] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 3.
I20260709 12:58:21.603080   904 raft_consensus.cc:2804] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:21.604236   904 raft_consensus.cc:697] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:21.605186   904 consensus_queue.cc:237] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:21.613767   461 catalog_manager.cc:5697] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 reported cstate change: term changed from 2 to 3, leader changed from fda989108897478fb1e3be4f6025e904 (127.0.107.194) to 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:21.655573   897 raft_consensus.cc:993] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904: : Instructing follower 161772e939c14b909e60e121f5bb7d61 to start an election
I20260709 12:58:21.656086   875 raft_consensus.cc:1081] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 3 LEADER]: Signalling peer 161772e939c14b909e60e121f5bb7d61 to start an election
I20260709 12:58:21.657599   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "971370e0477944d8996e319be2e1c092"
dest_uuid: "161772e939c14b909e60e121f5bb7d61"
 from {username='slave'} at 127.0.0.1:58456
I20260709 12:58:21.658042   714 raft_consensus.cc:493] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:21.658318   714 raft_consensus.cc:3060] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:21.662492   714 raft_consensus.cc:515] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:21.663937   714 leader_election.cc:290] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 4 election: Requested vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571)
I20260709 12:58:21.664924   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971370e0477944d8996e319be2e1c092" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:21.664934   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971370e0477944d8996e319be2e1c092" candidate_uuid: "161772e939c14b909e60e121f5bb7d61" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
I20260709 12:58:21.665657   641 raft_consensus.cc:3055] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:21.665663   564 raft_consensus.cc:3060] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:21.666134   641 raft_consensus.cc:740] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:21.666921   641 consensus_queue.cc:260] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:21.668007   641 raft_consensus.cc:3060] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:21.672549   564 raft_consensus.cc:2468] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 4.
I20260709 12:58:21.673807   680 leader_election.cc:304] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7; no voters: 
I20260709 12:58:21.673980   641 raft_consensus.cc:2468] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161772e939c14b909e60e121f5bb7d61 in term 4.
I20260709 12:58:21.674672   869 raft_consensus.cc:2804] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:21.675256   869 raft_consensus.cc:697] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 4 LEADER]: Becoming Leader. State: Replica: 161772e939c14b909e60e121f5bb7d61, State: Running, Role: LEADER
I20260709 12:58:21.676113   869 consensus_queue.cc:237] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } }
I20260709 12:58:21.682549   461 catalog_manager.cc:5697] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 reported cstate change: term changed from 3 to 4, leader changed from fda989108897478fb1e3be4f6025e904 (127.0.107.194) to 161772e939c14b909e60e121f5bb7d61 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "161772e939c14b909e60e121f5bb7d61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:21.781512   897 raft_consensus.cc:993] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904: : Instructing follower 3f3cc729867f49e0b0f93c48b60c13f7 to start an election
I20260709 12:58:21.781966   875 raft_consensus.cc:1081] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 4 LEADER]: Signalling peer 3f3cc729867f49e0b0f93c48b60c13f7 to start an election
I20260709 12:58:21.783478   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb"
dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
 from {username='slave'} at 127.0.0.1:42232
I20260709 12:58:21.783923   564 raft_consensus.cc:493] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:21.784169   564 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:21.789055   564 raft_consensus.cc:515] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:21.790841   564 leader_election.cc:290] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 5 election: Requested vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:21.791808   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:21.791844   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0df8f6ad8d46ddb59f729ea0fe63eb" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:21.792446   641 raft_consensus.cc:3055] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:21.792663   714 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:21.792805   641 raft_consensus.cc:740] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:21.793545   641 consensus_queue.cc:260] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:21.794353   641 raft_consensus.cc:3060] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:21.797320   714 raft_consensus.cc:2468] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 5.
I20260709 12:58:21.798382   531 leader_election.cc:304] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7; no voters: 
I20260709 12:58:21.798738   641 raft_consensus.cc:2468] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 5.
I20260709 12:58:21.799319   904 raft_consensus.cc:2804] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:21.799796   904 raft_consensus.cc:697] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 5 LEADER]: Becoming Leader. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:21.800841   904 consensus_queue.cc:237] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:21.807838   461 catalog_manager.cc:5697] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 reported cstate change: term changed from 4 to 5, leader changed from fda989108897478fb1e3be4f6025e904 (127.0.107.194) to 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:21.910652   897 raft_consensus.cc:993] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904: : Instructing follower 3f3cc729867f49e0b0f93c48b60c13f7 to start an election
I20260709 12:58:21.911671   875 raft_consensus.cc:1081] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 3 LEADER]: Signalling peer 3f3cc729867f49e0b0f93c48b60c13f7 to start an election
I20260709 12:58:21.913269   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49"
dest_uuid: "3f3cc729867f49e0b0f93c48b60c13f7"
 from {username='slave'} at 127.0.0.1:42232
I20260709 12:58:21.914052   564 raft_consensus.cc:493] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:21.914549   564 raft_consensus.cc:3060] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:21.919607   564 raft_consensus.cc:515] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:21.921432   564 leader_election.cc:290] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 4 election: Requested vote from peers fda989108897478fb1e3be4f6025e904 (127.0.107.194:39569), 161772e939c14b909e60e121f5bb7d61 (127.0.107.195:35059)
I20260709 12:58:21.922235   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fda989108897478fb1e3be4f6025e904"
I20260709 12:58:21.922540   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578c09d582dc4509a57497a3e8c55b49" candidate_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "161772e939c14b909e60e121f5bb7d61"
I20260709 12:58:21.922938   641 raft_consensus.cc:3055] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:21.923018   714 raft_consensus.cc:3060] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:21.923318   641 raft_consensus.cc:740] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fda989108897478fb1e3be4f6025e904, State: Running, Role: LEADER
I20260709 12:58:21.924103   641 consensus_queue.cc:260] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:21.925520   641 raft_consensus.cc:3060] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:21.930193   714 raft_consensus.cc:2468] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 4.
I20260709 12:58:21.931658   531 leader_election.cc:304] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161772e939c14b909e60e121f5bb7d61, 3f3cc729867f49e0b0f93c48b60c13f7; no voters: 
I20260709 12:58:21.932725   904 raft_consensus.cc:2804] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:21.932753   641 raft_consensus.cc:2468] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3cc729867f49e0b0f93c48b60c13f7 in term 4.
I20260709 12:58:21.933404   904 raft_consensus.cc:697] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f3cc729867f49e0b0f93c48b60c13f7, State: Running, Role: LEADER
I20260709 12:58:21.934551   904 consensus_queue.cc:237] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } }
I20260709 12:58:21.941864   461 catalog_manager.cc:5697] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 reported cstate change: term changed from 3 to 4, leader changed from fda989108897478fb1e3be4f6025e904 (127.0.107.194) to 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:21.955577   641 raft_consensus.cc:1275] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Refusing update from remote peer 161772e939c14b909e60e121f5bb7d61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:21.957734   898 consensus_queue.cc:1048] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:21.972664   564 raft_consensus.cc:1275] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Refusing update from remote peer 161772e939c14b909e60e121f5bb7d61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:21.975415   912 consensus_queue.cc:1048] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:21.991259   641 raft_consensus.cc:1275] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Refusing update from remote peer 3f3cc729867f49e0b0f93c48b60c13f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:21.992532   904 consensus_queue.cc:1048] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:22.002079   714 raft_consensus.cc:1275] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Refusing update from remote peer 3f3cc729867f49e0b0f93c48b60c13f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:22.005168   917 consensus_queue.cc:1048] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:22.064359   641 raft_consensus.cc:1275] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 4 FOLLOWER]: Refusing update from remote peer 161772e939c14b909e60e121f5bb7d61: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:22.065584   912 consensus_queue.cc:1048] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:22.074882   564 raft_consensus.cc:1275] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Refusing update from remote peer 161772e939c14b909e60e121f5bb7d61: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:22.076761   869 consensus_queue.cc:1048] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f3cc729867f49e0b0f93c48b60c13f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:22.281728   641 raft_consensus.cc:1275] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 5 FOLLOWER]: Refusing update from remote peer 3f3cc729867f49e0b0f93c48b60c13f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:58:22.283310   917 consensus_queue.cc:1048] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:22.294561   714 raft_consensus.cc:1275] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 5 FOLLOWER]: Refusing update from remote peer 3f3cc729867f49e0b0f93c48b60c13f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:58:22.297977   905 consensus_queue.cc:1048] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:22.349294   714 raft_consensus.cc:1275] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 4 FOLLOWER]: Refusing update from remote peer 3f3cc729867f49e0b0f93c48b60c13f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:22.350819   905 consensus_queue.cc:1048] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161772e939c14b909e60e121f5bb7d61" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:22.361722   641 raft_consensus.cc:1275] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 4 FOLLOWER]: Refusing update from remote peer 3f3cc729867f49e0b0f93c48b60c13f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:22.363159   904 consensus_queue.cc:1048] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda989108897478fb1e3be4f6025e904" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:22.439591   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:22.445164   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:58:22.470417   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:22.471218   431 tablet_replica.cc:333] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7: stopping tablet replica
I20260709 12:58:22.472147   431 raft_consensus.cc:2243] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:58:22.473070   431 raft_consensus.cc:2272] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 3f3cc729867f49e0b0f93c48b60c13f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.477236   431 tablet_replica.cc:333] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7: stopping tablet replica
I20260709 12:58:22.477766   431 raft_consensus.cc:2243] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.478233   431 raft_consensus.cc:2272] T e549157c45c640c68cc0fa9640e0dab2 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.479803   431 tablet_replica.cc:333] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7: stopping tablet replica
I20260709 12:58:22.480285   431 raft_consensus.cc:2243] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.480705   431 raft_consensus.cc:2272] T 9ba3b88fda0a4b43914839e64faeb702 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.483362   431 tablet_replica.cc:333] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7: stopping tablet replica
I20260709 12:58:22.483887   431 raft_consensus.cc:2243] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:22.484685   431 raft_consensus.cc:2272] T dbc77d4426ed495fb2ba29a6ed637f46 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.486696   431 tablet_replica.cc:333] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7: stopping tablet replica
I20260709 12:58:22.487151   431 raft_consensus.cc:2243] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:22.487798   431 raft_consensus.cc:2272] T 578c09d582dc4509a57497a3e8c55b49 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.489898   431 tablet_replica.cc:333] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7: stopping tablet replica
I20260709 12:58:22.490531   431 raft_consensus.cc:2243] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.491042   431 raft_consensus.cc:2272] T f5efa7edf6e8422f935f10bde32ff068 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.492799   431 tablet_replica.cc:333] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7: stopping tablet replica
I20260709 12:58:22.493336   431 raft_consensus.cc:2243] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.493752   431 raft_consensus.cc:2272] T 971370e0477944d8996e319be2e1c092 P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.495759   431 tablet_replica.cc:333] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7: stopping tablet replica
I20260709 12:58:22.496241   431 raft_consensus.cc:2243] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.496711   431 raft_consensus.cc:2272] T c14010b70425440e909875bf25f4eebf P 3f3cc729867f49e0b0f93c48b60c13f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.498382   431 tablet_replica.cc:333] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7: stopping tablet replica
I20260709 12:58:22.498828   431 raft_consensus.cc:2243] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.499358   431 raft_consensus.cc:2272] T 0f777b1f911549f68f4cc4aec116480c P 3f3cc729867f49e0b0f93c48b60c13f7 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:22.605815   606 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37571: connect: Connection refused (error 111)
I20260709 12:58:22.607064   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 12:58:22.610769   606 consensus_peers.cc:597] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 -> Peer 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571): Couldn't send request to peer 3f3cc729867f49e0b0f93c48b60c13f7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:22.613201   680 consensus_peers.cc:597] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 -> Peer 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571): Couldn't send request to peer 3f3cc729867f49e0b0f93c48b60c13f7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:22.629699   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:58:22.663431   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:22.664317   431 tablet_replica.cc:333] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904: stopping tablet replica
W20260709 12:58:22.664152   606 consensus_peers.cc:597] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 -> Peer 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571): Couldn't send request to peer 3f3cc729867f49e0b0f93c48b60c13f7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:22.665020   431 raft_consensus.cc:2243] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.665491   431 raft_consensus.cc:2272] T 578c09d582dc4509a57497a3e8c55b49 P fda989108897478fb1e3be4f6025e904 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.668009   431 tablet_replica.cc:333] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904: stopping tablet replica
I20260709 12:58:22.669030   431 raft_consensus.cc:2243] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:22.669894   431 raft_consensus.cc:2272] T c14010b70425440e909875bf25f4eebf P fda989108897478fb1e3be4f6025e904 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.671702   431 tablet_replica.cc:333] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904: stopping tablet replica
I20260709 12:58:22.672299   431 raft_consensus.cc:2243] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:22.673134   431 raft_consensus.cc:2272] T 0f777b1f911549f68f4cc4aec116480c P fda989108897478fb1e3be4f6025e904 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.674993   431 tablet_replica.cc:333] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904: stopping tablet replica
I20260709 12:58:22.675503   431 raft_consensus.cc:2243] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.675927   431 raft_consensus.cc:2272] T 971370e0477944d8996e319be2e1c092 P fda989108897478fb1e3be4f6025e904 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.678845   431 tablet_replica.cc:333] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904: stopping tablet replica
I20260709 12:58:22.679382   431 raft_consensus.cc:2243] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:22.680145   431 raft_consensus.cc:2272] T f5efa7edf6e8422f935f10bde32ff068 P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.681924   431 tablet_replica.cc:333] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904: stopping tablet replica
I20260709 12:58:22.682416   431 raft_consensus.cc:2243] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.682823   431 raft_consensus.cc:2272] T dbc77d4426ed495fb2ba29a6ed637f46 P fda989108897478fb1e3be4f6025e904 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.685225   431 tablet_replica.cc:333] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904: stopping tablet replica
I20260709 12:58:22.685732   431 raft_consensus.cc:2243] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.686146   431 raft_consensus.cc:2272] T 9ba3b88fda0a4b43914839e64faeb702 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.688270   431 tablet_replica.cc:333] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904: stopping tablet replica
I20260709 12:58:22.688947   431 raft_consensus.cc:2243] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.689380   431 raft_consensus.cc:2272] T e549157c45c640c68cc0fa9640e0dab2 P fda989108897478fb1e3be4f6025e904 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.691372   431 tablet_replica.cc:333] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904: stopping tablet replica
I20260709 12:58:22.691787   431 raft_consensus.cc:2243] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.692746   431 raft_consensus.cc:2272] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P fda989108897478fb1e3be4f6025e904 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:22.706518   680 consensus_peers.cc:597] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 -> Peer 3f3cc729867f49e0b0f93c48b60c13f7 (127.0.107.193:37571): Couldn't send request to peer 3f3cc729867f49e0b0f93c48b60c13f7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:22.719866   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:58:22.736554   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:58:22.771334   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:22.772114   431 tablet_replica.cc:333] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61: stopping tablet replica
I20260709 12:58:22.772857   431 raft_consensus.cc:2243] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.773727   431 raft_consensus.cc:2272] T 0e0df8f6ad8d46ddb59f729ea0fe63eb P 161772e939c14b909e60e121f5bb7d61 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.776331   431 tablet_replica.cc:333] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61: stopping tablet replica
I20260709 12:58:22.776901   431 raft_consensus.cc:2243] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.777318   431 raft_consensus.cc:2272] T dbc77d4426ed495fb2ba29a6ed637f46 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.779502   431 tablet_replica.cc:333] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61: stopping tablet replica
I20260709 12:58:22.780135   431 raft_consensus.cc:2243] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:22.780977   431 raft_consensus.cc:2272] T e549157c45c640c68cc0fa9640e0dab2 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.782789   431 tablet_replica.cc:333] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61: stopping tablet replica
I20260709 12:58:22.783512   431 raft_consensus.cc:2243] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:22.784250   431 raft_consensus.cc:2272] T 9ba3b88fda0a4b43914839e64faeb702 P 161772e939c14b909e60e121f5bb7d61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.786406   431 tablet_replica.cc:333] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61: stopping tablet replica
I20260709 12:58:22.787117   431 raft_consensus.cc:2243] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.787556   431 raft_consensus.cc:2272] T f5efa7edf6e8422f935f10bde32ff068 P 161772e939c14b909e60e121f5bb7d61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.789439   431 tablet_replica.cc:333] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61: stopping tablet replica
I20260709 12:58:22.789873   431 raft_consensus.cc:2243] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:22.790693   431 raft_consensus.cc:2272] T 971370e0477944d8996e319be2e1c092 P 161772e939c14b909e60e121f5bb7d61 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.792735   431 tablet_replica.cc:333] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61: stopping tablet replica
I20260709 12:58:22.793265   431 raft_consensus.cc:2243] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.793686   431 raft_consensus.cc:2272] T 0f777b1f911549f68f4cc4aec116480c P 161772e939c14b909e60e121f5bb7d61 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.795292   431 tablet_replica.cc:333] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61: stopping tablet replica
I20260709 12:58:22.795768   431 raft_consensus.cc:2243] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.796190   431 raft_consensus.cc:2272] T c14010b70425440e909875bf25f4eebf P 161772e939c14b909e60e121f5bb7d61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.797890   431 tablet_replica.cc:333] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61: stopping tablet replica
I20260709 12:58:22.798393   431 raft_consensus.cc:2243] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:22.798821   431 raft_consensus.cc:2272] T 578c09d582dc4509a57497a3e8c55b49 P 161772e939c14b909e60e121f5bb7d61 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:22.826579   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:58:22.846069   431 master.cc:562] Master@127.0.107.254:35023 shutting down...
I20260709 12:58:23.078334   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:23.079025   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:23.079393   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 96a49216662549f3906d69dc702ef77b: stopping tablet replica
I20260709 12:58:23.099201   431 master.cc:584] Master@127.0.107.254:35023 shutdown complete.
161772e939c14b909e60e121f5bb7d61  1
3f3cc729867f49e0b0f93c48b60c13f7  4
fda989108897478fb1e3be4f6025e904  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13337 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:58:23.138083   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:41223
I20260709 12:58:23.139257   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:23.146698   930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:23.146826   929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:23.146922   932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:23.148670   431 server_base.cc:1061] running on GCE node
I20260709 12:58:23.149448   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:23.149619   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:23.149739   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601903149724 us; error 0 us; skew 500 ppm
I20260709 12:58:23.150185   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:23.152907   431 webserver.cc:533] Webserver started at http://127.0.107.254:41311/ using document root <none> and password file <none>
I20260709 12:58:23.153434   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:23.153601   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:23.153931   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:23.155162   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/master-0-root/instance:
uuid: "079ea5ee49dc4199a84384716faf72a7"
format_stamp: "Formatted at 2026-07-09 12:58:23 on dist-test-slave-c08m"
I20260709 12:58:23.159837   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:58:23.163538   937 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.164691   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:58:23.164997   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/master-0-root
uuid: "079ea5ee49dc4199a84384716faf72a7"
format_stamp: "Formatted at 2026-07-09 12:58:23 on dist-test-slave-c08m"
I20260709 12:58:23.165441   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:23.176548   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:23.177904   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:23.227618   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:41223
I20260709 12:58:23.227732   988 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:41223 every 8 connection(s)
I20260709 12:58:23.233668   989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.244453   989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7: Bootstrap starting.
I20260709 12:58:23.249908   989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.255524   989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7: No bootstrap required, opened a new log
I20260709 12:58:23.257946   989 raft_consensus.cc:359] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "079ea5ee49dc4199a84384716faf72a7" member_type: VOTER }
I20260709 12:58:23.258450   989 raft_consensus.cc:385] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.258694   989 raft_consensus.cc:740] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 079ea5ee49dc4199a84384716faf72a7, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.259454   989 consensus_queue.cc:260] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "079ea5ee49dc4199a84384716faf72a7" member_type: VOTER }
I20260709 12:58:23.259924   989 raft_consensus.cc:399] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:23.260254   989 raft_consensus.cc:493] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:23.260538   989 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.264680   989 raft_consensus.cc:515] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "079ea5ee49dc4199a84384716faf72a7" member_type: VOTER }
I20260709 12:58:23.265210   989 leader_election.cc:304] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 079ea5ee49dc4199a84384716faf72a7; no voters: 
I20260709 12:58:23.266327   989 leader_election.cc:290] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:23.266811   992 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:23.268283   992 raft_consensus.cc:697] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [term 1 LEADER]: Becoming Leader. State: Replica: 079ea5ee49dc4199a84384716faf72a7, State: Running, Role: LEADER
I20260709 12:58:23.268986   992 consensus_queue.cc:237] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "079ea5ee49dc4199a84384716faf72a7" member_type: VOTER }
I20260709 12:58:23.269238   989 sys_catalog.cc:565] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:23.274257   994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 079ea5ee49dc4199a84384716faf72a7. Latest consensus state: current_term: 1 leader_uuid: "079ea5ee49dc4199a84384716faf72a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "079ea5ee49dc4199a84384716faf72a7" member_type: VOTER } }
I20260709 12:58:23.275098   994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:23.275399   993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "079ea5ee49dc4199a84384716faf72a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "079ea5ee49dc4199a84384716faf72a7" member_type: VOTER } }
I20260709 12:58:23.276069   993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:23.277387  1000 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:23.282519  1000 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:23.285126   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:23.291368  1000 catalog_manager.cc:1383] Generated new cluster ID: fd40d00197cd41088bc8d519fa4a29eb
I20260709 12:58:23.291684  1000 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:23.314400  1000 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:23.315723  1000 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:23.329722  1000 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7: Generated new TSK 0
I20260709 12:58:23.330473  1000 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:23.354390   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:23.361335  1010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:23.362901  1011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:23.365166  1013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:23.365952   431 server_base.cc:1061] running on GCE node
I20260709 12:58:23.366873   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:23.367092   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:23.367283   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601903367260 us; error 0 us; skew 500 ppm
I20260709 12:58:23.367820   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:23.370563   431 webserver.cc:533] Webserver started at http://127.0.107.193:45787/ using document root <none> and password file <none>
I20260709 12:58:23.371094   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:23.371256   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:23.371608   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:23.372954   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-0-root/instance:
uuid: "10b71dd7aed440b7bc652f8c78785f96"
format_stamp: "Formatted at 2026-07-09 12:58:23 on dist-test-slave-c08m"
I20260709 12:58:23.377916   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:58:23.381812  1018 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.382742   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:58:23.383067   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-0-root
uuid: "10b71dd7aed440b7bc652f8c78785f96"
format_stamp: "Formatted at 2026-07-09 12:58:23 on dist-test-slave-c08m"
I20260709 12:58:23.383404   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:23.401176   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:23.402467   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:23.403916   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:23.406313   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:23.406539   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.406800   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:23.406988   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.459884   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:39677
I20260709 12:58:23.459990  1080 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:39677 every 8 connection(s)
I20260709 12:58:23.464859   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:23.473958  1085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:23.474282  1086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:23.477900   431 server_base.cc:1061] running on GCE node
W20260709 12:58:23.478964  1088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:23.480008   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:23.480227   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:23.480508   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601903480488 us; error 0 us; skew 500 ppm
I20260709 12:58:23.481132   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:23.484705  1081 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41223
I20260709 12:58:23.484738   431 webserver.cc:533] Webserver started at http://127.0.107.194:32897/ using document root <none> and password file <none>
I20260709 12:58:23.485297  1081 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:23.485626   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:23.485911   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:23.486268   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:23.486254  1081 heartbeater.cc:507] Master 127.0.107.254:41223 requested a full tablet report, sending...
I20260709 12:58:23.487821   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-1-root/instance:
uuid: "cbcdb9aece834c08b02e84eff5a809a5"
format_stamp: "Formatted at 2026-07-09 12:58:23 on dist-test-slave-c08m"
I20260709 12:58:23.488889   954 ts_manager.cc:194] Registered new tserver with Master: 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677)
I20260709 12:58:23.490648   954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44052
I20260709 12:58:23.493335   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:58:23.497233  1093 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.498101   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:58:23.498474   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-1-root
uuid: "cbcdb9aece834c08b02e84eff5a809a5"
format_stamp: "Formatted at 2026-07-09 12:58:23 on dist-test-slave-c08m"
I20260709 12:58:23.498792   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:23.511868   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:23.513403   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:23.515069   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:23.517611   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:23.517817   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.518111   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:23.518338   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.562839   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:37373
I20260709 12:58:23.562940  1155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:37373 every 8 connection(s)
I20260709 12:58:23.567905   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:23.576628  1159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:23.577857  1160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:23.581243  1162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:23.581494  1156 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41223
I20260709 12:58:23.581954  1156 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:23.582762  1156 heartbeater.cc:507] Master 127.0.107.254:41223 requested a full tablet report, sending...
I20260709 12:58:23.583137   431 server_base.cc:1061] running on GCE node
I20260709 12:58:23.584059   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:23.584331   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:23.584509   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601903584488 us; error 0 us; skew 500 ppm
I20260709 12:58:23.585341   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:23.585340   954 ts_manager.cc:194] Registered new tserver with Master: cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:23.587250   954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44066
I20260709 12:58:23.589630   431 webserver.cc:533] Webserver started at http://127.0.107.195:39117/ using document root <none> and password file <none>
I20260709 12:58:23.590515   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:23.590864   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:23.591128   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:23.592239   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-2-root/instance:
uuid: "0933d7d26d6c4321ac2b184564bcfa50"
format_stamp: "Formatted at 2026-07-09 12:58:23 on dist-test-slave-c08m"
I20260709 12:58:23.597476   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.001s
I20260709 12:58:23.601150  1167 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.602129   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:58:23.602500   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-2-root
uuid: "0933d7d26d6c4321ac2b184564bcfa50"
format_stamp: "Formatted at 2026-07-09 12:58:23 on dist-test-slave-c08m"
I20260709 12:58:23.602770   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601889622018-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:23.619599   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:23.620867   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:23.622330   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:23.624635   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:23.624892   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.625144   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:23.625463   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:23.668105   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:33839
I20260709 12:58:23.668190  1229 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:33839 every 8 connection(s)
I20260709 12:58:23.688102  1230 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41223
I20260709 12:58:23.688452  1230 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:23.689265  1230 heartbeater.cc:507] Master 127.0.107.254:41223 requested a full tablet report, sending...
I20260709 12:58:23.691721   954 ts_manager.cc:194] Registered new tserver with Master: 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:23.691861   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020516432s
I20260709 12:58:23.693789   954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44082
I20260709 12:58:23.722568   954 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44084:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:23.725606   954 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:23.811547  1121 tablet_service.cc:1511] Processing CreateTablet for tablet e0bd400b46224eeaa2241dbca5e5ad7b (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:23.811939  1120 tablet_service.cc:1511] Processing CreateTablet for tablet 2a17d2df148243d29b308a1a36bc2d7c (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:23.812896  1121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bd400b46224eeaa2241dbca5e5ad7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.814395  1119 tablet_service.cc:1511] Processing CreateTablet for tablet 573c69d482de4112aa00a3c5ffe97306 (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:23.815726  1119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 573c69d482de4112aa00a3c5ffe97306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.821105  1120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a17d2df148243d29b308a1a36bc2d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.822522  1195 tablet_service.cc:1511] Processing CreateTablet for tablet e0bd400b46224eeaa2241dbca5e5ad7b (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:23.823912  1195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bd400b46224eeaa2241dbca5e5ad7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.824302  1045 tablet_service.cc:1511] Processing CreateTablet for tablet 2a17d2df148243d29b308a1a36bc2d7c (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:23.825169  1046 tablet_service.cc:1511] Processing CreateTablet for tablet e0bd400b46224eeaa2241dbca5e5ad7b (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:23.825783  1045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a17d2df148243d29b308a1a36bc2d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.826448  1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bd400b46224eeaa2241dbca5e5ad7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.827940  1044 tablet_service.cc:1511] Processing CreateTablet for tablet 573c69d482de4112aa00a3c5ffe97306 (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:23.829319  1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 573c69d482de4112aa00a3c5ffe97306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.829810  1194 tablet_service.cc:1511] Processing CreateTablet for tablet 2a17d2df148243d29b308a1a36bc2d7c (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:23.831097  1194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a17d2df148243d29b308a1a36bc2d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.833786  1043 tablet_service.cc:1511] Processing CreateTablet for tablet b1a1f8068f3f498c838e1185775a0dca (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:23.835140  1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a1f8068f3f498c838e1185775a0dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.836421  1193 tablet_service.cc:1511] Processing CreateTablet for tablet 573c69d482de4112aa00a3c5ffe97306 (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:23.837961  1193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 573c69d482de4112aa00a3c5ffe97306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.846750  1118 tablet_service.cc:1511] Processing CreateTablet for tablet b1a1f8068f3f498c838e1185775a0dca (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:23.848233  1118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a1f8068f3f498c838e1185775a0dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.849153  1192 tablet_service.cc:1511] Processing CreateTablet for tablet b1a1f8068f3f498c838e1185775a0dca (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:23.850983  1192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a1f8068f3f498c838e1185775a0dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.851182  1042 tablet_service.cc:1511] Processing CreateTablet for tablet df55d1c7d075497499bd9e7dc25368dc (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:23.853751  1117 tablet_service.cc:1511] Processing CreateTablet for tablet df55d1c7d075497499bd9e7dc25368dc (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:23.854492  1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df55d1c7d075497499bd9e7dc25368dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.855155  1117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df55d1c7d075497499bd9e7dc25368dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.870947  1191 tablet_service.cc:1511] Processing CreateTablet for tablet df55d1c7d075497499bd9e7dc25368dc (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:23.873128  1191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df55d1c7d075497499bd9e7dc25368dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.873014  1041 tablet_service.cc:1511] Processing CreateTablet for tablet 2167ef4ee1f2433d9436f6419d22ef0a (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:23.874521  1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2167ef4ee1f2433d9436f6419d22ef0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.880879  1190 tablet_service.cc:1511] Processing CreateTablet for tablet 2167ef4ee1f2433d9436f6419d22ef0a (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:23.882972  1190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2167ef4ee1f2433d9436f6419d22ef0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.884389  1040 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb238f427b94a3482d539531cba2a2d (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:23.885890  1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb238f427b94a3482d539531cba2a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.885269  1116 tablet_service.cc:1511] Processing CreateTablet for tablet 2167ef4ee1f2433d9436f6419d22ef0a (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:23.887171  1116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2167ef4ee1f2433d9436f6419d22ef0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.905690  1117 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb238f427b94a3482d539531cba2a2d (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:23.907652  1117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb238f427b94a3482d539531cba2a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.911131  1189 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb238f427b94a3482d539531cba2a2d (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:23.912720  1189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb238f427b94a3482d539531cba2a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.924882  1039 tablet_service.cc:1511] Processing CreateTablet for tablet cc20c65d841743c5b54b309014bfd3b8 (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:23.933265  1117 tablet_service.cc:1511] Processing CreateTablet for tablet cc20c65d841743c5b54b309014bfd3b8 (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:23.934615  1117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc20c65d841743c5b54b309014bfd3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.943986  1246 tablet_bootstrap.cc:492] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50: Bootstrap starting.
I20260709 12:58:23.945070  1188 tablet_service.cc:1511] Processing CreateTablet for tablet cc20c65d841743c5b54b309014bfd3b8 (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:23.946487  1188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc20c65d841743c5b54b309014bfd3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.950809  1038 tablet_service.cc:1511] Processing CreateTablet for tablet 42f97c45b0ef4ea38d0baa4673af6487 (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:23.954905  1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc20c65d841743c5b54b309014bfd3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.956488  1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f97c45b0ef4ea38d0baa4673af6487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.979952  1115 tablet_service.cc:1511] Processing CreateTablet for tablet 42f97c45b0ef4ea38d0baa4673af6487 (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:23.981827  1115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f97c45b0ef4ea38d0baa4673af6487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:23.989117  1189 tablet_service.cc:1511] Processing CreateTablet for tablet 42f97c45b0ef4ea38d0baa4673af6487 (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:24.001327  1189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f97c45b0ef4ea38d0baa4673af6487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.014993  1246 tablet_bootstrap.cc:654] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.012837  1040 tablet_service.cc:1511] Processing CreateTablet for tablet 86601eeee8e3462383b5947a0c6a497e (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:24.016036  1187 tablet_service.cc:1511] Processing CreateTablet for tablet 86601eeee8e3462383b5947a0c6a497e (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:24.023218  1187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86601eeee8e3462383b5947a0c6a497e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.029579  1245 tablet_bootstrap.cc:492] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5: Bootstrap starting.
I20260709 12:58:24.031872  1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86601eeee8e3462383b5947a0c6a497e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.033509  1246 tablet_bootstrap.cc:492] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50: No bootstrap required, opened a new log
I20260709 12:58:24.034063  1246 ts_tablet_manager.cc:1403] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.000s
I20260709 12:58:24.016662  1118 tablet_service.cc:1511] Processing CreateTablet for tablet 86601eeee8e3462383b5947a0c6a497e (DEFAULT_TABLE table=test-workload [id=8f8a0c1ce26a4562a517e0ecb895e7a7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:24.037478  1246 raft_consensus.cc:359] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.038513  1246 raft_consensus.cc:385] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.038902  1246 raft_consensus.cc:740] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.037470  1118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86601eeee8e3462383b5947a0c6a497e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.039067  1247 tablet_bootstrap.cc:492] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96: Bootstrap starting.
I20260709 12:58:24.042986  1246 consensus_queue.cc:260] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.047204  1247 tablet_bootstrap.cc:654] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.079773  1247 tablet_bootstrap.cc:492] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96: No bootstrap required, opened a new log
I20260709 12:58:24.080366  1247 ts_tablet_manager.cc:1403] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.007s
I20260709 12:58:24.083674  1247 raft_consensus.cc:359] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.084491  1247 raft_consensus.cc:385] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.084908  1247 raft_consensus.cc:740] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.085981  1247 consensus_queue.cc:260] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.088392  1245 tablet_bootstrap.cc:654] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.089401  1081 heartbeater.cc:499] Master 127.0.107.254:41223 was elected leader, sending a full tablet report...
I20260709 12:58:24.102113  1247 ts_tablet_manager.cc:1434] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 12:58:24.103894  1247 tablet_bootstrap.cc:492] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96: Bootstrap starting.
I20260709 12:58:24.113967  1247 tablet_bootstrap.cc:654] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.115418  1230 heartbeater.cc:499] Master 127.0.107.254:41223 was elected leader, sending a full tablet report...
I20260709 12:58:24.115967  1246 ts_tablet_manager.cc:1434] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50: Time spent starting tablet: real 0.082s	user 0.038s	sys 0.031s
I20260709 12:58:24.117106  1246 tablet_bootstrap.cc:492] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50: Bootstrap starting.
I20260709 12:58:24.128575  1245 tablet_bootstrap.cc:492] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5: No bootstrap required, opened a new log
I20260709 12:58:24.129217  1245 ts_tablet_manager.cc:1403] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5: Time spent bootstrapping tablet: real 0.100s	user 0.021s	sys 0.026s
I20260709 12:58:24.131513  1245 raft_consensus.cc:359] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } }
I20260709 12:58:24.132089  1245 raft_consensus.cc:385] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.132450  1245 raft_consensus.cc:740] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.132440  1246 tablet_bootstrap.cc:654] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.133872  1245 consensus_queue.cc:260] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } }
I20260709 12:58:24.135444  1247 tablet_bootstrap.cc:492] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96: No bootstrap required, opened a new log
I20260709 12:58:24.136045  1247 ts_tablet_manager.cc:1403] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.013s
I20260709 12:58:24.140559  1247 raft_consensus.cc:359] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.141829  1247 raft_consensus.cc:385] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.142367  1247 raft_consensus.cc:740] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.143564  1247 consensus_queue.cc:260] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.146946  1247 ts_tablet_manager.cc:1434] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:58:24.148057  1247 tablet_bootstrap.cc:492] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96: Bootstrap starting.
I20260709 12:58:24.157841  1247 tablet_bootstrap.cc:654] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.171828  1247 tablet_bootstrap.cc:492] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96: No bootstrap required, opened a new log
I20260709 12:58:24.172477  1247 ts_tablet_manager.cc:1403] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.009s
I20260709 12:58:24.177243  1247 raft_consensus.cc:359] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } }
I20260709 12:58:24.178435  1247 raft_consensus.cc:385] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.178915  1247 raft_consensus.cc:740] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.180084  1247 consensus_queue.cc:260] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } }
I20260709 12:58:24.186357  1247 ts_tablet_manager.cc:1434] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 12:58:24.188405  1247 tablet_bootstrap.cc:492] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96: Bootstrap starting.
I20260709 12:58:24.190701  1245 ts_tablet_manager.cc:1434] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5: Time spent starting tablet: real 0.061s	user 0.022s	sys 0.037s
I20260709 12:58:24.191687  1156 heartbeater.cc:499] Master 127.0.107.254:41223 was elected leader, sending a full tablet report...
I20260709 12:58:24.194208  1246 tablet_bootstrap.cc:492] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50: No bootstrap required, opened a new log
I20260709 12:58:24.194839  1246 ts_tablet_manager.cc:1403] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50: Time spent bootstrapping tablet: real 0.078s	user 0.022s	sys 0.046s
I20260709 12:58:24.195155  1245 tablet_bootstrap.cc:492] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5: Bootstrap starting.
I20260709 12:58:24.196101  1247 tablet_bootstrap.cc:654] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.198340  1246 raft_consensus.cc:359] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.199286  1246 raft_consensus.cc:385] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.199656  1246 raft_consensus.cc:740] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.200795  1246 consensus_queue.cc:260] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.203760  1246 ts_tablet_manager.cc:1434] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:58:24.203926  1245 tablet_bootstrap.cc:654] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.205583  1246 tablet_bootstrap.cc:492] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50: Bootstrap starting.
I20260709 12:58:24.216838  1246 tablet_bootstrap.cc:654] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.219527  1245 tablet_bootstrap.cc:492] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5: No bootstrap required, opened a new log
I20260709 12:58:24.220573  1245 ts_tablet_manager.cc:1403] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.014s
I20260709 12:58:24.223090  1251 raft_consensus.cc:493] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.223788  1251 raft_consensus.cc:515] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } }
I20260709 12:58:24.225010  1245 raft_consensus.cc:359] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.226035  1245 raft_consensus.cc:385] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.226733  1245 raft_consensus.cc:740] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.227978  1245 consensus_queue.cc:260] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.231299  1245 ts_tablet_manager.cc:1434] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:58:24.232626  1245 tablet_bootstrap.cc:492] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5: Bootstrap starting.
I20260709 12:58:24.233403  1251 leader_election.cc:290] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:24.241616  1245 tablet_bootstrap.cc:654] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.257622  1245 tablet_bootstrap.cc:492] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5: No bootstrap required, opened a new log
I20260709 12:58:24.258396  1245 ts_tablet_manager.cc:1403] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.006s
I20260709 12:58:24.262914  1245 raft_consensus.cc:359] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.264690  1245 raft_consensus.cc:385] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.265323  1245 raft_consensus.cc:740] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.266535  1245 consensus_queue.cc:260] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.267665  1247 tablet_bootstrap.cc:492] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96: No bootstrap required, opened a new log
I20260709 12:58:24.268203  1247 ts_tablet_manager.cc:1403] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96: Time spent bootstrapping tablet: real 0.080s	user 0.036s	sys 0.029s
I20260709 12:58:24.270018  1245 ts_tablet_manager.cc:1434] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:58:24.271174  1247 raft_consensus.cc:359] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.271624  1245 tablet_bootstrap.cc:492] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5: Bootstrap starting.
I20260709 12:58:24.271991  1247 raft_consensus.cc:385] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.272351  1247 raft_consensus.cc:740] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.273131  1247 consensus_queue.cc:260] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.275862  1247 ts_tablet_manager.cc:1434] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:58:24.278383  1247 tablet_bootstrap.cc:492] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96: Bootstrap starting.
W20260709 12:58:24.280264  1002 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:24.283350  1245 tablet_bootstrap.cc:654] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.282037  1246 tablet_bootstrap.cc:492] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50: No bootstrap required, opened a new log
I20260709 12:58:24.287688  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bd400b46224eeaa2241dbca5e5ad7b" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50" is_pre_election: true
I20260709 12:58:24.290395  1247 tablet_bootstrap.cc:654] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.290721  1246 ts_tablet_manager.cc:1403] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50: Time spent bootstrapping tablet: real 0.085s	user 0.035s	sys 0.032s
W20260709 12:58:24.290488  1022 leader_election.cc:343] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.293182  1249 raft_consensus.cc:493] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.293763  1249 raft_consensus.cc:515] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.294204  1246 raft_consensus.cc:359] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.294894  1246 raft_consensus.cc:385] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.295197  1246 raft_consensus.cc:740] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.295962  1246 consensus_queue.cc:260] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.296808  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bd400b46224eeaa2241dbca5e5ad7b" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5" is_pre_election: true
I20260709 12:58:24.297472  1131 raft_consensus.cc:2468] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 0.
I20260709 12:58:24.299017  1249 leader_election.cc:290] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:24.300195  1019 leader_election.cc:304] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 0933d7d26d6c4321ac2b184564bcfa50
I20260709 12:58:24.301100  1251 raft_consensus.cc:2804] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.301447  1251 raft_consensus.cc:493] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.301807  1251 raft_consensus.cc:3060] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.311841  1245 tablet_bootstrap.cc:492] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5: No bootstrap required, opened a new log
I20260709 12:58:24.312391  1245 ts_tablet_manager.cc:1403] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.006s
I20260709 12:58:24.315407  1245 raft_consensus.cc:359] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.316164  1245 raft_consensus.cc:385] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.316521  1251 raft_consensus.cc:515] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } }
I20260709 12:58:24.318032  1247 tablet_bootstrap.cc:492] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96: No bootstrap required, opened a new log
I20260709 12:58:24.318523  1247 ts_tablet_manager.cc:1403] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.004s
I20260709 12:58:24.319540  1251 leader_election.cc:290] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 election: Requested vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:24.316526  1245 raft_consensus.cc:740] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.320271  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bd400b46224eeaa2241dbca5e5ad7b" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:24.320864  1131 raft_consensus.cc:3060] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.320977  1245 consensus_queue.cc:260] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.323613  1245 ts_tablet_manager.cc:1434] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:58:24.320575  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bd400b46224eeaa2241dbca5e5ad7b" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:24.324678  1245 tablet_bootstrap.cc:492] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5: Bootstrap starting.
W20260709 12:58:24.325920  1022 leader_election.cc:343] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.330689  1131 raft_consensus.cc:2468] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 1.
I20260709 12:58:24.331629  1245 tablet_bootstrap.cc:654] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.332209  1019 leader_election.cc:304] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 0933d7d26d6c4321ac2b184564bcfa50
I20260709 12:58:24.333509  1251 raft_consensus.cc:2804] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.343349  1247 raft_consensus.cc:359] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.344327  1247 raft_consensus.cc:385] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.346319  1247 raft_consensus.cc:740] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.347512  1247 consensus_queue.cc:260] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.345366  1246 ts_tablet_manager.cc:1434] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50: Time spent starting tablet: real 0.054s	user 0.018s	sys 0.019s
I20260709 12:58:24.348930  1264 raft_consensus.cc:493] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.349463  1264 raft_consensus.cc:515] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.350226  1246 tablet_bootstrap.cc:492] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50: Bootstrap starting.
I20260709 12:58:24.355809  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc20c65d841743c5b54b309014bfd3b8" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96" is_pre_election: true
I20260709 12:58:24.357923  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96" is_pre_election: true
I20260709 12:58:24.358722  1251 raft_consensus.cc:697] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 1 LEADER]: Becoming Leader. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:24.359189  1055 raft_consensus.cc:2468] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 0.
I20260709 12:58:24.359908  1246 tablet_bootstrap.cc:654] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.359673  1251 consensus_queue.cc:237] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } }
I20260709 12:58:24.363648  1264 leader_election.cc:290] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
W20260709 12:58:24.364852  1168 leader_election.cc:343] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.365785  1168 leader_election.cc:304] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, 10b71dd7aed440b7bc652f8c78785f96; no voters: 
I20260709 12:58:24.367333  1268 raft_consensus.cc:493] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.367599  1264 raft_consensus.cc:2804] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.367848  1268 raft_consensus.cc:515] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.368173  1264 raft_consensus.cc:493] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.369171  1264 raft_consensus.cc:3060] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.374176  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c69d482de4112aa00a3c5ffe97306" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5" is_pre_election: true
W20260709 12:58:24.375829  1019 leader_election.cc:343] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.376279  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5" is_pre_election: true
I20260709 12:58:24.377096  1129 raft_consensus.cc:2468] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 0.
I20260709 12:58:24.378262  1249 raft_consensus.cc:493] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.378680  1246 tablet_bootstrap.cc:492] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50: No bootstrap required, opened a new log
I20260709 12:58:24.378553  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc20c65d841743c5b54b309014bfd3b8" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5" is_pre_election: true
I20260709 12:58:24.378760  1249 raft_consensus.cc:515] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.381311  1249 leader_election.cc:290] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:24.381592  1247 ts_tablet_manager.cc:1434] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96: Time spent starting tablet: real 0.060s	user 0.011s	sys 0.006s
I20260709 12:58:24.382639  1247 tablet_bootstrap.cc:492] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96: Bootstrap starting.
I20260709 12:58:24.384603  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86601eeee8e3462383b5947a0c6a497e" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96" is_pre_election: true
W20260709 12:58:24.386490  1168 leader_election.cc:343] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.386209  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c69d482de4112aa00a3c5ffe97306" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50" is_pre_election: true
I20260709 12:58:24.387398  1168 leader_election.cc:304] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50; no voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5
W20260709 12:58:24.388628  1168 leader_election.cc:343] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.389230  1247 tablet_bootstrap.cc:654] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.389331  1249 raft_consensus.cc:2749] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:24.389463  1022 leader_election.cc:343] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.390312  1246 ts_tablet_manager.cc:1403] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.004s
I20260709 12:58:24.390643  1022 leader_election.cc:304] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96; no voters: 0933d7d26d6c4321ac2b184564bcfa50, cbcdb9aece834c08b02e84eff5a809a5
I20260709 12:58:24.391921  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86601eeee8e3462383b5947a0c6a497e" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5" is_pre_election: true
I20260709 12:58:24.391744  1264 raft_consensus.cc:515] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.394469  1246 raft_consensus.cc:359] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } }
W20260709 12:58:24.393512  1168 leader_election.cc:343] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.396101  1270 raft_consensus.cc:2749] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:24.395900  1168 leader_election.cc:304] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50; no voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5
I20260709 12:58:24.397015  1268 leader_election.cc:290] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:24.397919  1249 raft_consensus.cc:2749] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:24.399216  1264 leader_election.cc:290] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:24.401054  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:24.401866  1055 raft_consensus.cc:3060] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.403184  1245 tablet_bootstrap.cc:492] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5: No bootstrap required, opened a new log
I20260709 12:58:24.403748  1245 ts_tablet_manager.cc:1403] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.018s
I20260709 12:58:24.405635  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:24.406416  1131 raft_consensus.cc:3060] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.408650  1251 raft_consensus.cc:493] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.409161  1251 raft_consensus.cc:515] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.411351  1251 leader_election.cc:290] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:24.411911  1246 raft_consensus.cc:385] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.414076  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167ef4ee1f2433d9436f6419d22ef0a" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5" is_pre_election: true
I20260709 12:58:24.415794  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167ef4ee1f2433d9436f6419d22ef0a" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50" is_pre_election: true
I20260709 12:58:24.415933  1055 raft_consensus.cc:2468] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 1.
W20260709 12:58:24.417439  1022 leader_election.cc:343] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.417829  1247 tablet_bootstrap.cc:492] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96: No bootstrap required, opened a new log
I20260709 12:58:24.417516  1168 leader_election.cc:304] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, 10b71dd7aed440b7bc652f8c78785f96; no voters: 
W20260709 12:58:24.418599  1019 leader_election.cc:343] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.419111  1264 raft_consensus.cc:2804] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.419052  1019 leader_election.cc:304] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96; no voters: 0933d7d26d6c4321ac2b184564bcfa50, cbcdb9aece834c08b02e84eff5a809a5
I20260709 12:58:24.419632  1264 raft_consensus.cc:697] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Becoming Leader. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Running, Role: LEADER
I20260709 12:58:24.418730  1247 ts_tablet_manager.cc:1403] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.025s
I20260709 12:58:24.420454  1264 consensus_queue.cc:237] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.416149  1246 raft_consensus.cc:740] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.424219  1131 raft_consensus.cc:2468] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 1.
I20260709 12:58:24.422806  1247 raft_consensus.cc:359] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.425027  1247 raft_consensus.cc:385] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.424494  1246 consensus_queue.cc:260] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } }
I20260709 12:58:24.425343  1247 raft_consensus.cc:740] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.426260  1247 consensus_queue.cc:260] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.427299  1251 raft_consensus.cc:2749] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:24.429558  1247 ts_tablet_manager.cc:1434] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:58:24.430534  1247 tablet_bootstrap.cc:492] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96: Bootstrap starting.
I20260709 12:58:24.412257   952 catalog_manager.cc:5697] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "10b71dd7aed440b7bc652f8c78785f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:24.431452   951 catalog_manager.cc:5697] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0933d7d26d6c4321ac2b184564bcfa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:24.437358  1247 tablet_bootstrap.cc:654] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.437500  1246 ts_tablet_manager.cc:1434] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.005s
I20260709 12:58:24.438050  1245 raft_consensus.cc:359] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.438663  1246 tablet_bootstrap.cc:492] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50: Bootstrap starting.
I20260709 12:58:24.439148  1245 raft_consensus.cc:385] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.439599  1245 raft_consensus.cc:740] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.440893  1245 consensus_queue.cc:260] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.447820  1246 tablet_bootstrap.cc:654] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.448557  1245 ts_tablet_manager.cc:1434] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 12:58:24.449409  1247 tablet_bootstrap.cc:492] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96: No bootstrap required, opened a new log
I20260709 12:58:24.449925  1245 tablet_bootstrap.cc:492] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5: Bootstrap starting.
I20260709 12:58:24.449921  1247 ts_tablet_manager.cc:1403] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:58:24.457324  1245 tablet_bootstrap.cc:654] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.457049  1247 raft_consensus.cc:359] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.458225  1247 raft_consensus.cc:385] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.458667  1247 raft_consensus.cc:740] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.459908  1247 consensus_queue.cc:260] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.467424  1247 ts_tablet_manager.cc:1434] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 12:58:24.476130  1247 tablet_bootstrap.cc:492] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96: Bootstrap starting.
I20260709 12:58:24.479939  1246 tablet_bootstrap.cc:492] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50: No bootstrap required, opened a new log
I20260709 12:58:24.480597  1246 ts_tablet_manager.cc:1403] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.023s
I20260709 12:58:24.483248  1247 tablet_bootstrap.cc:654] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.484352  1246 raft_consensus.cc:359] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.485363  1246 raft_consensus.cc:385] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.485788  1246 raft_consensus.cc:740] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.488499  1245 tablet_bootstrap.cc:492] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5: No bootstrap required, opened a new log
I20260709 12:58:24.488080  1246 consensus_queue.cc:260] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.489177  1245 ts_tablet_manager.cc:1403] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.019s
I20260709 12:58:24.491879  1246 ts_tablet_manager.cc:1434] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:58:24.493456  1246 tablet_bootstrap.cc:492] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50: Bootstrap starting.
I20260709 12:58:24.493194  1245 raft_consensus.cc:359] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.494032  1245 raft_consensus.cc:385] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.494369  1245 raft_consensus.cc:740] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.495294  1245 consensus_queue.cc:260] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.498657  1245 ts_tablet_manager.cc:1434] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:24.499934  1245 tablet_bootstrap.cc:492] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5: Bootstrap starting.
I20260709 12:58:24.502153  1246 tablet_bootstrap.cc:654] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.508134  1254 raft_consensus.cc:493] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.508709  1254 raft_consensus.cc:515] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.511026  1247 tablet_bootstrap.cc:492] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96: No bootstrap required, opened a new log
I20260709 12:58:24.511526  1245 tablet_bootstrap.cc:654] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.511745  1246 tablet_bootstrap.cc:492] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50: No bootstrap required, opened a new log
I20260709 12:58:24.511583  1247 ts_tablet_manager.cc:1403] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.009s
I20260709 12:58:24.512630  1246 ts_tablet_manager.cc:1403] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:58:24.514397  1254 leader_election.cc:290] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:24.522586  1246 raft_consensus.cc:359] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.523458  1246 raft_consensus.cc:385] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.524183  1246 raft_consensus.cc:740] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.525066  1246 consensus_queue.cc:260] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.522665  1247 raft_consensus.cc:359] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.527657  1247 raft_consensus.cc:385] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.528159  1246 ts_tablet_manager.cc:1434] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:58:24.528003  1247 raft_consensus.cc:740] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.529340  1247 consensus_queue.cc:260] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.531277  1245 tablet_bootstrap.cc:492] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5: No bootstrap required, opened a new log
I20260709 12:58:24.531792  1245 ts_tablet_manager.cc:1403] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.004s
I20260709 12:58:24.533440  1246 tablet_bootstrap.cc:492] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50: Bootstrap starting.
I20260709 12:58:24.535063  1247 ts_tablet_manager.cc:1434] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 12:58:24.534955  1245 raft_consensus.cc:359] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.535902  1245 raft_consensus.cc:385] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.536240  1247 tablet_bootstrap.cc:492] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96: Bootstrap starting.
I20260709 12:58:24.540632  1246 tablet_bootstrap.cc:654] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.543603  1247 tablet_bootstrap.cc:654] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.536231  1245 raft_consensus.cc:740] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.545360  1245 consensus_queue.cc:260] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.546579  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96" is_pre_election: true
I20260709 12:58:24.547232  1055 raft_consensus.cc:2468] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 0.
I20260709 12:58:24.547730  1245 ts_tablet_manager.cc:1434] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:58:24.548343  1094 leader_election.cc:304] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:24.549394  1254 raft_consensus.cc:2804] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.549872  1254 raft_consensus.cc:493] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.550431  1254 raft_consensus.cc:3060] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.555765  1246 tablet_bootstrap.cc:492] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50: No bootstrap required, opened a new log
I20260709 12:58:24.556144  1247 tablet_bootstrap.cc:492] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96: No bootstrap required, opened a new log
I20260709 12:58:24.556281  1246 ts_tablet_manager.cc:1403] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 12:58:24.556553  1247 ts_tablet_manager.cc:1403] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 12:58:24.558125  1254 raft_consensus.cc:515] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.559038  1247 raft_consensus.cc:359] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.559701  1247 raft_consensus.cc:385] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.559988  1247 raft_consensus.cc:740] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.560509  1254 leader_election.cc:290] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:24.559921  1246 raft_consensus.cc:359] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.561133  1246 raft_consensus.cc:385] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.560951  1247 consensus_queue.cc:260] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.561414  1246 raft_consensus.cc:740] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.562278  1246 consensus_queue.cc:260] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.563540  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:24.564136  1055 raft_consensus.cc:3060] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.564968  1245 tablet_bootstrap.cc:492] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5: Bootstrap starting.
I20260709 12:58:24.571502  1264 raft_consensus.cc:493] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.571738  1247 ts_tablet_manager.cc:1434] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:58:24.572052  1264 raft_consensus.cc:515] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.572643  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50" is_pre_election: true
I20260709 12:58:24.572865  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:24.572899  1275 raft_consensus.cc:493] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.574211  1264 leader_election.cc:290] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:24.572651  1247 tablet_bootstrap.cc:492] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96: Bootstrap starting.
I20260709 12:58:24.574648  1275 raft_consensus.cc:515] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.576085  1246 ts_tablet_manager.cc:1434] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:58:24.571527  1254 raft_consensus.cc:493] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.580204  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a17d2df148243d29b308a1a36bc2d7c" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96" is_pre_election: true
I20260709 12:58:24.580492  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a17d2df148243d29b308a1a36bc2d7c" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5" is_pre_election: true
I20260709 12:58:24.581037  1131 raft_consensus.cc:2468] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 0.
W20260709 12:58:24.580192  1097 leader_election.cc:343] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.582844  1168 leader_election.cc:304] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:24.581037  1056 raft_consensus.cc:2468] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 0.
I20260709 12:58:24.585008  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96" is_pre_election: true
I20260709 12:58:24.585908  1054 raft_consensus.cc:2468] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 0.
I20260709 12:58:24.588871  1264 raft_consensus.cc:2804] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.588327  1275 leader_election.cc:290] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:24.589681  1264 raft_consensus.cc:493] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.590080  1264 raft_consensus.cc:3060] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.589193  1246 tablet_bootstrap.cc:492] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50: Bootstrap starting.
I20260709 12:58:24.593056  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5" is_pre_election: true
I20260709 12:58:24.590377  1168 leader_election.cc:304] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, 10b71dd7aed440b7bc652f8c78785f96; no voters: 
I20260709 12:58:24.593724  1131 raft_consensus.cc:2468] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 0.
I20260709 12:58:24.593775  1245 tablet_bootstrap.cc:654] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.579067  1254 raft_consensus.cc:515] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.594491  1275 raft_consensus.cc:2804] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.596421  1264 raft_consensus.cc:515] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.596779  1275 raft_consensus.cc:493] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.597590  1275 raft_consensus.cc:3060] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.599469  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a17d2df148243d29b308a1a36bc2d7c" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:24.600242  1054 raft_consensus.cc:3060] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.602489  1246 tablet_bootstrap.cc:654] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:24.582816  1097 leader_election.cc:343] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.606462  1264 leader_election.cc:290] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:24.607057  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c69d482de4112aa00a3c5ffe97306" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96" is_pre_election: true
I20260709 12:58:24.607743  1254 leader_election.cc:290] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:24.607759  1056 raft_consensus.cc:2468] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 0.
I20260709 12:58:24.592696  1247 tablet_bootstrap.cc:654] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.595948  1055 raft_consensus.cc:2468] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 1.
I20260709 12:58:24.608872  1245 tablet_bootstrap.cc:492] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5: No bootstrap required, opened a new log
I20260709 12:58:24.611433  1245 ts_tablet_manager.cc:1403] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5: Time spent bootstrapping tablet: real 0.047s	user 0.007s	sys 0.011s
I20260709 12:58:24.613922  1054 raft_consensus.cc:2468] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 1.
I20260709 12:58:24.614368  1245 raft_consensus.cc:359] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.614549  1275 raft_consensus.cc:515] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.615082  1245 raft_consensus.cc:385] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.615124  1168 leader_election.cc:304] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, 10b71dd7aed440b7bc652f8c78785f96; no voters: 
I20260709 12:58:24.615470  1245 raft_consensus.cc:740] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.608783  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a17d2df148243d29b308a1a36bc2d7c" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:24.609292  1094 leader_election.cc:304] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:24.616043  1264 raft_consensus.cc:2804] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.616307  1131 raft_consensus.cc:3060] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.616524  1264 raft_consensus.cc:697] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Becoming Leader. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Running, Role: LEADER
I20260709 12:58:24.616539  1275 leader_election.cc:290] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:24.616825  1094 leader_election.cc:304] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 0933d7d26d6c4321ac2b184564bcfa50
I20260709 12:58:24.617631  1264 consensus_queue.cc:237] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.609377  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c69d482de4112aa00a3c5ffe97306" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50" is_pre_election: true
W20260709 12:58:24.619808  1097 leader_election.cc:343] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.619856  1254 raft_consensus.cc:2804] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.620858  1254 raft_consensus.cc:493] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.621245  1254 raft_consensus.cc:3060] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.621752  1247 tablet_bootstrap.cc:492] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96: No bootstrap required, opened a new log
I20260709 12:58:24.623301  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:24.623941  1130 raft_consensus.cc:3060] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.624063  1247 ts_tablet_manager.cc:1403] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.000s
I20260709 12:58:24.628252  1247 raft_consensus.cc:359] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.629076  1292 raft_consensus.cc:2804] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.629608  1247 raft_consensus.cc:385] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.630151  1247 raft_consensus.cc:740] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.631464  1247 consensus_queue.cc:260] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.634830  1131 raft_consensus.cc:2468] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 1.
I20260709 12:58:24.635584  1247 ts_tablet_manager.cc:1434] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:58:24.637008  1245 consensus_queue.cc:260] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.637562  1130 raft_consensus.cc:2468] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 1.
I20260709 12:58:24.623054  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:24.639392  1246 tablet_bootstrap.cc:492] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50: No bootstrap required, opened a new log
I20260709 12:58:24.639902  1054 raft_consensus.cc:3060] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.640100  1246 ts_tablet_manager.cc:1403] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.005s
I20260709 12:58:24.639212   952 catalog_manager.cc:5697] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0933d7d26d6c4321ac2b184564bcfa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:24.631788  1254 raft_consensus.cc:515] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.643090  1246 raft_consensus.cc:359] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.643467  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c69d482de4112aa00a3c5ffe97306" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:24.643925  1246 raft_consensus.cc:385] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.644097  1055 raft_consensus.cc:3060] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.644318  1246 raft_consensus.cc:740] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.645243  1246 consensus_queue.cc:260] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.647034  1054 raft_consensus.cc:2468] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 1.
I20260709 12:58:24.647632  1246 ts_tablet_manager.cc:1434] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:24.643049  1168 leader_election.cc:304] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:24.649505  1246 tablet_bootstrap.cc:492] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50: Bootstrap starting.
I20260709 12:58:24.650200  1264 raft_consensus.cc:2804] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.650712  1264 raft_consensus.cc:697] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Becoming Leader. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Running, Role: LEADER
I20260709 12:58:24.651588  1055 raft_consensus.cc:2468] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 1.
I20260709 12:58:24.651571  1264 consensus_queue.cc:237] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.652895  1094 leader_election.cc:304] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:24.658949  1246 tablet_bootstrap.cc:654] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.674006  1295 raft_consensus.cc:2804] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.674559  1295 raft_consensus.cc:697] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Becoming Leader. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Running, Role: LEADER
I20260709 12:58:24.675474  1295 consensus_queue.cc:237] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.677251  1254 leader_election.cc:290] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:24.677440  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c69d482de4112aa00a3c5ffe97306" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:24.684670  1204 raft_consensus.cc:3060] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.684734  1292 raft_consensus.cc:697] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Becoming Leader. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Running, Role: LEADER
I20260709 12:58:24.685745  1292 consensus_queue.cc:237] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.689294   951 catalog_manager.cc:5697] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0933d7d26d6c4321ac2b184564bcfa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:24.694345  1204 raft_consensus.cc:2468] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 1.
I20260709 12:58:24.679541  1245 ts_tablet_manager.cc:1434] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5: Time spent starting tablet: real 0.068s	user 0.013s	sys 0.019s
I20260709 12:58:24.696872  1245 tablet_bootstrap.cc:492] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5: Bootstrap starting.
I20260709 12:58:24.707558  1246 tablet_bootstrap.cc:492] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50: No bootstrap required, opened a new log
I20260709 12:58:24.711618  1245 tablet_bootstrap.cc:654] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.711642  1246 ts_tablet_manager.cc:1403] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.019s
I20260709 12:58:24.714870  1246 raft_consensus.cc:359] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.715566  1246 raft_consensus.cc:385] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.715870  1246 raft_consensus.cc:740] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.716656  1246 consensus_queue.cc:260] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.718762  1246 ts_tablet_manager.cc:1434] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:58:24.718554   951 catalog_manager.cc:5697] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "cbcdb9aece834c08b02e84eff5a809a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:24.719899  1246 tablet_bootstrap.cc:492] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50: Bootstrap starting.
I20260709 12:58:24.726351  1246 tablet_bootstrap.cc:654] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.733510  1295 raft_consensus.cc:493] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.734467  1246 tablet_bootstrap.cc:492] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50: No bootstrap required, opened a new log
I20260709 12:58:24.734036  1295 raft_consensus.cc:515] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.734915  1246 ts_tablet_manager.cc:1403] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 12:58:24.737641  1246 raft_consensus.cc:359] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.738332  1246 raft_consensus.cc:385] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.738606  1246 raft_consensus.cc:740] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.739028  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f97c45b0ef4ea38d0baa4673af6487" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50" is_pre_election: true
I20260709 12:58:24.739365  1246 consensus_queue.cc:260] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.739629  1204 raft_consensus.cc:2468] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 0.
I20260709 12:58:24.738495  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f97c45b0ef4ea38d0baa4673af6487" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96" is_pre_election: true
I20260709 12:58:24.740983  1055 raft_consensus.cc:2468] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 0.
I20260709 12:58:24.741442  1246 ts_tablet_manager.cc:1434] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:58:24.741011  1097 leader_election.cc:304] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:24.738593  1295 leader_election.cc:290] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:24.742813  1292 raft_consensus.cc:2804] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.743177  1292 raft_consensus.cc:493] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.743530  1292 raft_consensus.cc:3060] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.746050  1245 tablet_bootstrap.cc:492] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5: No bootstrap required, opened a new log
I20260709 12:58:24.746642  1245 ts_tablet_manager.cc:1403] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.008s
I20260709 12:58:24.746318   952 catalog_manager.cc:5697] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "cbcdb9aece834c08b02e84eff5a809a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:24.749836  1245 raft_consensus.cc:359] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.750895  1245 raft_consensus.cc:385] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.751228  1245 raft_consensus.cc:740] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.751685  1292 raft_consensus.cc:515] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.751963  1245 consensus_queue.cc:260] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.753762  1292 leader_election.cc:290] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:24.754002  1245 ts_tablet_manager.cc:1434] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:24.754611  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f97c45b0ef4ea38d0baa4673af6487" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:24.754913  1245 tablet_bootstrap.cc:492] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5: Bootstrap starting.
I20260709 12:58:24.755254  1055 raft_consensus.cc:3060] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.757031  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f97c45b0ef4ea38d0baa4673af6487" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:24.757627  1204 raft_consensus.cc:3060] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.761152  1245 tablet_bootstrap.cc:654] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.764694  1055 raft_consensus.cc:2468] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 1.
I20260709 12:58:24.765516  1204 raft_consensus.cc:2468] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 1.
I20260709 12:58:24.766759  1094 leader_election.cc:304] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:24.767665  1292 raft_consensus.cc:2804] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.768424  1292 raft_consensus.cc:697] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Becoming Leader. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Running, Role: LEADER
I20260709 12:58:24.769302  1245 tablet_bootstrap.cc:492] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5: No bootstrap required, opened a new log
I20260709 12:58:24.769737  1245 ts_tablet_manager.cc:1403] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.001s
I20260709 12:58:24.769323  1292 consensus_queue.cc:237] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.771910  1245 raft_consensus.cc:359] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.772432  1245 raft_consensus.cc:385] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.772680  1245 raft_consensus.cc:740] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.773200  1245 consensus_queue.cc:260] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.775151  1245 ts_tablet_manager.cc:1434] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:58:24.778731   952 catalog_manager.cc:5697] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "cbcdb9aece834c08b02e84eff5a809a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:24.797375  1295 raft_consensus.cc:493] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.797919  1295 raft_consensus.cc:515] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.799811  1295 leader_election.cc:290] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:24.800794  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc20c65d841743c5b54b309014bfd3b8" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96" is_pre_election: true
I20260709 12:58:24.801011  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc20c65d841743c5b54b309014bfd3b8" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50" is_pre_election: true
I20260709 12:58:24.801362  1055 raft_consensus.cc:2468] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 0.
I20260709 12:58:24.801592  1204 raft_consensus.cc:2468] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 0.
I20260709 12:58:24.802673  1094 leader_election.cc:304] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:24.803438  1295 raft_consensus.cc:2804] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.803794  1295 raft_consensus.cc:493] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.804081  1295 raft_consensus.cc:3060] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.809504  1295 raft_consensus.cc:515] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.811342  1295 leader_election.cc:290] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:24.812141  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc20c65d841743c5b54b309014bfd3b8" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:24.812680  1055 raft_consensus.cc:3060] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.812572  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc20c65d841743c5b54b309014bfd3b8" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:24.813304  1204 raft_consensus.cc:3060] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.818166  1055 raft_consensus.cc:2468] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 1.
I20260709 12:58:24.819205  1204 raft_consensus.cc:2468] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 1.
I20260709 12:58:24.819386  1094 leader_election.cc:304] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:24.820297  1295 raft_consensus.cc:2804] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.820901  1295 raft_consensus.cc:697] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Becoming Leader. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Running, Role: LEADER
I20260709 12:58:24.821636  1295 consensus_queue.cc:237] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.828759  1268 raft_consensus.cc:493] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.829252  1268 raft_consensus.cc:515] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.830989  1268 leader_election.cc:290] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:24.832077  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86601eeee8e3462383b5947a0c6a497e" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5" is_pre_election: true
I20260709 12:58:24.832157  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86601eeee8e3462383b5947a0c6a497e" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50" is_pre_election: true
I20260709 12:58:24.831614   952 catalog_manager.cc:5697] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "cbcdb9aece834c08b02e84eff5a809a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:24.832706  1130 raft_consensus.cc:2468] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 0.
I20260709 12:58:24.833026  1204 raft_consensus.cc:2468] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 0.
I20260709 12:58:24.833855  1019 leader_election.cc:304] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:24.834623  1268 raft_consensus.cc:2804] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.835031  1268 raft_consensus.cc:493] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.835315  1268 raft_consensus.cc:3060] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.836766  1264 raft_consensus.cc:493] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.837258  1264 raft_consensus.cc:515] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } }
I20260709 12:58:24.839933  1264 leader_election.cc:290] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677)
I20260709 12:58:24.841589  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bd400b46224eeaa2241dbca5e5ad7b" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5" is_pre_election: true
I20260709 12:58:24.842533  1130 raft_consensus.cc:2393] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0933d7d26d6c4321ac2b184564bcfa50 in current term 1: Already voted for candidate 10b71dd7aed440b7bc652f8c78785f96 in this term.
I20260709 12:58:24.841589  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bd400b46224eeaa2241dbca5e5ad7b" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96" is_pre_election: true
I20260709 12:58:24.844228  1168 leader_election.cc:304] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50; no voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5
I20260709 12:58:24.845165  1264 raft_consensus.cc:3060] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.845940  1268 raft_consensus.cc:515] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.847587  1268 leader_election.cc:290] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 election: Requested vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:24.848712  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86601eeee8e3462383b5947a0c6a497e" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:24.849109  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86601eeee8e3462383b5947a0c6a497e" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:24.849397  1130 raft_consensus.cc:3060] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.849646  1204 raft_consensus.cc:3060] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.850975  1264 raft_consensus.cc:2749] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:24.856181  1130 raft_consensus.cc:2468] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 1.
I20260709 12:58:24.856181  1204 raft_consensus.cc:2468] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 1.
I20260709 12:58:24.857713  1022 leader_election.cc:304] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, 10b71dd7aed440b7bc652f8c78785f96; no voters: 
I20260709 12:58:24.858570  1268 raft_consensus.cc:2804] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.859119  1268 raft_consensus.cc:697] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 1 LEADER]: Becoming Leader. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:24.860051  1268 consensus_queue.cc:237] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:24.868721   952 catalog_manager.cc:5697] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "10b71dd7aed440b7bc652f8c78785f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:24.910938  1264 consensus_queue.cc:1048] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:24.922777  1264 consensus_queue.cc:1048] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:24.940935  1268 consensus_queue.cc:1048] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:24.954998  1313 consensus_queue.cc:1048] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.068876  1204 raft_consensus.cc:3060] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.090406  1295 raft_consensus.cc:493] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.090901  1295 raft_consensus.cc:515] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.093091  1295 leader_election.cc:290] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:25.094442  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167ef4ee1f2433d9436f6419d22ef0a" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50" is_pre_election: true
I20260709 12:58:25.094209  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167ef4ee1f2433d9436f6419d22ef0a" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96" is_pre_election: true
I20260709 12:58:25.095192  1205 raft_consensus.cc:2468] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 0.
I20260709 12:58:25.095320  1055 raft_consensus.cc:2468] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 0.
I20260709 12:58:25.096728  1097 leader_election.cc:304] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:25.097671  1295 raft_consensus.cc:2804] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.098073  1295 raft_consensus.cc:493] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.098374  1295 raft_consensus.cc:3060] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.103652  1275 consensus_queue.cc:1048] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.115754  1316 consensus_queue.cc:1048] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:25.119676  1295 raft_consensus.cc:515] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.121891  1295 leader_election.cc:290] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:25.122852  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167ef4ee1f2433d9436f6419d22ef0a" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:25.123481  1054 raft_consensus.cc:3060] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.124951  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167ef4ee1f2433d9436f6419d22ef0a" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:25.125046  1264 raft_consensus.cc:493] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.125571  1204 raft_consensus.cc:3060] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.126190  1264 raft_consensus.cc:515] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.132784  1295 consensus_queue.cc:1048] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.133831  1264 leader_election.cc:290] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:25.133870  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96" is_pre_election: true
I20260709 12:58:25.134688  1056 raft_consensus.cc:2468] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 1.
I20260709 12:58:25.135138  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5" is_pre_election: true
I20260709 12:58:25.138638  1168 leader_election.cc:304] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, 10b71dd7aed440b7bc652f8c78785f96; no voters: 
I20260709 12:58:25.146322  1295 consensus_queue.cc:1048] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.146838  1264 raft_consensus.cc:2804] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:25.149091  1264 raft_consensus.cc:493] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbcdb9aece834c08b02e84eff5a809a5)
I20260709 12:58:25.149611  1264 raft_consensus.cc:3060] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.156078  1294 consensus_queue.cc:1048] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.161844  1249 consensus_queue.cc:1048] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:25.176116  1295 consensus_queue.cc:1048] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.176316  1316 consensus_queue.cc:1048] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:25.192291  1295 consensus_queue.cc:1048] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:25.217916  1294 consensus_queue.cc:1048] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.219347  1054 raft_consensus.cc:2468] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 1.
I20260709 12:58:25.221796  1094 leader_election.cc:304] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:25.222699  1294 raft_consensus.cc:2804] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.223393  1294 raft_consensus.cc:697] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Becoming Leader. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Running, Role: LEADER
I20260709 12:58:25.223459  1204 raft_consensus.cc:2468] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 1.
I20260709 12:58:25.224283  1294 consensus_queue.cc:237] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.239078   953 catalog_manager.cc:5697] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "cbcdb9aece834c08b02e84eff5a809a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.258340  1313 consensus_queue.cc:1048] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.271010  1329 consensus_queue.cc:1048] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.310210  1254 consensus_queue.cc:1048] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.314093  1264 raft_consensus.cc:515] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.316848  1264 leader_election.cc:290] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 2 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:25.319335  1254 consensus_queue.cc:1048] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:25.319487  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:25.322000  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:25.322002  1203 raft_consensus.cc:1240] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Rejecting Update request from peer cbcdb9aece834c08b02e84eff5a809a5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:25.325619  1168 leader_election.cc:304] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50; no voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5
I20260709 12:58:25.326910  1264 raft_consensus.cc:2749] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:25.328121  1254 consensus_queue.cc:1059] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:25.329424  1254 raft_consensus.cc:3055] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:25.329767  1254 raft_consensus.cc:740] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Running, Role: LEADER
I20260709 12:58:25.330735  1254 consensus_queue.cc:260] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.333280  1254 raft_consensus.cc:3060] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.520957  1204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a17d2df148243d29b308a1a36bc2d7c"
dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
mode: GRACEFUL
new_leader_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:42090
I20260709 12:58:25.521486  1204 raft_consensus.cc:606] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Received request to transfer leadership to TS 10b71dd7aed440b7bc652f8c78785f96
I20260709 12:58:25.537268  1130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "573c69d482de4112aa00a3c5ffe97306"
dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
mode: GRACEFUL
new_leader_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:47520
I20260709 12:58:25.537802  1130 raft_consensus.cc:606] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Received request to transfer leadership to TS 10b71dd7aed440b7bc652f8c78785f96
I20260709 12:58:25.544086  1204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca"
dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
mode: GRACEFUL
new_leader_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:42090
I20260709 12:58:25.544657  1204 raft_consensus.cc:606] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Received request to transfer leadership to TS 10b71dd7aed440b7bc652f8c78785f96
I20260709 12:58:25.550848  1130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc"
dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
mode: GRACEFUL
new_leader_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:47520
I20260709 12:58:25.551369  1130 raft_consensus.cc:606] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Received request to transfer leadership to TS 10b71dd7aed440b7bc652f8c78785f96
I20260709 12:58:25.551658  1130 raft_consensus.cc:614] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:25.561326  1204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d"
dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
mode: GRACEFUL
new_leader_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
 from {username='slave'} at 127.0.0.1:42090
I20260709 12:58:25.561898  1204 raft_consensus.cc:606] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Received request to transfer leadership to TS cbcdb9aece834c08b02e84eff5a809a5
I20260709 12:58:25.584972  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86601eeee8e3462383b5947a0c6a497e"
dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
mode: GRACEFUL
new_leader_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
 from {username='slave'} at 127.0.0.1:52710
I20260709 12:58:25.585614  1053 raft_consensus.cc:606] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 1 LEADER]: Received request to transfer leadership to TS 0933d7d26d6c4321ac2b184564bcfa50
I20260709 12:58:25.654906  1329 raft_consensus.cc:993] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96: : Instructing follower 0933d7d26d6c4321ac2b184564bcfa50 to start an election
I20260709 12:58:25.655344  1268 raft_consensus.cc:1081] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 1 LEADER]: Signalling peer 0933d7d26d6c4321ac2b184564bcfa50 to start an election
I20260709 12:58:25.657016  1204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86601eeee8e3462383b5947a0c6a497e"
dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
 from {username='slave'} at 127.0.0.1:42068
I20260709 12:58:25.657485  1204 raft_consensus.cc:493] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:25.657737  1204 raft_consensus.cc:3060] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.692790  1204 raft_consensus.cc:515] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.694890  1204 leader_election.cc:290] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 2 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:25.697412  1316 raft_consensus.cc:993] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50: : Instructing follower 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:25.697432  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86601eeee8e3462383b5947a0c6a497e" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:25.697916  1316 raft_consensus.cc:1081] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Signalling peer 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:25.698163  1130 raft_consensus.cc:3060] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.698210  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86601eeee8e3462383b5947a0c6a497e" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:25.700248  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca"
dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:58:25.698956  1053 raft_consensus.cc:3055] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:25.700848  1054 raft_consensus.cc:493] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:25.701244  1053 raft_consensus.cc:740] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:25.701328  1054 raft_consensus.cc:3060] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.702270  1053 consensus_queue.cc:260] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.703562  1053 raft_consensus.cc:3060] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.743209  1292 raft_consensus.cc:993] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5: : Instructing follower 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:25.743822  1294 raft_consensus.cc:1081] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Signalling peer 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:25.745527  1056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "573c69d482de4112aa00a3c5ffe97306"
dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:52698
I20260709 12:58:25.746068  1056 raft_consensus.cc:493] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:25.746373  1056 raft_consensus.cc:3060] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.796262  1053 raft_consensus.cc:2468] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 2.
I20260709 12:58:25.796249  1130 raft_consensus.cc:2468] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 2.
I20260709 12:58:25.798477  1054 raft_consensus.cc:515] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.798985  1168 leader_election.cc:304] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, 10b71dd7aed440b7bc652f8c78785f96; no voters: 
I20260709 12:58:25.801558  1264 raft_consensus.cc:2804] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:25.802093  1264 raft_consensus.cc:697] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 LEADER]: Becoming Leader. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Running, Role: LEADER
I20260709 12:58:25.802906  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:25.802974  1264 consensus_queue.cc:237] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.803637  1203 raft_consensus.cc:3055] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:25.804082  1203 raft_consensus.cc:740] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Running, Role: LEADER
I20260709 12:58:25.804311  1294 consensus_queue.cc:1048] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:25.804900  1203 consensus_queue.cc:260] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.805332  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:25.805863  1130 raft_consensus.cc:3060] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.806037  1203 raft_consensus.cc:3060] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.814816  1054 leader_election.cc:290] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 2 election: Requested vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:25.816710   954 catalog_manager.cc:5697] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 reported cstate change: term changed from 1 to 2, leader changed from 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193) to 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0933d7d26d6c4321ac2b184564bcfa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:25.818517  1294 consensus_queue.cc:1048] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.840049  1264 raft_consensus.cc:993] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50: : Instructing follower cbcdb9aece834c08b02e84eff5a809a5 to start an election
I20260709 12:58:25.840673  1316 raft_consensus.cc:1081] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Signalling peer cbcdb9aece834c08b02e84eff5a809a5 to start an election
I20260709 12:58:25.842450  1131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d"
dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
 from {username='slave'} at 127.0.0.1:47514
I20260709 12:58:25.842922  1131 raft_consensus.cc:493] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:25.843196  1131 raft_consensus.cc:3060] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.889931  1203 raft_consensus.cc:2468] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 2.
I20260709 12:58:25.890259  1130 raft_consensus.cc:2468] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 2.
I20260709 12:58:25.889997  1056 raft_consensus.cc:515] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.891762  1022 leader_election.cc:304] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, 10b71dd7aed440b7bc652f8c78785f96; no voters: 
I20260709 12:58:25.892705  1268 raft_consensus.cc:2804] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:25.892791  1056 leader_election.cc:290] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 2 election: Requested vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:25.893263  1268 raft_consensus.cc:697] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Becoming Leader. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:25.894094  1268 consensus_queue.cc:237] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.895722  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c69d482de4112aa00a3c5ffe97306" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:25.896380  1130 raft_consensus.cc:3055] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:25.896770  1130 raft_consensus.cc:740] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Running, Role: LEADER
I20260709 12:58:25.897107  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c69d482de4112aa00a3c5ffe97306" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:25.897730  1203 raft_consensus.cc:3060] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.897922  1130 consensus_queue.cc:260] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.899385  1130 raft_consensus.cc:3060] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.907536   952 catalog_manager.cc:5697] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 reported cstate change: term changed from 1 to 2, leader changed from 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195) to 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "10b71dd7aed440b7bc652f8c78785f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.991657  1203 raft_consensus.cc:2468] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 2.
I20260709 12:58:25.993597  1022 leader_election.cc:304] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, 10b71dd7aed440b7bc652f8c78785f96; no voters: 
I20260709 12:58:25.994568  1268 raft_consensus.cc:2804] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:25.994395  1131 raft_consensus.cc:515] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.995080  1268 raft_consensus.cc:697] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Becoming Leader. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:25.996800  1131 leader_election.cc:290] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 2 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:25.997563  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:25.997943  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:25.998191  1056 raft_consensus.cc:3060] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.999228  1203 raft_consensus.cc:3055] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:25.998119  1268 consensus_queue.cc:237] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:25.999648  1203 raft_consensus.cc:740] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Running, Role: LEADER
I20260709 12:58:26.000626  1203 consensus_queue.cc:260] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:26.001896  1203 raft_consensus.cc:3060] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.006912   952 catalog_manager.cc:5697] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 reported cstate change: term changed from 1 to 2, leader changed from cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194) to 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "10b71dd7aed440b7bc652f8c78785f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.063561  1264 raft_consensus.cc:993] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50: : Instructing follower 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:26.064028  1264 raft_consensus.cc:1081] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Signalling peer 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:26.065660  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a17d2df148243d29b308a1a36bc2d7c"
dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:58:26.066118  1053 raft_consensus.cc:493] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.066391  1053 raft_consensus.cc:3060] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.092562  1130 raft_consensus.cc:2468] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 2.
I20260709 12:58:26.092550  1056 raft_consensus.cc:2468] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 2.
I20260709 12:58:26.092550  1203 raft_consensus.cc:2468] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 2.
I20260709 12:58:26.094775  1094 leader_election.cc:304] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:26.095968  1294 raft_consensus.cc:2804] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.096475  1294 raft_consensus.cc:697] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 2 LEADER]: Becoming Leader. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Running, Role: LEADER
I20260709 12:58:26.097339  1294 consensus_queue.cc:237] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:26.100425  1053 raft_consensus.cc:515] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:26.102615  1053 leader_election.cc:290] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 2 election: Requested vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:26.103719  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a17d2df148243d29b308a1a36bc2d7c" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:26.103780  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a17d2df148243d29b308a1a36bc2d7c" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:26.104475  1130 raft_consensus.cc:3060] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.104661  1203 raft_consensus.cc:3055] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.105187  1203 raft_consensus.cc:740] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Running, Role: LEADER
I20260709 12:58:26.106047  1203 consensus_queue.cc:260] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:26.107623  1203 raft_consensus.cc:3060] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.106581   952 catalog_manager.cc:5697] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 reported cstate change: term changed from 1 to 2, leader changed from 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195) to cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "cbcdb9aece834c08b02e84eff5a809a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.112815  1130 raft_consensus.cc:2468] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 2.
I20260709 12:58:26.114416  1019 leader_election.cc:304] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:26.114692  1203 raft_consensus.cc:2468] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 2.
I20260709 12:58:26.115334  1268 raft_consensus.cc:2804] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.116020  1268 raft_consensus.cc:697] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Becoming Leader. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:26.116991  1268 consensus_queue.cc:237] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:26.123371   952 catalog_manager.cc:5697] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 reported cstate change: term changed from 1 to 2, leader changed from 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195) to 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "10b71dd7aed440b7bc652f8c78785f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.257093  1130 raft_consensus.cc:1275] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Refusing update from remote peer 0933d7d26d6c4321ac2b184564bcfa50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.258515  1264 consensus_queue.cc:1048] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.266711  1053 raft_consensus.cc:1275] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Refusing update from remote peer 0933d7d26d6c4321ac2b184564bcfa50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.269300  1343 consensus_queue.cc:1048] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.305884  1203 raft_consensus.cc:1275] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.307711  1268 consensus_queue.cc:1048] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.318770  1130 raft_consensus.cc:1275] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.320359  1329 consensus_queue.cc:1048] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.399927  1130 raft_consensus.cc:1275] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.401319  1346 consensus_queue.cc:1048] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.409761  1203 raft_consensus.cc:1275] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.411582  1268 consensus_queue.cc:1048] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.501466  1203 raft_consensus.cc:1275] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.502841  1268 consensus_queue.cc:1048] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.512387  1130 raft_consensus.cc:1275] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.514271  1329 consensus_queue.cc:1048] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:26.615535  1053 raft_consensus.cc:1275] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Refusing update from remote peer cbcdb9aece834c08b02e84eff5a809a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.617393  1348 consensus_queue.cc:1048] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.626659  1203 raft_consensus.cc:1275] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Refusing update from remote peer cbcdb9aece834c08b02e84eff5a809a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:26.628966  1294 consensus_queue.cc:1048] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:26.661079  1329 raft_consensus.cc:493] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbcdb9aece834c08b02e84eff5a809a5)
I20260709 12:58:26.661656  1329 raft_consensus.cc:515] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:26.663376  1329 leader_election.cc:290] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:26.664422  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5" is_pre_election: true
I20260709 12:58:26.664479  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50" is_pre_election: true
I20260709 12:58:26.665298  1130 raft_consensus.cc:2468] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 2.
I20260709 12:58:26.665484  1203 raft_consensus.cc:2393] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10b71dd7aed440b7bc652f8c78785f96 in current term 2: Already voted for candidate 0933d7d26d6c4321ac2b184564bcfa50 in this term.
I20260709 12:58:26.666792  1019 leader_election.cc:304] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:26.667670  1329 raft_consensus.cc:2804] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:26.668033  1329 raft_consensus.cc:493] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbcdb9aece834c08b02e84eff5a809a5)
I20260709 12:58:26.668797  1329 raft_consensus.cc:3060] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.675266  1329 raft_consensus.cc:515] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:26.677074  1329 leader_election.cc:290] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 2 election: Requested vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:26.678205  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:26.678305  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:26.679217  1203 raft_consensus.cc:2393] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10b71dd7aed440b7bc652f8c78785f96 in current term 2: Already voted for candidate 0933d7d26d6c4321ac2b184564bcfa50 in this term.
I20260709 12:58:26.684645  1130 raft_consensus.cc:2468] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 2.
I20260709 12:58:26.686028  1019 leader_election.cc:304] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 0933d7d26d6c4321ac2b184564bcfa50
I20260709 12:58:26.686762  1329 raft_consensus.cc:2804] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.687446  1329 raft_consensus.cc:697] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Becoming Leader. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:26.688201  1329 consensus_queue.cc:237] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:26.696138   954 catalog_manager.cc:5697] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 reported cstate change: term changed from 1 to 2, leader changed from cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194) to 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "10b71dd7aed440b7bc652f8c78785f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.932449  1343 raft_consensus.cc:493] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.932978  1343 raft_consensus.cc:515] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:26.934724  1343 leader_election.cc:290] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:26.935531  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96" is_pre_election: true
I20260709 12:58:26.935837  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5" is_pre_election: true
I20260709 12:58:26.936937  1130 raft_consensus.cc:2468] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 2.
I20260709 12:58:26.937870  1168 leader_election.cc:304] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, cbcdb9aece834c08b02e84eff5a809a5; no voters: 10b71dd7aed440b7bc652f8c78785f96
I20260709 12:58:26.938617  1343 raft_consensus.cc:2804] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:26.938953  1343 raft_consensus.cc:493] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.939262  1343 raft_consensus.cc:3060] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:26.944118  1343 raft_consensus.cc:515] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:26.945804  1343 leader_election.cc:290] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 3 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:26.946997  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:26.947103  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:26.947724  1130 raft_consensus.cc:3060] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:26.952637  1130 raft_consensus.cc:2468] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 3.
I20260709 12:58:26.953966  1168 leader_election.cc:304] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, cbcdb9aece834c08b02e84eff5a809a5; no voters: 10b71dd7aed440b7bc652f8c78785f96
I20260709 12:58:26.954733  1343 raft_consensus.cc:2804] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:26.955368  1343 raft_consensus.cc:697] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 LEADER]: Becoming Leader. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Running, Role: LEADER
I20260709 12:58:26.956213  1343 consensus_queue.cc:237] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:26.964191   954 catalog_manager.cc:5697] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 reported cstate change: term changed from 2 to 3, leader changed from 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193) to 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0933d7d26d6c4321ac2b184564bcfa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:27.142059  1130 raft_consensus.cc:1240] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Rejecting Update request from peer 10b71dd7aed440b7bc652f8c78785f96 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:27.143373  1329 consensus_queue.cc:1059] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:27.144150  1329 raft_consensus.cc:3055] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:27.144378  1329 raft_consensus.cc:740] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:27.145099  1329 consensus_queue.cc:260] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:27.145964  1329 raft_consensus.cc:3060] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:27.416111  1053 raft_consensus.cc:1275] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Refusing update from remote peer 0933d7d26d6c4321ac2b184564bcfa50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:27.416440  1053 pending_rounds.cc:85] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96: Aborting all ops after (but not including) 1
I20260709 12:58:27.416813  1053 pending_rounds.cc:107] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:27.417069  1053 raft_consensus.cc:2889] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:27.418633  1343 consensus_queue.cc:1048] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:27.428882  1130 raft_consensus.cc:1275] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Refusing update from remote peer 0933d7d26d6c4321ac2b184564bcfa50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:27.430748  1343 consensus_queue.cc:1048] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:28.624488   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:58:28.625458   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:28.648952  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca"
dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
mode: GRACEFUL
new_leader_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
 from {username='slave'} at 127.0.0.1:34484
I20260709 12:58:28.649529  1053 raft_consensus.cc:606] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Received request to transfer leadership to TS 0933d7d26d6c4321ac2b184564bcfa50
I20260709 12:58:28.650691   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:58:28.651142   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:29.058655  1329 raft_consensus.cc:993] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96: : Instructing follower 0933d7d26d6c4321ac2b184564bcfa50 to start an election
I20260709 12:58:29.059142  1369 raft_consensus.cc:1081] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Signalling peer 0933d7d26d6c4321ac2b184564bcfa50 to start an election
I20260709 12:58:29.060650  1203 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca"
dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
 from {username='slave'} at 127.0.0.1:42068
I20260709 12:58:29.061088  1203 raft_consensus.cc:493] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:29.061374  1203 raft_consensus.cc:3060] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:29.066782  1203 raft_consensus.cc:515] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:29.068382  1203 leader_election.cc:290] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 3 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:29.069298  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:29.069638  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:29.070032  1053 raft_consensus.cc:3055] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:29.070168  1130 raft_consensus.cc:3060] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:29.070410  1053 raft_consensus.cc:740] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:29.071185  1053 consensus_queue.cc:260] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:29.072438  1053 raft_consensus.cc:3060] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:29.076965  1130 raft_consensus.cc:2468] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 3.
I20260709 12:58:29.078876  1168 leader_election.cc:304] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:29.079700  1343 raft_consensus.cc:2804] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:29.080332  1053 raft_consensus.cc:2468] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 3.
I20260709 12:58:29.080755  1343 raft_consensus.cc:697] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 LEADER]: Becoming Leader. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Running, Role: LEADER
I20260709 12:58:29.081626  1343 consensus_queue.cc:237] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:29.088876   952 catalog_manager.cc:5697] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 reported cstate change: term changed from 2 to 3, leader changed from 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193) to 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0933d7d26d6c4321ac2b184564bcfa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:29.570417  1130 raft_consensus.cc:1275] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Refusing update from remote peer 0933d7d26d6c4321ac2b184564bcfa50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:29.571978  1343 consensus_queue.cc:1048] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:29.584421  1053 raft_consensus.cc:1275] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Refusing update from remote peer 0933d7d26d6c4321ac2b184564bcfa50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:29.587795  1378 consensus_queue.cc:1048] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:29.652000   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:29.671695  1205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca"
dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
mode: GRACEFUL
new_leader_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:42090
I20260709 12:58:29.672293  1205 raft_consensus.cc:606] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 LEADER]: Received request to transfer leadership to TS 10b71dd7aed440b7bc652f8c78785f96
I20260709 12:58:29.677744  1205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc"
dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
mode: GRACEFUL
new_leader_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:42090
I20260709 12:58:29.678407  1205 raft_consensus.cc:606] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 LEADER]: Received request to transfer leadership to TS 10b71dd7aed440b7bc652f8c78785f96
I20260709 12:58:29.684322  1130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2167ef4ee1f2433d9436f6419d22ef0a"
dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
mode: GRACEFUL
new_leader_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:47520
I20260709 12:58:29.684962  1130 raft_consensus.cc:606] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Received request to transfer leadership to TS 10b71dd7aed440b7bc652f8c78785f96
I20260709 12:58:29.689893  1130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d"
dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
mode: GRACEFUL
new_leader_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:47520
I20260709 12:58:29.690449  1130 raft_consensus.cc:606] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 2 LEADER]: Received request to transfer leadership to TS 10b71dd7aed440b7bc652f8c78785f96
I20260709 12:58:29.695348  1130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc20c65d841743c5b54b309014bfd3b8"
dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
mode: GRACEFUL
new_leader_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:47520
I20260709 12:58:29.695971  1130 raft_consensus.cc:606] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Received request to transfer leadership to TS 10b71dd7aed440b7bc652f8c78785f96
I20260709 12:58:29.948300  1343 raft_consensus.cc:993] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50: : Instructing follower 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:29.949121  1343 raft_consensus.cc:1081] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 LEADER]: Signalling peer 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:29.951224  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc"
dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:58:29.952366  1053 raft_consensus.cc:493] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:29.953020  1053 raft_consensus.cc:3060] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:29.960208  1053 raft_consensus.cc:515] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:29.962208  1053 leader_election.cc:290] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 4 election: Requested vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:29.963462  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:29.964372  1130 raft_consensus.cc:3060] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:29.964268  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df55d1c7d075497499bd9e7dc25368dc" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:29.965067  1205 raft_consensus.cc:3055] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:29.965334  1205 raft_consensus.cc:740] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Running, Role: LEADER
I20260709 12:58:29.966187  1205 consensus_queue.cc:260] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:29.967931  1205 raft_consensus.cc:3060] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:29.970811  1130 raft_consensus.cc:2468] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 4.
I20260709 12:58:29.972779  1019 leader_election.cc:304] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:29.974082  1369 raft_consensus.cc:2804] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:29.975334  1205 raft_consensus.cc:2468] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 4.
I20260709 12:58:29.975333  1369 raft_consensus.cc:697] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 4 LEADER]: Becoming Leader. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:29.977298  1369 consensus_queue.cc:237] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:29.987138   954 catalog_manager.cc:5697] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 reported cstate change: term changed from 3 to 4, leader changed from 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195) to 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "10b71dd7aed440b7bc652f8c78785f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.001200  1294 raft_consensus.cc:993] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5: : Instructing follower 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:30.001849  1388 raft_consensus.cc:1081] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 2 LEADER]: Signalling peer 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:30.003746  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d"
dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:52698
I20260709 12:58:30.004305  1053 raft_consensus.cc:493] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:30.004681  1053 raft_consensus.cc:3060] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.009961  1053 raft_consensus.cc:515] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:30.011778  1053 leader_election.cc:290] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 3 election: Requested vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:30.012670  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:30.013042  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:30.013238  1130 raft_consensus.cc:3055] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:30.013564  1205 raft_consensus.cc:3060] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.013631  1130 raft_consensus.cc:740] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Running, Role: LEADER
I20260709 12:58:30.014478  1130 consensus_queue.cc:260] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:30.015514  1130 raft_consensus.cc:3060] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.020828  1205 raft_consensus.cc:2468] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 3.
I20260709 12:58:30.021888  1130 raft_consensus.cc:2468] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 3.
I20260709 12:58:30.022632  1022 leader_election.cc:304] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, 10b71dd7aed440b7bc652f8c78785f96; no voters: 
I20260709 12:58:30.024183  1369 raft_consensus.cc:2804] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:30.024675  1369 raft_consensus.cc:697] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 3 LEADER]: Becoming Leader. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:30.025694  1369 consensus_queue.cc:237] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:30.027287  1388 raft_consensus.cc:993] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5: : Instructing follower 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:30.027776  1294 raft_consensus.cc:1081] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Signalling peer 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:30.029811  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc20c65d841743c5b54b309014bfd3b8"
dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:52698
I20260709 12:58:30.030570  1053 raft_consensus.cc:493] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:30.030999  1053 raft_consensus.cc:3060] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:30.034574   954 catalog_manager.cc:5697] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 reported cstate change: term changed from 2 to 3, leader changed from cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194) to 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "10b71dd7aed440b7bc652f8c78785f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.036422  1053 raft_consensus.cc:515] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:30.039400  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc20c65d841743c5b54b309014bfd3b8" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:30.039569  1053 leader_election.cc:290] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 2 election: Requested vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:30.039992  1130 raft_consensus.cc:3055] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:30.040316  1130 raft_consensus.cc:740] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Running, Role: LEADER
I20260709 12:58:30.040684  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc20c65d841743c5b54b309014bfd3b8" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:30.041718  1205 raft_consensus.cc:3060] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:30.042237  1130 consensus_queue.cc:260] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:30.043757  1130 raft_consensus.cc:3060] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:30.048243  1205 raft_consensus.cc:2468] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 2.
I20260709 12:58:30.049360  1022 leader_election.cc:304] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, 10b71dd7aed440b7bc652f8c78785f96; no voters: 
I20260709 12:58:30.049957  1130 raft_consensus.cc:2468] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 2.
I20260709 12:58:30.050204  1369 raft_consensus.cc:2804] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:30.050714  1369 raft_consensus.cc:697] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Becoming Leader. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:30.051559  1369 consensus_queue.cc:237] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:30.057983   954 catalog_manager.cc:5697] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 reported cstate change: term changed from 1 to 2, leader changed from cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194) to 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "10b71dd7aed440b7bc652f8c78785f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.064639  1370 raft_consensus.cc:993] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50: : Instructing follower 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:30.065191  1343 raft_consensus.cc:1081] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 LEADER]: Signalling peer 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:30.067098  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca"
dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:58:30.067651  1053 raft_consensus.cc:493] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:30.068008  1053 raft_consensus.cc:3060] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:30.072849  1053 raft_consensus.cc:515] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:30.074608  1053 leader_election.cc:290] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 4 election: Requested vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:30.075641  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:30.075836  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a1f8068f3f498c838e1185775a0dca" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:30.076236  1130 raft_consensus.cc:3060] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:30.076318  1205 raft_consensus.cc:3055] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:30.076674  1205 raft_consensus.cc:740] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Running, Role: LEADER
I20260709 12:58:30.077494  1205 consensus_queue.cc:260] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:30.078794  1205 raft_consensus.cc:3060] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:30.083669  1130 raft_consensus.cc:2468] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 4.
I20260709 12:58:30.085218  1019 leader_election.cc:304] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:30.086272  1369 raft_consensus.cc:2804] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:30.086553  1205 raft_consensus.cc:2468] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 4.
I20260709 12:58:30.086788  1369 raft_consensus.cc:697] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 4 LEADER]: Becoming Leader. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:30.087733  1369 consensus_queue.cc:237] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:30.094508   952 catalog_manager.cc:5697] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 reported cstate change: term changed from 3 to 4, leader changed from 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195) to 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "10b71dd7aed440b7bc652f8c78785f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.270843  1388 raft_consensus.cc:993] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5: : Instructing follower 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:30.271389  1294 raft_consensus.cc:1081] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Signalling peer 10b71dd7aed440b7bc652f8c78785f96 to start an election
I20260709 12:58:30.273078  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2167ef4ee1f2433d9436f6419d22ef0a"
dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
 from {username='slave'} at 127.0.0.1:52698
I20260709 12:58:30.273571  1053 raft_consensus.cc:493] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:30.273859  1053 raft_consensus.cc:3060] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:30.278414  1053 raft_consensus.cc:515] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:30.280099  1053 leader_election.cc:290] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 2 election: Requested vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:30.280921  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167ef4ee1f2433d9436f6419d22ef0a" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:30.281219  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2167ef4ee1f2433d9436f6419d22ef0a" candidate_uuid: "10b71dd7aed440b7bc652f8c78785f96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:30.281455  1130 raft_consensus.cc:3055] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:30.281730  1205 raft_consensus.cc:3060] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:30.281934  1130 raft_consensus.cc:740] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Running, Role: LEADER
I20260709 12:58:30.282692  1130 consensus_queue.cc:260] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:30.283680  1130 raft_consensus.cc:3060] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:30.288239  1205 raft_consensus.cc:2468] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 2.
I20260709 12:58:30.289510  1022 leader_election.cc:304] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, 10b71dd7aed440b7bc652f8c78785f96; no voters: 
I20260709 12:58:30.289587  1130 raft_consensus.cc:2468] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10b71dd7aed440b7bc652f8c78785f96 in term 2.
I20260709 12:58:30.290607  1369 raft_consensus.cc:2804] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:30.291199  1369 raft_consensus.cc:697] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Becoming Leader. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:30.292033  1369 consensus_queue.cc:237] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:30.299446   952 catalog_manager.cc:5697] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 reported cstate change: term changed from 1 to 2, leader changed from cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194) to 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "10b71dd7aed440b7bc652f8c78785f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.478262  1205 raft_consensus.cc:1275] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 4 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:30.479943  1369 consensus_queue.cc:1048] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:30.491243  1130 raft_consensus.cc:1275] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 4 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:30.492852  1369 consensus_queue.cc:1048] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:30.513381  1205 raft_consensus.cc:1275] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 4 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:30.514819  1369 consensus_queue.cc:1048] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.524255  1130 raft_consensus.cc:1275] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 4 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:30.526620  1396 consensus_queue.cc:1048] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.572948  1205 raft_consensus.cc:1275] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:30.575284  1396 consensus_queue.cc:1048] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.582690  1130 raft_consensus.cc:1275] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:30.584184  1369 consensus_queue.cc:1048] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:30.591315  1130 raft_consensus.cc:1275] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:30.593071  1383 consensus_queue.cc:1048] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.599969  1205 raft_consensus.cc:1275] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:30.602910  1399 consensus_queue.cc:1048] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:30.872750  1205 raft_consensus.cc:1275] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:30.874246  1383 consensus_queue.cc:1048] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:30.882367  1131 raft_consensus.cc:1275] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Refusing update from remote peer 10b71dd7aed440b7bc652f8c78785f96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:30.883805  1396 consensus_queue.cc:1048] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.703694   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:32.711792  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a17d2df148243d29b308a1a36bc2d7c"
dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
mode: GRACEFUL
new_leader_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
 from {username='slave'} at 127.0.0.1:34484
I20260709 12:58:32.712423  1053 raft_consensus.cc:606] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Received request to transfer leadership to TS 0933d7d26d6c4321ac2b184564bcfa50
I20260709 12:58:32.715607  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d"
dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
mode: GRACEFUL
new_leader_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
 from {username='slave'} at 127.0.0.1:34484
I20260709 12:58:32.716229  1053 raft_consensus.cc:606] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 3 LEADER]: Received request to transfer leadership to TS cbcdb9aece834c08b02e84eff5a809a5
I20260709 12:58:32.718786  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc20c65d841743c5b54b309014bfd3b8"
dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
mode: GRACEFUL
new_leader_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
 from {username='slave'} at 127.0.0.1:34484
I20260709 12:58:32.719306  1053 raft_consensus.cc:606] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Received request to transfer leadership to TS cbcdb9aece834c08b02e84eff5a809a5
I20260709 12:58:32.721736  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0bd400b46224eeaa2241dbca5e5ad7b"
dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
mode: GRACEFUL
new_leader_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
 from {username='slave'} at 127.0.0.1:34484
I20260709 12:58:32.722291  1053 raft_consensus.cc:606] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 1 LEADER]: Received request to transfer leadership to TS 0933d7d26d6c4321ac2b184564bcfa50
I20260709 12:58:32.723400   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:58:32.723878   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:32.728022  1399 raft_consensus.cc:993] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96: : Instructing follower cbcdb9aece834c08b02e84eff5a809a5 to start an election
I20260709 12:58:32.728619  1399 raft_consensus.cc:1081] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 3 LEADER]: Signalling peer cbcdb9aece834c08b02e84eff5a809a5 to start an election
I20260709 12:58:32.730585  1131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d"
dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:58:32.731086  1131 raft_consensus.cc:493] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:32.731449  1131 raft_consensus.cc:3060] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:32.814483  1131 raft_consensus.cc:515] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:32.817039  1131 leader_election.cc:290] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 4 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:32.818009  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:32.818364  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb238f427b94a3482d539531cba2a2d" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:32.818601  1053 raft_consensus.cc:3055] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:32.818919  1053 raft_consensus.cc:740] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:32.818956  1203 raft_consensus.cc:3060] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:32.819705  1053 consensus_queue.cc:260] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:32.820667  1053 raft_consensus.cc:3060] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:32.847158  1405 raft_consensus.cc:993] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96: : Instructing follower 0933d7d26d6c4321ac2b184564bcfa50 to start an election
I20260709 12:58:32.847615  1405 raft_consensus.cc:1081] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Signalling peer 0933d7d26d6c4321ac2b184564bcfa50 to start an election
I20260709 12:58:32.849258  1205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a17d2df148243d29b308a1a36bc2d7c"
dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
 from {username='slave'} at 127.0.0.1:42068
I20260709 12:58:32.849660  1205 raft_consensus.cc:493] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:32.849881  1205 raft_consensus.cc:3060] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:32.868181  1399 raft_consensus.cc:993] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96: : Instructing follower 0933d7d26d6c4321ac2b184564bcfa50 to start an election
I20260709 12:58:32.868832  1405 raft_consensus.cc:1081] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 1 LEADER]: Signalling peer 0933d7d26d6c4321ac2b184564bcfa50 to start an election
I20260709 12:58:32.870522  1204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0bd400b46224eeaa2241dbca5e5ad7b"
dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
 from {username='slave'} at 127.0.0.1:42068
I20260709 12:58:32.871187  1204 raft_consensus.cc:493] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:32.871726  1204 raft_consensus.cc:3060] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:32.916553  1053 raft_consensus.cc:2468] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 4.
I20260709 12:58:32.916646  1203 raft_consensus.cc:2468] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 4.
I20260709 12:58:32.918618  1094 leader_election.cc:304] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10b71dd7aed440b7bc652f8c78785f96, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:32.919620  1294 raft_consensus.cc:2804] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:32.925983  1294 raft_consensus.cc:697] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 4 LEADER]: Becoming Leader. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Running, Role: LEADER
I20260709 12:58:32.927037  1294 consensus_queue.cc:237] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:32.936051   954 catalog_manager.cc:5697] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 reported cstate change: term changed from 3 to 4, leader changed from 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193) to cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "cbcdb9aece834c08b02e84eff5a809a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:33.019913  1205 raft_consensus.cc:515] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:33.019827  1204 raft_consensus.cc:515] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } }
I20260709 12:58:33.022560  1204 leader_election.cc:290] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 2 election: Requested vote from peers cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373), 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677)
I20260709 12:58:33.023252  1205 leader_election.cc:290] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 3 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194:37373)
I20260709 12:58:33.024410  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bd400b46224eeaa2241dbca5e5ad7b" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:33.025048  1130 raft_consensus.cc:3060] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:33.025251  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bd400b46224eeaa2241dbca5e5ad7b" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:33.025480  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a17d2df148243d29b308a1a36bc2d7c" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
I20260709 12:58:33.025833  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a17d2df148243d29b308a1a36bc2d7c" candidate_uuid: "0933d7d26d6c4321ac2b184564bcfa50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:33.026077  1131 raft_consensus.cc:3060] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:33.025939  1053 raft_consensus.cc:3055] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:33.026537  1056 raft_consensus.cc:3055] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:33.026615  1053 raft_consensus.cc:740] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:33.026952  1056 raft_consensus.cc:740] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:33.027550  1053 consensus_queue.cc:260] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } }
I20260709 12:58:33.027944  1056 consensus_queue.cc:260] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:33.029142  1053 raft_consensus.cc:3060] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:33.029379  1056 raft_consensus.cc:3060] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:33.121563  1130 raft_consensus.cc:2468] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 2.
I20260709 12:58:33.121563  1053 raft_consensus.cc:2468] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 2.
I20260709 12:58:33.121769  1131 raft_consensus.cc:2468] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 3.
I20260709 12:58:33.121949  1056 raft_consensus.cc:2468] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0933d7d26d6c4321ac2b184564bcfa50 in term 3.
I20260709 12:58:33.123838  1168 leader_election.cc:304] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:33.124858  1406 raft_consensus.cc:2804] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:33.125051  1168 leader_election.cc:304] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:33.126288  1406 raft_consensus.cc:697] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 LEADER]: Becoming Leader. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Running, Role: LEADER
I20260709 12:58:33.126768  1413 raft_consensus.cc:2804] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:33.127295  1413 raft_consensus.cc:697] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 LEADER]: Becoming Leader. State: Replica: 0933d7d26d6c4321ac2b184564bcfa50, State: Running, Role: LEADER
I20260709 12:58:33.127242  1406 consensus_queue.cc:237] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } }
I20260709 12:58:33.128316  1413 consensus_queue.cc:237] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:33.135630   954 catalog_manager.cc:5697] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 reported cstate change: term changed from 1 to 2, leader changed from 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193) to 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0933d7d26d6c4321ac2b184564bcfa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:33.147161   954 catalog_manager.cc:5697] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 reported cstate change: term changed from 2 to 3, leader changed from 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193) to 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0933d7d26d6c4321ac2b184564bcfa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:33.176249  1399 raft_consensus.cc:993] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96: : Instructing follower cbcdb9aece834c08b02e84eff5a809a5 to start an election
I20260709 12:58:33.176802  1405 raft_consensus.cc:1081] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Signalling peer cbcdb9aece834c08b02e84eff5a809a5 to start an election
I20260709 12:58:33.178465  1130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc20c65d841743c5b54b309014bfd3b8"
dest_uuid: "cbcdb9aece834c08b02e84eff5a809a5"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:58:33.178941  1130 raft_consensus.cc:493] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:33.179312  1130 raft_consensus.cc:3060] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:33.222656  1130 raft_consensus.cc:515] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:33.224223  1130 leader_election.cc:290] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 3 election: Requested vote from peers 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677), 0933d7d26d6c4321ac2b184564bcfa50 (127.0.107.195:33839)
I20260709 12:58:33.225430  1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc20c65d841743c5b54b309014bfd3b8" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0933d7d26d6c4321ac2b184564bcfa50"
I20260709 12:58:33.225430  1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc20c65d841743c5b54b309014bfd3b8" candidate_uuid: "cbcdb9aece834c08b02e84eff5a809a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10b71dd7aed440b7bc652f8c78785f96"
I20260709 12:58:33.226274  1056 raft_consensus.cc:3055] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:33.226250  1205 raft_consensus.cc:3060] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:33.226755  1056 raft_consensus.cc:740] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10b71dd7aed440b7bc652f8c78785f96, State: Running, Role: LEADER
I20260709 12:58:33.227564  1056 consensus_queue.cc:260] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:33.228856  1056 raft_consensus.cc:3060] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:33.322279  1205 raft_consensus.cc:2468] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 3.
I20260709 12:58:33.322379  1056 raft_consensus.cc:2468] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbcdb9aece834c08b02e84eff5a809a5 in term 3.
I20260709 12:58:33.323770  1097 leader_election.cc:304] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0933d7d26d6c4321ac2b184564bcfa50, cbcdb9aece834c08b02e84eff5a809a5; no voters: 
I20260709 12:58:33.324635  1294 raft_consensus.cc:2804] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:33.325242  1294 raft_consensus.cc:697] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 3 LEADER]: Becoming Leader. State: Replica: cbcdb9aece834c08b02e84eff5a809a5, State: Running, Role: LEADER
I20260709 12:58:33.326026  1294 consensus_queue.cc:237] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } }
I20260709 12:58:33.333551   954 catalog_manager.cc:5697] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 reported cstate change: term changed from 2 to 3, leader changed from 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193) to cbcdb9aece834c08b02e84eff5a809a5 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "cbcdb9aece834c08b02e84eff5a809a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:33.374382  1205 raft_consensus.cc:1275] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 4 FOLLOWER]: Refusing update from remote peer cbcdb9aece834c08b02e84eff5a809a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:33.375540  1294 consensus_queue.cc:1048] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:33.385983  1056 raft_consensus.cc:1275] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 4 FOLLOWER]: Refusing update from remote peer cbcdb9aece834c08b02e84eff5a809a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:33.387276  1420 consensus_queue.cc:1048] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:33.581565  1130 raft_consensus.cc:1275] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Refusing update from remote peer 0933d7d26d6c4321ac2b184564bcfa50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:33.582805  1413 consensus_queue.cc:1048] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.587688  1056 raft_consensus.cc:1275] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Refusing update from remote peer 0933d7d26d6c4321ac2b184564bcfa50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:33.589118  1413 consensus_queue.cc:1048] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.678459  1056 raft_consensus.cc:1275] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Refusing update from remote peer 0933d7d26d6c4321ac2b184564bcfa50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:33.679786  1425 consensus_queue.cc:1048] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:33.689898  1130 raft_consensus.cc:1275] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Refusing update from remote peer 0933d7d26d6c4321ac2b184564bcfa50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:33.691452  1413 consensus_queue.cc:1048] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbcdb9aece834c08b02e84eff5a809a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:33.724848   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:33.725340  1056 raft_consensus.cc:1275] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Refusing update from remote peer cbcdb9aece834c08b02e84eff5a809a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:33.726596  1407 consensus_queue.cc:1048] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10b71dd7aed440b7bc652f8c78785f96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.732239   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:58:33.739795  1205 raft_consensus.cc:1275] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Refusing update from remote peer cbcdb9aece834c08b02e84eff5a809a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:58:33.740250  1094 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 12:58:33.744776  1407 consensus_queue.cc:1048] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0933d7d26d6c4321ac2b184564bcfa50" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:58:33.747521  1094 consensus_peers.cc:597] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 -> Peer 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677): Couldn't send request to peer 10b71dd7aed440b7bc652f8c78785f96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:33.781008   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:33.781889   431 tablet_replica.cc:333] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96: stopping tablet replica
I20260709 12:58:33.782635   431 raft_consensus.cc:2243] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.783121   431 pending_rounds.cc:70] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96: Trying to abort 1 pending ops.
I20260709 12:58:33.783344   431 pending_rounds.cc:77] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305633436990754816 op_type: NO_OP noop_request { }
I20260709 12:58:33.783681   431 raft_consensus.cc:2889] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:58:33.783967   431 raft_consensus.cc:2272] T cc20c65d841743c5b54b309014bfd3b8 P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.786180   431 tablet_replica.cc:333] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96: stopping tablet replica
I20260709 12:58:33.786876   431 raft_consensus.cc:2243] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:33.787699   431 raft_consensus.cc:2272] T df55d1c7d075497499bd9e7dc25368dc P 10b71dd7aed440b7bc652f8c78785f96 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.789469   431 tablet_replica.cc:333] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96: stopping tablet replica
I20260709 12:58:33.789978   431 raft_consensus.cc:2243] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.790376   431 raft_consensus.cc:2272] T 42f97c45b0ef4ea38d0baa4673af6487 P 10b71dd7aed440b7bc652f8c78785f96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.791991   431 tablet_replica.cc:333] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96: stopping tablet replica
I20260709 12:58:33.792484   431 raft_consensus.cc:2243] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:33.793200   431 raft_consensus.cc:2272] T b1a1f8068f3f498c838e1185775a0dca P 10b71dd7aed440b7bc652f8c78785f96 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.794764   431 tablet_replica.cc:333] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96: stopping tablet replica
I20260709 12:58:33.795256   431 raft_consensus.cc:2243] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.795701   431 raft_consensus.cc:2272] T 86601eeee8e3462383b5947a0c6a497e P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.797587   431 tablet_replica.cc:333] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96: stopping tablet replica
I20260709 12:58:33.798147   431 raft_consensus.cc:2243] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:33.798807   431 raft_consensus.cc:2272] T 2167ef4ee1f2433d9436f6419d22ef0a P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.800555   431 tablet_replica.cc:333] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96: stopping tablet replica
I20260709 12:58:33.801218   431 raft_consensus.cc:2243] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.801636   431 raft_consensus.cc:2272] T 2bb238f427b94a3482d539531cba2a2d P 10b71dd7aed440b7bc652f8c78785f96 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.803853   431 tablet_replica.cc:333] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96: stopping tablet replica
I20260709 12:58:33.804463   431 raft_consensus.cc:2243] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.804970   431 raft_consensus.cc:2272] T 2a17d2df148243d29b308a1a36bc2d7c P 10b71dd7aed440b7bc652f8c78785f96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.807122   431 tablet_replica.cc:333] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96: stopping tablet replica
I20260709 12:58:33.807646   431 raft_consensus.cc:2243] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:33.808374   431 raft_consensus.cc:2272] T 573c69d482de4112aa00a3c5ffe97306 P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.810045   431 tablet_replica.cc:333] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96: stopping tablet replica
I20260709 12:58:33.810488   431 raft_consensus.cc:2243] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.810875   431 raft_consensus.cc:2272] T e0bd400b46224eeaa2241dbca5e5ad7b P 10b71dd7aed440b7bc652f8c78785f96 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:33.820698  1094 consensus_peers.cc:597] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 -> Peer 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677): Couldn't send request to peer 10b71dd7aed440b7bc652f8c78785f96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:33.822434  1094 consensus_peers.cc:597] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 -> Peer 10b71dd7aed440b7bc652f8c78785f96 (127.0.107.193:39677): Couldn't send request to peer 10b71dd7aed440b7bc652f8c78785f96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:33.843760   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:58:33.862155   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:58:33.885181   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:33.885898   431 tablet_replica.cc:333] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5: stopping tablet replica
I20260709 12:58:33.886456   431 raft_consensus.cc:2243] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.886845   431 raft_consensus.cc:2272] T 2167ef4ee1f2433d9436f6419d22ef0a P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.888430   431 tablet_replica.cc:333] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5: stopping tablet replica
I20260709 12:58:33.888994   431 raft_consensus.cc:2243] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.889346   431 raft_consensus.cc:2272] T 86601eeee8e3462383b5947a0c6a497e P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.891013   431 tablet_replica.cc:333] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5: stopping tablet replica
I20260709 12:58:33.891481   431 raft_consensus.cc:2243] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:33.892143   431 raft_consensus.cc:2272] T cc20c65d841743c5b54b309014bfd3b8 P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.894567   431 tablet_replica.cc:333] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5: stopping tablet replica
I20260709 12:58:33.895022   431 raft_consensus.cc:2243] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:33.895713   431 raft_consensus.cc:2272] T 42f97c45b0ef4ea38d0baa4673af6487 P cbcdb9aece834c08b02e84eff5a809a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.897480   431 tablet_replica.cc:333] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5: stopping tablet replica
I20260709 12:58:33.897897   431 raft_consensus.cc:2243] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.898272   431 raft_consensus.cc:2272] T b1a1f8068f3f498c838e1185775a0dca P cbcdb9aece834c08b02e84eff5a809a5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.899871   431 tablet_replica.cc:333] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5: stopping tablet replica
I20260709 12:58:33.900350   431 raft_consensus.cc:2243] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.900851   431 raft_consensus.cc:2272] T 573c69d482de4112aa00a3c5ffe97306 P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.902453   431 tablet_replica.cc:333] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5: stopping tablet replica
I20260709 12:58:33.902925   431 raft_consensus.cc:2243] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.903322   431 raft_consensus.cc:2272] T df55d1c7d075497499bd9e7dc25368dc P cbcdb9aece834c08b02e84eff5a809a5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.905012   431 tablet_replica.cc:333] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5: stopping tablet replica
I20260709 12:58:33.905541   431 raft_consensus.cc:2243] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.905941   431 raft_consensus.cc:2272] T 2a17d2df148243d29b308a1a36bc2d7c P cbcdb9aece834c08b02e84eff5a809a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.907951   431 tablet_replica.cc:333] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5: stopping tablet replica
I20260709 12:58:33.908445   431 raft_consensus.cc:2243] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:33.909198   431 raft_consensus.cc:2272] T 2bb238f427b94a3482d539531cba2a2d P cbcdb9aece834c08b02e84eff5a809a5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.911170   431 tablet_replica.cc:333] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5: stopping tablet replica
I20260709 12:58:33.911621   431 raft_consensus.cc:2243] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.912002   431 raft_consensus.cc:2272] T e0bd400b46224eeaa2241dbca5e5ad7b P cbcdb9aece834c08b02e84eff5a809a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.942301   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:58:33.960258   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:58:33.984575   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:33.985374   431 tablet_replica.cc:333] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50: stopping tablet replica
I20260709 12:58:33.985962   431 raft_consensus.cc:2243] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.986418   431 raft_consensus.cc:2272] T df55d1c7d075497499bd9e7dc25368dc P 0933d7d26d6c4321ac2b184564bcfa50 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.988066   431 tablet_replica.cc:333] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50: stopping tablet replica
I20260709 12:58:33.988574   431 raft_consensus.cc:2243] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.989051   431 raft_consensus.cc:2272] T 573c69d482de4112aa00a3c5ffe97306 P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.990674   431 tablet_replica.cc:333] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50: stopping tablet replica
I20260709 12:58:33.991192   431 raft_consensus.cc:2243] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.991598   431 raft_consensus.cc:2272] T 2167ef4ee1f2433d9436f6419d22ef0a P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.993177   431 tablet_replica.cc:333] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50: stopping tablet replica
I20260709 12:58:33.993716   431 raft_consensus.cc:2243] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:33.994457   431 raft_consensus.cc:2272] T 86601eeee8e3462383b5947a0c6a497e P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.996054   431 tablet_replica.cc:333] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50: stopping tablet replica
I20260709 12:58:33.996536   431 raft_consensus.cc:2243] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.996968   431 raft_consensus.cc:2272] T cc20c65d841743c5b54b309014bfd3b8 P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.999898   431 tablet_replica.cc:333] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50: stopping tablet replica
I20260709 12:58:34.000720   431 raft_consensus.cc:2243] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.001255   431 raft_consensus.cc:2272] T b1a1f8068f3f498c838e1185775a0dca P 0933d7d26d6c4321ac2b184564bcfa50 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.002807   431 tablet_replica.cc:333] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50: stopping tablet replica
I20260709 12:58:34.003293   431 raft_consensus.cc:2243] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.003773   431 raft_consensus.cc:2272] T 42f97c45b0ef4ea38d0baa4673af6487 P 0933d7d26d6c4321ac2b184564bcfa50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.006486   431 tablet_replica.cc:333] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50: stopping tablet replica
I20260709 12:58:34.007223   431 raft_consensus.cc:2243] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.008111   431 raft_consensus.cc:2272] T e0bd400b46224eeaa2241dbca5e5ad7b P 0933d7d26d6c4321ac2b184564bcfa50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.010185   431 tablet_replica.cc:333] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50: stopping tablet replica
I20260709 12:58:34.010704   431 raft_consensus.cc:2243] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.011722   431 raft_consensus.cc:2272] T 2a17d2df148243d29b308a1a36bc2d7c P 0933d7d26d6c4321ac2b184564bcfa50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.013671   431 tablet_replica.cc:333] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50: stopping tablet replica
I20260709 12:58:34.014153   431 raft_consensus.cc:2243] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.014587   431 raft_consensus.cc:2272] T 2bb238f427b94a3482d539531cba2a2d P 0933d7d26d6c4321ac2b184564bcfa50 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.044497   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:58:34.063714   431 master.cc:562] Master@127.0.107.254:41223 shutting down...
I20260709 12:58:34.087921   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.088492   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.088924   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 079ea5ee49dc4199a84384716faf72a7: stopping tablet replica
I20260709 12:58:34.109594   431 master.cc:584] Master@127.0.107.254:41223 shutdown complete.
0933d7d26d6c4321ac2b184564bcfa50  2
10b71dd7aed440b7bc652f8c78785f96  4
cbcdb9aece834c08b02e84eff5a809a5  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (11017 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:58:34.155460   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:44807
I20260709 12:58:34.156669   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:34.162365  1433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.162675  1434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.164357  1436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:34.165205   431 server_base.cc:1061] running on GCE node
I20260709 12:58:34.166123   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:34.166328   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:34.166445   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601914166433 us; error 0 us; skew 500 ppm
I20260709 12:58:34.166957   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:34.169525   431 webserver.cc:533] Webserver started at http://127.0.107.254:37675/ using document root <none> and password file <none>
I20260709 12:58:34.169972   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:34.170120   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:34.170351   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:34.171396   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/master-0-root/instance:
uuid: "1d002eece69f4b28add96a7bb163d0f2"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-c08m"
I20260709 12:58:34.175910   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:58:34.179287  1441 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.180140   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:58:34.180465   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/master-0-root
uuid: "1d002eece69f4b28add96a7bb163d0f2"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-c08m"
I20260709 12:58:34.180853   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:34.214381   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:34.215685   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:34.258688   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:44807
I20260709 12:58:34.258837  1492 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:44807 every 8 connection(s)
I20260709 12:58:34.262873  1493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.273892  1493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Bootstrap starting.
I20260709 12:58:34.278973  1493 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:34.283737  1493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: No bootstrap required, opened a new log
I20260709 12:58:34.285938  1493 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d002eece69f4b28add96a7bb163d0f2" member_type: VOTER }
I20260709 12:58:34.286324  1493 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:34.286571  1493 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d002eece69f4b28add96a7bb163d0f2, State: Initialized, Role: FOLLOWER
I20260709 12:58:34.287243  1493 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d002eece69f4b28add96a7bb163d0f2" member_type: VOTER }
I20260709 12:58:34.287691  1493 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:34.287909  1493 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:34.288195  1493 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:34.292445  1493 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d002eece69f4b28add96a7bb163d0f2" member_type: VOTER }
I20260709 12:58:34.292990  1493 leader_election.cc:304] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d002eece69f4b28add96a7bb163d0f2; no voters: 
I20260709 12:58:34.294099  1493 leader_election.cc:290] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:34.294559  1496 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:34.295835  1496 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [term 1 LEADER]: Becoming Leader. State: Replica: 1d002eece69f4b28add96a7bb163d0f2, State: Running, Role: LEADER
I20260709 12:58:34.296514  1496 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d002eece69f4b28add96a7bb163d0f2" member_type: VOTER }
I20260709 12:58:34.297065  1493 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:34.301007  1497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d002eece69f4b28add96a7bb163d0f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d002eece69f4b28add96a7bb163d0f2" member_type: VOTER } }
I20260709 12:58:34.301717  1497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:34.301626  1498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d002eece69f4b28add96a7bb163d0f2. Latest consensus state: current_term: 1 leader_uuid: "1d002eece69f4b28add96a7bb163d0f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d002eece69f4b28add96a7bb163d0f2" member_type: VOTER } }
I20260709 12:58:34.302193  1498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:34.303920  1503 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:34.312012  1503 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:34.313086   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:34.321420  1503 catalog_manager.cc:1383] Generated new cluster ID: 60542ccae51147ff9402f597d758b578
I20260709 12:58:34.321750  1503 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:34.343482  1503 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:34.344779  1503 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:34.365211  1503 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Generated new TSK 0
I20260709 12:58:34.365836  1503 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:34.380259   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:34.386507  1514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.387492  1515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.389323  1517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:34.389837   431 server_base.cc:1061] running on GCE node
I20260709 12:58:34.390700   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:34.390873   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:34.391059   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601914391044 us; error 0 us; skew 500 ppm
I20260709 12:58:34.391623   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:34.394024   431 webserver.cc:533] Webserver started at http://127.0.107.193:33177/ using document root <none> and password file <none>
I20260709 12:58:34.394515   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:34.394703   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:34.394979   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:34.396020   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root/instance:
uuid: "e4c78b411eb34b3d92183a86d34a81f1"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-c08m"
I20260709 12:58:34.400786   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:58:34.403954  1522 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.404843   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:58:34.405151   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root
uuid: "e4c78b411eb34b3d92183a86d34a81f1"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-c08m"
I20260709 12:58:34.405525   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:34.430590   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:34.431869   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:34.433483   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:34.435808   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:34.436049   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.436308   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:34.436512   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.482383   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43439
I20260709 12:58:34.482882  1584 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43439 every 8 connection(s)
I20260709 12:58:34.489306   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:34.497509  1589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.498382  1590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.502068  1592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:34.505111   431 server_base.cc:1061] running on GCE node
I20260709 12:58:34.506896   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:34.507251   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:34.507470   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601914507450 us; error 0 us; skew 500 ppm
I20260709 12:58:34.508384   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:34.511597  1585 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44807
I20260709 12:58:34.512053  1585 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:34.512636   431 webserver.cc:533] Webserver started at http://127.0.107.194:46181/ using document root <none> and password file <none>
I20260709 12:58:34.513371   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:34.513031  1585 heartbeater.cc:507] Master 127.0.107.254:44807 requested a full tablet report, sending...
I20260709 12:58:34.513854   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:34.514246   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:34.515805   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root/instance:
uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-c08m"
I20260709 12:58:34.516134  1458 ts_manager.cc:194] Registered new tserver with Master: e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:58:34.518882  1458 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41156
I20260709 12:58:34.525573   431 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:58:34.531201  1597 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.532361   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:58:34.532800   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root
uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-c08m"
I20260709 12:58:34.533242   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:34.553715   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:34.554822   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:34.556174   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:34.558449   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:34.558627   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.558928   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:34.559068   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.599244   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:43887
I20260709 12:58:34.599349  1659 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:43887 every 8 connection(s)
I20260709 12:58:34.604066   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:34.611011  1663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:34.612181  1664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:34.615298   431 server_base.cc:1061] running on GCE node
W20260709 12:58:34.616827  1667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:34.617063  1660 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44807
I20260709 12:58:34.617497  1660 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:34.617987   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:34.618228   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:34.618316  1660 heartbeater.cc:507] Master 127.0.107.254:44807 requested a full tablet report, sending...
I20260709 12:58:34.618439   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601914618399 us; error 0 us; skew 500 ppm
I20260709 12:58:34.619138   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:34.620685  1458 ts_manager.cc:194] Registered new tserver with Master: 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:34.622046   431 webserver.cc:533] Webserver started at http://127.0.107.195:34141/ using document root <none> and password file <none>
I20260709 12:58:34.622355  1458 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41160
I20260709 12:58:34.622649   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:34.622922   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:34.623242   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:34.624495   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root/instance:
uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-c08m"
I20260709 12:58:34.629607   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:58:34.633009  1671 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.633869   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:58:34.634289   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root
uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
format_stamp: "Formatted at 2026-07-09 12:58:34 on dist-test-slave-c08m"
I20260709 12:58:34.634627   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:34.648268   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:34.649559   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:34.651022   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:34.653254   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:34.653488   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.653764   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:34.653942   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:34.696997  1733 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:42699 every 8 connection(s)
I20260709 12:58:34.696990   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:42699
I20260709 12:58:34.712966  1734 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44807
I20260709 12:58:34.713335  1734 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:34.714123  1734 heartbeater.cc:507] Master 127.0.107.254:44807 requested a full tablet report, sending...
I20260709 12:58:34.716138  1458 ts_manager.cc:194] Registered new tserver with Master: 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:34.716276   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015178561s
I20260709 12:58:34.717689  1458 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41166
I20260709 12:58:34.744656  1458 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41176:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:34.751145  1458 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:34.963086  1625 tablet_service.cc:1511] Processing CreateTablet for tablet e89d6bd5df2a49f7b78e8695456652b5 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:34.963496  1624 tablet_service.cc:1511] Processing CreateTablet for tablet 428c176495744009b63bfa690baa17c6 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:34.964634  1625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89d6bd5df2a49f7b78e8695456652b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.966506  1624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 428c176495744009b63bfa690baa17c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.968099  1699 tablet_service.cc:1511] Processing CreateTablet for tablet e89d6bd5df2a49f7b78e8695456652b5 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:34.969484  1699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89d6bd5df2a49f7b78e8695456652b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.972649  1698 tablet_service.cc:1511] Processing CreateTablet for tablet 428c176495744009b63bfa690baa17c6 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:34.974109  1698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 428c176495744009b63bfa690baa17c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.977851  1697 tablet_service.cc:1511] Processing CreateTablet for tablet dfc7199563cc4b68b76fa96af21d01c4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:34.978289  1623 tablet_service.cc:1511] Processing CreateTablet for tablet dfc7199563cc4b68b76fa96af21d01c4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:34.979334  1697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc7199563cc4b68b76fa96af21d01c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.979712  1623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc7199563cc4b68b76fa96af21d01c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.981777  1696 tablet_service.cc:1511] Processing CreateTablet for tablet 4d906a33e42d4a08ae9d1a9d2e39351c (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:34.982600  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 4d906a33e42d4a08ae9d1a9d2e39351c (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:34.983198  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d906a33e42d4a08ae9d1a9d2e39351c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.984436  1621 tablet_service.cc:1511] Processing CreateTablet for tablet 79c0adefd7b845bb8ddbb72d7edb7bc7 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:34.985817  1621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c0adefd7b845bb8ddbb72d7edb7bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.985773  1694 tablet_service.cc:1511] Processing CreateTablet for tablet c538f09573cd4214b1d7cab1dddee46f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:34.987223  1694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c538f09573cd4214b1d7cab1dddee46f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.987818  1620 tablet_service.cc:1511] Processing CreateTablet for tablet c538f09573cd4214b1d7cab1dddee46f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:34.989753  1693 tablet_service.cc:1511] Processing CreateTablet for tablet b4ec8ad3927940f69c368052fdeef53b (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:34.989866  1619 tablet_service.cc:1511] Processing CreateTablet for tablet b4ec8ad3927940f69c368052fdeef53b (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:34.991117  1693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ec8ad3927940f69c368052fdeef53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.991809  1618 tablet_service.cc:1511] Processing CreateTablet for tablet f0b9ebe321414b42a927557c66adbb7e (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:34.993999  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c538f09573cd4214b1d7cab1dddee46f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.993651  1616 tablet_service.cc:1511] Processing CreateTablet for tablet d1461e6ea3a84192b5ce68699dc52d80 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:34.995236  1616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1461e6ea3a84192b5ce68699dc52d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.995913  1691 tablet_service.cc:1511] Processing CreateTablet for tablet bf4201f98c934feca49bae13648b2835 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:34.997344  1691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4201f98c934feca49bae13648b2835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.997594  1619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ec8ad3927940f69c368052fdeef53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.993716  1617 tablet_service.cc:1511] Processing CreateTablet for tablet bf4201f98c934feca49bae13648b2835 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:34.999912  1617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4201f98c934feca49bae13648b2835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.000037  1695 tablet_service.cc:1511] Processing CreateTablet for tablet 79c0adefd7b845bb8ddbb72d7edb7bc7 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:35.000957  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d906a33e42d4a08ae9d1a9d2e39351c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.001456  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c0adefd7b845bb8ddbb72d7edb7bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.003582  1618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b9ebe321414b42a927557c66adbb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:34.993651  1692 tablet_service.cc:1511] Processing CreateTablet for tablet f0b9ebe321414b42a927557c66adbb7e (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:35.006683  1692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b9ebe321414b42a927557c66adbb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.063105  1550 tablet_service.cc:1511] Processing CreateTablet for tablet e89d6bd5df2a49f7b78e8695456652b5 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:35.065584  1543 tablet_service.cc:1511] Processing CreateTablet for tablet f0b9ebe321414b42a927557c66adbb7e (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:35.065688  1549 tablet_service.cc:1511] Processing CreateTablet for tablet 428c176495744009b63bfa690baa17c6 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:35.067619  1548 tablet_service.cc:1511] Processing CreateTablet for tablet dfc7199563cc4b68b76fa96af21d01c4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:35.069885  1547 tablet_service.cc:1511] Processing CreateTablet for tablet 4d906a33e42d4a08ae9d1a9d2e39351c (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:35.072220  1546 tablet_service.cc:1511] Processing CreateTablet for tablet 79c0adefd7b845bb8ddbb72d7edb7bc7 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:35.073348  1620 tablet_service.cc:1511] Processing CreateTablet for tablet 5c1e1be9de68405393292149e41c0724 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:35.074506  1545 tablet_service.cc:1511] Processing CreateTablet for tablet c538f09573cd4214b1d7cab1dddee46f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:35.076753  1544 tablet_service.cc:1511] Processing CreateTablet for tablet b4ec8ad3927940f69c368052fdeef53b (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:35.080071  1542 tablet_service.cc:1511] Processing CreateTablet for tablet bf4201f98c934feca49bae13648b2835 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:35.074889  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c1e1be9de68405393292149e41c0724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.064491  1550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89d6bd5df2a49f7b78e8695456652b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.088483  1690 tablet_service.cc:1511] Processing CreateTablet for tablet d1461e6ea3a84192b5ce68699dc52d80 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:35.090551  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1461e6ea3a84192b5ce68699dc52d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.094470  1541 tablet_service.cc:1511] Processing CreateTablet for tablet d1461e6ea3a84192b5ce68699dc52d80 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:35.096814  1549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 428c176495744009b63bfa690baa17c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.104956  1546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c0adefd7b845bb8ddbb72d7edb7bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.106074  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c538f09573cd4214b1d7cab1dddee46f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.111694  1543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b9ebe321414b42a927557c66adbb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.115373  1548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc7199563cc4b68b76fa96af21d01c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.145128  1616 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8e024148f547e4b090c0c8c1155232 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:35.146518  1616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8e024148f547e4b090c0c8c1155232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.135759  1542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4201f98c934feca49bae13648b2835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.156157  1547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d906a33e42d4a08ae9d1a9d2e39351c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.156976  1541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1461e6ea3a84192b5ce68699dc52d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.160993  1695 tablet_service.cc:1511] Processing CreateTablet for tablet 5c1e1be9de68405393292149e41c0724 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:35.163359  1544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ec8ad3927940f69c368052fdeef53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.163751  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c1e1be9de68405393292149e41c0724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.165066  1749 tablet_bootstrap.cc:492] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:35.144392  1621 tablet_service.cc:1511] Processing CreateTablet for tablet 15f3a55bc1874c9cbd400712a345dcf0 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:35.169888  1621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f3a55bc1874c9cbd400712a345dcf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.169814  1697 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8e024148f547e4b090c0c8c1155232 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:35.178879  1750 tablet_bootstrap.cc:492] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:35.188522  1699 tablet_service.cc:1511] Processing CreateTablet for tablet 15f3a55bc1874c9cbd400712a345dcf0 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:35.197909  1697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8e024148f547e4b090c0c8c1155232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.199920  1624 tablet_service.cc:1511] Processing CreateTablet for tablet f4a5771425b14503aa3a070b20d0bf86 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:35.206970  1624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a5771425b14503aa3a070b20d0bf86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.206487  1549 tablet_service.cc:1511] Processing CreateTablet for tablet 5c1e1be9de68405393292149e41c0724 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:35.208118  1549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c1e1be9de68405393292149e41c0724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.221504  1550 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8e024148f547e4b090c0c8c1155232 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:35.222654  1749 tablet_bootstrap.cc:654] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.222978  1550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8e024148f547e4b090c0c8c1155232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.224978  1699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f3a55bc1874c9cbd400712a345dcf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.247017  1549 tablet_service.cc:1511] Processing CreateTablet for tablet 15f3a55bc1874c9cbd400712a345dcf0 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:35.248365  1549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f3a55bc1874c9cbd400712a345dcf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.254484  1547 tablet_service.cc:1511] Processing CreateTablet for tablet f4a5771425b14503aa3a070b20d0bf86 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:35.255844  1547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a5771425b14503aa3a070b20d0bf86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.261264  1751 tablet_bootstrap.cc:492] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:35.270934  1696 tablet_service.cc:1511] Processing CreateTablet for tablet f4a5771425b14503aa3a070b20d0bf86 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:35.285697  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a5771425b14503aa3a070b20d0bf86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.289074  1750 tablet_bootstrap.cc:654] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.299001  1542 tablet_service.cc:1511] Processing CreateTablet for tablet dd7d9d192f7349b7bb550962c2e6c957 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:35.300460  1542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd7d9d192f7349b7bb550962c2e6c957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.304641  1617 tablet_service.cc:1511] Processing CreateTablet for tablet dd7d9d192f7349b7bb550962c2e6c957 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
W20260709 12:58:35.308048  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:35.311702  1696 tablet_service.cc:1511] Processing CreateTablet for tablet dd7d9d192f7349b7bb550962c2e6c957 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:35.306280  1617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd7d9d192f7349b7bb550962c2e6c957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.321661  1546 tablet_service.cc:1511] Processing CreateTablet for tablet 7b6551a6ae764e24a141aa53353df444 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:35.323140  1546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b6551a6ae764e24a141aa53353df444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.323709  1623 tablet_service.cc:1511] Processing CreateTablet for tablet 7b6551a6ae764e24a141aa53353df444 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:35.339634  1623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b6551a6ae764e24a141aa53353df444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.351485  1694 tablet_service.cc:1511] Processing CreateTablet for tablet 7b6551a6ae764e24a141aa53353df444 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:35.352934  1694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b6551a6ae764e24a141aa53353df444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.353938  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 6325e0281aa547efa677c29cabdf5de4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:35.355232  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6325e0281aa547efa677c29cabdf5de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.358915  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd7d9d192f7349b7bb550962c2e6c957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.365453  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 6325e0281aa547efa677c29cabdf5de4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:35.366848  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6325e0281aa547efa677c29cabdf5de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.367305  1750 tablet_bootstrap.cc:492] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:35.367772  1750 ts_tablet_manager.cc:1403] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.189s	user 0.012s	sys 0.009s
I20260709 12:58:35.378165  1750 raft_consensus.cc:359] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:58:35.378948  1750 raft_consensus.cc:385] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.379263  1750 raft_consensus.cc:740] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.385082  1749 tablet_bootstrap.cc:492] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:35.385615  1749 ts_tablet_manager.cc:1403] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.221s	user 0.029s	sys 0.022s
I20260709 12:58:35.385768  1750 consensus_queue.cc:260] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:58:35.389431  1749 raft_consensus.cc:359] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.390255  1749 raft_consensus.cc:385] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.390625  1749 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.391472  1749 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.394253  1751 tablet_bootstrap.cc:654] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.396795  1690 tablet_service.cc:1511] Processing CreateTablet for tablet 6325e0281aa547efa677c29cabdf5de4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:35.398131  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6325e0281aa547efa677c29cabdf5de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.401759  1624 tablet_service.cc:1511] Processing CreateTablet for tablet 376e686ba5f94a11b46d68b6abe55d53 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:35.403229  1696 tablet_service.cc:1511] Processing CreateTablet for tablet 376e686ba5f94a11b46d68b6abe55d53 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:35.404392  1624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376e686ba5f94a11b46d68b6abe55d53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.404539  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376e686ba5f94a11b46d68b6abe55d53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.406641  1734 heartbeater.cc:499] Master 127.0.107.254:44807 was elected leader, sending a full tablet report...
I20260709 12:58:35.412906  1620 tablet_service.cc:1511] Processing CreateTablet for tablet 22195ce47a0c43e5ab7e7ed47f7e5a1f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:35.413489  1547 tablet_service.cc:1511] Processing CreateTablet for tablet 22195ce47a0c43e5ab7e7ed47f7e5a1f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:35.414422  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22195ce47a0c43e5ab7e7ed47f7e5a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.414618  1750 ts_tablet_manager.cc:1434] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 12:58:35.415823  1750 tablet_bootstrap.cc:492] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:35.414746  1547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22195ce47a0c43e5ab7e7ed47f7e5a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.421936  1691 tablet_service.cc:1511] Processing CreateTablet for tablet 22195ce47a0c43e5ab7e7ed47f7e5a1f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:35.423457  1691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22195ce47a0c43e5ab7e7ed47f7e5a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.425884  1550 tablet_service.cc:1511] Processing CreateTablet for tablet 376e686ba5f94a11b46d68b6abe55d53 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:35.427266  1550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376e686ba5f94a11b46d68b6abe55d53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.449717  1543 tablet_service.cc:1511] Processing CreateTablet for tablet 08d2a27acc8245ffb64e2f7a75ff92a4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:35.451164  1543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d2a27acc8245ffb64e2f7a75ff92a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.455542  1750 tablet_bootstrap.cc:654] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.458432  1751 tablet_bootstrap.cc:492] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:35.473464  1751 ts_tablet_manager.cc:1403] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.212s	user 0.028s	sys 0.008s
I20260709 12:58:35.478029  1695 tablet_service.cc:1511] Processing CreateTablet for tablet 08d2a27acc8245ffb64e2f7a75ff92a4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:35.480540  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d2a27acc8245ffb64e2f7a75ff92a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.482102  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 08d2a27acc8245ffb64e2f7a75ff92a4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:35.483409  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d2a27acc8245ffb64e2f7a75ff92a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.483682  1546 tablet_service.cc:1511] Processing CreateTablet for tablet 78e528e98cb24afd985ad0425501f5ed (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:35.485128  1546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e528e98cb24afd985ad0425501f5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.489460  1749 ts_tablet_manager.cc:1434] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.104s	user 0.029s	sys 0.019s
I20260709 12:58:35.490358  1660 heartbeater.cc:499] Master 127.0.107.254:44807 was elected leader, sending a full tablet report...
I20260709 12:58:35.499845  1624 tablet_service.cc:1511] Processing CreateTablet for tablet 78e528e98cb24afd985ad0425501f5ed (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:35.496061  1749 tablet_bootstrap.cc:492] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:35.504891  1751 raft_consensus.cc:359] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.505645  1751 raft_consensus.cc:385] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.505944  1751 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.506723  1750 tablet_bootstrap.cc:492] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:35.506682  1751 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.507293  1750 ts_tablet_manager.cc:1403] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.003s
I20260709 12:58:35.508455  1624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e528e98cb24afd985ad0425501f5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.510635  1750 raft_consensus.cc:359] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.511407  1750 raft_consensus.cc:385] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.511708  1750 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.512560  1749 tablet_bootstrap.cc:654] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.512509  1750 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.522445  1585 heartbeater.cc:499] Master 127.0.107.254:44807 was elected leader, sending a full tablet report...
I20260709 12:58:35.524401  1620 tablet_service.cc:1511] Processing CreateTablet for tablet 9e112d5c05d14e7ca923c272912bcec9 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:35.525848  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e112d5c05d14e7ca923c272912bcec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.521556  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 9e112d5c05d14e7ca923c272912bcec9 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:35.528823  1696 tablet_service.cc:1511] Processing CreateTablet for tablet 78e528e98cb24afd985ad0425501f5ed (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:35.529371  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e112d5c05d14e7ca923c272912bcec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.530247  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e528e98cb24afd985ad0425501f5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.537003  1750 ts_tablet_manager.cc:1434] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 12:58:35.538187  1750 tablet_bootstrap.cc:492] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:35.548743  1690 tablet_service.cc:1511] Processing CreateTablet for tablet 9e112d5c05d14e7ca923c272912bcec9 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:35.551159  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 03348d9c2a344a6f8e716751b1024647 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:35.552546  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03348d9c2a344a6f8e716751b1024647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.553654  1547 tablet_service.cc:1511] Processing CreateTablet for tablet 03348d9c2a344a6f8e716751b1024647 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:35.554740  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e112d5c05d14e7ca923c272912bcec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.554935  1547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03348d9c2a344a6f8e716751b1024647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.564503  1750 tablet_bootstrap.cc:654] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.561731  1751 ts_tablet_manager.cc:1434] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.002s
I20260709 12:58:35.569437  1751 tablet_bootstrap.cc:492] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:35.575133  1756 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.576917  1756 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.579766  1756 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:35.610002  1751 tablet_bootstrap.cc:654] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.610581  1695 tablet_service.cc:1511] Processing CreateTablet for tablet 03348d9c2a344a6f8e716751b1024647 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:35.611991  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03348d9c2a344a6f8e716751b1024647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.617058  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 5149d64e3d354b728df20cd4c75510c6 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:35.618436  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5149d64e3d354b728df20cd4c75510c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.621544  1749 tablet_bootstrap.cc:492] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:35.629544  1543 tablet_service.cc:1511] Processing CreateTablet for tablet 1d92f9e0b7fb49ab8fad982d80cbd39f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:35.630167  1749 ts_tablet_manager.cc:1403] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.012s
I20260709 12:58:35.634085  1691 tablet_service.cc:1511] Processing CreateTablet for tablet 5149d64e3d354b728df20cd4c75510c6 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:35.634851  1750 tablet_bootstrap.cc:492] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:35.635367  1758 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.640075  1750 ts_tablet_manager.cc:1403] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.102s	user 0.016s	sys 0.010s
I20260709 12:58:35.640311  1758 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.643389  1758 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:35.646737  1750 raft_consensus.cc:359] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.637854  1543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d92f9e0b7fb49ab8fad982d80cbd39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.653432  1750 raft_consensus.cc:385] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.654055  1750 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.649192  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:35.655033  1750 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.657295  1750 ts_tablet_manager.cc:1434] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:58:35.659444  1547 tablet_service.cc:1511] Processing CreateTablet for tablet 54abded5f0d34ab1871704bc5a3c1b4a (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:35.660768  1547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54abded5f0d34ab1871704bc5a3c1b4a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:35.661309  1601 leader_election.cc:343] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.665829  1690 tablet_service.cc:1511] Processing CreateTablet for tablet 1d92f9e0b7fb49ab8fad982d80cbd39f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:35.658298  1750 tablet_bootstrap.cc:492] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:35.666807  1691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5149d64e3d354b728df20cd4c75510c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.672508  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 1d92f9e0b7fb49ab8fad982d80cbd39f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:35.673123  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d92f9e0b7fb49ab8fad982d80cbd39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.673938  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d92f9e0b7fb49ab8fad982d80cbd39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.636279  1749 raft_consensus.cc:359] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.674557  1749 raft_consensus.cc:385] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.674928  1749 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.678787  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:35.679276  1751 tablet_bootstrap.cc:492] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:35.679646  1560 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:35.679806  1751 ts_tablet_manager.cc:1403] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.111s	user 0.011s	sys 0.002s
I20260709 12:58:35.682533  1750 tablet_bootstrap.cc:654] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.678751  1749 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.694847  1749 ts_tablet_manager.cc:1434] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.001s
I20260709 12:58:35.694542  1696 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec5abf47e7f48a3a476ef08dd5f179d (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:35.695850  1749 tablet_bootstrap.cc:492] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:35.696017  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec5abf47e7f48a3a476ef08dd5f179d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.697723  1624 tablet_service.cc:1511] Processing CreateTablet for tablet 5149d64e3d354b728df20cd4c75510c6 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:35.701427  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec5abf47e7f48a3a476ef08dd5f179d (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:35.703066  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec5abf47e7f48a3a476ef08dd5f179d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.684250  1751 raft_consensus.cc:359] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:58:35.706992  1751 raft_consensus.cc:385] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.707398  1751 raft_consensus.cc:740] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.708143  1751 consensus_queue.cc:260] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:58:35.692339  1695 tablet_service.cc:1511] Processing CreateTablet for tablet 54abded5f0d34ab1871704bc5a3c1b4a (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:35.715071  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54abded5f0d34ab1871704bc5a3c1b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.715958  1751 ts_tablet_manager.cc:1434] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:58:35.716315  1624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5149d64e3d354b728df20cd4c75510c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.717000  1751 tablet_bootstrap.cc:492] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:35.718519  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:35.719211  1635 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:35.720678  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:35.721585  1758 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:35.721939  1758 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.722267  1758 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.729575  1758 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.731256  1758 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:35.708248  1620 tablet_service.cc:1511] Processing CreateTablet for tablet 54abded5f0d34ab1871704bc5a3c1b4a (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:35.731933  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:35.732511  1635 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.732969  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54abded5f0d34ab1871704bc5a3c1b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.732987  1750 tablet_bootstrap.cc:492] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:35.735440  1750 ts_tablet_manager.cc:1403] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.002s
I20260709 12:58:35.738991  1750 raft_consensus.cc:359] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.739735  1750 raft_consensus.cc:385] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.740041  1750 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.685920  1599 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 12:58:35.741514  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 55790.8us
I20260709 12:58:35.741724  1635 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:35.742368  1751 tablet_bootstrap.cc:654] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.742360  1756 raft_consensus.cc:2764] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:58:35.745757  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:35.746752  1758 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:35.746670  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec5abf47e7f48a3a476ef08dd5f179d (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:35.748247  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec5abf47e7f48a3a476ef08dd5f179d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.753648  1750 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.755074  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 4d71f760473d4219a951e6e5f061bfb5 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:35.756186  1750 ts_tablet_manager.cc:1434] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.002s
I20260709 12:58:35.756403  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d71f760473d4219a951e6e5f061bfb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.757210  1750 tablet_bootstrap.cc:492] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:35.766192  1547 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2e95946efd462d8cee2bc7302fe094 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:35.767494  1547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2e95946efd462d8cee2bc7302fe094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.768144  1751 tablet_bootstrap.cc:492] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:35.768697  1751 ts_tablet_manager.cc:1403] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.003s
I20260709 12:58:35.769515  1749 tablet_bootstrap.cc:654] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.771771  1751 raft_consensus.cc:359] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.772716  1617 tablet_service.cc:1511] Processing CreateTablet for tablet 4d71f760473d4219a951e6e5f061bfb5 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:35.781505  1617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d71f760473d4219a951e6e5f061bfb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.781831  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:35.782580  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:58:35.783535  1526 leader_election.cc:343] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.785439  1543 tablet_service.cc:1511] Processing CreateTablet for tablet 5299151db28746cf82a5b6d791a71d60 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:35.786777  1543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5299151db28746cf82a5b6d791a71d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.772838  1695 tablet_service.cc:1511] Processing CreateTablet for tablet 4d71f760473d4219a951e6e5f061bfb5 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:35.787830  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d71f760473d4219a951e6e5f061bfb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.776499  1616 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2e95946efd462d8cee2bc7302fe094 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:35.793438  1616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2e95946efd462d8cee2bc7302fe094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.795414  1621 tablet_service.cc:1511] Processing CreateTablet for tablet 5299151db28746cf82a5b6d791a71d60 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:35.796779  1621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5299151db28746cf82a5b6d791a71d60. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:35.796727  1526 leader_election.cc:343] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.774997  1758 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:35.798262  1758 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.778656  1696 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2e95946efd462d8cee2bc7302fe094 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:35.806265  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2e95946efd462d8cee2bc7302fe094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.791992  1750 tablet_bootstrap.cc:654] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.799336  1751 raft_consensus.cc:385] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.808463  1751 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.812371  1751 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.826143  1751 ts_tablet_manager.cc:1434] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 12:58:35.824123  1550 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3f4d9e2c0643f1be1fe0de2078f6da (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:35.815549  1690 tablet_service.cc:1511] Processing CreateTablet for tablet 5299151db28746cf82a5b6d791a71d60 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:35.827232  1751 tablet_bootstrap.cc:492] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:35.828181  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5299151db28746cf82a5b6d791a71d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.829988  1754 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.830516  1754 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:58:35.838920  1751 tablet_bootstrap.cc:654] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.844470  1550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3f4d9e2c0643f1be1fe0de2078f6da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.843204  1754 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:58:35.865599  1754 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.866232  1754 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.868269  1754 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:35.878484  1749 tablet_bootstrap.cc:492] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:35.879038  1749 ts_tablet_manager.cc:1403] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.183s	user 0.003s	sys 0.011s
I20260709 12:58:35.882302  1749 raft_consensus.cc:359] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.893564  1617 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3f4d9e2c0643f1be1fe0de2078f6da (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:35.894414  1750 tablet_bootstrap.cc:492] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:35.894909  1750 ts_tablet_manager.cc:1403] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.138s	user 0.025s	sys 0.031s
I20260709 12:58:35.895113  1617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3f4d9e2c0643f1be1fe0de2078f6da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.898118  1750 raft_consensus.cc:359] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.898932  1750 raft_consensus.cc:385] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.899380  1750 raft_consensus.cc:740] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.900096  1750 consensus_queue.cc:260] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.902287  1750 ts_tablet_manager.cc:1434] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:35.903271  1750 tablet_bootstrap.cc:492] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:35.909457  1771 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.910173  1771 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:58:35.914376  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:35.916324  1526 leader_election.cc:343] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.890025  1749 raft_consensus.cc:385] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.917976  1771 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:35.917037  1749 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.919736  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:35.919879  1749 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.920405  1708 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:35.921907  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:35.922338  1749 ts_tablet_manager.cc:1434] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:58:35.923446  1771 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:35.923872  1771 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.924207  1771 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.927254  1691 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3f4d9e2c0643f1be1fe0de2078f6da (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:35.927788  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 193165fa679c4f6c9d6ac6b39ef823bd (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:35.928665  1691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3f4d9e2c0643f1be1fe0de2078f6da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.929208  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 193165fa679c4f6c9d6ac6b39ef823bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.929517  1616 tablet_service.cc:1511] Processing CreateTablet for tablet 746cf49ba083454e8a50cff619835a56 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:35.933604  1696 tablet_service.cc:1511] Processing CreateTablet for tablet 746cf49ba083454e8a50cff619835a56 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:35.935074  1754 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.935622  1754 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.927335  1458 catalog_manager.cc:5697] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:35.938050  1754 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:35.943912  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746cf49ba083454e8a50cff619835a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.945791  1749 tablet_bootstrap.cc:492] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:35.946921  1620 tablet_service.cc:1511] Processing CreateTablet for tablet 193165fa679c4f6c9d6ac6b39ef823bd (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:35.949879  1616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746cf49ba083454e8a50cff619835a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.950822  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 193165fa679c4f6c9d6ac6b39ef823bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.952260  1543 tablet_service.cc:1511] Processing CreateTablet for tablet 52b0712953ef42ddb724cd8c29a0ec0b (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:35.953577  1543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b0712953ef42ddb724cd8c29a0ec0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.962002  1754 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.962520  1754 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:35.963038  1695 tablet_service.cc:1511] Processing CreateTablet for tablet 193165fa679c4f6c9d6ac6b39ef823bd (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:35.963531  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:35.964398  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 193165fa679c4f6c9d6ac6b39ef823bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.964991  1754 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:35.965387  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:35.968228  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:35.970336  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:35.971237  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:35.971766  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:35.971964  1675 leader_election.cc:343] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.971272  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:35.974390  1675 leader_election.cc:343] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.974100  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:35.978363  1675 leader_election.cc:343] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.981739  1621 tablet_service.cc:1511] Processing CreateTablet for tablet 52b0712953ef42ddb724cd8c29a0ec0b (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:35.983161  1621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b0712953ef42ddb724cd8c29a0ec0b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:35.985059  1675 leader_election.cc:343] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:35.987879  1750 tablet_bootstrap.cc:654] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.965412  1771 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:58:35.995710  1546 tablet_service.cc:1511] Processing CreateTablet for tablet 1242a7b5484b4cc6a066e0c93629550f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:35.996966  1547 tablet_service.cc:1511] Processing CreateTablet for tablet 746cf49ba083454e8a50cff619835a56 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:35.997201  1546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1242a7b5484b4cc6a066e0c93629550f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.998004  1547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746cf49ba083454e8a50cff619835a56. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:35.991878  1673 leader_election.cc:343] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.003049  1751 tablet_bootstrap.cc:492] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:36.003597  1751 ts_tablet_manager.cc:1403] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.177s	user 0.066s	sys 0.031s
I20260709 12:58:36.006524  1560 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:36.006661  1673 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:36.007954  1754 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.008038  1751 raft_consensus.cc:359] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.009012  1751 raft_consensus.cc:385] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.009361  1751 raft_consensus.cc:740] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
W20260709 12:58:36.009788  1673 leader_election.cc:343] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.010174  1751 consensus_queue.cc:260] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.010520  1673 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:36.011583  1754 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.012503  1617 tablet_service.cc:1511] Processing CreateTablet for tablet 1242a7b5484b4cc6a066e0c93629550f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 12:58:36.012987  1673 leader_election.cc:343] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.013846  1617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1242a7b5484b4cc6a066e0c93629550f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.013640  1673 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:36.014644  1754 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.015974  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:36.016853  1754 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.019805  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:36.020093  1771 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:36.019934  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 3426c98205bc4a609f37342176ca9b0a (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:36.018833  1751 ts_tablet_manager.cc:1434] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:58:36.021266  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:36.021235  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3426c98205bc4a609f37342176ca9b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.022094  1751 tablet_bootstrap.cc:492] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
W20260709 12:58:36.021256  1526 leader_election.cc:343] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.026319  1541 tablet_service.cc:1511] Processing CreateTablet for tablet 01ab117f13144a07986c484571fb73a2 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:36.027652  1541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ab117f13144a07986c484571fb73a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.028764  1751 tablet_bootstrap.cc:654] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.028328  1624 tablet_service.cc:1511] Processing CreateTablet for tablet 01ab117f13144a07986c484571fb73a2 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:36.028944  1756 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.029780  1624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ab117f13144a07986c484571fb73a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.029706  1756 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.034562  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:36.032841  1756 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:58:36.036911  1601 leader_election.cc:343] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.037889  1542 tablet_service.cc:1511] Processing CreateTablet for tablet 234fc17fda8e45db9455b24cfd3939f4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:36.039182  1542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 234fc17fda8e45db9455b24cfd3939f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.038833  1550 tablet_service.cc:1511] Processing CreateTablet for tablet 3426c98205bc4a609f37342176ca9b0a (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:36.040305  1550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3426c98205bc4a609f37342176ca9b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.041004  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:58:36.042562  1599 leader_election.cc:343] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.042999  1599 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:36.044171  1756 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.045840  1749 tablet_bootstrap.cc:654] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.049116  1623 tablet_service.cc:1511] Processing CreateTablet for tablet 234fc17fda8e45db9455b24cfd3939f4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:36.050508  1623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 234fc17fda8e45db9455b24cfd3939f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.060840  1754 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.074652  1544 tablet_service.cc:1511] Processing CreateTablet for tablet 48837d0ac86f4664b4bfe442411bc28f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:36.076109  1544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48837d0ac86f4664b4bfe442411bc28f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.080878  1618 tablet_service.cc:1511] Processing CreateTablet for tablet 48837d0ac86f4664b4bfe442411bc28f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:36.083963  1618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48837d0ac86f4664b4bfe442411bc28f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.084753  1756 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.088198  1548 tablet_service.cc:1511] Processing CreateTablet for tablet 7485c87933f940ec96f52fe33972ecd3 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:36.088553  1625 tablet_service.cc:1511] Processing CreateTablet for tablet bb62bfd8ccab4ff7925d27d979888b38 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:36.096765  1756 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.097424  1548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7485c87933f940ec96f52fe33972ecd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.101488  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:36.102816  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:36.103811  1756 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:58:36.071944  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 56056.2us
W20260709 12:58:36.105010  1599 leader_election.cc:343] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:36.106168  1601 leader_election.cc:343] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.106633  1754 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.107138  1754 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.107236  1691 tablet_service.cc:1511] Processing CreateTablet for tablet 52b0712953ef42ddb724cd8c29a0ec0b (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:36.107450  1696 tablet_service.cc:1511] Processing CreateTablet for tablet 1242a7b5484b4cc6a066e0c93629550f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:36.108520  1691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b0712953ef42ddb724cd8c29a0ec0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.106633  1601 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:36.109267  1754 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:36.109957  1756 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.111555  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:36.111579  1690 tablet_service.cc:1511] Processing CreateTablet for tablet 3426c98205bc4a609f37342176ca9b0a (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:36.113080  1694 tablet_service.cc:1511] Processing CreateTablet for tablet 01ab117f13144a07986c484571fb73a2 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:36.113988  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3426c98205bc4a609f37342176ca9b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.115434  1699 tablet_service.cc:1511] Processing CreateTablet for tablet 234fc17fda8e45db9455b24cfd3939f4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:36.116039  1692 tablet_service.cc:1511] Processing CreateTablet for tablet 48837d0ac86f4664b4bfe442411bc28f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:36.116719  1697 tablet_service.cc:1511] Processing CreateTablet for tablet 7485c87933f940ec96f52fe33972ecd3 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:36.117197  1699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 234fc17fda8e45db9455b24cfd3939f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.117282  1750 tablet_bootstrap.cc:492] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:36.117846  1750 ts_tablet_manager.cc:1403] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.215s	user 0.015s	sys 0.001s
I20260709 12:58:36.117924  1697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7485c87933f940ec96f52fe33972ecd3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:36.118842  1675 leader_election.cc:343] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.090296  1708 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:36.093357  1620 tablet_service.cc:1511] Processing CreateTablet for tablet 7485c87933f940ec96f52fe33972ecd3 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:36.121481  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7485c87933f940ec96f52fe33972ecd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.121255  1750 raft_consensus.cc:359] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.089892  1549 tablet_service.cc:1511] Processing CreateTablet for tablet bb62bfd8ccab4ff7925d27d979888b38 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:36.122663  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1242a7b5484b4cc6a066e0c93629550f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.122136  1750 raft_consensus.cc:385] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.124033  1750 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.124514  1549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb62bfd8ccab4ff7925d27d979888b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.124888  1750 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.128808  1625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb62bfd8ccab4ff7925d27d979888b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.132019  1750 ts_tablet_manager.cc:1434] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:58:36.133133  1750 tablet_bootstrap.cc:492] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:36.137848  1698 tablet_service.cc:1511] Processing CreateTablet for tablet bb62bfd8ccab4ff7925d27d979888b38 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:36.139355  1698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb62bfd8ccab4ff7925d27d979888b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.143692  1544 tablet_service.cc:1511] Processing CreateTablet for tablet e5f9ac80ae924622bceefdf9814aca1e (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:36.145119  1544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f9ac80ae924622bceefdf9814aca1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.145931  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:36.146719  1560 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:36.150071  1617 tablet_service.cc:1511] Processing CreateTablet for tablet e5f9ac80ae924622bceefdf9814aca1e (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:36.151311  1750 tablet_bootstrap.cc:654] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.151520  1617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f9ac80ae924622bceefdf9814aca1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.155539  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:36.156876  1771 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:36.157421  1771 raft_consensus.cc:697] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:36.158429  1543 tablet_service.cc:1511] Processing CreateTablet for tablet 327c042262d94ababf63c12c177e29ed (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:36.158366  1771 consensus_queue.cc:237] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:58:36.159873  1543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327c042262d94ababf63c12c177e29ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.166356  1619 tablet_service.cc:1511] Processing CreateTablet for tablet 327c042262d94ababf63c12c177e29ed (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:36.169687  1691 tablet_service.cc:1511] Processing CreateTablet for tablet e5f9ac80ae924622bceefdf9814aca1e (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:36.171239  1691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f9ac80ae924622bceefdf9814aca1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.202759  1696 tablet_service.cc:1511] Processing CreateTablet for tablet 327c042262d94ababf63c12c177e29ed (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:36.212761  1694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ab117f13144a07986c484571fb73a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.192608  1619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327c042262d94ababf63c12c177e29ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.215425  1547 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf16dd2ae6a404a9ae81192db51e512 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:36.216737  1547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf16dd2ae6a404a9ae81192db51e512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.223639  1622 tablet_service.cc:1511] Processing CreateTablet for tablet f4ee010e653949d581d35eb9b09d59dd (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:36.225008  1758 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:36.229911  1544 tablet_service.cc:1511] Processing CreateTablet for tablet f4ee010e653949d581d35eb9b09d59dd (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:36.225106  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4ee010e653949d581d35eb9b09d59dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.231549  1544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4ee010e653949d581d35eb9b09d59dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.242379  1758 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.243332  1758 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.248854  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:36.251151  1526 leader_election.cc:343] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.253497  1758 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:36.253614  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:58:36.255226  1526 leader_election.cc:343] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.255684  1526 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:36.256774  1758 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.270560  1751 tablet_bootstrap.cc:492] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:36.271106  1751 ts_tablet_manager.cc:1403] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.249s	user 0.016s	sys 0.031s
I20260709 12:58:36.274560  1751 raft_consensus.cc:359] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.275388  1751 raft_consensus.cc:385] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.275913  1751 raft_consensus.cc:740] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.277717  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327c042262d94ababf63c12c177e29ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.293589  1692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48837d0ac86f4664b4bfe442411bc28f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:36.311271  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:36.312538  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 81a2ecbb8bc64b12a8b6f2f3af475103 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:36.315320  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a2ecbb8bc64b12a8b6f2f3af475103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.317021  1625 tablet_service.cc:1511] Processing CreateTablet for tablet 81a2ecbb8bc64b12a8b6f2f3af475103 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:36.318684  1625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a2ecbb8bc64b12a8b6f2f3af475103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.320315  1621 tablet_service.cc:1511] Processing CreateTablet for tablet e8ceb3afda0646d2b7815d235d107857 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:36.325992  1621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ceb3afda0646d2b7815d235d107857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.324766  1543 tablet_service.cc:1511] Processing CreateTablet for tablet 57c707e7d0374c378524e43ee47284c2 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:36.327587  1543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c707e7d0374c378524e43ee47284c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.327818  1708 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.290191  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:36.311362  1624 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf16dd2ae6a404a9ae81192db51e512 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 12:58:36.329276  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 47989.5us
I20260709 12:58:36.329669  1754 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:36.330790  1624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf16dd2ae6a404a9ae81192db51e512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.361820  1623 tablet_service.cc:1511] Processing CreateTablet for tablet 32eb5ab4f2154adb88f8148264914ee9 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:36.363158  1623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32eb5ab4f2154adb88f8148264914ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.329852  1550 tablet_service.cc:1511] Processing CreateTablet for tablet e8ceb3afda0646d2b7815d235d107857 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:36.364398  1693 tablet_service.cc:1511] Processing CreateTablet for tablet e8ceb3afda0646d2b7815d235d107857 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:36.365420  1550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ceb3afda0646d2b7815d235d107857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.365123  1695 tablet_service.cc:1511] Processing CreateTablet for tablet 81a2ecbb8bc64b12a8b6f2f3af475103 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:36.365942  1693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ceb3afda0646d2b7815d235d107857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.366648  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a2ecbb8bc64b12a8b6f2f3af475103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.337549  1758 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:58:36.290426  1751 consensus_queue.cc:260] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.352234  1541 tablet_service.cc:1511] Processing CreateTablet for tablet 32eb5ab4f2154adb88f8148264914ee9 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:36.370289  1541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32eb5ab4f2154adb88f8148264914ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.340447  1616 tablet_service.cc:1511] Processing CreateTablet for tablet 57c707e7d0374c378524e43ee47284c2 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:36.345129  1549 tablet_service.cc:1511] Processing CreateTablet for tablet 076fd1ae95e4457d8361a9b4c963b26f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:36.372836  1771 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.373442  1549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076fd1ae95e4457d8361a9b4c963b26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.373323  1771 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.375808  1691 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf16dd2ae6a404a9ae81192db51e512 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:36.348289  1618 tablet_service.cc:1511] Processing CreateTablet for tablet 076fd1ae95e4457d8361a9b4c963b26f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:36.357285  1754 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.381251  1696 tablet_service.cc:1511] Processing CreateTablet for tablet f4ee010e653949d581d35eb9b09d59dd (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:36.373442  1616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c707e7d0374c378524e43ee47284c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.376940  1749 tablet_bootstrap.cc:492] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:36.390654  1691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf16dd2ae6a404a9ae81192db51e512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.392987  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4ee010e653949d581d35eb9b09d59dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.382609  1754 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.412842  1618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076fd1ae95e4457d8361a9b4c963b26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.415354  1750 tablet_bootstrap.cc:492] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:36.416177  1750 ts_tablet_manager.cc:1403] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.283s	user 0.014s	sys 0.010s
I20260709 12:58:36.395669  1749 ts_tablet_manager.cc:1403] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.450s	user 0.013s	sys 0.020s
I20260709 12:58:36.422731  1750 raft_consensus.cc:359] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.423898  1750 raft_consensus.cc:385] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.423648  1749 raft_consensus.cc:359] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.424103  1545 tablet_service.cc:1511] Processing CreateTablet for tablet a6272972864842479d82e86cc14f8ff4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:36.424777  1749 raft_consensus.cc:385] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.425293  1749 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.426605  1749 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.434348  1749 ts_tablet_manager.cc:1434] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:58:36.435318  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6272972864842479d82e86cc14f8ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.436151  1749 tablet_bootstrap.cc:492] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:36.438314  1694 tablet_service.cc:1511] Processing CreateTablet for tablet 57c707e7d0374c378524e43ee47284c2 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:36.439776  1694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c707e7d0374c378524e43ee47284c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.442319  1771 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:36.446834  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:36.440021  1754 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.463999  1697 tablet_service.cc:1511] Processing CreateTablet for tablet 076fd1ae95e4457d8361a9b4c963b26f (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:36.450866  1750 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
W20260709 12:58:36.465095  1526 leader_election.cc:343] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.494534  1622 tablet_service.cc:1511] Processing CreateTablet for tablet a6272972864842479d82e86cc14f8ff4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:36.495633  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6272972864842479d82e86cc14f8ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.517819  1750 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.519793  1754 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:36.521155  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:36.521580  1750 ts_tablet_manager.cc:1434] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.105s	user 0.004s	sys 0.004s
W20260709 12:58:36.523037  1675 leader_election.cc:343] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.526010  1546 tablet_service.cc:1511] Processing CreateTablet for tablet a5e08456c7bb4b07bedf36cb9587b6b4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:36.527242  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 15bc2b03c4ec4de282e245ab3015bfd6 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:36.527818  1546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e08456c7bb4b07bedf36cb9587b6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.528550  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15bc2b03c4ec4de282e245ab3015bfd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.534301  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:36.535696  1695 tablet_service.cc:1511] Processing CreateTablet for tablet 32eb5ab4f2154adb88f8148264914ee9 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:36.536962  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32eb5ab4f2154adb88f8148264914ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.540005  1697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076fd1ae95e4457d8361a9b4c963b26f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:36.541564  1526 leader_election.cc:343] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.542124  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:36.543721  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:36.544387  1560 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.545805  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 15bc2b03c4ec4de282e245ab3015bfd6 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:36.553435  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15bc2b03c4ec4de282e245ab3015bfd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.553622  1542 tablet_service.cc:1511] Processing CreateTablet for tablet a4ce544917f545499da64014539a4ff2 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:36.554936  1756 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.559103  1696 tablet_service.cc:1511] Processing CreateTablet for tablet a6272972864842479d82e86cc14f8ff4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:36.561861  1698 tablet_service.cc:1511] Processing CreateTablet for tablet a5e08456c7bb4b07bedf36cb9587b6b4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:36.563151  1756 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.565526  1756 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:36.567257  1786 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.568348  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:58:36.570483  1599 leader_election.cc:343] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.573899  1549 tablet_service.cc:1511] Processing CreateTablet for tablet 78990af8f5ef4464b9e3bbb9749e7337 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:36.576929  1542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ce544917f545499da64014539a4ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.577637  1560 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:36.581280  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:36.581578  1620 tablet_service.cc:1511] Processing CreateTablet for tablet a5e08456c7bb4b07bedf36cb9587b6b4 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:36.582499  1754 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:36.583004  1754 raft_consensus.cc:697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:36.583693  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e08456c7bb4b07bedf36cb9587b6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.583813  1754 consensus_queue.cc:237] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.589576  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:36.589861  1699 tablet_service.cc:1511] Processing CreateTablet for tablet 15bc2b03c4ec4de282e245ab3015bfd6 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:36.590265  1708 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:36.591483  1601 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:36.593430  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6272972864842479d82e86cc14f8ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.596490  1756 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:36.596939  1756 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.597308  1756 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.598881  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 78990af8f5ef4464b9e3bbb9749e7337 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:36.601552  1623 tablet_service.cc:1511] Processing CreateTablet for tablet a4ce544917f545499da64014539a4ff2 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:36.602890  1623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ce544917f545499da64014539a4ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.605406  1756 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.596441  1549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78990af8f5ef4464b9e3bbb9749e7337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.608819  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78990af8f5ef4464b9e3bbb9749e7337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.610253  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:36.611361  1750 tablet_bootstrap.cc:492] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
W20260709 12:58:36.611594  1599 leader_election.cc:343] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.616158  1690 tablet_service.cc:1511] Processing CreateTablet for tablet a4ce544917f545499da64014539a4ff2 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:36.632042  1698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e08456c7bb4b07bedf36cb9587b6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.637409  1749 tablet_bootstrap.cc:654] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.639154  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:36.639770  1708 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.641073  1751 ts_tablet_manager.cc:1434] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.370s	user 0.037s	sys 0.045s
I20260709 12:58:36.642140  1751 tablet_bootstrap.cc:492] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:36.647274  1708 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:36.646883  1693 tablet_service.cc:1511] Processing CreateTablet for tablet 78990af8f5ef4464b9e3bbb9749e7337 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:36.646898  1619 tablet_service.cc:1511] Processing CreateTablet for tablet 627d40025a324704a4ae94c9ed8c404c (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:36.648424  1693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78990af8f5ef4464b9e3bbb9749e7337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.649050  1619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 627d40025a324704a4ae94c9ed8c404c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.637427  1756 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:36.653319  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ce544917f545499da64014539a4ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.653537  1601 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:36.640053  1548 tablet_service.cc:1511] Processing CreateTablet for tablet 627d40025a324704a4ae94c9ed8c404c (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:36.656441  1756 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:36.656945  1548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 627d40025a324704a4ae94c9ed8c404c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.657362  1695 tablet_service.cc:1511] Processing CreateTablet for tablet 627d40025a324704a4ae94c9ed8c404c (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:36.660720  1699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15bc2b03c4ec4de282e245ab3015bfd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.670307  1750 tablet_bootstrap.cc:654] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.671566  1544 tablet_service.cc:1511] Processing CreateTablet for tablet 1702e80023fd4939b4565d5f3dde73c2 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:36.673724  1544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1702e80023fd4939b4565d5f3dde73c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.676949  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 627d40025a324704a4ae94c9ed8c404c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.672281  1751 tablet_bootstrap.cc:654] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.722458  1786 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:36.731462  1620 tablet_service.cc:1511] Processing CreateTablet for tablet 1702e80023fd4939b4565d5f3dde73c2 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:36.733093  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1702e80023fd4939b4565d5f3dde73c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.744266  1756 raft_consensus.cc:697] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:36.767850  1749 tablet_bootstrap.cc:492] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
W20260709 12:58:36.777352  1526 consensus_peers.cc:597] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:36.777737  1690 tablet_service.cc:1511] Processing CreateTablet for tablet 1702e80023fd4939b4565d5f3dde73c2 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:36.778903  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1702e80023fd4939b4565d5f3dde73c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.790272  1749 ts_tablet_manager.cc:1403] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.354s	user 0.034s	sys 0.042s
I20260709 12:58:36.803159  1623 tablet_service.cc:1511] Processing CreateTablet for tablet c6bbedfd642f4fde92dc31fa176c6582 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:36.803692  1546 tablet_service.cc:1511] Processing CreateTablet for tablet c6bbedfd642f4fde92dc31fa176c6582 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:36.805537  1749 raft_consensus.cc:359] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.806154  1749 raft_consensus.cc:385] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.806417  1546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bbedfd642f4fde92dc31fa176c6582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.806353  1749 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.801584  1697 tablet_service.cc:1511] Processing CreateTablet for tablet c6bbedfd642f4fde92dc31fa176c6582 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:36.807490  1697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bbedfd642f4fde92dc31fa176c6582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.804840  1619 tablet_service.cc:1511] Processing CreateTablet for tablet 01dee5ecdb2748fb89b7b02c8a346cb1 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:36.796868  1756 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.787462  1457 catalog_manager.cc:5697] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:36.820924  1749 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.812904  1549 tablet_service.cc:1511] Processing CreateTablet for tablet 01dee5ecdb2748fb89b7b02c8a346cb1 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:36.813756  1750 tablet_bootstrap.cc:492] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:36.823876  1750 ts_tablet_manager.cc:1403] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.213s	user 0.012s	sys 0.015s
I20260709 12:58:36.824239  1549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01dee5ecdb2748fb89b7b02c8a346cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.824398  1749 ts_tablet_manager.cc:1434] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:58:36.825848  1749 tablet_bootstrap.cc:492] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:36.827159  1750 raft_consensus.cc:359] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.827931  1750 raft_consensus.cc:385] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.827669  1698 tablet_service.cc:1511] Processing CreateTablet for tablet 01dee5ecdb2748fb89b7b02c8a346cb1 (DEFAULT_TABLE table=test-workload [id=42382d5664d647d6af9c2fb7f701ad97]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:36.828307  1750 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.829552  1698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01dee5ecdb2748fb89b7b02c8a346cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.829406  1750 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.831975  1750 ts_tablet_manager.cc:1434] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 12:58:36.832921  1750 tablet_bootstrap.cc:492] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:36.817304  1623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bbedfd642f4fde92dc31fa176c6582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.835619  1619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01dee5ecdb2748fb89b7b02c8a346cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.853999  1796 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.854967  1750 tablet_bootstrap.cc:654] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.854707  1796 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.859690  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:58:36.861239  1599 leader_election.cc:343] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.863315  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:36.863958  1708 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:36.867774  1458 catalog_manager.cc:5697] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:36.871598  1601 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:36.873013  1796 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:36.876868  1756 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:36.877321  1756 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.877893  1756 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.881738  1749 tablet_bootstrap.cc:654] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.884061  1756 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.894759  1751 tablet_bootstrap.cc:492] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:36.894822  1750 tablet_bootstrap.cc:492] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:36.895336  1751 ts_tablet_manager.cc:1403] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.253s	user 0.020s	sys 0.033s
I20260709 12:58:36.895390  1750 ts_tablet_manager.cc:1403] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.007s
I20260709 12:58:36.898058  1750 raft_consensus.cc:359] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.898762  1750 raft_consensus.cc:385] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.899101  1750 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.899539  1751 raft_consensus.cc:359] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.899816  1750 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.900393  1751 raft_consensus.cc:385] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.900779  1751 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.901574  1751 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.902024  1750 ts_tablet_manager.cc:1434] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:36.903258  1750 tablet_bootstrap.cc:492] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:36.905804  1749 tablet_bootstrap.cc:492] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:36.906376  1749 ts_tablet_manager.cc:1403] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.004s
I20260709 12:58:36.907891  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:36.908531  1560 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.909487  1750 tablet_bootstrap.cc:654] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.909915  1749 raft_consensus.cc:359] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:58:36.911088  1749 raft_consensus.cc:385] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.911370  1749 raft_consensus.cc:740] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.912058  1749 consensus_queue.cc:260] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:58:36.913353  1456 catalog_manager.cc:5697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:36.916364  1751 ts_tablet_manager.cc:1434] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.005s
I20260709 12:58:36.917069  1560 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:36.917460  1751 tablet_bootstrap.cc:492] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:36.918148  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:36.918268  1599 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:36.918726  1708 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.919144  1796 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:36.915020  1756 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:36.930171  1749 ts_tablet_manager.cc:1434] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:58:36.931416  1749 tablet_bootstrap.cc:492] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:36.933791  1708 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:36.936420  1796 raft_consensus.cc:697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:36.937438  1796 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.950042  1749 tablet_bootstrap.cc:654] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.956869  1751 tablet_bootstrap.cc:654] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.961489  1754 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.962286  1754 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.966632  1754 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:36.966847  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:36.969754  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:36.971935  1675 leader_election.cc:343] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:36.973421  1673 leader_election.cc:343] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.974033  1673 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:36.975795  1754 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.984460  1750 tablet_bootstrap.cc:492] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:36.985064  1750 ts_tablet_manager.cc:1403] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.082s	user 0.030s	sys 0.018s
I20260709 12:58:36.985826  1749 tablet_bootstrap.cc:492] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:36.986524  1749 ts_tablet_manager.cc:1403] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.005s
I20260709 12:58:36.988469  1750 raft_consensus.cc:359] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.989236  1750 raft_consensus.cc:385] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.989537  1750 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.990036  1749 raft_consensus.cc:359] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.990406  1750 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.990876  1749 raft_consensus.cc:385] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.991297  1749 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.992523  1750 ts_tablet_manager.cc:1434] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:36.992177  1749 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:36.993503  1750 tablet_bootstrap.cc:492] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:36.995184  1749 ts_tablet_manager.cc:1434] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:36.996249  1749 tablet_bootstrap.cc:492] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:37.000370  1750 tablet_bootstrap.cc:654] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.001124  1457 catalog_manager.cc:5697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:37.004009  1749 tablet_bootstrap.cc:654] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.017585  1751 tablet_bootstrap.cc:492] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:37.018090  1751 ts_tablet_manager.cc:1403] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.033s
I20260709 12:58:37.020968  1751 raft_consensus.cc:359] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.021715  1751 raft_consensus.cc:385] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.024821  1751 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
W20260709 12:58:37.025674  1675 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:37.025679  1751 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.028339  1751 ts_tablet_manager.cc:1434] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:58:37.028789  1750 tablet_bootstrap.cc:492] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:37.029377  1750 ts_tablet_manager.cc:1403] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.036s	user 0.022s	sys 0.007s
I20260709 12:58:37.029395  1751 tablet_bootstrap.cc:492] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:37.033542  1750 raft_consensus.cc:359] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.034492  1750 raft_consensus.cc:385] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.034855  1750 raft_consensus.cc:740] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.035982  1750 consensus_queue.cc:260] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.037730  1751 tablet_bootstrap.cc:654] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.043735  1750 ts_tablet_manager.cc:1434] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:58:37.045418  1750 tablet_bootstrap.cc:492] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:37.049486  1751 tablet_bootstrap.cc:492] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:37.050032  1751 ts_tablet_manager.cc:1403] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:58:37.050649  1754 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:37.053184  1751 raft_consensus.cc:359] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.053555  1750 tablet_bootstrap.cc:654] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.053870  1751 raft_consensus.cc:385] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.054165  1751 raft_consensus.cc:740] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.054934  1751 consensus_queue.cc:260] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.057232  1751 ts_tablet_manager.cc:1434] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:37.058159  1751 tablet_bootstrap.cc:492] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:37.063872  1751 tablet_bootstrap.cc:654] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.070220  1750 tablet_bootstrap.cc:492] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:37.070894  1750 ts_tablet_manager.cc:1403] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.008s
I20260709 12:58:37.072997  1751 tablet_bootstrap.cc:492] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:37.073555  1751 ts_tablet_manager.cc:1403] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 12:58:37.076814  1751 raft_consensus.cc:359] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.077571  1751 raft_consensus.cc:385] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.078207  1751 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.082155  1750 raft_consensus.cc:359] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.083047  1750 raft_consensus.cc:385] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.083658  1750 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.084730  1750 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.078948  1751 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.087759  1751 ts_tablet_manager.cc:1434] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:58:37.088706  1751 tablet_bootstrap.cc:492] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:37.092191  1750 ts_tablet_manager.cc:1434] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:58:37.093663  1750 tablet_bootstrap.cc:492] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:37.100526  1751 tablet_bootstrap.cc:654] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.102869  1750 tablet_bootstrap.cc:654] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.113121  1751 tablet_bootstrap.cc:492] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:37.113590  1751 ts_tablet_manager.cc:1403] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.025s	user 0.003s	sys 0.013s
I20260709 12:58:37.116359  1750 tablet_bootstrap.cc:492] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:37.117055  1750 ts_tablet_manager.cc:1403] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.007s
I20260709 12:58:37.116209  1751 raft_consensus.cc:359] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.120124  1751 raft_consensus.cc:385] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.120427  1751 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.121106  1750 raft_consensus.cc:359] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.121284  1751 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.122110  1750 raft_consensus.cc:385] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.122515  1750 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.123935  1751 ts_tablet_manager.cc:1434] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:58:37.123720  1750 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.124928  1751 tablet_bootstrap.cc:492] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:37.130962  1751 tablet_bootstrap.cc:654] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.131359  1750 ts_tablet_manager.cc:1434] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 12:58:37.132649  1750 tablet_bootstrap.cc:492] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:37.137457  1758 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.138048  1758 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.140367  1758 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:37.142647  1750 tablet_bootstrap.cc:654] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.143558  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:37.144263  1708 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:37.143576  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:37.146587  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 12:58:37.147683  1526 leader_election.cc:343] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.149052  1751 tablet_bootstrap.cc:492] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:37.149145  1758 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.149627  1751 ts_tablet_manager.cc:1403] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.010s
I20260709 12:58:37.149585  1758 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.149706  1750 tablet_bootstrap.cc:492] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:37.150095  1758 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.150753  1750 ts_tablet_manager.cc:1403] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:58:37.154295  1749 tablet_bootstrap.cc:492] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:37.154765  1749 ts_tablet_manager.cc:1403] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.159s	user 0.062s	sys 0.068s
I20260709 12:58:37.154521  1751 raft_consensus.cc:359] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.155162  1751 raft_consensus.cc:385] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.155441  1751 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.156037  1751 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.156821  1750 raft_consensus.cc:359] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.157459  1750 raft_consensus.cc:385] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.157999  1750 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.158856  1751 ts_tablet_manager.cc:1434] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:58:37.158077  1749 raft_consensus.cc:359] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.159617  1749 raft_consensus.cc:385] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.158900  1750 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.160033  1749 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.160140  1751 tablet_bootstrap.cc:492] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:37.161454  1750 ts_tablet_manager.cc:1434] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:58:37.161265  1749 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.162312  1750 tablet_bootstrap.cc:492] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:37.163625  1749 ts_tablet_manager.cc:1434] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:58:37.166801  1749 tablet_bootstrap.cc:492] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:37.169133  1750 tablet_bootstrap.cc:654] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.173023  1749 tablet_bootstrap.cc:654] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.168438  1758 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.176081  1758 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:37.177884  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:37.178728  1708 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.180517  1751 tablet_bootstrap.cc:654] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.182051  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 12:58:37.184258  1526 leader_election.cc:343] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.188302  1750 tablet_bootstrap.cc:492] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:37.188803  1750 ts_tablet_manager.cc:1403] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.014s
I20260709 12:58:37.192303  1708 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:37.192065  1750 raft_consensus.cc:359] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.193065  1750 raft_consensus.cc:385] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.193372  1750 raft_consensus.cc:740] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.193960  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:37.194063  1750 consensus_queue.cc:260] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.194860  1758 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.195272  1758 raft_consensus.cc:697] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:37.195637  1749 tablet_bootstrap.cc:492] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:37.196069  1749 ts_tablet_manager.cc:1403] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.002s
I20260709 12:58:37.196049  1758 consensus_queue.cc:237] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.196432  1750 ts_tablet_manager.cc:1434] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:58:37.198560  1750 tablet_bootstrap.cc:492] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:37.199187  1749 raft_consensus.cc:359] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.199841  1749 raft_consensus.cc:385] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.200129  1749 raft_consensus.cc:740] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.200920  1749 consensus_queue.cc:260] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.203999  1751 tablet_bootstrap.cc:492] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:37.206447  1751 ts_tablet_manager.cc:1403] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.003s
I20260709 12:58:37.207491  1750 tablet_bootstrap.cc:654] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.207607  1749 ts_tablet_manager.cc:1434] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 12:58:37.209293  1749 tablet_bootstrap.cc:492] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:37.212034  1751 raft_consensus.cc:359] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.217569  1751 raft_consensus.cc:385] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.215932  1796 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.218050  1751 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.218456  1796 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:58:37.219406  1751 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.221125  1796 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:58:37.222448  1751 ts_tablet_manager.cc:1434] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:58:37.222395  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:37.216028  1749 tablet_bootstrap.cc:654] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.223875  1751 tablet_bootstrap.cc:492] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:37.224351  1750 tablet_bootstrap.cc:492] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:37.224812  1750 ts_tablet_manager.cc:1403] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.004s
I20260709 12:58:37.226578  1815 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.227078  1815 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.228340  1750 raft_consensus.cc:359] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.229230  1750 raft_consensus.cc:385] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.229540  1750 raft_consensus.cc:740] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.222059  1455 catalog_manager.cc:5697] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:37.230448  1815 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:37.230571  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:37.231365  1560 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:37.231397  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:37.231513  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:37.232299  1751 tablet_bootstrap.cc:654] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.232748  1673 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:37.232795  1634 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:37.234951  1815 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.234654  1601 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:37.235355  1815 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.235759  1815 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.237519  1796 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:37.243443  1634 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.245613  1815 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.249063  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:37.249697  1560 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.256835  1750 consensus_queue.cc:260] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.258105  1751 tablet_bootstrap.cc:492] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:37.258702  1751 ts_tablet_manager.cc:1403] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.009s
I20260709 12:58:37.259960  1560 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:37.261569  1673 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:37.261771  1751 raft_consensus.cc:359] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.262673  1751 raft_consensus.cc:385] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.263000  1751 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.264787  1751 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.267031  1749 tablet_bootstrap.cc:492] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:37.267437  1754 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.267582  1788 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.268038  1788 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.270714  1788 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:37.272171  1559 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.273078  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:37.276448  1750 ts_tablet_manager.cc:1434] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:58:37.277673  1750 tablet_bootstrap.cc:492] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
W20260709 12:58:37.281819  1675 leader_election.cc:343] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.267575  1749 ts_tablet_manager.cc:1403] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.026s
I20260709 12:58:37.284374  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:37.285081  1632 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.288357  1796 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.287835  1749 raft_consensus.cc:359] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.289112  1749 raft_consensus.cc:385] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.289526  1749 raft_consensus.cc:740] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.290498  1749 consensus_queue.cc:260] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.288939  1796 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.296038  1749 ts_tablet_manager.cc:1434] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:58:37.296430  1796 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:37.297430  1749 tablet_bootstrap.cc:492] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:37.297757  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:37.298287  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:37.298507  1708 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:37.298959  1560 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:37.300195  1673 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:37.301187  1751 ts_tablet_manager.cc:1434] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:58:37.301743  1788 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.302856  1751 tablet_bootstrap.cc:492] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:37.302271  1788 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.303467  1754 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:37.303936  1788 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.304419  1754 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.305030  1750 tablet_bootstrap.cc:654] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.305549  1632 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:37.294014  1815 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:37.300217  1796 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:58:37.307466  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:37.309090  1559 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
W20260709 12:58:37.323577  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:37.300199  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:37.340392  1796 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.342527  1796 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.343029  1796 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.351308  1804 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:37.351557  1455 catalog_manager.cc:5697] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:37.354113  1796 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.356339  1796 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:37.357577  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:37.358349  1559 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.360473  1788 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.363363  1788 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:37.364066  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:37.364655  1758 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.365487  1709 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.365435  1758 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.366886  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:37.367779  1558 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.377874  1758 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:37.379880  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:37.380873  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:37.382036  1559 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:37.382036  1707 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:37.384464  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:37.385355  1675 leader_election.cc:343] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.385211  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 12:58:37.386535  1526 leader_election.cc:343] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.387845  1758 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.388325  1758 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.388765  1758 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.375635  1709 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:37.391927  1788 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.394454  1599 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:37.397058  1796 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.397552  1796 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:37.398401  1796 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.402498  1558 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:37.402635  1758 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.403620  1673 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:37.404932  1788 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.405705  1754 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.406225  1754 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:37.406445  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:37.407343  1788 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:37.407171  1754 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.408993  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:37.410231  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:37.411304  1632 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:37.411566  1751 tablet_bootstrap.cc:654] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.413540  1675 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:37.416429  1750 tablet_bootstrap.cc:492] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:37.417119  1750 ts_tablet_manager.cc:1403] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.140s	user 0.009s	sys 0.007s
I20260709 12:58:37.415460  1788 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.422200  1756 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.422892  1756 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.426827  1804 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:37.429410  1756 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:58:37.417712  1526 leader_election.cc:343] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:37.432340  1673 leader_election.cc:343] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.436306  1750 raft_consensus.cc:359] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.437572  1750 raft_consensus.cc:385] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.438060  1750 raft_consensus.cc:740] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.441761  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:37.441351  1750 consensus_queue.cc:260] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.432801  1788 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.450791  1788 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.456662  1749 tablet_bootstrap.cc:654] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.462075  1750 ts_tablet_manager.cc:1434] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.045s	user 0.010s	sys 0.000s
I20260709 12:58:37.442857  1560 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:37.464865  1599 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:37.466132  1756 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.466681  1756 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.467147  1756 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.476545  1632 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.482434  1788 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.487042  1750 tablet_bootstrap.cc:492] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:37.475255  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:37.485234  1758 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:37.485492  1804 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:58:37.504372  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:37.505151  1709 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.495810  1708 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:37.509212  1754 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.518715  1749 tablet_bootstrap.cc:492] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:37.519219  1749 ts_tablet_manager.cc:1403] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.222s	user 0.019s	sys 0.008s
I20260709 12:58:37.518854  1754 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.521762  1754 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:37.528371  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:37.531147  1749 raft_consensus.cc:359] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.555706  1749 raft_consensus.cc:385] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.531888  1454 catalog_manager.cc:5697] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:37.561460  1750 tablet_bootstrap.cc:654] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:37.546258  1673 leader_election.cc:343] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.527248  1788 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:37.567073  1788 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.567574  1788 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.556679  1749 raft_consensus.cc:740] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.540997  1758 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.569049  1758 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.569186  1749 consensus_queue.cc:260] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:37.531026  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47087.1us
I20260709 12:58:37.572228  1749 ts_tablet_manager.cc:1434] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.053s	user 0.017s	sys 0.012s
I20260709 12:58:37.559010  1709 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:37.573222  1749 tablet_bootstrap.cc:492] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:37.545709  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:37.573719  1558 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:37.609866  1673 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:37.618594  1788 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:37.619088  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:37.617376  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:37.622342  1788 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.622941  1788 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.622989  1633 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.624747  1758 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:37.630560  1751 tablet_bootstrap.cc:492] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:37.631587  1751 ts_tablet_manager.cc:1403] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.329s	user 0.014s	sys 0.019s
I20260709 12:58:37.623167  1756 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.634864  1756 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:37.635943  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:37.636626  1558 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.638017  1749 tablet_bootstrap.cc:654] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.623483  1788 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.613379  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:58:37.643186  1675 leader_election.cc:343] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.633610  1455 catalog_manager.cc:5697] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:37.644528  1758 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.644773  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:37.645767  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:37.656724  1634 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:37.661684  1750 tablet_bootstrap.cc:492] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:37.662446  1750 ts_tablet_manager.cc:1403] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.176s	user 0.014s	sys 0.001s
I20260709 12:58:37.659008  1758 raft_consensus.cc:697] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:37.653193  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:37.663553  1707 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.654289  1754 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.670044  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:37.668747  1635 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:37.671311  1754 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.672411  1706 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:37.672796  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:37.673820  1754 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:37.674441  1754 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.675252  1754 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.675637  1754 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.675755  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:37.676744  1632 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:37.665800  1758 consensus_queue.cc:237] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.692333  1788 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.693400  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:37.694435  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:37.695240  1771 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.696170  1749 tablet_bootstrap.cc:492] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:37.696671  1749 ts_tablet_manager.cc:1403] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.124s	user 0.020s	sys 0.013s
I20260709 12:58:37.696545  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:37.695631  1771 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.698407  1771 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.700083  1749 raft_consensus.cc:359] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.701749  1749 raft_consensus.cc:385] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.702137  1749 raft_consensus.cc:740] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.703003  1749 consensus_queue.cc:260] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.704909  1788 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:37.706883  1749 ts_tablet_manager.cc:1434] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:58:37.707988  1749 tablet_bootstrap.cc:492] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:37.710136  1750 raft_consensus.cc:359] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.712373  1750 raft_consensus.cc:385] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.712780  1750 raft_consensus.cc:740] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.713006  1758 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:37.707978  1675 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:37.714164  1788 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.714035  1750 consensus_queue.cc:260] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.714565  1788 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.715620  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:37.717540  1750 ts_tablet_manager.cc:1434] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 12:58:37.718576  1750 tablet_bootstrap.cc:492] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
W20260709 12:58:37.719419  1675 leader_election.cc:343] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:37.725911  1673 leader_election.cc:343] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.727407  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:37.723483  1751 raft_consensus.cc:359] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.728659  1751 raft_consensus.cc:385] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.715734  1788 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.728961  1559 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.729478  1829 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:37.728976  1751 raft_consensus.cc:740] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.732007  1751 consensus_queue.cc:260] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.733848  1633 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:37.737888  1771 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.738080  1675 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:37.739521  1751 ts_tablet_manager.cc:1434] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.107s	user 0.006s	sys 0.000s
I20260709 12:58:37.742137  1557 raft_consensus.cc:2393] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:37.742787  1829 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.743016  1751 tablet_bootstrap.cc:492] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:37.748706  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:37.749586  1633 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.749233  1458 catalog_manager.cc:5697] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:37.753886  1754 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.756062  1754 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:37.757470  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:37.758181  1635 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.760063  1771 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:37.762447  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:37.762491  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 12:58:37.763823  1842 log.cc:927] Time spent T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:58:37.763567  1788 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.763628  1707 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:37.765069  1706 raft_consensus.cc:2393] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 1: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:58:37.768827  1601 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:37.749233  1558 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:37.772183  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:37.769229  1788 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:37.775732  1756 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.776367  1756 raft_consensus.cc:697] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:37.777493  1749 tablet_bootstrap.cc:654] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.778471  1756 consensus_queue.cc:237] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:37.782317  1673 leader_election.cc:343] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.789605  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:37.790733  1558 raft_consensus.cc:2393] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:37.795423  1559 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:37.797861  1635 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:37.801072  1633 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:37.801488  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:37.803193  1815 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.803889  1815 raft_consensus.cc:697] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:37.804847  1751 tablet_bootstrap.cc:654] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.806152  1829 raft_consensus.cc:697] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:37.807054  1673 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:37.807160  1829 consensus_queue.cc:237] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.807507  1771 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.808137  1771 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.808306  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:58:37.808419  1673 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:37.809585  1754 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:37.810672  1754 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.810992  1771 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:37.811157  1754 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:37.805029  1815 consensus_queue.cc:237] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.813457  1758 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.812114  1754 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.814137  1758 raft_consensus.cc:697] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:37.815660  1758 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.832536  1788 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.833330  1788 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.865412  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:37.870927  1458 catalog_manager.cc:5697] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:37.874980  1751 tablet_bootstrap.cc:492] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:37.875685  1751 ts_tablet_manager.cc:1403] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.133s	user 0.020s	sys 0.027s
I20260709 12:58:37.879518  1788 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:37.883960  1635 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.885005  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:37.885900  1709 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:37.892221  1751 raft_consensus.cc:359] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.893276  1751 raft_consensus.cc:385] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.893632  1751 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.894407  1749 tablet_bootstrap.cc:492] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:37.895022  1749 ts_tablet_manager.cc:1403] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.187s	user 0.031s	sys 0.019s
I20260709 12:58:37.895938  1751 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.884019  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:37.900270  1788 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:37.900794  1675 leader_election.cc:343] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.901710  1750 tablet_bootstrap.cc:654] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.908322  1751 ts_tablet_manager.cc:1434] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:58:37.909359  1751 tablet_bootstrap.cc:492] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:37.909348  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:37.911758  1756 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:37.917459  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:37.924835  1771 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.925271  1771 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.925601  1771 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.925524  1749 raft_consensus.cc:359] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.926359  1749 raft_consensus.cc:385] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.926635  1749 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.927289  1749 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:37.933486  1526 leader_election.cc:343] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.939446  1458 catalog_manager.cc:5697] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:37.950402  1673 leader_election.cc:343] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.950906  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:37.957477  1749 ts_tablet_manager.cc:1434] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.062s	user 0.014s	sys 0.005s
I20260709 12:58:37.958791  1749 tablet_bootstrap.cc:492] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:37.956373  1771 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:37.964313  1751 tablet_bootstrap.cc:654] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.979724  1771 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:58:37.981200  1675 consensus_peers.cc:597] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:37.959440  1815 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:37.982899  1455 catalog_manager.cc:5697] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:37.988912  1458 catalog_manager.cc:5697] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:37.986621  1455 catalog_manager.cc:5697] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:37.992703  1750 tablet_bootstrap.cc:492] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:37.994040  1756 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:37.996973  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:37.995435  1750 ts_tablet_manager.cc:1403] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.277s	user 0.023s	sys 0.007s
I20260709 12:58:38.000859  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:38.001478  1709 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.002642  1750 raft_consensus.cc:359] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.003331  1750 raft_consensus.cc:385] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.003598  1750 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.008755  1749 tablet_bootstrap.cc:654] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.010522  1750 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.012557  1750 ts_tablet_manager.cc:1434] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:58:38.013522  1750 tablet_bootstrap.cc:492] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:38.019472  1862 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:58:38.023586  1526 leader_election.cc:343] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.032296  1709 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:38.035972  1751 tablet_bootstrap.cc:492] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:38.036686  1751 ts_tablet_manager.cc:1403] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.128s	user 0.024s	sys 0.020s
I20260709 12:58:38.042249  1751 raft_consensus.cc:359] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.043162  1751 raft_consensus.cc:385] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.043642  1751 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.044548  1751 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.046936  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:38.049202  1751 ts_tablet_manager.cc:1434] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:58:38.050845  1751 tablet_bootstrap.cc:492] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:38.053242  1862 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.054912  1862 raft_consensus.cc:697] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:38.055083  1754 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.055840  1862 consensus_queue.cc:237] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.060559  1750 tablet_bootstrap.cc:654] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.071398  1862 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.086403  1749 tablet_bootstrap.cc:492] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:38.086880  1749 ts_tablet_manager.cc:1403] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.128s	user 0.022s	sys 0.004s
I20260709 12:58:38.076361  1839 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.080714  1862 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.089485  1839 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.103696  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:38.104979  1558 raft_consensus.cc:2393] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 1: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:58:38.104558  1749 raft_consensus.cc:359] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.105546  1749 raft_consensus.cc:385] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.105916  1749 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.108062  1749 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.106747  1839 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:38.113171  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:38.115561  1601 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:38.117553  1839 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.123265  1749 ts_tablet_manager.cc:1434] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 12:58:38.124348  1749 tablet_bootstrap.cc:492] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:38.128289  1751 tablet_bootstrap.cc:654] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.131510  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:38.133832  1526 leader_election.cc:343] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.138127  1862 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:38.140058  1839 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.143210  1750 tablet_bootstrap.cc:492] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:38.143846  1750 ts_tablet_manager.cc:1403] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.131s	user 0.020s	sys 0.013s
I20260709 12:58:38.141932  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:38.145489  1706 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:38.147210  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:38.150516  1749 tablet_bootstrap.cc:654] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.150490  1750 raft_consensus.cc:359] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.151803  1750 raft_consensus.cc:385] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.152127  1750 raft_consensus.cc:740] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.153100  1751 tablet_bootstrap.cc:492] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:38.152940  1862 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.152987  1750 consensus_queue.cc:260] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.153772  1862 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.154201  1862 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.155750  1750 ts_tablet_manager.cc:1434] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:58:38.156826  1750 tablet_bootstrap.cc:492] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:38.161736  1862 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.153779  1751 ts_tablet_manager.cc:1403] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.008s
I20260709 12:58:38.166846  1839 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.167528  1839 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.169914  1839 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:38.170200  1750 tablet_bootstrap.cc:654] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.167452  1751 raft_consensus.cc:359] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.174808  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:38.175140  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:38.176699  1754 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.177445  1754 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.178318  1862 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:38.173444  1751 raft_consensus.cc:385] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.179062  1751 raft_consensus.cc:740] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.179491  1754 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:38.179756  1751 consensus_queue.cc:260] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.181885  1751 ts_tablet_manager.cc:1434] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:58:38.182818  1751 tablet_bootstrap.cc:492] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:38.182726  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:38.189790  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:38.191227  1839 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.193650  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:38.194506  1706 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.197343  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:38.236404  1749 tablet_bootstrap.cc:492] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:38.237178  1749 ts_tablet_manager.cc:1403] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.113s	user 0.017s	sys 0.011s
W20260709 12:58:38.240267  1675 leader_election.cc:343] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.240489  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:38.242594  1749 raft_consensus.cc:359] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.243381  1749 raft_consensus.cc:385] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.243678  1749 raft_consensus.cc:740] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.245237  1706 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:38.245368  1749 consensus_queue.cc:260] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.249682  1756 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:38.251302  1751 tablet_bootstrap.cc:654] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.253902  1750 tablet_bootstrap.cc:492] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:38.254995  1750 ts_tablet_manager.cc:1403] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.098s	user 0.056s	sys 0.031s
W20260709 12:58:38.258179  1673 leader_election.cc:343] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.254359  1749 ts_tablet_manager.cc:1434] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 12:58:38.258677  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:38.259856  1749 tablet_bootstrap.cc:492] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:38.261458  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:38.261940  1754 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.263439  1754 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.260030  1454 catalog_manager.cc:5697] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.265547  1848 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.266067  1848 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:38.266880  1848 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.269804  1750 raft_consensus.cc:359] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.270529  1750 raft_consensus.cc:385] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.270807  1750 raft_consensus.cc:740] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.271572  1750 consensus_queue.cc:260] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.274060  1750 ts_tablet_manager.cc:1434] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
W20260709 12:58:38.274070  1526 leader_election.cc:343] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.275599  1750 tablet_bootstrap.cc:492] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
W20260709 12:58:38.276948  1526 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:38.279734  1771 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.281767  1749 tablet_bootstrap.cc:654] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.284855  1750 tablet_bootstrap.cc:654] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.293883  1829 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.294809  1829 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.301453  1751 tablet_bootstrap.cc:492] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:38.301970  1751 ts_tablet_manager.cc:1403] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.119s	user 0.014s	sys 0.005s
I20260709 12:58:38.318707  1771 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.319151  1829 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:38.319576  1848 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.321213  1848 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.323386  1751 raft_consensus.cc:359] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.324275  1751 raft_consensus.cc:385] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.324659  1751 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.325611  1751 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.326164  1771 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.328392  1751 ts_tablet_manager.cc:1434] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 12:58:38.329032  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:38.330945  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:38.330860  1756 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:38.331403  1749 tablet_bootstrap.cc:492] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:38.333524  1749 ts_tablet_manager.cc:1403] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.020s
I20260709 12:58:38.329624  1751 tablet_bootstrap.cc:492] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
W20260709 12:58:38.337188  1675 leader_election.cc:343] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.329079  1848 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:38.340813  1635 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 1: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:58:38.349983  1829 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:58:38.351529  1877 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:58:38.361392  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:38.372666  1749 raft_consensus.cc:359] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.373626  1749 raft_consensus.cc:385] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.373976  1749 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.379963  1749 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.372231  1458 catalog_manager.cc:5697] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.389600  1848 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.390559  1848 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.394805  1749 ts_tablet_manager.cc:1434] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 12:58:38.396783  1749 tablet_bootstrap.cc:492] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:38.394649  1815 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.400805  1815 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.454945  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:38.515488  1815 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:38.518524  1632 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.522076  1885 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:38.534380  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:38.534986  1751 tablet_bootstrap.cc:654] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:38.542513  1879 log.cc:927] Time spent T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:58:38.542672  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:38.526608  1848 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:38.550932  1796 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:38.551054  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 141065us
I20260709 12:58:38.561537  1796 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.602367  1771 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.602941  1771 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.604871  1771 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:38.605036  1749 tablet_bootstrap.cc:654] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.605366  1796 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:38.606323  1750 tablet_bootstrap.cc:492] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:38.606798  1750 ts_tablet_manager.cc:1403] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.331s	user 0.019s	sys 0.021s
W20260709 12:58:38.610595  1880 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.115s	user 0.001s	sys 0.001s
I20260709 12:58:38.611711  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:38.613659  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:38.614477  1706 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:38.616425  1750 raft_consensus.cc:359] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.617372  1750 raft_consensus.cc:385] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.617723  1750 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.619194  1750 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.615940  1601 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:38.625801  1750 ts_tablet_manager.cc:1434] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 12:58:38.626977  1756 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.627400  1750 tablet_bootstrap.cc:492] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:38.634189  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:38.635223  1771 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.657711  1756 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.658838  1771 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:38.659027  1673 leader_election.cc:343] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.659584  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:38.660607  1829 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.663493  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:38.664160  1706 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:38.663360  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:38.668439  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:38.670945  1751 tablet_bootstrap.cc:492] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:38.671598  1751 ts_tablet_manager.cc:1403] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.342s	user 0.020s	sys 0.010s
I20260709 12:58:38.670945  1749 tablet_bootstrap.cc:492] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:38.672650  1749 ts_tablet_manager.cc:1403] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.276s	user 0.032s	sys 0.005s
I20260709 12:58:38.673455  1750 tablet_bootstrap.cc:654] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.674808  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:38.678674  1829 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.679730  1751 raft_consensus.cc:359] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.680438  1751 raft_consensus.cc:385] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.680740  1751 raft_consensus.cc:740] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.681797  1751 consensus_queue.cc:260] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.686043  1749 raft_consensus.cc:359] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.687894  1749 raft_consensus.cc:385] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.688302  1749 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
W20260709 12:58:38.690955  1675 leader_election.cc:343] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.693538  1751 ts_tablet_manager.cc:1434] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 12:58:38.695309  1751 tablet_bootstrap.cc:492] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:38.704442  1749 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.707468  1633 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.714694  1751 tablet_bootstrap.cc:654] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:38.717051  1526 leader_election.cc:343] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.722286  1749 ts_tablet_manager.cc:1434] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.049s	user 0.011s	sys 0.001s
I20260709 12:58:38.723206  1749 tablet_bootstrap.cc:492] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:38.726651  1558 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.731262  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:38.732025  1559 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:38.746112  1749 tablet_bootstrap.cc:654] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.747597  1633 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.767568  1749 tablet_bootstrap.cc:492] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:38.768173  1749 ts_tablet_manager.cc:1403] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.006s
I20260709 12:58:38.771420  1749 raft_consensus.cc:359] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.772483  1749 raft_consensus.cc:385] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.772483  1885 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:38.773278  1749 raft_consensus.cc:740] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.774161  1749 consensus_queue.cc:260] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.776091  1673 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:38.777105  1885 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.777493  1885 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.778010  1885 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.780915  1749 ts_tablet_manager.cc:1434] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 12:58:38.782261  1749 tablet_bootstrap.cc:492] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:38.794564  1750 tablet_bootstrap.cc:492] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:38.795120  1889 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:38.795617  1750 ts_tablet_manager.cc:1403] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.169s	user 0.017s	sys 0.015s
I20260709 12:58:38.800068  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:38.800971  1771 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.801327  1771 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.801677  1771 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.798275  1750 raft_consensus.cc:359] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.815752  1750 raft_consensus.cc:385] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.816075  1750 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.818111  1885 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.820683  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:38.821485  1848 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.824844  1750 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.826275  1771 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.828877  1750 ts_tablet_manager.cc:1434] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:58:38.830602  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:38.830391  1885 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:38.831161  1749 tablet_bootstrap.cc:654] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.831276  1633 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.833977  1771 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:38.835312  1862 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.839929  1633 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:38.841092  1750 tablet_bootstrap.cc:492] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:38.841266  1675 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:38.842334  1885 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.843016  1885 raft_consensus.cc:697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:38.843837  1885 consensus_queue.cc:237] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.844375  1838 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.844872  1838 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.847048  1838 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:38.849597  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:38.850445  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:38.852420  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:38.853166  1708 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.857329  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:38.857954  1709 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:38.864705  1601 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:38.866035  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:38.866649  1559 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:38.867449  1526 leader_election.cc:343] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.868067  1838 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:38.869465  1848 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.868464  1838 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:58:38.873987  1838 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:38.876231  1559 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:38.887220  1708 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:38.897269  1838 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.901621  1751 tablet_bootstrap.cc:492] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:38.903074  1633 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:38.902292  1751 ts_tablet_manager.cc:1403] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.207s	user 0.034s	sys 0.039s
I20260709 12:58:38.907279  1862 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.911263  1751 raft_consensus.cc:359] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.912249  1751 raft_consensus.cc:385] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.912613  1751 raft_consensus.cc:740] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.913342  1751 consensus_queue.cc:260] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.915810  1751 ts_tablet_manager.cc:1434] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:58:38.917060  1751 tablet_bootstrap.cc:492] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:38.918174  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:38.920468  1889 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.921027  1889 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.907397  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:38.926237  1862 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.926863  1862 raft_consensus.cc:697] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:38.927616  1889 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:38.928166  1862 consensus_queue.cc:237] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.928445  1771 consensus_queue.cc:1059] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.929250  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:38.929471  1771 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.930819  1758 raft_consensus.cc:3055] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:38.931188  1758 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:38.931589  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:38.932070  1758 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.933244  1838 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:58:38.933384  1675 leader_election.cc:343] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:38.934644  1673 leader_election.cc:343] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.935210  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:38.933382  1758 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:38.942479  1749 tablet_bootstrap.cc:492] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:38.943161  1749 ts_tablet_manager.cc:1403] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.161s	user 0.025s	sys 0.031s
I20260709 12:58:38.953437  1751 tablet_bootstrap.cc:654] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.947853  1889 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.955644  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:38.972558  1601 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:38.973986  1838 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:38.975261  1749 raft_consensus.cc:359] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.976164  1749 raft_consensus.cc:385] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.976768  1749 raft_consensus.cc:740] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.979348  1749 consensus_queue.cc:260] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:38.987272  1454 catalog_manager.cc:5697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:39.002439  1749 ts_tablet_manager.cc:1434] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:58:39.010958  1750 tablet_bootstrap.cc:654] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.021417  1749 tablet_bootstrap.cc:492] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:39.026340  1751 tablet_bootstrap.cc:492] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:39.026893  1751 ts_tablet_manager.cc:1403] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.110s	user 0.008s	sys 0.005s
I20260709 12:58:39.035303  1751 raft_consensus.cc:359] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.036141  1751 raft_consensus.cc:385] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.036423  1751 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.037048  1749 tablet_bootstrap.cc:654] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.037235  1751 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.039776  1751 ts_tablet_manager.cc:1434] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:58:39.041113  1751 tablet_bootstrap.cc:492] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:39.042658  1458 catalog_manager.cc:5697] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.049819  1750 tablet_bootstrap.cc:492] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:39.050295  1750 ts_tablet_manager.cc:1403] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.209s	user 0.028s	sys 0.006s
I20260709 12:58:39.054374  1750 raft_consensus.cc:359] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.055032  1751 tablet_bootstrap.cc:654] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.055109  1750 raft_consensus.cc:385] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.055624  1750 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.056315  1750 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.062956  1750 ts_tablet_manager.cc:1434] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:58:39.066510  1750 tablet_bootstrap.cc:492] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:39.070714  1749 tablet_bootstrap.cc:492] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:39.071209  1749 ts_tablet_manager.cc:1403] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.011s
I20260709 12:58:39.073699  1749 raft_consensus.cc:359] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.074410  1749 raft_consensus.cc:385] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.074738  1749 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.075518  1749 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.076401  1750 tablet_bootstrap.cc:654] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.077507  1749 ts_tablet_manager.cc:1434] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:58:39.078771  1749 tablet_bootstrap.cc:492] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:39.086912  1750 tablet_bootstrap.cc:492] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:39.087618  1751 tablet_bootstrap.cc:492] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:39.087970  1750 ts_tablet_manager.cc:1403] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.003s
I20260709 12:58:39.088070  1751 ts_tablet_manager.cc:1403] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.003s
I20260709 12:58:39.090950  1750 raft_consensus.cc:359] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.091701  1750 raft_consensus.cc:385] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.092641  1750 raft_consensus.cc:740] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.091391  1751 raft_consensus.cc:359] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.093556  1751 raft_consensus.cc:385] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.093713  1749 tablet_bootstrap.cc:654] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.093390  1750 consensus_queue.cc:260] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.093966  1751 raft_consensus.cc:740] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.095389  1750 ts_tablet_manager.cc:1434] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:39.095046  1751 consensus_queue.cc:260] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.096464  1750 tablet_bootstrap.cc:492] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:39.097237  1751 ts_tablet_manager.cc:1434] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:58:39.098276  1751 tablet_bootstrap.cc:492] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:39.103286  1750 tablet_bootstrap.cc:654] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.109889  1751 tablet_bootstrap.cc:654] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.122998  1749 tablet_bootstrap.cc:492] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:39.123683  1749 ts_tablet_manager.cc:1403] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.001s
I20260709 12:58:39.127580  1749 raft_consensus.cc:359] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.128544  1749 raft_consensus.cc:385] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.128944  1749 raft_consensus.cc:740] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.130689  1749 consensus_queue.cc:260] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.134080  1749 ts_tablet_manager.cc:1434] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:58:39.135190  1749 tablet_bootstrap.cc:492] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:39.138821  1750 tablet_bootstrap.cc:492] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:39.139786  1750 ts_tablet_manager.cc:1403] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.020s
I20260709 12:58:39.142221  1749 tablet_bootstrap.cc:654] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.142789  1750 raft_consensus.cc:359] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.143675  1750 raft_consensus.cc:385] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.144013  1750 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.144783  1750 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.146843  1750 ts_tablet_manager.cc:1434] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:39.147948  1750 tablet_bootstrap.cc:492] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:39.155809  1750 tablet_bootstrap.cc:654] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.158576  1751 tablet_bootstrap.cc:492] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:39.159049  1751 ts_tablet_manager.cc:1403] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.061s	user 0.006s	sys 0.007s
I20260709 12:58:39.160983  1750 tablet_bootstrap.cc:492] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:39.161448  1750 ts_tablet_manager.cc:1403] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:58:39.161653  1751 raft_consensus.cc:359] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.162724  1751 raft_consensus.cc:385] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.162986  1751 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.163599  1751 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.164394  1750 raft_consensus.cc:359] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.165068  1750 raft_consensus.cc:385] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.165391  1750 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.166095  1751 ts_tablet_manager.cc:1434] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:39.166038  1750 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.167053  1751 tablet_bootstrap.cc:492] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:39.168141  1750 ts_tablet_manager.cc:1434] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:58:39.169332  1750 tablet_bootstrap.cc:492] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:39.169996  1749 tablet_bootstrap.cc:492] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:39.170426  1749 ts_tablet_manager.cc:1403] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.000s
I20260709 12:58:39.170256  1754 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.171075  1754 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.173799  1749 raft_consensus.cc:359] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.174679  1749 raft_consensus.cc:385] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.175029  1749 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.175654  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:39.175971  1750 tablet_bootstrap.cc:654] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:39.177183  1675 leader_election.cc:343] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.177969  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:39.175652  1749 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.182147  1750 tablet_bootstrap.cc:492] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:39.182596  1750 ts_tablet_manager.cc:1403] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.005s
W20260709 12:58:39.183238  1673 leader_election.cc:343] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.183673  1673 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:39.184508  1829 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:39.185874  1749 ts_tablet_manager.cc:1434] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:58:39.186187  1750 raft_consensus.cc:359] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.186918  1749 tablet_bootstrap.cc:492] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:39.186928  1750 raft_consensus.cc:385] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.187299  1750 raft_consensus.cc:740] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.187924  1750 consensus_queue.cc:260] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.188925  1754 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:39.190716  1750 ts_tablet_manager.cc:1434] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:39.191709  1750 tablet_bootstrap.cc:492] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:39.198115  1751 tablet_bootstrap.cc:654] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.198170  1750 tablet_bootstrap.cc:654] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.202899  1839 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.203474  1839 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.203487  1749 tablet_bootstrap.cc:654] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.205751  1751 tablet_bootstrap.cc:492] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:39.206286  1751 ts_tablet_manager.cc:1403] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.000s
I20260709 12:58:39.207083  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:39.207785  1706 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:39.209192  1601 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:39.210774  1838 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.210562  1751 raft_consensus.cc:359] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.211195  1838 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.211371  1751 raft_consensus.cc:385] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.211622  1838 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.211714  1751 raft_consensus.cc:740] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.212808  1751 consensus_queue.cc:260] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.214069  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:39.214696  1557 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:39.214999  1751 ts_tablet_manager.cc:1434] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:39.215866  1751 tablet_bootstrap.cc:492] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:39.223269  1751 tablet_bootstrap.cc:654] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.223394  1838 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.224697  1839 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.228379  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:39.229247  1557 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.239745  1758 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.240119  1557 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:39.240345  1862 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.240469  1758 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.242563  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:39.243376  1706 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.245683  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:39.246641  1631 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:39.240813  1862 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.250389  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:39.251152  1709 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:39.251946  1862 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.252689  1838 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.253837  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:39.254598  1706 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:39.256507  1601 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:39.257637  1838 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:39.258217  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:39.258796  1838 raft_consensus.cc:697] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:39.259764  1838 consensus_queue.cc:237] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.260880  1758 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:58:39.262669  1526 leader_election.cc:343] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.261503  1862 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.265558  1862 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.265993  1862 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.261353  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:39.267081  1706 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:39.262971  1750 tablet_bootstrap.cc:492] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:39.268132  1750 ts_tablet_manager.cc:1403] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.023s
I20260709 12:58:39.270818  1750 raft_consensus.cc:359] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.271499  1750 raft_consensus.cc:385] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.271780  1750 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.272075  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:39.272184  1454 catalog_manager.cc:5697] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.273347  1758 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.273753  1758 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.274091  1758 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.278277  1751 tablet_bootstrap.cc:492] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:39.278800  1751 ts_tablet_manager.cc:1403] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.063s	user 0.026s	sys 0.019s
I20260709 12:58:39.278924  1862 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.281633  1862 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.282374  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:39.283001  1631 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.284466  1749 tablet_bootstrap.cc:492] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:39.285000  1749 ts_tablet_manager.cc:1403] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.098s	user 0.019s	sys 0.015s
I20260709 12:58:39.272394  1750 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.286736  1750 ts_tablet_manager.cc:1434] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.002s
I20260709 12:58:39.287700  1750 tablet_bootstrap.cc:492] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:39.287760  1749 raft_consensus.cc:359] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.288941  1749 raft_consensus.cc:385] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.289250  1749 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.289964  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:39.289935  1749 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.290634  1706 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.292294  1749 ts_tablet_manager.cc:1434] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:58:39.293696  1749 tablet_bootstrap.cc:492] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:39.294992  1750 tablet_bootstrap.cc:654] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.282648  1751 raft_consensus.cc:359] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.296761  1751 raft_consensus.cc:385] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.297086  1751 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.298148  1751 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.300726  1751 ts_tablet_manager.cc:1434] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.005s
I20260709 12:58:39.301844  1751 tablet_bootstrap.cc:492] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:39.302877  1631 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:39.304204  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:39.304421  1758 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.305089  1862 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:39.305604  1862 raft_consensus.cc:697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:39.306404  1758 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.306666  1829 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.307901  1829 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.306505  1862 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.311430  1829 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:39.314106  1749 tablet_bootstrap.cc:654] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.318051  1885 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.312534  1706 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:39.318732  1885 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.321095  1885 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:39.334023  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:39.337086  1675 leader_election.cc:343] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.340036  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:39.340785  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:39.341032  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:39.341481  1635 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.342067  1557 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:39.342276  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:58:39.343274  1675 leader_election.cc:343] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.343461  1706 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.344340  1751 tablet_bootstrap.cc:654] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.344521  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:39.347376  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:58:39.347437  1526 leader_election.cc:343] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.349112  1885 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.349709  1885 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.350199  1885 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:39.353823  1673 leader_election.cc:343] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.354748  1862 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:39.354947  1673 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:39.356877  1829 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:39.358929  1458 catalog_manager.cc:5697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.364748  1885 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.366730  1749 tablet_bootstrap.cc:492] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:39.367367  1749 ts_tablet_manager.cc:1403] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.019s
I20260709 12:58:39.367871  1885 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:39.368165  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:39.368563  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:39.368821  1557 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:39.370028  1675 leader_election.cc:343] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.370069  1749 raft_consensus.cc:359] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.370960  1749 raft_consensus.cc:385] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.371234  1749 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.371953  1749 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.374197  1749 ts_tablet_manager.cc:1434] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:39.375250  1749 tablet_bootstrap.cc:492] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:39.376734  1885 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:39.378803  1557 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:39.382611  1750 tablet_bootstrap.cc:492] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:39.383234  1750 ts_tablet_manager.cc:1403] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.096s	user 0.004s	sys 0.033s
I20260709 12:58:39.394619  1750 raft_consensus.cc:359] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.395350  1750 raft_consensus.cc:385] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.395622  1750 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.385440  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:39.396270  1750 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.402299  1750 ts_tablet_manager.cc:1434] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:58:39.407750  1706 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:39.418218  1829 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:39.418797  1829 raft_consensus.cc:697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:39.419684  1829 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.423635  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:39.427856  1771 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:39.441457  1771 raft_consensus.cc:697] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:39.429445  1838 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.442459  1771 consensus_queue.cc:237] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.442616  1838 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.427944  1887 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:58:39.447495  1754 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:39.450083  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:39.450115  1750 tablet_bootstrap.cc:492] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:39.450858  1559 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:39.452045  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:39.452380  1599 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:39.452736  1706 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:39.453305  1839 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.447695  1838 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.454121  1839 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.458014  1839 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.458494  1749 tablet_bootstrap.cc:654] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.462198  1751 tablet_bootstrap.cc:492] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:39.462707  1751 ts_tablet_manager.cc:1403] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.161s	user 0.014s	sys 0.008s
I20260709 12:58:39.463654  1887 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.464193  1887 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.466753  1839 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.476980  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:39.477672  1633 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:39.476373  1887 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.484536  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:39.486917  1751 raft_consensus.cc:359] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.488683  1751 raft_consensus.cc:385] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.489137  1751 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.488860  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:39.489935  1751 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.491174  1709 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:39.492092  1751 ts_tablet_manager.cc:1434] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:58:39.494522  1751 tablet_bootstrap.cc:492] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:39.487089  1887 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.505055  1458 catalog_manager.cc:5697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:39.512368  1454 catalog_manager.cc:5697] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.511821  1885 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.502955  1887 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.514827  1889 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.516844  1885 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.517046  1889 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.518872  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:39.519341  1558 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.519526  1885 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:39.519556  1889 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:39.521543  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:39.521823  1887 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.522711  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:39.526330  1675 leader_election.cc:343] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.528330  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:39.529237  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:39.530192  1839 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.532150  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:39.532905  1709 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:39.536094  1673 leader_election.cc:343] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.539383  1750 tablet_bootstrap.cc:654] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:39.542148  1675 leader_election.cc:343] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.542766  1675 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:39.543757  1885 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:39.545924  1673 leader_election.cc:343] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.562296  1709 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:39.550191  1673 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:39.563937  1601 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:39.564983  1829 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:39.555941  1558 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:39.572094  1829 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.572866  1749 tablet_bootstrap.cc:492] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:39.573277  1751 tablet_bootstrap.cc:654] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.573318  1749 ts_tablet_manager.cc:1403] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.198s	user 0.015s	sys 0.006s
I20260709 12:58:39.573025  1829 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.579573  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:39.569794  1933 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:39.580564  1933 raft_consensus.cc:697] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 12:58:39.581286  1673 leader_election.cc:343] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.582144  1933 consensus_queue.cc:237] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.589716  1758 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.590456  1758 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.593272  1758 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.597000  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:39.597340  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:39.597936  1706 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
W20260709 12:58:39.603741  1526 leader_election.cc:343] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.570308  1887 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.604863  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:39.606617  1758 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.607120  1758 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.607568  1758 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.628662  1750 tablet_bootstrap.cc:492] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:39.629400  1750 ts_tablet_manager.cc:1403] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.189s	user 0.012s	sys 0.004s
I20260709 12:58:39.624305  1829 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:39.631493  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:39.632917  1675 leader_election.cc:343] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.633407  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:39.634697  1829 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:39.637320  1758 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.640377  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:39.641106  1706 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.637792  1887 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.646607  1758 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.647053  1749 raft_consensus.cc:359] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.653335  1749 raft_consensus.cc:385] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.655113  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:39.656014  1749 raft_consensus.cc:740] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.656723  1749 consensus_queue.cc:260] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.656646  1750 raft_consensus.cc:359] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.657861  1750 raft_consensus.cc:385] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.658151  1750 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.658803  1750 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.655771  1708 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.662371  1749 ts_tablet_manager.cc:1434] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.006s
I20260709 12:58:39.664800  1750 ts_tablet_manager.cc:1434] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:58:39.666945  1749 tablet_bootstrap.cc:492] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:39.667939  1706 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:39.670121  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:39.670711  1635 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.669513  1750 tablet_bootstrap.cc:492] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:39.676869  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:39.685472  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:39.687681  1771 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:58:39.688789  1526 leader_election.cc:343] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.689222  1771 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:39.689884  1771 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.701579  1708 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:39.704406  1751 tablet_bootstrap.cc:492] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:39.713362  1751 ts_tablet_manager.cc:1403] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.219s	user 0.030s	sys 0.037s
I20260709 12:58:39.719470  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:39.725881  1933 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.726778  1933 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.729020  1933 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.731969  1751 raft_consensus.cc:359] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.724375  1862 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:39.733068  1750 tablet_bootstrap.cc:654] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.733642  1862 raft_consensus.cc:697] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:39.734033  1751 raft_consensus.cc:385] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.734040  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:39.734465  1751 raft_consensus.cc:740] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.735119  1558 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 1: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:58:39.734840  1862 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.735195  1751 consensus_queue.cc:260] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.720975  1635 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:39.740046  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:58:39.742681  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:39.743023  1601 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:39.744715  1751 ts_tablet_manager.cc:1434] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:58:39.744901  1933 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.745891  1751 tablet_bootstrap.cc:492] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:39.748492  1749 tablet_bootstrap.cc:654] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.757124  1933 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:39.760336  1749 tablet_bootstrap.cc:492] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:39.761194  1749 ts_tablet_manager.cc:1403] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.000s
I20260709 12:58:39.760726  1458 catalog_manager.cc:5697] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.764874  1750 tablet_bootstrap.cc:492] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:39.765391  1750 ts_tablet_manager.cc:1403] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.001s
I20260709 12:58:39.767872  1751 tablet_bootstrap.cc:654] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.767375  1749 raft_consensus.cc:359] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.768406  1749 raft_consensus.cc:385] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.768842  1749 raft_consensus.cc:740] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.769006  1750 raft_consensus.cc:359] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.769767  1750 raft_consensus.cc:385] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.770265  1750 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.769882  1749 consensus_queue.cc:260] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.771333  1750 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.772313  1749 ts_tablet_manager.cc:1434] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:58:39.773303  1750 ts_tablet_manager.cc:1434] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:39.773362  1749 tablet_bootstrap.cc:492] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:39.774318  1750 tablet_bootstrap.cc:492] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:39.781916  1750 tablet_bootstrap.cc:654] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.791391  1749 tablet_bootstrap.cc:654] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.795830  1839 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:39.798337  1454 catalog_manager.cc:5697] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.801398  1454 catalog_manager.cc:5697] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.815408  1751 tablet_bootstrap.cc:492] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:39.815943  1751 ts_tablet_manager.cc:1403] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.070s	user 0.028s	sys 0.011s
I20260709 12:58:39.819166  1751 raft_consensus.cc:359] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.819877  1751 raft_consensus.cc:385] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.820425  1751 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.821103  1751 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.824134  1635 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.824946  1751 ts_tablet_manager.cc:1434] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:58:39.825906  1751 tablet_bootstrap.cc:492] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:39.827994  1750 tablet_bootstrap.cc:492] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:39.828488  1750 ts_tablet_manager.cc:1403] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.003s
I20260709 12:58:39.831125  1750 raft_consensus.cc:359] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.831802  1750 raft_consensus.cc:385] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.832069  1750 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.832289  1862 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:39.832845  1750 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.835223  1750 ts_tablet_manager.cc:1434] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:58:39.836676  1750 tablet_bootstrap.cc:492] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:39.840746  1839 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:39.843523  1751 tablet_bootstrap.cc:654] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.847486  1750 tablet_bootstrap.cc:654] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.850631  1829 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:39.852128  1749 tablet_bootstrap.cc:492] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:39.852665  1749 ts_tablet_manager.cc:1403] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.004s
I20260709 12:58:39.859707  1749 raft_consensus.cc:359] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.860425  1749 raft_consensus.cc:385] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.860855  1749 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.861101  1862 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:39.862614  1749 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.866597  1862 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.874559  1862 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.875602  1829 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.876144  1829 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.877328  1862 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.879022  1829 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:39.872574  1749 ts_tablet_manager.cc:1434] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:58:39.881808  1749 tablet_bootstrap.cc:492] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:39.884285  1838 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.884819  1838 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.887766  1838 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.888236  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:39.889321  1559 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:39.890345  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:39.890985  1706 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:39.892354  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:39.892752  1599 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:39.894858  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:39.894928  1838 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.895543  1838 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.895586  1634 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:39.896034  1838 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.897688  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:39.898038  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:39.898663  1707 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
W20260709 12:58:39.899307  1675 leader_election.cc:343] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.900792  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 12:58:39.901654  1673 leader_election.cc:343] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.902187  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:39.903446  1829 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:39.904189  1771 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.904604  1771 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.904991  1771 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.920984  1838 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.923449  1838 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.924840  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:39.924911  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:39.926744  1862 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:39.926792  1708 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.927651  1751 tablet_bootstrap.cc:492] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:39.925661  1558 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.928114  1751 ts_tablet_manager.cc:1403] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.102s	user 0.016s	sys 0.001s
I20260709 12:58:39.932385  1751 raft_consensus.cc:359] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.933132  1751 raft_consensus.cc:385] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.933415  1751 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.934123  1751 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.936757  1708 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:39.937625  1558 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:39.939234  1599 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:39.941434  1749 tablet_bootstrap.cc:654] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.941435  1758 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:39.944255  1838 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:39.944980  1838 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:39.945842  1838 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.936146  1751 ts_tablet_manager.cc:1434] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:58:39.953287  1751 tablet_bootstrap.cc:492] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:39.952556  1771 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.956640  1749 tablet_bootstrap.cc:492] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:39.958704  1749 ts_tablet_manager.cc:1403] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.002s
I20260709 12:58:39.960101  1771 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:39.960562  1750 tablet_bootstrap.cc:492] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:39.961063  1750 ts_tablet_manager.cc:1403] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.008s
I20260709 12:58:39.962813  1749 raft_consensus.cc:359] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.967388  1749 raft_consensus.cc:385] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.967747  1749 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.968364  1749 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.963750  1750 raft_consensus.cc:359] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.969785  1750 raft_consensus.cc:385] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.970239  1750 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.970482  1749 ts_tablet_manager.cc:1434] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 12:58:39.971175  1751 tablet_bootstrap.cc:654] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.971468  1749 tablet_bootstrap.cc:492] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:39.971304  1750 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:39.974478  1750 ts_tablet_manager.cc:1434] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 12:58:40.034667  1749 tablet_bootstrap.cc:654] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.036887  1838 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.055852  1751 tablet_bootstrap.cc:492] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:40.030225  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:40.055852  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:40.057265  1708 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.060863  1632 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.062950  1889 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.039660  1838 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.073078  1889 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.066385  1754 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:40.075312  1838 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:40.068162  1885 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.076437  1889 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:40.076462  1751 ts_tablet_manager.cc:1403] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.123s	user 0.007s	sys 0.010s
I20260709 12:58:40.079939  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:40.085069  1675 leader_election.cc:343] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.086609  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:40.087734  1707 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:40.092556  1885 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.095239  1885 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:40.094996  1751 raft_consensus.cc:359] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.096202  1751 raft_consensus.cc:385] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.096688  1751 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.103497  1708 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:40.104276  1751 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.115115  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:40.118158  1751 ts_tablet_manager.cc:1434] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.004s
I20260709 12:58:40.118808  1962 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:40.119939  1751 tablet_bootstrap.cc:492] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:40.121898  1750 tablet_bootstrap.cc:492] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:40.122380  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:40.123992  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:58:40.133966  1675 leader_election.cc:343] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.134562  1632 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
W20260709 12:58:40.139820  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 44683.7us
I20260709 12:58:40.147128  1962 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.148908  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:40.149583  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:40.150707  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:40.152935  1771 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:40.153602  1771 raft_consensus.cc:697] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:40.155781  1771 consensus_queue.cc:237] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.161834  1829 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.162699  1829 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.167439  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:40.169315  1675 leader_election.cc:343] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.170399  1933 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:58:40.182054  1749 tablet_bootstrap.cc:492] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:40.179478  1829 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:40.200362  1749 ts_tablet_manager.cc:1403] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.229s	user 0.027s	sys 0.005s
I20260709 12:58:40.204396  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:58:40.200564  1673 leader_election.cc:343] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.208636  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:58:40.210955  1673 leader_election.cc:343] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.211650  1673 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:40.213150  1965 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:40.213363  1829 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:40.227949  1962 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:40.230791  1750 tablet_bootstrap.cc:654] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.241824  1887 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.242767  1887 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.245103  1887 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:40.251006  1749 raft_consensus.cc:359] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.258626  1749 raft_consensus.cc:385] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.259146  1749 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
W20260709 12:58:40.259056  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 57892us
I20260709 12:58:40.254269  1751 tablet_bootstrap.cc:654] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:40.263824  1673 leader_election.cc:343] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.264321  1673 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:40.261379  1749 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.265801  1965 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:40.268388  1749 ts_tablet_manager.cc:1434] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.001s
I20260709 12:58:40.269845  1749 tablet_bootstrap.cc:492] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:40.274138  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:40.275064  1709 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:40.277882  1749 tablet_bootstrap.cc:654] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.278313  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:40.278981  1633 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:40.284619  1455 catalog_manager.cc:5697] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.287410  1750 tablet_bootstrap.cc:492] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:40.287953  1750 ts_tablet_manager.cc:1403] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.313s	user 0.014s	sys 0.011s
I20260709 12:58:40.290244  1971 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:40.293148  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:40.295015  1750 raft_consensus.cc:359] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.296132  1750 raft_consensus.cc:385] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.296510  1750 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.296394  1971 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:40.297320  1971 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.297412  1750 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.298178  1971 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.303207  1750 ts_tablet_manager.cc:1434] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.009s
I20260709 12:58:40.304663  1750 tablet_bootstrap.cc:492] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:40.312693  1750 tablet_bootstrap.cc:654] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.338124  1751 tablet_bootstrap.cc:492] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:40.338685  1751 ts_tablet_manager.cc:1403] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.219s	user 0.014s	sys 0.008s
I20260709 12:58:40.345710  1751 raft_consensus.cc:359] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.346735  1751 raft_consensus.cc:385] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.347208  1751 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.347970  1751 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.350597  1751 ts_tablet_manager.cc:1434] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:58:40.353356  1971 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.358556  1749 tablet_bootstrap.cc:492] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:40.359155  1749 ts_tablet_manager.cc:1403] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.007s
I20260709 12:58:40.381381  1750 tablet_bootstrap.cc:492] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:40.381963  1750 ts_tablet_manager.cc:1403] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.078s	user 0.018s	sys 0.016s
I20260709 12:58:40.383011  1971 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:40.385036  1751 tablet_bootstrap.cc:492] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:40.391462  1750 raft_consensus.cc:359] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.392307  1750 raft_consensus.cc:385] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.392647  1750 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.394672  1750 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.395227  1749 raft_consensus.cc:359] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.395893  1749 raft_consensus.cc:385] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.396176  1749 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.397827  1749 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.403527  1750 ts_tablet_manager.cc:1434] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:58:40.404852  1750 tablet_bootstrap.cc:492] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:40.405171  1749 ts_tablet_manager.cc:1434] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:58:40.406298  1749 tablet_bootstrap.cc:492] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:40.408900  1751 tablet_bootstrap.cc:654] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.419167  1749 tablet_bootstrap.cc:654] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.419291  1750 tablet_bootstrap.cc:654] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.422400  1751 tablet_bootstrap.cc:492] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:40.422956  1751 ts_tablet_manager.cc:1403] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.005s
I20260709 12:58:40.424016  1862 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:40.425917  1751 raft_consensus.cc:359] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.426766  1751 raft_consensus.cc:385] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.427124  1751 raft_consensus.cc:740] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.427837  1751 consensus_queue.cc:260] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.430150  1751 ts_tablet_manager.cc:1434] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:58:40.432776  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:40.433591  1709 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.434068  1751 tablet_bootstrap.cc:492] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:40.443037  1751 tablet_bootstrap.cc:654] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.479018  1751 tablet_bootstrap.cc:492] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:40.479637  1751 ts_tablet_manager.cc:1403] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.008s
I20260709 12:58:40.483000  1971 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.483676  1971 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.502354  1971 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:40.502096  1751 raft_consensus.cc:359] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.503094  1751 raft_consensus.cc:385] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.503460  1751 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.504375  1751 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.506469  1751 ts_tablet_manager.cc:1434] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:58:40.508061  1751 tablet_bootstrap.cc:492] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:40.515200  1751 tablet_bootstrap.cc:654] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.516821  1971 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:40.517854  1758 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.518358  1758 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.520370  1758 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:40.524221  1971 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:40.526018  1749 tablet_bootstrap.cc:492] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:40.526532  1749 ts_tablet_manager.cc:1403] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.120s	user 0.006s	sys 0.004s
I20260709 12:58:40.531814  1751 tablet_bootstrap.cc:492] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:40.532485  1751 ts_tablet_manager.cc:1403] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.003s
I20260709 12:58:40.535926  1751 raft_consensus.cc:359] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.536474  1885 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.537055  1885 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.540941  1885 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:40.542557  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:40.543367  1635 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:40.544078  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:40.545428  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:40.545827  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:58:40.554651  1526 leader_election.cc:343] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.536760  1751 raft_consensus.cc:385] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.562244  1751 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.564977  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:40.565958  1887 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:58:40.566052  1526 leader_election.cc:343] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.566468  1887 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.566596  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:40.566964  1887 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.567539  1862 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:40.566696  1751 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.571049  1557 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:40.574945  1749 raft_consensus.cc:359] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.575745  1749 raft_consensus.cc:385] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.576040  1749 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.592293  1709 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:40.606448  1982 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:40.633414  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:40.634213  1703 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:40.640861  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:40.643309  1962 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:40.651489  1987 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.652088  1987 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.655225  1889 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:58:40.655620  1987 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:40.656100  1889 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.658676  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:40.658915  1675 leader_election.cc:343] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:40.660066  1675 leader_election.cc:343] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.661074  1889 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:40.663069  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:40.664136  1634 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 2: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:58:40.671092  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:40.671783  1632 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.678990  1632 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:40.687652  1887 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.689675  1887 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:40.707116  1750 tablet_bootstrap.cc:492] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:40.707643  1750 ts_tablet_manager.cc:1403] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.303s	user 0.030s	sys 0.042s
I20260709 12:58:40.710969  1750 raft_consensus.cc:359] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.711676  1750 raft_consensus.cc:385] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.711933  1750 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.712570  1862 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:40.712623  1750 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.576913  1749 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.715493  1750 ts_tablet_manager.cc:1434] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:58:40.715714  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:40.716521  1758 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:40.717177  1749 ts_tablet_manager.cc:1434] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.190s	user 0.013s	sys 0.000s
I20260709 12:58:40.718267  1749 tablet_bootstrap.cc:492] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:40.718909  1750 tablet_bootstrap.cc:492] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:40.725611  1750 tablet_bootstrap.cc:654] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.726176  1751 ts_tablet_manager.cc:1434] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.193s	user 0.011s	sys 0.001s
I20260709 12:58:40.727560  1751 tablet_bootstrap.cc:492] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:40.739761  1458 catalog_manager.cc:5697] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:40.786787  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 69337.9us
I20260709 12:58:40.796623  1749 tablet_bootstrap.cc:654] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.788789  1887 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.841406  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:40.842198  1706 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.850251  1751 tablet_bootstrap.cc:654] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.804117  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:40.842751  1673 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:40.862660  1892 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.865221  1758 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 12:58:40.866573  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 62430.3us
I20260709 12:58:40.856487  1971 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.863365  1892 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.867959  1965 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:40.877024  1758 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.871733  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:40.856217  1887 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.883504  1965 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.889467  1632 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.890498  1750 tablet_bootstrap.cc:492] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
W20260709 12:58:40.923509  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 45052.9us
I20260709 12:58:40.899399  1750 ts_tablet_manager.cc:1403] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.181s	user 0.017s	sys 0.012s
I20260709 12:58:40.881139  1971 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.957572  1933 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.965626  1933 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.899039  1965 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:40.950685  1673 leader_election.cc:343] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.978681  1673 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:40.979149  1887 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:58:40.979688  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 47247.4us
I20260709 12:58:40.980846  1829 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:40.979736  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:40.982748  1558 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:40.968438  1933 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:40.987402  1750 raft_consensus.cc:359] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:40.990456  1971 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:40.988420  1750 raft_consensus.cc:385] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.996078  1750 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.999580  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:41.000720  1933 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:41.000944  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:41.001498  1933 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.005405  1933 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.009218  1750 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.000706  1706 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:41.015183  1750 ts_tablet_manager.cc:1434] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
I20260709 12:58:41.018286  1749 tablet_bootstrap.cc:492] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:41.018925  1749 ts_tablet_manager.cc:1403] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.301s	user 0.025s	sys 0.020s
I20260709 12:58:41.019667  1750 tablet_bootstrap.cc:492] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:41.001745  1700 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:40.972242  1892 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.034904  1632 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:41.032920  1749 raft_consensus.cc:359] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.036890  1749 raft_consensus.cc:385] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.037863  1749 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.039721  1749 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.042824  1749 ts_tablet_manager.cc:1434] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 12:58:41.047566  1933 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.048048  1751 tablet_bootstrap.cc:492] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:41.048667  1751 ts_tablet_manager.cc:1403] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.321s	user 0.011s	sys 0.009s
I20260709 12:58:41.049401  1750 tablet_bootstrap.cc:654] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.055716  1749 tablet_bootstrap.cc:492] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:41.056311  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:41.056968  1556 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.059682  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:41.060305  1700 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.062987  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:41.070235  1751 raft_consensus.cc:359] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.070899  1751 raft_consensus.cc:385] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.061455  1933 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.071221  1751 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.071920  1751 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.074664  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:41.075778  1557 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:58:41.074671  1996 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:41.078511  1996 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:41.053718  1965 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.079826  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:41.086313  1632 raft_consensus.cc:2393] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 1: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 12:58:41.088709  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:41.091109  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:41.095930  1751 ts_tablet_manager.cc:1434] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:58:41.097479  1751 tablet_bootstrap.cc:492] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:41.088860  1673 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:41.100441  1962 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.100566  1885 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:41.101294  1962 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.101742  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:41.103160  1703 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:41.103855  1885 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:58:41.105474  1885 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.105690  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:41.079444  1996 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.109174  1630 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:58:41.112228  1965 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:41.113953  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:41.089349  1862 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:58:41.118753  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:41.120558  1892 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:41.121168  1892 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.121501  1892 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.120371  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:41.123775  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:41.124403  1557 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.131880  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:41.137308  1962 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.137871  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:41.138604  1558 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:58:41.139993  1599 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:41.140758  1751 tablet_bootstrap.cc:654] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.141604  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 12:58:41.143059  1675 leader_election.cc:343] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.143661  1962 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:41.144069  1962 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.145273  1962 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:41.156512  1749 tablet_bootstrap.cc:654] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.156842  1889 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.163260  1750 tablet_bootstrap.cc:492] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:41.163857  1750 ts_tablet_manager.cc:1403] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.148s	user 0.022s	sys 0.015s
I20260709 12:58:41.163255  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:41.154937  1892 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.167203  1556 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:41.170524  1999 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.164539  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:41.173345  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:41.173954  1700 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:41.175691  1933 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:41.176126  1557 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:41.163971  1889 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.182430  1889 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:41.184705  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:41.186372  1675 leader_election.cc:343] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.187209  1885 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.189111  1706 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:58:41.169359  1996 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:41.189769  1996 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.176237  1933 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 12:58:41.190363  1526 leader_election.cc:343] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.190160  1996 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:41.195950  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:41.191069  1933 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.208559  1458 catalog_manager.cc:5697] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.212167  1962 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:41.216177  1673 leader_election.cc:343] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.216743  1673 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:41.223493  1892 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.224160  1889 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.229411  1673 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:41.229655  1885 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:41.229970  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:41.230479  1885 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:41.230614  1706 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.238917  1996 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.240973  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:41.231875  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:41.232125  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 12:58:41.243295  1526 leader_election.cc:343] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.246501  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:41.244825  1632 raft_consensus.cc:2368] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3.
I20260709 12:58:41.246105  1751 tablet_bootstrap.cc:492] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:41.248788  1751 ts_tablet_manager.cc:1403] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.152s	user 0.015s	sys 0.013s
I20260709 12:58:41.245931  1706 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:41.248019  1750 raft_consensus.cc:359] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.249686  1675 leader_election.cc:400] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3.
I20260709 12:58:41.251752  1557 raft_consensus.cc:2368] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3.
I20260709 12:58:41.254478  1675 leader_election.cc:403] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:58:41.256300  1965 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:41.252249  1962 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.254120  1751 raft_consensus.cc:359] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.260854  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:41.261924  1751 raft_consensus.cc:385] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.262461  1751 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.254598  1750 raft_consensus.cc:385] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.263072  1750 raft_consensus.cc:740] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.263979  1458 catalog_manager.cc:5697] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.244324  1885 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:41.268448  1750 consensus_queue.cc:260] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.264472  1971 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:41.270531  1996 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.271605  1971 raft_consensus.cc:697] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:41.272399  1971 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.270961  1673 leader_election.cc:400] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3.
I20260709 12:58:41.274227  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:41.274979  1632 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:58:41.275686  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:41.275753  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:41.277606  1601 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:41.278725  1933 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:41.283816  1751 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.284868  1965 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3.
I20260709 12:58:41.285881  1751 ts_tablet_manager.cc:1434] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 12:58:41.287070  1751 tablet_bootstrap.cc:492] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:41.291510  1750 ts_tablet_manager.cc:1434] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.127s	user 0.008s	sys 0.000s
I20260709 12:58:41.293525  1749 tablet_bootstrap.cc:492] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:41.294066  1749 ts_tablet_manager.cc:1403] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.243s	user 0.015s	sys 0.007s
I20260709 12:58:41.296789  1749 raft_consensus.cc:359] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.297487  1749 raft_consensus.cc:385] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.297736  1749 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.298382  1749 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.299713  1706 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:58:41.299526  1454 catalog_manager.cc:5697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.300843  1749 ts_tablet_manager.cc:1434] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:58:41.301576  1750 tablet_bootstrap.cc:492] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:41.301867  1749 tablet_bootstrap.cc:492] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:41.304162  1751 tablet_bootstrap.cc:654] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.293525  1885 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.309185  1971 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.309723  1971 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.311779  1971 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.312456  1749 tablet_bootstrap.cc:654] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.320379  1750 tablet_bootstrap.cc:654] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.328773  1749 tablet_bootstrap.cc:492] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:41.329306  1749 ts_tablet_manager.cc:1403] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 12:58:41.336668  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:41.351292  1829 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.351763  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:41.352820  1706 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:41.337965  1971 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:58:41.355116  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:41.344398  1999 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:41.356539  1999 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 12:58:41.357517  1526 leader_election.cc:343] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.357482  1999 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.361534  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:41.362339  1749 raft_consensus.cc:359] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.362876  1749 raft_consensus.cc:385] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.363168  1749 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.359773  1458 catalog_manager.cc:5697] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.364730  1749 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.367110  1749 ts_tablet_manager.cc:1434] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 12:58:41.351824  1829 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.368427  1749 tablet_bootstrap.cc:492] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:41.372291  1971 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:41.372892  1971 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.373278  1971 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.373477  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:41.370491  1829 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:41.379715  1751 tablet_bootstrap.cc:492] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
W20260709 12:58:41.379606  1675 leader_election.cc:343] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.381888  1751 ts_tablet_manager.cc:1403] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.012s
I20260709 12:58:41.370430  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:58:41.388211  1673 leader_election.cc:343] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.388707  1673 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:41.389703  1750 tablet_bootstrap.cc:492] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:41.390231  1750 ts_tablet_manager.cc:1403] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.008s
I20260709 12:58:41.393746  1965 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.394459  1454 catalog_manager.cc:5697] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:41.401984  1992 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:41.406374  1751 raft_consensus.cc:359] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.415215  1751 raft_consensus.cc:385] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.415562  1751 raft_consensus.cc:740] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.416623  1749 tablet_bootstrap.cc:654] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.416261  1750 raft_consensus.cc:359] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.418686  1750 raft_consensus.cc:385] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.419385  1750 raft_consensus.cc:740] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.421082  1750 consensus_queue.cc:260] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.423403  1750 ts_tablet_manager.cc:1434] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.002s
I20260709 12:58:41.422924  1458 catalog_manager.cc:5697] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.416193  1751 consensus_queue.cc:260] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.425712  1750 tablet_bootstrap.cc:492] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:41.426740  1751 ts_tablet_manager.cc:1434] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:58:41.410215  1971 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.431537  1971 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.434075  1750 tablet_bootstrap.cc:654] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.434710  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:41.435348  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:41.435349  1700 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:41.437173  1526 leader_election.cc:343] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.435613  1751 tablet_bootstrap.cc:492] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:41.441879  1933 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.442415  1933 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.445079  1933 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.448079  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:58:41.450476  1599 leader_election.cc:343] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.451607  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:41.452931  1706 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:41.457931  1749 tablet_bootstrap.cc:492] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:41.458443  1749 ts_tablet_manager.cc:1403] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.090s	user 0.007s	sys 0.011s
I20260709 12:58:41.458575  1601 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:41.461611  1933 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:41.462018  1933 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.462344  1933 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.462703  1749 raft_consensus.cc:359] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.463361  1749 raft_consensus.cc:385] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.463610  1749 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.464251  1749 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.469545  1933 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.470696  1700 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:41.473242  1749 ts_tablet_manager.cc:1434] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:58:41.474740  1749 tablet_bootstrap.cc:492] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:41.479137  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:41.481235  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 12:58:41.489825  1599 leader_election.cc:343] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.490554  1971 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:41.491061  1971 raft_consensus.cc:697] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:41.492369  1971 consensus_queue.cc:237] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.497396  1962 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.497932  1962 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.500411  1962 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.502133  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:41.502609  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:41.502842  1700 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
W20260709 12:58:41.504469  1599 leader_election.cc:343] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.505548  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:41.506249  1700 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.507563  1751 tablet_bootstrap.cc:654] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.509253  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:41.510746  1750 tablet_bootstrap.cc:492] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:41.511564  1750 ts_tablet_manager.cc:1403] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.087s	user 0.033s	sys 0.029s
I20260709 12:58:41.510766  1962 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:41.516484  1962 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.516853  1962 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.517028  1750 raft_consensus.cc:359] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.518536  1750 raft_consensus.cc:385] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.520370  1750 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.520694  1933 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.521507  1750 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.524943  1962 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.526080  1750 ts_tablet_manager.cc:1434] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 12:58:41.527650  1750 tablet_bootstrap.cc:492] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:41.528005  1749 tablet_bootstrap.cc:654] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.528411  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 12:58:41.529990  1599 leader_election.cc:343] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.533289  1700 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:41.534569  1601 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:41.535673  1933 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:41.535924  1750 tablet_bootstrap.cc:654] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.536324  1933 raft_consensus.cc:697] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:41.537420  1933 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.542610  1751 tablet_bootstrap.cc:492] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:41.543093  1751 ts_tablet_manager.cc:1403] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.108s	user 0.009s	sys 0.005s
I20260709 12:58:41.543974  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:41.544615  1700 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.545866  1751 raft_consensus.cc:359] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.548693  1962 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.551354  1749 tablet_bootstrap.cc:492] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:41.551863  1749 ts_tablet_manager.cc:1403] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.002s
I20260709 12:58:41.555493  1749 raft_consensus.cc:359] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.556416  1749 raft_consensus.cc:385] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.556788  1749 raft_consensus.cc:740] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.546571  1751 raft_consensus.cc:385] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.558423  1751 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.559303  1751 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.560863  1751 ts_tablet_manager.cc:1434] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:58:41.561849  1751 tablet_bootstrap.cc:492] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:41.565361  1933 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.566341  1933 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.569619  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:41.570451  1706 raft_consensus.cc:2393] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:41.572058  1933 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.574625  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:41.575026  1965 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.575502  1965 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.576718  1599 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:41.577733  1965 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:41.578138  1962 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.580260  1458 catalog_manager.cc:5697] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:41.581573  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08000c07c0 after lost signal to thread 434
I20260709 12:58:41.580885  1454 catalog_manager.cc:5697] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:41.582806  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08000c0100 after lost signal to thread 1492
W20260709 12:58:41.583992  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08000579c0 after lost signal to thread 1584
W20260709 12:58:41.585202  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08001db6e0 after lost signal to thread 1659
W20260709 12:58:41.586333  1730 debug-util.cc:398] Leaking SignalData structure 0x7b0800224fc0 after lost signal to thread 1733
I20260709 12:58:41.588992  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:41.588804  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:58:41.590590  1675 leader_election.cc:343] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:41.591825  1673 leader_election.cc:343] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.592299  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:41.593829  1965 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.596096  1751 tablet_bootstrap.cc:654] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.604382  1749 consensus_queue.cc:260] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.609469  1749 ts_tablet_manager.cc:1434] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.002s
I20260709 12:58:41.611466  1749 tablet_bootstrap.cc:492] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:41.611651  1700 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:41.614508  1751 tablet_bootstrap.cc:492] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:41.615274  1751 ts_tablet_manager.cc:1403] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.003s
I20260709 12:58:41.618295  1749 tablet_bootstrap.cc:654] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.622870  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:41.609159  1963 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.625579  1751 raft_consensus.cc:359] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.628360  1751 raft_consensus.cc:385] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.628783  1751 raft_consensus.cc:740] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.629446  1751 consensus_queue.cc:260] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.633071  1971 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:41.634457  1751 ts_tablet_manager.cc:1434] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:58:41.635455  1751 tablet_bootstrap.cc:492] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:41.638351  1885 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.638857  1885 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.629107  1963 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.641605  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:58:41.643136  1673 leader_election.cc:343] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.643421  1962 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.628206  1933 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:41.648792  1933 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:41.650368  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:41.649941  1933 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.651021  1557 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:41.652285  1599 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:41.652539  1885 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:41.653139  1838 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:41.653491  1838 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.653837  1838 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.653498  1963 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.658483  1751 tablet_bootstrap.cc:654] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.665199  1750 tablet_bootstrap.cc:492] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:41.665724  1750 ts_tablet_manager.cc:1403] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.138s	user 0.032s	sys 0.031s
I20260709 12:58:41.674181  1750 raft_consensus.cc:359] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.675014  1750 raft_consensus.cc:385] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.675276  1750 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.675931  1750 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.678769  1750 ts_tablet_manager.cc:1434] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:58:41.668373  1838 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.686430  1971 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.689152  1971 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.689473  1750 tablet_bootstrap.cc:492] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:41.692028  1971 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.693048  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:41.694067  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:58:41.696192  1526 leader_election.cc:343] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.687107  1992 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.699116  1992 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.701161  1992 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:58:41.702962  1526 leader_election.cc:343] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.703413  1526 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:41.708902  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:41.713382  1557 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.688477  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:41.708801  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:41.715276  1458 catalog_manager.cc:5697] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:41.722977  1601 leader_election.cc:343] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:41.726157  1675 leader_election.cc:343] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.726649  1675 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:41.718307  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:41.727885  1885 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.728545  1707 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 1: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:58:41.731616  1885 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:41.720546  1862 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.733649  1838 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.740936  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:41.741219  1557 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:41.744604  1862 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.747053  1862 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.746064  1971 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:41.748972  1749 tablet_bootstrap.cc:492] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:41.749439  1749 ts_tablet_manager.cc:1403] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.008s
I20260709 12:58:41.751096  1862 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.754413  1749 raft_consensus.cc:359] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.755097  1749 raft_consensus.cc:385] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.755379  1749 raft_consensus.cc:740] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.756850  1749 consensus_queue.cc:260] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.753654  2024 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:58:41.755604  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:41.753921  1599 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:41.761179  1971 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:41.763639  1838 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:41.764195  1838 raft_consensus.cc:697] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:41.764415  1963 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.764952  1963 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.765372  1526 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:41.766937  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:58:41.768533  1526 leader_election.cc:343] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.768533  1963 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:41.775092  1749 ts_tablet_manager.cc:1434] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 12:58:41.776160  1749 tablet_bootstrap.cc:492] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:41.776666  1838 consensus_queue.cc:237] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.778748  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:58:41.785279  1675 consensus_peers.cc:597] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:41.787573  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:41.768963  1862 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.792784  1751 tablet_bootstrap.cc:492] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:41.793558  1751 ts_tablet_manager.cc:1403] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.158s	user 0.028s	sys 0.028s
W20260709 12:58:41.796943  1526 leader_election.cc:343] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.798177  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:58:41.801117  1601 leader_election.cc:343] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.799505  1992 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.798501  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:41.809710  1703 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
W20260709 12:58:41.795186  1599 leader_election.cc:343] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.816902  1971 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:41.818675  1749 tablet_bootstrap.cc:654] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.828610  1750 tablet_bootstrap.cc:654] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.829386  1965 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.830719  1965 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.831421  1708 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:41.833205  1965 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:41.833774  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:58:41.836548  1673 leader_election.cc:343] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.837385  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:41.839876  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:41.841516  1933 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:41.841882  1933 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.842217  1933 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.842742  1862 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.848033  1971 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:41.856421  1675 leader_election.cc:343] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.857951  1675 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:41.866201  1751 raft_consensus.cc:359] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.866994  1751 raft_consensus.cc:385] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.867285  1751 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.867935  1751 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.867131  1965 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.870543  1963 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:58:41.874760  1933 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.880753  1751 ts_tablet_manager.cc:1434] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.001s
I20260709 12:58:41.902515  1750 tablet_bootstrap.cc:492] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:41.903332  1750 ts_tablet_manager.cc:1403] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.215s	user 0.010s	sys 0.008s
I20260709 12:58:41.914016  1749 tablet_bootstrap.cc:492] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:41.915305  1749 ts_tablet_manager.cc:1403] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.139s	user 0.010s	sys 0.006s
I20260709 12:58:41.927742  1751 tablet_bootstrap.cc:492] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:41.930442  1996 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.930981  1996 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.931595  1750 raft_consensus.cc:359] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.932296  1750 raft_consensus.cc:385] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.932567  1750 raft_consensus.cc:740] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.933902  1454 catalog_manager.cc:5697] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.933295  1750 consensus_queue.cc:260] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.936452  1750 ts_tablet_manager.cc:1434] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 12:58:41.937636  1750 tablet_bootstrap.cc:492] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:41.943781  1749 raft_consensus.cc:359] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.945521  1749 raft_consensus.cc:385] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.945895  1749 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.952899  1749 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:41.954855  1749 ts_tablet_manager.cc:1434] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:58:41.955883  1749 tablet_bootstrap.cc:492] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:41.989626  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:42.005040  1526 leader_election.cc:343] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:42.005548  1838 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.006063  1838 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.007458  1933 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:42.007820  1634 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:41.974277  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 12:58:42.026927  1599 leader_election.cc:343] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:42.031279  1758 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:42.075883  1996 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:42.097210  1750 tablet_bootstrap.cc:654] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.088433  1962 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.088989  1838 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:42.100234  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:42.101692  1962 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:42.107609  1599 leader_election.cc:343] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:42.104578  1962 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:42.116254  1751 tablet_bootstrap.cc:654] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.119696  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:42.123170  1557 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:42.136966  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:42.137144  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:42.137676  1703 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:42.137997  1700 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.130403  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:42.150074  1749 tablet_bootstrap.cc:654] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.139838  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:42.153841  1707 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:42.151506  2043 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:42.168164  1751 tablet_bootstrap.cc:492] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
W20260709 12:58:42.168243  1526 consensus_peers.cc:597] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:42.168784  1751 ts_tablet_manager.cc:1403] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.270s	user 0.021s	sys 0.020s
I20260709 12:58:42.172838  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:42.174880  1707 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
W20260709 12:58:42.177047  1599 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:42.162784  2043 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.181888  1750 tablet_bootstrap.cc:492] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:42.185457  1750 ts_tablet_manager.cc:1403] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.248s	user 0.015s	sys 0.025s
I20260709 12:58:42.176249  1700 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:42.187346  1933 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:42.187503  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:42.186836  1751 raft_consensus.cc:359] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.189496  1751 raft_consensus.cc:385] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.189749  1933 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:42.184769  2043 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.189774  1751 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.193415  1751 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.196771  1892 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:42.196877  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:42.198169  1892 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:42.198825  1892 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.199374  1892 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.190176  1933 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.190092  1962 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:42.208114  2024 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:42.209409  1933 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.212384  1751 ts_tablet_manager.cc:1434] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:58:42.214475  1751 tablet_bootstrap.cc:492] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:42.191457  1750 raft_consensus.cc:359] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.220993  1750 raft_consensus.cc:385] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.221583  1750 raft_consensus.cc:740] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.227305  1749 tablet_bootstrap.cc:492] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:42.227823  1749 ts_tablet_manager.cc:1403] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.272s	user 0.012s	sys 0.000s
I20260709 12:58:42.233214  1750 consensus_queue.cc:260] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.243310  1751 tablet_bootstrap.cc:654] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.243631  1892 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.256042  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:42.257076  1708 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.259744  2024 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:42.260296  2024 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:42.268811  2024 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.281591  1750 ts_tablet_manager.cc:1434] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.093s	user 0.012s	sys 0.000s
I20260709 12:58:42.283115  1758 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.285720  1838 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:42.288410  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:42.289211  1706 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.288301  2043 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.283797  1758 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.300405  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:42.301328  1704 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.302896  1758 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:42.310946  2043 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:42.317489  1706 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:42.319020  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:42.320182  1758 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:42.320819  1758 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:42.313907  1704 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:42.321417  1758 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.264456  1892 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:42.334403  1601 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:42.341519  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:42.355855  1750 tablet_bootstrap.cc:492] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:42.358111  1703 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 1: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:58:42.359143  2049 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:42.351018  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:42.360275  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:42.361029  1555 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.373291  2049 raft_consensus.cc:697] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:42.374307  2049 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:42.396418  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:42.410326  1933 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.429086  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:42.499272  1862 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.500177  1862 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.503633  1862 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:42.518105  1555 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
W20260709 12:58:42.520733  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 141824us
I20260709 12:58:42.537094  1933 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:42.539453  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:42.541787  1749 raft_consensus.cc:359] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.546064  1749 raft_consensus.cc:385] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.546612  1749 raft_consensus.cc:740] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
W20260709 12:58:42.525827  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 146048us
I20260709 12:58:42.556911  1749 consensus_queue.cc:260] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.564821  1751 tablet_bootstrap.cc:492] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:42.565450  1751 ts_tablet_manager.cc:1403] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.351s	user 0.015s	sys 0.007s
W20260709 12:58:42.571853  1526 leader_election.cc:343] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:42.578418  1454 catalog_manager.cc:5697] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.587488  2024 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:42.593933  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:42.597901  1751 raft_consensus.cc:359] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.598984  1751 raft_consensus.cc:385] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.599273  1751 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.599606  1750 tablet_bootstrap.cc:654] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.599989  1751 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.611490  1751 ts_tablet_manager.cc:1434] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 12:58:42.620009  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:42.620891  1702 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:42.621439  1526 leader_election.cc:343] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:42.633401  2057 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:58:42.638221  1749 ts_tablet_manager.cc:1434] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.410s	user 0.034s	sys 0.046s
I20260709 12:58:42.644111  1751 tablet_bootstrap.cc:492] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:42.642041  1526 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:42.645750  1758 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.649541  1749 tablet_bootstrap.cc:492] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:42.656276  1750 tablet_bootstrap.cc:492] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:42.656903  1750 ts_tablet_manager.cc:1403] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.314s	user 0.015s	sys 0.007s
I20260709 12:58:42.669355  1758 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:42.701908  1455 catalog_manager.cc:5697] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.703989  1560 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.705873  1702 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:42.707435  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:42.707965  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:42.708272  1633 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:42.710894  2059 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:42.711436  2059 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:42.715744  1455 catalog_manager.cc:5697] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.712280  2059 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.749209  1750 raft_consensus.cc:359] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.753720  1750 raft_consensus.cc:385] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.754128  1750 raft_consensus.cc:740] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.759244  1751 tablet_bootstrap.cc:654] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.761754  1749 tablet_bootstrap.cc:654] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.763581  1750 consensus_queue.cc:260] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.748865  1560 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
W20260709 12:58:42.762907  2068 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:58:42.772179  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:58:42.774207  1892 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:42.775697  1892 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.776579  1892 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.782228  1750 ts_tablet_manager.cc:1434] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.125s	user 0.002s	sys 0.006s
W20260709 12:58:42.783027  1526 consensus_peers.cc:597] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:42.805594  1750 tablet_bootstrap.cc:492] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:42.818941  1933 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:42.828756  2056 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:58:42.836298  1455 catalog_manager.cc:5697] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.847576  1892 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.847983  2038 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.851348  1892 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:42.858582  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:42.848860  2038 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.868968  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:42.869421  1708 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.869930  1629 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.877465  1750 tablet_bootstrap.cc:654] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.883867  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:42.885411  1555 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:42.896039  2059 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:42.899714  2038 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:42.902310  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:42.907802  1675 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:42.908562  2059 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:42.922180  1708 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:42.925593  2062 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:42.944768  1751 tablet_bootstrap.cc:492] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:42.945438  1751 ts_tablet_manager.cc:1403] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.316s	user 0.014s	sys 0.014s
I20260709 12:58:42.948948  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:42.954980  2056 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:42.967504  2056 raft_consensus.cc:697] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:42.968604  2056 consensus_queue.cc:237] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:42.976662  1963 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:42.990300  1750 tablet_bootstrap.cc:492] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:42.996977  1750 ts_tablet_manager.cc:1403] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.192s	user 0.025s	sys 0.008s
I20260709 12:58:43.000720  1749 tablet_bootstrap.cc:492] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:43.001259  1749 ts_tablet_manager.cc:1403] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.356s	user 0.053s	sys 0.058s
I20260709 12:58:43.034898  1751 raft_consensus.cc:359] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.035717  1751 raft_consensus.cc:385] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.036047  1751 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.036772  1750 raft_consensus.cc:359] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.037580  1750 raft_consensus.cc:385] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.037895  1750 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.038622  1750 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.043090  1751 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.045156  1629 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:43.050797  1750 ts_tablet_manager.cc:1434] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.002s
I20260709 12:58:43.053985  1750 tablet_bootstrap.cc:492] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:43.055083  1751 ts_tablet_manager.cc:1434] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.002s
I20260709 12:58:43.056267  1751 tablet_bootstrap.cc:492] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:43.067705  1749 raft_consensus.cc:359] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.068810  1749 raft_consensus.cc:385] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.069151  1749 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.069842  1749 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.071480  1751 tablet_bootstrap.cc:654] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.072307  1749 ts_tablet_manager.cc:1434] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.071s	user 0.002s	sys 0.010s
I20260709 12:58:43.073637  1749 tablet_bootstrap.cc:492] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:43.074271  1750 tablet_bootstrap.cc:654] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:43.082989  1586 tablet.cc:2406] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:58:43.104192  1751 tablet_bootstrap.cc:492] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:43.104717  1751 ts_tablet_manager.cc:1403] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.000s
I20260709 12:58:43.103351  2056 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.115491  2056 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.119763  1751 raft_consensus.cc:359] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.120576  1751 raft_consensus.cc:385] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.120916  1751 raft_consensus.cc:740] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.121637  1751 consensus_queue.cc:260] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.123487  2056 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:43.126375  1751 ts_tablet_manager.cc:1434] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:58:43.127895  1751 tablet_bootstrap.cc:492] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:43.130936  1750 tablet_bootstrap.cc:492] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:43.130998  1749 tablet_bootstrap.cc:654] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.131537  1750 ts_tablet_manager.cc:1403] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.078s	user 0.019s	sys 0.000s
I20260709 12:58:43.134140  1750 raft_consensus.cc:359] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.134774  1750 raft_consensus.cc:385] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.135085  1750 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.135712  1750 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.137379  1751 tablet_bootstrap.cc:654] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.137799  1750 ts_tablet_manager.cc:1434] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:58:43.145434  1454 catalog_manager.cc:5697] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:43.152405  1750 tablet_bootstrap.cc:492] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:43.154735  1751 tablet_bootstrap.cc:492] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:43.155258  1751 ts_tablet_manager.cc:1403] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.007s
I20260709 12:58:43.159638  1751 raft_consensus.cc:359] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.161176  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:43.163971  1750 tablet_bootstrap.cc:654] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.165695  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:43.160380  1751 raft_consensus.cc:385] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.168269  1751 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.169216  1751 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.172022  1751 ts_tablet_manager.cc:1434] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:58:43.173323  1751 tablet_bootstrap.cc:492] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:43.176915  1885 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.177950  1885 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.180902  1885 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:43.182905  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:43.187943  1675 leader_election.cc:343] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.190716  1751 tablet_bootstrap.cc:654] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.195827  1749 tablet_bootstrap.cc:492] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:43.196370  1749 ts_tablet_manager.cc:1403] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.123s	user 0.018s	sys 0.021s
I20260709 12:58:43.198400  1750 tablet_bootstrap.cc:492] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:43.198987  1750 ts_tablet_manager.cc:1403] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.005s
I20260709 12:58:43.200222  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:43.200685  1749 raft_consensus.cc:359] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.201452  1749 raft_consensus.cc:385] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:58:43.205608  1673 leader_election.cc:343] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.201645  1750 raft_consensus.cc:359] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.224277  1750 raft_consensus.cc:385] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.224220  1673 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:43.224776  1750 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.225143  1885 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.225509  1750 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:43.205610  1526 leader_election.cc:343] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.230419  1750 ts_tablet_manager.cc:1434] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.031s	user 0.018s	sys 0.010s
I20260709 12:58:43.231421  1750 tablet_bootstrap.cc:492] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:43.201771  1749 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.232234  1749 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.234251  1749 ts_tablet_manager.cc:1434] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 12:58:43.236552  1749 tablet_bootstrap.cc:492] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:43.237566  1885 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.238109  1885 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.242128  1750 tablet_bootstrap.cc:654] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.242370  1749 tablet_bootstrap.cc:654] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.250030  1751 tablet_bootstrap.cc:492] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:43.250494  1751 ts_tablet_manager.cc:1403] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.006s
I20260709 12:58:43.253211  1963 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:43.253796  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:43.258070  1675 leader_election.cc:343] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.240367  1885 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:43.259982  1751 raft_consensus.cc:359] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.260754  1751 raft_consensus.cc:385] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.261018  1751 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.261934  1751 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.264516  1751 ts_tablet_manager.cc:1434] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:58:43.265377  1555 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.265547  1751 tablet_bootstrap.cc:492] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
W20260709 12:58:43.269714  1526 leader_election.cc:343] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.271065  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:43.272454  1971 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.282837  1751 tablet_bootstrap.cc:654] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.301585  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:43.302563  1557 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:43.307287  1885 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.307924  1885 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.313259  1673 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:43.314266  1885 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:43.314874  1885 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:43.315212  1885 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.317607  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:43.319482  1675 leader_election.cc:343] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.320010  2059 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.320544  2059 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.323057  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:43.323287  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:43.324827  2059 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:58:43.325618  1673 leader_election.cc:343] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.326040  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:43.327102  2062 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.344244  1971 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.345000  1971 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.347071  1971 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:43.349442  1838 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:43.349778  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:58:43.351644  1526 leader_election.cc:343] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.315563  1885 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.364080  1963 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.375075  1963 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.377597  1751 tablet_bootstrap.cc:492] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:43.378111  1751 ts_tablet_manager.cc:1403] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.113s	user 0.020s	sys 0.019s
I20260709 12:58:43.378106  1963 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:43.367659  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:43.381639  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:43.382599  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:43.383281  1702 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:43.383373  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:58:43.386667  1599 leader_election.cc:343] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.387638  1601 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:43.401652  1750 tablet_bootstrap.cc:492] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:43.402194  1750 ts_tablet_manager.cc:1403] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.171s	user 0.032s	sys 0.025s
W20260709 12:58:43.405206  1526 leader_election.cc:343] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.405370  1601 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:43.405738  1526 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:43.407408  1749 tablet_bootstrap.cc:492] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:43.407907  1749 ts_tablet_manager.cc:1403] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.172s	user 0.015s	sys 0.016s
I20260709 12:58:43.409255  1758 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.395082  2059 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.408385  1750 raft_consensus.cc:359] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.411031  1750 raft_consensus.cc:385] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.411340  1750 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.412096  1750 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.414109  1749 raft_consensus.cc:359] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.414919  1749 raft_consensus.cc:385] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.415236  1749 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.417562  1750 ts_tablet_manager.cc:1434] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:58:43.418646  1750 tablet_bootstrap.cc:492] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:43.420634  1749 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.421831  1629 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.422983  1749 ts_tablet_manager.cc:1434] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 12:58:43.423612  2059 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:43.424044  2059 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.424423  2059 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.421120  1751 raft_consensus.cc:359] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.426796  1751 raft_consensus.cc:385] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.427268  1751 raft_consensus.cc:740] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.428066  1751 consensus_queue.cc:260] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.433337  1751 ts_tablet_manager.cc:1434] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 12:58:43.435236  1751 tablet_bootstrap.cc:492] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:43.447795  1749 tablet_bootstrap.cc:492] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:43.450886  1758 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:43.458279  1758 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.458765  1758 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.472306  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:43.475999  1758 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:58:43.478880  1526 leader_election.cc:343] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.444345  1885 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.482610  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:43.483800  1702 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:43.485092  1526 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:43.486477  1758 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:43.486807  1758 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.487118  1758 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.494903  1750 tablet_bootstrap.cc:654] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.504303  1751 tablet_bootstrap.cc:654] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:43.507130  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:43.507295  1885 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:43.512835  1758 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.513278  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:43.514194  1555 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.517869  1758 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:43.522372  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:43.523156  1702 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.527590  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:43.529547  1749 tablet_bootstrap.cc:654] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:43.530362  1526 leader_election.cc:343] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.531116  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:43.533716  2056 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:58:43.540428  1675 leader_election.cc:343] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.543828  1758 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.544348  1758 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.547490  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:43.550988  1526 leader_election.cc:343] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.536083  2059 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.557467  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:43.557961  1758 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:43.558157  1709 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:43.570613  1702 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:43.570964  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 12:58:43.572394  1599 leader_election.cc:343] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.572830  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:43.572964  2059 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:43.574018  1526 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:43.575238  1999 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:43.575599  1999 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.575924  1999 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.579545  1555 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:43.580549  1971 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:43.583787  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:43.582556  1971 raft_consensus.cc:697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:43.584450  1709 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.585409  1971 consensus_queue.cc:237] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.590785  1749 tablet_bootstrap.cc:492] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:43.591493  1749 ts_tablet_manager.cc:1403] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.144s	user 0.008s	sys 0.007s
I20260709 12:58:43.593454  1673 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:43.594640  2095 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:43.595180  2095 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:43.596160  1751 tablet_bootstrap.cc:492] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:43.595983  2095 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.596633  1751 ts_tablet_manager.cc:1403] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.162s	user 0.011s	sys 0.011s
I20260709 12:58:43.594353  1749 raft_consensus.cc:359] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.602768  1749 raft_consensus.cc:385] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.603098  1749 raft_consensus.cc:740] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.604857  1749 consensus_queue.cc:260] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.607585  1751 raft_consensus.cc:359] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.612666  1751 raft_consensus.cc:385] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.612968  1751 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.614995  1885 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.615517  1885 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.611151  1749 ts_tablet_manager.cc:1434] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:58:43.610296  1999 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.617835  1885 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:43.618316  1749 tablet_bootstrap.cc:492] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:43.619765  1999 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:43.613584  1751 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.622515  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:43.623674  1630 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:43.623685  1751 ts_tablet_manager.cc:1434] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.002s
I20260709 12:58:43.625339  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:43.626390  1751 tablet_bootstrap.cc:492] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:43.626467  1885 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:43.626974  1885 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.627349  1885 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.637068  1750 tablet_bootstrap.cc:492] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:43.638506  1750 ts_tablet_manager.cc:1403] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.220s	user 0.021s	sys 0.002s
I20260709 12:58:43.643873  1749 tablet_bootstrap.cc:654] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.650449  1751 tablet_bootstrap.cc:654] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.652566  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:43.654980  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:43.655694  1704 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.708660  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:43.709753  1751 tablet_bootstrap.cc:492] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:43.711388  1751 ts_tablet_manager.cc:1403] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.007s
I20260709 12:58:43.719852  1709 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:43.726408  1455 catalog_manager.cc:5697] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:43.727959  1601 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:58:43.731518  1673 leader_election.cc:343] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.731546  2059 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.733578  2059 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.734443  1971 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.735060  1971 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.739176  1971 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:43.733882  1933 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:43.740849  1933 raft_consensus.cc:697] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:43.741045  1704 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:43.741743  1933 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.636576  1885 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.746482  1885 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:43.746690  2059 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:43.746244  1454 catalog_manager.cc:5697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:43.748333  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:43.750839  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:43.751968  1709 raft_consensus.cc:2393] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:43.753291  1750 raft_consensus.cc:359] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.755054  1750 raft_consensus.cc:385] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.755406  1750 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.756456  1750 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.753264  1751 raft_consensus.cc:359] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.758052  1751 raft_consensus.cc:385] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.758785  1751 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.758823  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:43.759874  1751 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.761688  1629 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:43.757153  1526 leader_election.cc:343] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.766462  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:43.767154  1751 ts_tablet_manager.cc:1434] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.003s
I20260709 12:58:43.768699  1751 tablet_bootstrap.cc:492] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:43.769721  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:43.769750  1750 ts_tablet_manager.cc:1434] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.131s	user 0.007s	sys 0.001s
I20260709 12:58:43.770447  1709 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:43.771593  1750 tablet_bootstrap.cc:492] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:43.773257  1749 tablet_bootstrap.cc:492] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:43.782178  1749 ts_tablet_manager.cc:1403] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.164s	user 0.021s	sys 0.021s
I20260709 12:58:43.789088  1601 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:43.791415  2059 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.799216  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:43.800685  1749 raft_consensus.cc:359] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.800944  1557 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.801410  1749 raft_consensus.cc:385] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.801783  1749 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.808187  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:43.809412  1971 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:43.809886  1971 raft_consensus.cc:697] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:43.810575  1971 consensus_queue.cc:237] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.813140  2059 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.814917  1526 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:43.815857  1892 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:43.816286  1892 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.816638  1892 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.818140  1750 tablet_bootstrap.cc:654] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.819922  1629 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:43.821724  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:43.822842  2038 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:43.823108  1749 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.823580  2038 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:43.824069  1751 tablet_bootstrap.cc:654] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.824687  2038 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.828063  1458 catalog_manager.cc:5697] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:43.833048  1526 leader_election.cc:343] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.831187  1892 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.833428  1749 ts_tablet_manager.cc:1434] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:58:43.839587  1892 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:43.847637  2059 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.848184  2059 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.840133  1749 tablet_bootstrap.cc:492] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:43.841943  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:43.851231  1709 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.851943  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:43.852856  1555 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:43.855088  1599 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:43.856462  1933 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:43.857077  1933 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.857887  1933 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.842953  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 12:58:43.861835  1526 leader_election.cc:343] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.862547  1750 tablet_bootstrap.cc:492] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:43.863010  1750 ts_tablet_manager.cc:1403] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.092s	user 0.009s	sys 0.005s
I20260709 12:58:43.866305  1750 raft_consensus.cc:359] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.867098  1750 raft_consensus.cc:385] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.867390  1750 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.869313  2059 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:43.870854  1709 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:43.871215  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:43.872160  1704 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:43.874838  1526 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:43.875662  1892 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:43.876384  1892 raft_consensus.cc:697] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:43.880131  1749 tablet_bootstrap.cc:654] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.880263  1933 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.869019  1750 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.882465  1933 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:43.880836  1892 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.892480  1751 tablet_bootstrap.cc:492] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:43.893167  1751 ts_tablet_manager.cc:1403] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.125s	user 0.016s	sys 0.000s
I20260709 12:58:43.884629  1557 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:43.885963  1750 ts_tablet_manager.cc:1434] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 12:58:43.886565  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:43.894914  1750 tablet_bootstrap.cc:492] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:43.895148  1555 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.887683  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:43.890501  1454 catalog_manager.cc:5697] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:43.896082  1709 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.901096  1751 raft_consensus.cc:359] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.902552  1751 raft_consensus.cc:385] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.904341  1751 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.903402  1709 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:43.908290  1601 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:43.906940  1751 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.909009  1933 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:43.913245  1933 raft_consensus.cc:697] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:43.914070  1933 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.921384  1751 ts_tablet_manager.cc:1434] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 12:58:43.955579  1749 tablet_bootstrap.cc:492] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:43.956060  1749 ts_tablet_manager.cc:1403] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.118s	user 0.022s	sys 0.011s
I20260709 12:58:43.962066  1751 tablet_bootstrap.cc:492] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:43.963369  1749 raft_consensus.cc:359] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.963991  1749 raft_consensus.cc:385] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.964249  1749 raft_consensus.cc:740] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.965292  1555 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:43.965138  1749 consensus_queue.cc:260] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:43.966070  1750 tablet_bootstrap.cc:654] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.970809  1454 catalog_manager.cc:5697] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:43.972916  1458 catalog_manager.cc:5697] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:43.975149  1749 ts_tablet_manager.cc:1434] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 12:58:43.974694  1458 catalog_manager.cc:5697] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:43.981321  1751 tablet_bootstrap.cc:654] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.990914  1749 tablet_bootstrap.cc:492] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:44.056308  1749 tablet_bootstrap.cc:654] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.058665  1750 tablet_bootstrap.cc:492] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:44.059249  1750 ts_tablet_manager.cc:1403] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.165s	user 0.029s	sys 0.031s
I20260709 12:58:44.063050  1750 raft_consensus.cc:359] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.063994  1750 raft_consensus.cc:385] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.070012  1751 tablet_bootstrap.cc:492] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:44.064347  1750 raft_consensus.cc:740] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.072101  1885 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:44.072614  1749 tablet_bootstrap.cc:492] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:44.073362  1749 ts_tablet_manager.cc:1403] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.086s	user 0.015s	sys 0.007s
I20260709 12:58:44.070525  1751 ts_tablet_manager.cc:1403] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.117s	user 0.008s	sys 0.005s
I20260709 12:58:44.076653  1751 raft_consensus.cc:359] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.077291  1751 raft_consensus.cc:385] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.077584  1751 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.078179  1751 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.078791  1892 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:44.079542  1749 raft_consensus.cc:359] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.080199  1749 raft_consensus.cc:385] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.080446  1749 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.080687  1751 ts_tablet_manager.cc:1434] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:44.081683  1751 tablet_bootstrap.cc:492] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:44.081314  1749 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.084141  1749 ts_tablet_manager.cc:1434] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:58:44.085441  1749 tablet_bootstrap.cc:492] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:44.087672  1892 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:44.089828  1751 tablet_bootstrap.cc:654] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.092926  1749 tablet_bootstrap.cc:654] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.093210  1750 consensus_queue.cc:260] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.102576  1750 ts_tablet_manager.cc:1434] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 12:58:44.103587  1750 tablet_bootstrap.cc:492] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:44.109150  1933 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.109860  1933 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.117192  1971 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.117848  1971 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.120224  1933 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:44.120365  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:44.136523  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:44.137705  1709 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:44.147763  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:44.150014  1751 tablet_bootstrap.cc:492] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:44.150504  1751 ts_tablet_manager.cc:1403] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.014s
I20260709 12:58:44.154125  1971 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:44.164942  1601 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:44.167259  1885 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.167701  1885 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.171327  1885 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:44.173269  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:44.173933  1557 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:44.174243  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:44.175086  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:44.175834  1885 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:44.176180  1885 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.176473  1885 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:44.175583  1675 leader_election.cc:343] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.171317  2059 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.182534  1751 raft_consensus.cc:359] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.183561  1751 raft_consensus.cc:385] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.183897  1751 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.188308  1751 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.228250  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:44.229707  1703 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 1: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 12:58:44.237319  1675 consensus_peers.cc:597] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:44.272266  1885 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.278863  1750 tablet_bootstrap.cc:654] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.279222  1557 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.280763  1885 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:44.282275  1749 tablet_bootstrap.cc:492] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:44.282764  1749 ts_tablet_manager.cc:1403] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.198s	user 0.029s	sys 0.018s
I20260709 12:58:44.285152  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:44.287248  1749 raft_consensus.cc:359] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.287953  1749 raft_consensus.cc:385] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.288215  1749 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.288853  1749 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.291260  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:44.295197  1749 ts_tablet_manager.cc:1434] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:58:44.313616  1749 tablet_bootstrap.cc:492] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
W20260709 12:58:44.296645  1675 leader_election.cc:343] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.315018  1838 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.326218  1838 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.295877  2130 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:44.329749  2132 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.330289  2132 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.343006  1838 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:44.316015  2096 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:58:44.347301  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:44.347642  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:44.350626  1558 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.337026  2132 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:44.353332  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:44.347337  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:44.348300  2059 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:44.359903  1630 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:44.367654  1750 tablet_bootstrap.cc:492] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:44.368212  1750 ts_tablet_manager.cc:1403] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.265s	user 0.021s	sys 0.021s
I20260709 12:58:44.371192  1751 ts_tablet_manager.cc:1434] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.220s	user 0.016s	sys 0.006s
I20260709 12:58:44.372538  1751 tablet_bootstrap.cc:492] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:44.379573  1885 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:44.382501  1933 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.382997  1933 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:44.380209  1601 leader_election.cc:343] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:44.387881  1526 leader_election.cc:343] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.405751  1933 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:58:44.406702  1675 consensus_peers.cc:597] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:58:44.405273  1526 consensus_peers.cc:597] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:44.412374  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:44.405217  1558 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:44.413094  1709 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:44.408470  1838 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:58:44.392882  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:44.415880  1601 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:44.417075  1560 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:44.408661  1750 raft_consensus.cc:359] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.475559  1750 raft_consensus.cc:385] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.476161  1750 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
W20260709 12:58:44.472078  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 62612.2us
I20260709 12:58:44.478000  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:58:44.481967  1749 tablet_bootstrap.cc:654] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.480260  1750 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.484054  1599 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:58:44.417258  2096 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:44.487205  1838 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:44.489699  1758 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:44.484246  1892 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:44.493467  1885 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.497195  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:44.496845  1885 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.421418  2038 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.072s
I20260709 12:58:44.501981  1885 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:44.502592  1885 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.503089  1885 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.504487  1758 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:44.509410  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:44.510268  1557 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:44.493013  2096 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.512575  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:44.516021  1750 ts_tablet_manager.cc:1434] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.148s	user 0.009s	sys 0.003s
I20260709 12:58:44.495188  1838 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.495121  1892 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.520030  1885 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:44.513826  2095 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:58:44.533357  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 49404.1us
I20260709 12:58:44.537478  1750 tablet_bootstrap.cc:492] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:44.517143  2096 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.525693  1892 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.522362  1838 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:44.562429  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 63384.6us
I20260709 12:58:44.548257  2095 raft_consensus.cc:697] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:44.574469  2038 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:44.587253  2038 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.587653  2038 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.625092  1838 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.637161  2095 consensus_queue.cc:237] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.640061  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:44.656653  2096 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.660552  1751 tablet_bootstrap.cc:654] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.691221  1838 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:44.698153  2038 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.698745  1892 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.703349  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:44.705114  1599 leader_election.cc:343] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.715163  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:44.718036  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:44.719486  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:44.720317  1559 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 12:58:44.732777  1675 leader_election.cc:343] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:44.733737  1675 leader_election.cc:343] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.689867  2137 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:58:44.701642  2038 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:58:44.795383  2112 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:58:44.822857  1749 tablet_bootstrap.cc:492] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:44.823405  1749 ts_tablet_manager.cc:1403] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.510s	user 0.016s	sys 0.010s
I20260709 12:58:44.827420  1750 tablet_bootstrap.cc:654] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.825006  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:44.772182  2143 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.064s
W20260709 12:58:44.856762  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:58:44.902071  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 185335us
W20260709 12:58:44.910544  1599 leader_election.cc:343] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.937112  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:58:44.939248  1675 leader_election.cc:343] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.939992  1892 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:44.944149  2096 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:44.955029  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:44.955741  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:44.955909  1706 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.955896  1749 raft_consensus.cc:359] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.956521  1630 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 1: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:58:44.963862  1749 raft_consensus.cc:385] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.964295  1749 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
W20260709 12:58:44.948298  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 435775us
I20260709 12:58:44.970638  1706 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:44.964993  1749 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:44.985884  1749 ts_tablet_manager.cc:1434] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.162s	user 0.007s	sys 0.000s
I20260709 12:58:45.012621  1749 tablet_bootstrap.cc:492] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
W20260709 12:58:45.039487  1601 leader_election.cc:343] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:45.039988  1601 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:45.041815  1601 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:45.048152  1838 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:45.053844  1963 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:45.065794  1963 raft_consensus.cc:697] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:45.066954  1963 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.095369  1751 tablet_bootstrap.cc:492] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:45.095983  1751 ts_tablet_manager.cc:1403] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.724s	user 0.035s	sys 0.043s
I20260709 12:58:45.102823  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:45.155598  1751 raft_consensus.cc:359] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.160043  1749 tablet_bootstrap.cc:654] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:45.171244  1675 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:45.156541  1751 raft_consensus.cc:385] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:45.181352  1751 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:45.183622  1751 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.187021  1750 tablet_bootstrap.cc:492] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:45.187585  1750 ts_tablet_manager.cc:1403] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.668s	user 0.021s	sys 0.019s
I20260709 12:58:45.199393  1750 raft_consensus.cc:359] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.200838  1750 raft_consensus.cc:385] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:45.201400  1750 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:45.202353  1751 ts_tablet_manager.cc:1434] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.002s
I20260709 12:58:45.209813  1631 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.223963  1750 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.226425  2095 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.233318  2095 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.250349  1750 ts_tablet_manager.cc:1434] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.001s
I20260709 12:58:45.253225  1751 tablet_bootstrap.cc:492] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
W20260709 12:58:45.256162  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 72008.4us
I20260709 12:58:45.260941  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:45.262965  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:45.263823  1553 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.270516  1750 tablet_bootstrap.cc:492] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:45.274807  2095 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:45.297492  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:45.305550  1675 leader_election.cc:343] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:45.308806  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:45.309329  2134 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:45.309523  1558 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:45.320608  1553 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:45.330842  1749 tablet_bootstrap.cc:492] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:45.331347  1749 ts_tablet_manager.cc:1403] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.319s	user 0.037s	sys 0.032s
W20260709 12:58:45.332475  1526 leader_election.cc:343] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:45.332990  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:45.335121  2132 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:45.352313  1749 raft_consensus.cc:359] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.353319  1749 raft_consensus.cc:385] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:45.353603  1749 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:45.359163  1750 tablet_bootstrap.cc:654] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:45.365445  1749 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:45.367038  1673 leader_election.cc:343] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:45.382750  1673 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:45.387486  1751 tablet_bootstrap.cc:654] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:45.399675  2095 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:45.405795  1749 ts_tablet_manager.cc:1434] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.011s
I20260709 12:58:45.408555  1458 catalog_manager.cc:5697] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:45.410425  1749 tablet_bootstrap.cc:492] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:45.414304  1673 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:45.417764  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:45.421530  2145 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:45.421980  2145 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.422323  2145 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.432493  2147 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:45.433260  2147 raft_consensus.cc:697] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:45.434158  2147 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.436374  2038 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:45.438644  2059 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:58:45.439268  2059 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.450655  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:45.471611  2059 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:45.480921  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:58:45.481389  1526 consensus_peers.cc:597] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:58:45.494766  1750 tablet_bootstrap.cc:492] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:45.495311  1750 ts_tablet_manager.cc:1403] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.230s	user 0.025s	sys 0.016s
I20260709 12:58:45.498987  1599 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:45.505227  2165 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:45.533705  1750 raft_consensus.cc:359] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.534458  1750 raft_consensus.cc:385] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:45.534729  1750 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:45.539459  1749 tablet_bootstrap.cc:654] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:45.541450  1750 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.546218  1750 ts_tablet_manager.cc:1434] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.001s
I20260709 12:58:45.520342  2145 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.558321  1750 tablet_bootstrap.cc:492] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:45.579501  1750 tablet_bootstrap.cc:654] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:45.597271  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:45.587803  2145 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:58:45.606030  1675 leader_election.cc:343] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:45.608038  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:45.636682  1751 tablet_bootstrap.cc:492] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:45.649202  1751 ts_tablet_manager.cc:1403] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.419s	user 0.015s	sys 0.008s
I20260709 12:58:45.620864  2059 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.652024  1751 raft_consensus.cc:359] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.653869  1751 raft_consensus.cc:385] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:45.654572  1751 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:45.656384  1751 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.659458  1749 tablet_bootstrap.cc:492] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:45.660439  1749 ts_tablet_manager.cc:1403] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.250s	user 0.021s	sys 0.031s
I20260709 12:58:45.652922  1560 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.653998  2059 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.669310  2059 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:45.683780  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:58:45.686604  1599 consensus_peers.cc:597] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:45.689998  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:45.693542  2131 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.702684  1751 ts_tablet_manager.cc:1434] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 12:58:45.704839  1601 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:45.705310  2143 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:45.705833  2165 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:45.694252  2131 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.720666  1751 tablet_bootstrap.cc:492] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:45.725311  1560 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:45.726938  1673 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:45.728536  2145 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:45.729193  2145 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:45.730149  2145 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.737059  1750 tablet_bootstrap.cc:492] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:45.737605  1750 ts_tablet_manager.cc:1403] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.180s	user 0.029s	sys 0.012s
I20260709 12:58:45.795431  1750 raft_consensus.cc:359] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.796304  1750 raft_consensus.cc:385] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:45.796564  1750 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:45.797729  1750 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.807093  1749 raft_consensus.cc:359] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.807854  1749 raft_consensus.cc:385] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:45.808111  1749 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:45.809870  1749 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.816829  1750 ts_tablet_manager.cc:1434] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.004s
I20260709 12:58:45.817785  1749 ts_tablet_manager.cc:1434] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.157s	user 0.006s	sys 0.000s
I20260709 12:58:45.875511  1749 tablet_bootstrap.cc:492] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:45.886917  1750 tablet_bootstrap.cc:492] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:45.875208  2062 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:45.946277  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:58:45.961726  2184 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:58:45.960984  2131 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:45.923626  2062 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:45.991099  1750 tablet_bootstrap.cc:654] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.002610  1749 tablet_bootstrap.cc:654] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.002297  2062 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:46.013295  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:46.015585  1751 tablet_bootstrap.cc:654] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:46.017261  1675 leader_election.cc:343] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.216900  2171 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.217415  2171 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.219460  2171 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:46.225093  2191 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:58:46.225670  2191 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.228019  2191 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:46.239246  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:46.239456  1675 consensus_peers.cc:597] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:46.247282  1751 tablet_bootstrap.cc:492] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:46.247437  2171 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:58:46.248536  2171 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.247961  1751 ts_tablet_manager.cc:1403] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.528s	user 0.013s	sys 0.010s
I20260709 12:58:46.253829  2171 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:46.254956  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:46.256206  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:46.258436  1601 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:46.260658  2171 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.300060  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:46.304538  2191 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:58:46.305191  2191 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.307375  2191 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:46.308715  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:46.324327  1629 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:46.324753  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:46.327839  1601 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:46.336938  1750 tablet_bootstrap.cc:492] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:46.337464  1750 ts_tablet_manager.cc:1403] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.514s	user 0.027s	sys 0.028s
I20260709 12:58:46.341302  1750 raft_consensus.cc:359] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.342054  1750 raft_consensus.cc:385] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:58:46.341748  1675 consensus_peers.cc:597] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:46.342473  1750 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.343351  1750 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.346654  1750 ts_tablet_manager.cc:1434] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 12:58:46.347999  1750 tablet_bootstrap.cc:492] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:46.353374  1751 raft_consensus.cc:359] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.354094  1751 raft_consensus.cc:385] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:46.354876  1751 raft_consensus.cc:740] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.355504  1751 consensus_queue.cc:260] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.358460  1751 ts_tablet_manager.cc:1434] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.000s
I20260709 12:58:46.358410  1455 catalog_manager.cc:5697] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:46.361593  1750 tablet_bootstrap.cc:654] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.366559  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:46.367380  1555 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 0.
I20260709 12:58:46.377502  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:46.386896  1633 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:46.374060  1749 tablet_bootstrap.cc:492] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:46.394747  1749 ts_tablet_manager.cc:1403] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.572s	user 0.009s	sys 0.017s
I20260709 12:58:46.399314  1750 tablet_bootstrap.cc:492] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:46.399896  1750 ts_tablet_manager.cc:1403] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.001s
I20260709 12:58:46.401800  1749 raft_consensus.cc:359] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.402515  1749 raft_consensus.cc:385] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:46.402769  1749 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.404199  2144 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.404486  1750 raft_consensus.cc:359] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.404865  2144 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.405728  1750 raft_consensus.cc:385] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:46.406317  1750 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.407616  1750 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.409466  1749 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.410557  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:46.412009  1749 ts_tablet_manager.cc:1434] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:58:46.412037  1705 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:46.413887  1749 tablet_bootstrap.cc:492] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:46.429567  1750 ts_tablet_manager.cc:1434] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.003s
I20260709 12:58:46.430795  1750 tablet_bootstrap.cc:492] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: Bootstrap starting.
I20260709 12:58:46.433560  2144 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:46.435868  1751 tablet_bootstrap.cc:492] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:46.439543  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:46.440023  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:46.440680  2147 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:46.441047  2147 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.441356  2147 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:46.443333  1675 leader_election.cc:343] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.445739  1633 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:46.447922  2144 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.448645  2144 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.453850  2147 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.455201  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:46.456096  1750 tablet_bootstrap.cc:654] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.468932  1630 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 1: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:58:46.456697  2144 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:46.457577  1458 catalog_manager.cc:5697] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:46.462793  2167 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:46.472826  1458 catalog_manager.cc:5697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:46.474295  1751 tablet_bootstrap.cc:654] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.475355  1749 tablet_bootstrap.cc:654] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.476078  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:46.481736  2202 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:46.482807  1454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41156 (request call id 77) took 1116 ms. Trace:
I20260709 12:58:46.483357  1454 rpcz_store.cc:276] 0709 12:58:45.375065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.375244 (+   179us) service_pool.cc:224] Handling call
0709 12:58:46.482694 (+1107450us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14253,"reported_tablets":14}
I20260709 12:58:46.482213  2202 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.485885  2202 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:46.502524  2147 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:46.503901  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:46.504561  2202 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:46.505421  1675 leader_election.cc:343] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.506891  2202 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:46.512252  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:46.515568  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:46.521136  1750 tablet_bootstrap.cc:492] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: No bootstrap required, opened a new log
I20260709 12:58:46.521726  1750 ts_tablet_manager.cc:1403] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.001s
I20260709 12:58:46.522485  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:46.523643  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:46.524528  1552 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:46.525897  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:46.526724  1552 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:46.527232  1750 raft_consensus.cc:359] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.528348  1750 raft_consensus.cc:385] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:46.528759  1750 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.530264  1750 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:46.531050  1526 leader_election.cc:343] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.541302  1750 ts_tablet_manager.cc:1434] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:58:46.557982  1749 tablet_bootstrap.cc:492] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:46.558503  1749 ts_tablet_manager.cc:1403] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.145s	user 0.007s	sys 0.012s
I20260709 12:58:46.558657  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:46.560889  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:46.561232  2147 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:46.561599  1708 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 1: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:58:46.561514  1749 raft_consensus.cc:359] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.562326  1749 raft_consensus.cc:385] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:46.562626  1749 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.563294  1749 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.563900  1673 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:46.564879  2147 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.568284  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:46.569693  2147 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.570355  1749 ts_tablet_manager.cc:1434] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:58:46.571355  1749 tablet_bootstrap.cc:492] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:46.571801  2147 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:46.578859  1749 tablet_bootstrap.cc:654] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.579067  1751 tablet_bootstrap.cc:492] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:46.579466  1751 ts_tablet_manager.cc:1403] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.007s
I20260709 12:58:46.582540  1751 raft_consensus.cc:359] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.588002  1751 raft_consensus.cc:385] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:46.588433  1751 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.589135  1751 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:46.585359  1673 leader_election.cc:343] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.590085  1673 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:46.591454  1673 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:46.592468  2144 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:46.593325  2144 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:46.602687  2144 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:46.603917  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:46.617621  2147 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:46.624118  1749 tablet_bootstrap.cc:492] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:46.624653  1749 ts_tablet_manager.cc:1403] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.012s
I20260709 12:58:46.628866  1749 raft_consensus.cc:359] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.629976  1749 raft_consensus.cc:385] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:46.630393  1749 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.631238  1749 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.607349  1751 ts_tablet_manager.cc:1434] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:58:46.631976  2095 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.633172  2095 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.636469  1751 tablet_bootstrap.cc:492] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:46.636602  2095 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:46.638041  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:46.639935  1749 ts_tablet_manager.cc:1434] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:58:46.642302  1749 tablet_bootstrap.cc:492] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
W20260709 12:58:46.642445  1675 leader_election.cc:343] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.645967  2202 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.646991  2202 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.649286  2202 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:46.650274  1749 tablet_bootstrap.cc:654] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:46.659500  1526 leader_election.cc:343] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.660059  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:46.661197  2202 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:46.669484  2062 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.669055  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:46.670197  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:46.670010  2062 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.676344  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:58:46.677606  1675 leader_election.cc:343] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.677098  2062 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:46.672178  1702 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:46.683923  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:46.684680  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:46.689014  1749 tablet_bootstrap.cc:492] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:46.693408  1749 ts_tablet_manager.cc:1403] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.007s
I20260709 12:58:46.694094  2202 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:46.694509  2202 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.689649  1751 tablet_bootstrap.cc:654] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:46.691354  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:58:46.695446  1526 leader_election.cc:343] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.694845  2202 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:46.697325  1749 raft_consensus.cc:359] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.698199  1749 raft_consensus.cc:385] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:58:46.698341  1673 leader_election.cc:343] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.698549  1749 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:46.698786  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:46.700016  2144 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:46.701474  1749 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:46.715463  1673 leader_election.cc:343] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:46.733073  1673 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:46.732375  2167 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.755168  2195 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.749162  2145 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:46.761984  1749 ts_tablet_manager.cc:1434] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.001s
I20260709 12:58:46.758848  2167 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.761914  2195 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.758033  2202 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:46.918128  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 144756us
I20260709 12:58:46.915189  1553 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:46.960562  2202 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:46.971653  1749 tablet_bootstrap.cc:492] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:46.978060  1892 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.978567  1892 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:46.994695  1892 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:47.019272  1751 tablet_bootstrap.cc:492] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:47.020328  1751 ts_tablet_manager.cc:1403] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.387s	user 0.023s	sys 0.001s
I20260709 12:58:47.028239  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:47.029071  1703 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:47.030938  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:47.008563  2141 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.032323  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:47.077996  2167 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:47.079542  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:47.080435  1704 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:47.082444  1489 debug-util.cc:398] Leaking SignalData structure 0x7b080008b6c0 after lost signal to thread 434
W20260709 12:58:47.088881  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:58:47.084204  1489 debug-util.cc:398] Leaking SignalData structure 0x7b080003a280 after lost signal to thread 1492
I20260709 12:58:47.080042  1751 raft_consensus.cc:359] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.109550  1751 raft_consensus.cc:385] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.109923  1751 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
W20260709 12:58:47.110872  1526 leader_election.cc:343] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.120468  1751 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.074213  1629 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:47.069983  2141 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:58:47.138300  1489 debug-util.cc:398] Leaking SignalData structure 0x7b08002c4500 after lost signal to thread 1584
I20260709 12:58:47.145373  1749 tablet_bootstrap.cc:654] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.137535  2195 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:47.139580  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:58:47.164443  1489 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3ca0 after lost signal to thread 1659
I20260709 12:58:47.168613  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:58:47.185388  1489 debug-util.cc:398] Leaking SignalData structure 0x7b0800278a00 after lost signal to thread 1733
I20260709 12:58:47.174582  2189 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:58:47.192183  1751 ts_tablet_manager.cc:1434] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.171s	user 0.009s	sys 0.013s
W20260709 12:58:47.191985  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 72955.5us
I20260709 12:58:47.194041  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:47.202957  2229 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:47.203408  1634 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.203727  2229 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.204385  2229 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.204113  2141 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:47.194509  2189 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.229550  2226 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.201630  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:47.230122  2226 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.239595  2226 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:47.244910  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:47.249559  1704 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:47.269733  2189 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:47.270826  1601 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:47.271641  2165 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.272071  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:47.274749  2130 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:47.275521  2130 raft_consensus.cc:697] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:47.278152  1751 tablet_bootstrap.cc:492] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:47.279299  1749 tablet_bootstrap.cc:492] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:47.279789  1749 ts_tablet_manager.cc:1403] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.325s	user 0.013s	sys 0.015s
I20260709 12:58:47.281795  2130 consensus_queue.cc:237] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.284238  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:47.284940  1703 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:47.285297  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:47.287994  1749 raft_consensus.cc:359] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.288731  1749 raft_consensus.cc:385] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.289021  1749 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.291132  1751 tablet_bootstrap.cc:654] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.291666  1749 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.290638  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:47.296641  1707 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 1: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:58:47.298573  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:47.299404  1556 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:47.330871  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:47.331990  1601 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:47.332443  2229 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.333750  1557 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 2: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:47.334046  1630 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.334853  1601 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:47.336689  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:47.337427  2224 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:47.338078  2224 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.338593  2224 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.347525  1601 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:47.354228  1749 ts_tablet_manager.cc:1434] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.000s
I20260709 12:58:47.359587  2059 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.362586  2229 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:47.364471  1526 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:47.377997  2136 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.387974  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:47.388159  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:47.390491  1705 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.398551  1749 tablet_bootstrap.cc:492] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:47.410118  2059 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.425257  2224 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.439767  1455 catalog_manager.cc:5697] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.443723  2200 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.447166  1749 tablet_bootstrap.cc:654] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.458252  2200 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.461982  1628 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 2: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:58:47.458895  2200 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.474459  1705 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:58:47.475060  1751 tablet_bootstrap.cc:492] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:47.475924  1751 ts_tablet_manager.cc:1403] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.198s	user 0.030s	sys 0.043s
I20260709 12:58:47.477835  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:47.478775  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:47.478890  1557 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 2: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:47.483053  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:47.490259  2200 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:47.492985  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:47.493722  1703 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 0.
I20260709 12:58:47.494729  2224 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:58:47.496071  1599 leader_election.cc:343] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.487555  2229 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:47.496842  2229 raft_consensus.cc:697] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:47.498310  1601 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:47.500121  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:47.500972  1703 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 2: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:47.501703  2224 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.502117  2224 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.502476  2224 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.502768  1601 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:47.503682  2200 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.506654  2229 consensus_queue.cc:237] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.514982  1751 raft_consensus.cc:359] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.515604  1751 raft_consensus.cc:385] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.515857  1751 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.528144  1749 tablet_bootstrap.cc:492] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:47.528688  1749 ts_tablet_manager.cc:1403] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.148s	user 0.017s	sys 0.002s
I20260709 12:58:47.534399  1749 raft_consensus.cc:359] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.535360  1749 raft_consensus.cc:385] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.535622  1749 raft_consensus.cc:740] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.536350  1749 consensus_queue.cc:260] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.539758  1749 ts_tablet_manager.cc:1434] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:58:47.529722  2224 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.542599  2224 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:47.543874  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:47.544735  1751 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.545791  1554 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.550465  1751 ts_tablet_manager.cc:1434] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.004s
I20260709 12:58:47.543958  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:47.557101  1703 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.547271  1749 tablet_bootstrap.cc:492] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:47.551755  1751 tablet_bootstrap.cc:492] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1: Bootstrap starting.
I20260709 12:58:47.572755  2130 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.573304  2130 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.575414  2130 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:47.577486  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:47.580371  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:47.581059  1705 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
W20260709 12:58:47.585707  1526 leader_election.cc:343] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.593319  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:47.594403  2231 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:47.594862  2231 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.595170  2231 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.597271  1554 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:47.599447  1599 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:47.600270  2200 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:47.601074  2200 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:58:47.601956  2200 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.605114  1751 tablet_bootstrap.cc:654] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.608142  1749 tablet_bootstrap.cc:654] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.615559  2231 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.612243  1703 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:58:47.617977  2231 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:47.625080  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:47.625581  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:47.625849  1703 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:47.628466  1526 leader_election.cc:343] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:47.642792  2224 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.643389  2224 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.639083  1703 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:47.645629  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:58:47.648967  2224 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:47.651481  2188 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:47.652015  2188 raft_consensus.cc:697] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:47.652946  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:47.652835  2188 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.653721  1705 raft_consensus.cc:2393] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:47.654023  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:47.656711  1599 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:47.658154  2200 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.661163  1749 tablet_bootstrap.cc:492] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:47.661679  1749 ts_tablet_manager.cc:1403] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.121s	user 0.009s	sys 0.014s
I20260709 12:58:47.664458  1749 raft_consensus.cc:359] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.665222  1749 raft_consensus.cc:385] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.665508  1749 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.666401  1749 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.667213  1458 catalog_manager.cc:5697] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 2, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.668354  1749 ts_tablet_manager.cc:1434] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:58:47.669669  1749 tablet_bootstrap.cc:492] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:47.677197  1751 tablet_bootstrap.cc:492] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1: No bootstrap required, opened a new log
I20260709 12:58:47.677743  1751 ts_tablet_manager.cc:1403] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.004s
I20260709 12:58:47.678814  1749 tablet_bootstrap.cc:654] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.690096  1751 raft_consensus.cc:359] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.691684  2200 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.692804  1749 tablet_bootstrap.cc:492] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:47.693346  1749 ts_tablet_manager.cc:1403] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.005s
I20260709 12:58:47.696419  1749 raft_consensus.cc:359] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.697232  1749 raft_consensus.cc:385] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.699223  1749 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.699957  1749 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.702962  1749 ts_tablet_manager.cc:1434] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:58:47.702636  1454 catalog_manager.cc:5697] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.716053  1749 tablet_bootstrap.cc:492] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Bootstrap starting.
I20260709 12:58:47.690891  1751 raft_consensus.cc:385] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.723364  1751 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.724110  1751 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.722466  1455 catalog_manager.cc:5697] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.723479  1749 tablet_bootstrap.cc:654] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:47.737387  1751 ts_tablet_manager.cc:1434] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 12:58:47.745329  2130 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:47.761577  2188 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:47.773023  1749 tablet_bootstrap.cc:492] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: No bootstrap required, opened a new log
I20260709 12:58:47.773559  1749 ts_tablet_manager.cc:1403] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.003s
I20260709 12:58:47.776238  2225 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.776748  1749 raft_consensus.cc:359] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.777076  2225 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.777591  1749 raft_consensus.cc:385] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:47.778473  1749 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Initialized, Role: FOLLOWER
I20260709 12:58:47.779388  2225 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:47.781740  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:47.781740  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:47.785931  1599 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:47.787395  2224 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.789829  1749 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.792248  1749 ts_tablet_manager.cc:1434] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:58:47.919723  2224 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.920326  2224 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:47.928462  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:47.928505  2224 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:47.930490  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:47.931560  1704 raft_consensus.cc:2393] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 1: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:58:47.932618  1601 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:58:47.933408  2224 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:47.941322  2224 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:47.954262  1634 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.021415  2167 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.046826  2167 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.078980  1704 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:48.080725  2231 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:48.086653  1628 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:48.088745  2136 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.105386  2229 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.105952  2229 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:48.108079  2229 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:48.123327  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:58:48.123960  1703 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:48.125700  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:48.126371  1634 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 0.
I20260709 12:58:48.132341  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:48.133311  2136 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:48.133729  2136 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.134032  2136 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.177541  2136 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:48.190387  2136 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:48.198441  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:48.199373  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:58:48.200014  1628 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.200139  1704 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.204600  2095 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.205226  2095 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:48.209756  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:58:48.209465  2095 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:48.210632  1634 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:48.219668  1675 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:48.220988  2095 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:48.221522  2095 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.221980  2095 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:48.227825  1704 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:48.226450  1628 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:58:48.240154  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:58:48.257081  2130 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:48.257694  2130 raft_consensus.cc:697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:58:48.258659  2130 consensus_queue.cc:237] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:48.281113  2095 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:48.282510  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:58:48.294592  1557 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:58:48.296998  2095 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:48.309191  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:58:48.311255  1628 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:48.335207  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:58:48.335912  1557 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:48.345247  1557 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:58:48.346417  2136 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.348574  1628 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:58:48.354508  1675 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:58:48.355338  2263 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:48.355850  2263 raft_consensus.cc:697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:58:48.356704  2263 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:58:48.381029  1455 catalog_manager.cc:5697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 0 to 2, leader changed from <none> to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.405968  2188 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:58:48.450071  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:48.454744  1455 catalog_manager.cc:5697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:48.668421  2136 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.691272  2229 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.782763  1632 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:48.784945  2095 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:48.856737  1557 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:48.869493  2264 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:49.586723   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:49.595983  2276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:49.597841  2277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:49.603466   431 server_base.cc:1061] running on GCE node
W20260709 12:58:49.612493  2279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:49.615351   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:49.615742   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:49.616029   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601929616009 us; error 0 us; skew 500 ppm
I20260709 12:58:49.616987   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:49.641263   431 webserver.cc:533] Webserver started at http://127.0.107.196:41855/ using document root <none> and password file <none>
I20260709 12:58:49.642241   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:49.642669   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:49.643244   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:49.645375   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-3-root/instance:
uuid: "6b9e73092f6146639bf310a3d18cfe37"
format_stamp: "Formatted at 2026-07-09 12:58:49 on dist-test-slave-c08m"
I20260709 12:58:49.672140   431 fs_manager.cc:696] Time spent creating directory manager: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:58:49.683497  2284 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:49.684716   431 fs_manager.cc:730] Time spent opening block manager: real 0.009s	user 0.007s	sys 0.003s
I20260709 12:58:49.685245   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-3-root
uuid: "6b9e73092f6146639bf310a3d18cfe37"
format_stamp: "Formatted at 2026-07-09 12:58:49 on dist-test-slave-c08m"
I20260709 12:58:49.685735   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:58:49.823722  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 45582.2us
I20260709 12:58:49.835292   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:49.839872   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:49.853078   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:50.034965   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:50.035435   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:58:50.035899   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:50.036232   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
W20260709 12:58:50.210427  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46905.1us
W20260709 12:58:50.283154  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 70134.6us
I20260709 12:58:51.197665   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:39387
I20260709 12:58:51.197782  2353 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:39387 every 8 connection(s)
I20260709 12:58:51.237411   431 auto_leader_rebalancer-test.cc:384] add a tserver: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:58:51.261125  2354 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44807
I20260709 12:58:51.261924  2354 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:51.263672  2354 heartbeater.cc:507] Master 127.0.107.254:44807 requested a full tablet report, sending...
I20260709 12:58:51.266595  1454 ts_manager.cc:194] Registered new tserver with Master: 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:58:51.268823  1454 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57414
I20260709 12:58:52.080614  1707 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:52.123797  1632 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:52.128822  2303 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:52.131675  1560 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:52.152474  2275 raft_consensus.cc:2955] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
W20260709 12:58:52.167637  1672 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d92f9e0b7fb49ab8fad982d80cbd39f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:52.172072  1630 raft_consensus.cc:2955] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:52.189711  1454 catalog_manager.cc:5697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.273025  2354 heartbeater.cc:499] Master 127.0.107.254:44807 was elected leader, sending a full tablet report...
I20260709 12:58:52.289808  1554 consensus_queue.cc:237] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:52.296075  2367 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:58:52.365013  1556 raft_consensus.cc:2955] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:52.394479  1628 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:52.399120  1705 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:52.429840  2301 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:52.436635  1523 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ec5abf47e7f48a3a476ef08dd5f179d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:52.451702  2364 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:52.487598  2188 raft_consensus.cc:2955] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:52.489615  1628 raft_consensus.cc:2955] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:52.511118  1705 raft_consensus.cc:2955] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:52.552258  1458 catalog_manager.cc:5697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:52.616290  1628 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:52.678920  1705 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:52.681967  2167 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:52.687541  1556 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:52.691097  2371 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:52.745750  1598 consensus_peers.cc:597] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6272972864842479d82e86cc14f8ff4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:52.749040  2167 raft_consensus.cc:2955] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:52.752243  1558 raft_consensus.cc:2955] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:52.759222  1703 raft_consensus.cc:2955] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:52.769243  2386 ts_tablet_manager.cc:933] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:52.782248  1628 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:52.789364  1458 catalog_manager.cc:5697] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.873219  2386 tablet_copy_client.cc:323] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:42699
I20260709 12:58:52.876951  2387 ts_tablet_manager.cc:933] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:58:52.886600  1702 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:52.888916  1598 consensus_peers.cc:597] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb62bfd8ccab4ff7925d27d979888b38. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:52.895800  2167 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:52.897729  2387 tablet_copy_client.cc:323] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:58:52.914189  1556 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:52.917924  2371 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:52.975050  1719 tablet_copy_service.cc:140] P 4f6fa2fd61114dc190d8f9b310696e1a: Received BeginTabletCopySession request for tablet 1d92f9e0b7fb49ab8fad982d80cbd39f from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:35632)
I20260709 12:58:52.975754  1719 tablet_copy_service.cc:161] P 4f6fa2fd61114dc190d8f9b310696e1a: Beginning new tablet copy session on tablet 1d92f9e0b7fb49ab8fad982d80cbd39f from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:35632: session id = 6b9e73092f6146639bf310a3d18cfe37-1d92f9e0b7fb49ab8fad982d80cbd39f
I20260709 12:58:52.991310  2371 raft_consensus.cc:2955] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:52.998922  1702 raft_consensus.cc:2955] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:53.087319  1719 tablet_copy_source_session.cc:215] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:53.099011  2386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d92f9e0b7fb49ab8fad982d80cbd39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:53.110562  1458 catalog_manager.cc:5697] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.099882  1556 raft_consensus.cc:2955] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:53.141499  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet 4ec5abf47e7f48a3a476ef08dd5f179d from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:58:53.142146  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet 4ec5abf47e7f48a3a476ef08dd5f179d from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-4ec5abf47e7f48a3a476ef08dd5f179d
I20260709 12:58:53.156699  1570 tablet_copy_source_session.cc:215] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:53.182610  2386 tablet_copy_client.cc:806] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:53.183784  2386 tablet_copy_client.cc:670] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:53.185869  2387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec5abf47e7f48a3a476ef08dd5f179d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:53.190804  2386 tablet_copy_client.cc:538] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:53.219560  2386 tablet_bootstrap.cc:492] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:58:53.228048  2387 tablet_copy_client.cc:806] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:53.232035  2387 tablet_copy_client.cc:670] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:53.241380  2387 tablet_copy_client.cc:538] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:53.262971  2387 tablet_bootstrap.cc:492] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:58:53.290033  2398 ts_tablet_manager.cc:933] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:53.291004  2386 tablet_bootstrap.cc:492] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:53.292229  2386 tablet_bootstrap.cc:492] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:58:53.293079  2386 ts_tablet_manager.cc:1403] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.075s	user 0.036s	sys 0.014s
I20260709 12:58:53.317548  2398 tablet_copy_client.cc:323] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43887
I20260709 12:58:53.335640  2386 raft_consensus.cc:359] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:53.339661  2386 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:58:53.341099  2386 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:53.347043  2387 tablet_bootstrap.cc:492] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:53.351444  2387 tablet_bootstrap.cc:492] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:58:53.358039  2387 ts_tablet_manager.cc:1403] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.095s	user 0.030s	sys 0.004s
I20260709 12:58:53.366493  2386 ts_tablet_manager.cc:1434] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.005s
I20260709 12:58:53.367213  1645 tablet_copy_service.cc:140] P 8106dfc0bda54df0ae10ba13c28ccc18: Received BeginTabletCopySession request for tablet a6272972864842479d82e86cc14f8ff4 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:46120)
I20260709 12:58:53.368048  1645 tablet_copy_service.cc:161] P 8106dfc0bda54df0ae10ba13c28ccc18: Beginning new tablet copy session on tablet a6272972864842479d82e86cc14f8ff4 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:46120: session id = 6b9e73092f6146639bf310a3d18cfe37-a6272972864842479d82e86cc14f8ff4
I20260709 12:58:53.369354  2387 raft_consensus.cc:359] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:53.371816  2387 raft_consensus.cc:740] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:58:53.372813  2387 consensus_queue.cc:260] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:53.375728  2387 ts_tablet_manager.cc:1434] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:58:53.379060  1570 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-4ec5abf47e7f48a3a476ef08dd5f179d received from {username='slave'} at 127.0.0.1:33810
I20260709 12:58:53.379621  1570 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-4ec5abf47e7f48a3a476ef08dd5f179d on tablet 4ec5abf47e7f48a3a476ef08dd5f179d with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:58:53.385891  1645 tablet_copy_source_session.cc:215] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:53.389582  2398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6272972864842479d82e86cc14f8ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:53.394897  1719 tablet_copy_service.cc:342] P 4f6fa2fd61114dc190d8f9b310696e1a: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-1d92f9e0b7fb49ab8fad982d80cbd39f received from {username='slave'} at 127.0.0.1:35632
I20260709 12:58:53.395455  1719 tablet_copy_service.cc:434] P 4f6fa2fd61114dc190d8f9b310696e1a: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-1d92f9e0b7fb49ab8fad982d80cbd39f on tablet 1d92f9e0b7fb49ab8fad982d80cbd39f with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:58:53.428231  2398 tablet_copy_client.cc:806] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:53.429139  2398 tablet_copy_client.cc:670] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:53.437747  2398 tablet_copy_client.cc:538] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:53.472519  2398 tablet_bootstrap.cc:492] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:58:53.481335  2386 ts_tablet_manager.cc:933] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:53.483667  2386 tablet_copy_client.cc:323] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43887
I20260709 12:58:53.485795  1645 tablet_copy_service.cc:140] P 8106dfc0bda54df0ae10ba13c28ccc18: Received BeginTabletCopySession request for tablet bb62bfd8ccab4ff7925d27d979888b38 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:46120)
I20260709 12:58:53.486400  1645 tablet_copy_service.cc:161] P 8106dfc0bda54df0ae10ba13c28ccc18: Beginning new tablet copy session on tablet bb62bfd8ccab4ff7925d27d979888b38 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:46120: session id = 6b9e73092f6146639bf310a3d18cfe37-bb62bfd8ccab4ff7925d27d979888b38
I20260709 12:58:53.493957  1645 tablet_copy_source_session.cc:215] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:53.501139  2386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb62bfd8ccab4ff7925d27d979888b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:53.515290  2398 tablet_bootstrap.cc:492] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:53.525921  2398 tablet_bootstrap.cc:492] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:58:53.526757  2398 ts_tablet_manager.cc:1403] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.055s	user 0.026s	sys 0.004s
I20260709 12:58:53.534065  2398 raft_consensus.cc:359] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:53.535331  2398 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:58:53.549017  2398 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:53.560120  2398 ts_tablet_manager.cc:1434] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:58:53.571661  1645 tablet_copy_service.cc:342] P 8106dfc0bda54df0ae10ba13c28ccc18: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-a6272972864842479d82e86cc14f8ff4 received from {username='slave'} at 127.0.0.1:46120
I20260709 12:58:53.572240  1645 tablet_copy_service.cc:434] P 8106dfc0bda54df0ae10ba13c28ccc18: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-a6272972864842479d82e86cc14f8ff4 on tablet a6272972864842479d82e86cc14f8ff4 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:58:53.664327  2329 raft_consensus.cc:1217] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:53.674592  2386 tablet_copy_client.cc:806] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:53.676733  2386 tablet_copy_client.cc:670] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:53.682893  2386 tablet_copy_client.cc:538] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:53.694419  2386 tablet_bootstrap.cc:492] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:58:53.697775  2329 raft_consensus.cc:1217] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:53.747320  2386 tablet_bootstrap.cc:492] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:53.748471  2386 tablet_bootstrap.cc:492] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:58:53.749248  2386 ts_tablet_manager.cc:1403] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.022s
I20260709 12:58:53.752336  2386 raft_consensus.cc:359] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:53.753290  2386 raft_consensus.cc:740] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:58:53.753978  2386 consensus_queue.cc:260] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:53.765655  2386 ts_tablet_manager.cc:1434] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:58:53.777093  1645 tablet_copy_service.cc:342] P 8106dfc0bda54df0ae10ba13c28ccc18: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-bb62bfd8ccab4ff7925d27d979888b38 received from {username='slave'} at 127.0.0.1:46120
I20260709 12:58:53.777607  1645 tablet_copy_service.cc:434] P 8106dfc0bda54df0ae10ba13c28ccc18: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-bb62bfd8ccab4ff7925d27d979888b38 on tablet bb62bfd8ccab4ff7925d27d979888b38 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:58:53.803572  2329 raft_consensus.cc:1217] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:53.986753  2329 raft_consensus.cc:1217] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:54.044426  2364 raft_consensus.cc:1064] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:58:54.047343  2364 consensus_queue.cc:237] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:58:54.080222  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 123501us
I20260709 12:58:54.157660  2329 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.160688  2378 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:54.227355  1628 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.233551  1702 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.277702  2304 raft_consensus.cc:1064] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:58:54.279443  2275 raft_consensus.cc:1064] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:58:54.280225  2304 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:54.281961  2275 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:54.303785  1554 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.305754  2329 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.310381  2364 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:54.311586  2371 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:54.314465  1705 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.314199  2371 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:54.319689  2167 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:54.329118  2328 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.330544  1628 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.331077  2367 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:54.332566  2406 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:54.355408  2378 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:54.412729  2371 raft_consensus.cc:2955] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.417251  1554 raft_consensus.cc:2955] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.423189  2367 raft_consensus.cc:2955] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.424995  2328 raft_consensus.cc:2955] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.430365  2329 raft_consensus.cc:2955] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.445412  1455 catalog_manager.cc:5697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.452203  2358 raft_consensus.cc:1064] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:58:54.455037  2358 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:54.474601  2328 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.476224  2304 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:54.487522  1558 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.490226  2167 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:54.494210  1702 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.502041  1557 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.507706  2167 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:54.607556  1705 raft_consensus.cc:2955] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.600561  1628 raft_consensus.cc:2955] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.626793  2275 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:58:54.633791  2426 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:58:54.653000  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 93084.2us
I20260709 12:58:54.659884  2365 raft_consensus.cc:2955] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.661559  2167 raft_consensus.cc:2955] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.665134  1458 catalog_manager.cc:5697] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:54.667574  1558 raft_consensus.cc:2955] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.693277  2328 raft_consensus.cc:2955] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:58:54.699718  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 45881.2us
I20260709 12:58:54.703792  2329 raft_consensus.cc:2955] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:58:54.706097  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 48773.8us
W20260709 12:58:54.707115  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 80645.2us
I20260709 12:58:54.729452  1628 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:54.741472  2327 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:54.758502  2409 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:58:54.770191  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 56116.4us
I20260709 12:58:54.790858  1626 raft_consensus.cc:2955] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.848187  1703 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:54.843087  1707 raft_consensus.cc:2955] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.856149  2328 raft_consensus.cc:2955] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.857621  2304 raft_consensus.cc:2955] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:58:54.951567  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 54771.7us
W20260709 12:58:54.952343  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 162471us
W20260709 12:58:54.956475  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 159072us
I20260709 12:58:54.960868  2436 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:58:54.957417  1560 raft_consensus.cc:2955] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:54.991715  1458 catalog_manager.cc:5697] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:58:55.018218  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 52797.3us
I20260709 12:58:55.045204  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6272972864842479d82e86cc14f8ff4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:55.077214  1454 catalog_manager.cc:5697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:58:55.093137  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 139843us
W20260709 12:58:55.100314  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 143394us
I20260709 12:58:55.079427  1454 catalog_manager.cc:5697] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:55.137470  1702 raft_consensus.cc:2955] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:55.158399  1549 tablet_service.cc:1558] Processing DeleteTablet for tablet a6272972864842479d82e86cc14f8ff4 with delete_type TABLET_DATA_TOMBSTONED (TS e4c78b411eb34b3d92183a86d34a81f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47896
I20260709 12:58:55.163717  1703 raft_consensus.cc:2955] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:55.202009  1554 consensus_queue.cc:237] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:55.222425  2328 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:55.229568  1634 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:55.236603  1703 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:55.248003  1554 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:55.247707  2433 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:58:55.257697  2409 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:55.262492  2329 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:55.272051  2440 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:58:55.277859  2167 raft_consensus.cc:2955] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:55.283521  1634 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:55.289026  2367 raft_consensus.cc:2955] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:55.294672  2327 raft_consensus.cc:2955] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:55.297384  1554 raft_consensus.cc:2955] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:55.304502  2328 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:55.306248  2409 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:58:55.317975  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d92f9e0b7fb49ab8fad982d80cbd39f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:55.315557  2328 raft_consensus.cc:2955] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:55.329792  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb62bfd8ccab4ff7925d27d979888b38 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:55.325730  2433 raft_consensus.cc:2955] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:55.336860  2446 tablet_replica.cc:333] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 12:58:55.340157  2446 raft_consensus.cc:2243] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:55.346555  2329 raft_consensus.cc:2955] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:55.349041  1458 catalog_manager.cc:5697] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.349962  1454 catalog_manager.cc:5697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:55.389117  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 54161.4us
I20260709 12:58:55.393291  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ec5abf47e7f48a3a476ef08dd5f179d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:55.396302  1619 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d92f9e0b7fb49ab8fad982d80cbd39f with delete_type TABLET_DATA_TOMBSTONED (TS 8106dfc0bda54df0ae10ba13c28ccc18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60036
I20260709 12:58:55.396329  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet bb62bfd8ccab4ff7925d27d979888b38 with delete_type TABLET_DATA_TOMBSTONED (TS 4f6fa2fd61114dc190d8f9b310696e1a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39852
I20260709 12:58:55.402551  2446 raft_consensus.cc:2272] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:55.414012  2430 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:55.430296  2446 ts_tablet_manager.cc:1916] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:55.445197  1554 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:55.446386  2448 tablet_replica.cc:333] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 12:58:55.447784  2448 raft_consensus.cc:2243] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:55.448475  2448 raft_consensus.cc:2272] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:55.454018  2448 ts_tablet_manager.cc:1916] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:55.471037  2449 tablet_replica.cc:333] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 12:58:55.472476  2449 raft_consensus.cc:2243] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:55.473281  2449 raft_consensus.cc:2272] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:55.478220  1455 catalog_manager.cc:5697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:55.517213  2429 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:55.518275  1630 raft_consensus.cc:2955] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:55.538779  2449 ts_tablet_manager.cc:1916] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:55.544302  1554 raft_consensus.cc:2955] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:55.558851  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ec5abf47e7f48a3a476ef08dd5f179d with delete_type TABLET_DATA_TOMBSTONED (TS 4f6fa2fd61114dc190d8f9b310696e1a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39852
I20260709 12:58:55.577509  2449 ts_tablet_manager.cc:1929] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:55.578135  2449 log.cc:1199] T bb62bfd8ccab4ff7925d27d979888b38 P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root/wals/bb62bfd8ccab4ff7925d27d979888b38
I20260709 12:58:55.596235  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet bb62bfd8ccab4ff7925d27d979888b38 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:58:55.599645  2449 tablet_replica.cc:333] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 12:58:55.605597  2449 raft_consensus.cc:2243] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:55.606842  2449 raft_consensus.cc:2272] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:55.621829  2448 ts_tablet_manager.cc:1929] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:55.622481  2448 log.cc:1199] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root/wals/1d92f9e0b7fb49ab8fad982d80cbd39f
I20260709 12:58:55.624100  1445 catalog_manager.cc:5028] TS 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): tablet 1d92f9e0b7fb49ab8fad982d80cbd39f (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:58:55.624547  2446 ts_tablet_manager.cc:1929] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:55.625968  2446 log.cc:1199] T a6272972864842479d82e86cc14f8ff4 P e4c78b411eb34b3d92183a86d34a81f1: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root/wals/a6272972864842479d82e86cc14f8ff4
I20260709 12:58:55.627740  1443 catalog_manager.cc:5028] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): tablet a6272972864842479d82e86cc14f8ff4 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:58:55.629622  2449 ts_tablet_manager.cc:1916] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:55.651407  2449 ts_tablet_manager.cc:1929] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:55.652729  2449 log.cc:1199] T 4ec5abf47e7f48a3a476ef08dd5f179d P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root/wals/4ec5abf47e7f48a3a476ef08dd5f179d
I20260709 12:58:55.654978  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 4ec5abf47e7f48a3a476ef08dd5f179d (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:58:56.738201  1705 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
W20260709 12:58:56.799913  1672 consensus_peers.cc:597] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8ceb3afda0646d2b7815d235d107857. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:56.835959  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44474.2us
I20260709 12:58:56.839972  1632 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:56.879958  2367 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:56.906728  1560 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:56.963171  2367 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:56.981539  2441 raft_consensus.cc:2955] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:56.997090  1628 raft_consensus.cc:2955] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
W20260709 12:58:57.122097  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 112566us
I20260709 12:58:57.205190  1557 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:57.209857  1458 catalog_manager.cc:5697] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
W20260709 12:58:57.253928  1523 consensus_peers.cc:597] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52b0712953ef42ddb724cd8c29a0ec0b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:57.291303  1560 raft_consensus.cc:2955] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:57.315550  1705 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.318671  1634 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.346443  2469 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.348960  2445 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.374536  2471 ts_tablet_manager.cc:933] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:57.396842  2469 raft_consensus.cc:2955] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:57.399497  2471 tablet_copy_client.cc:323] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:42699
I20260709 12:58:57.401432  1719 tablet_copy_service.cc:140] P 4f6fa2fd61114dc190d8f9b310696e1a: Received BeginTabletCopySession request for tablet e8ceb3afda0646d2b7815d235d107857 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:35632)
I20260709 12:58:57.401989  1719 tablet_copy_service.cc:161] P 4f6fa2fd61114dc190d8f9b310696e1a: Beginning new tablet copy session on tablet e8ceb3afda0646d2b7815d235d107857 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:35632: session id = 6b9e73092f6146639bf310a3d18cfe37-e8ceb3afda0646d2b7815d235d107857
I20260709 12:58:57.410171  1719 tablet_copy_source_session.cc:215] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:57.416297  2471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ceb3afda0646d2b7815d235d107857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:57.416028  1705 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:57.429109  1628 raft_consensus.cc:2955] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:57.429929  1455 catalog_manager.cc:5697] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:57.434803  1672 consensus_peers.cc:597] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e5f9ac80ae924622bceefdf9814aca1e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:57.438845  1629 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.439306  1707 raft_consensus.cc:2955] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:57.441119  2441 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.453457  1553 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.455097  2453 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.471321  2453 raft_consensus.cc:2955] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:57.474526  1553 raft_consensus.cc:2955] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:57.490221  1629 raft_consensus.cc:2955] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:57.518534  1628 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:57.526289  1454 catalog_manager.cc:5697] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:57.535424  2471 tablet_copy_client.cc:806] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:57.536041  2471 tablet_copy_client.cc:670] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:57.544773  2471 tablet_copy_client.cc:538] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:57.554509  2471 tablet_bootstrap.cc:492] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
W20260709 12:58:57.558394  1598 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1242a7b5484b4cc6a066e0c93629550f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:57.569389  1553 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.571609  2444 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:57.578635  1707 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.581045  2167 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.588045  2471 tablet_bootstrap.cc:492] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:57.589251  2471 tablet_bootstrap.cc:492] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:58:57.590344  2471 ts_tablet_manager.cc:1403] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.036s	user 0.022s	sys 0.009s
I20260709 12:58:57.600440  2471 raft_consensus.cc:359] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:57.602571  2471 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:58:57.603394  2471 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:57.622675  2471 ts_tablet_manager.cc:1434] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.028s	user 0.014s	sys 0.006s
I20260709 12:58:57.633339  1719 tablet_copy_service.cc:342] P 4f6fa2fd61114dc190d8f9b310696e1a: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-e8ceb3afda0646d2b7815d235d107857 received from {username='slave'} at 127.0.0.1:35632
I20260709 12:58:57.633888  1719 tablet_copy_service.cc:434] P 4f6fa2fd61114dc190d8f9b310696e1a: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-e8ceb3afda0646d2b7815d235d107857 on tablet e8ceb3afda0646d2b7815d235d107857 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:58:57.644879  2459 raft_consensus.cc:2955] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:57.649576  1553 raft_consensus.cc:2955] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:57.669883  2471 ts_tablet_manager.cc:933] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:58:57.677028  1705 raft_consensus.cc:2955] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:58:57.711599  1455 catalog_manager.cc:5697] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:57.721494  2471 tablet_copy_client.cc:323] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:58:57.723215  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet 52b0712953ef42ddb724cd8c29a0ec0b from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:58:57.723829  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet 52b0712953ef42ddb724cd8c29a0ec0b from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-52b0712953ef42ddb724cd8c29a0ec0b
I20260709 12:58:57.745944  1570 tablet_copy_source_session.cc:215] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:57.749089  2471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b0712953ef42ddb724cd8c29a0ec0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:57.804863  2328 raft_consensus.cc:1217] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:57.826872  2471 tablet_copy_client.cc:806] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:57.827559  2471 tablet_copy_client.cc:670] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:57.832693  2471 tablet_copy_client.cc:538] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:57.843603  2471 tablet_bootstrap.cc:492] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:58:57.917949  2471 tablet_bootstrap.cc:492] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:57.920486  2471 tablet_bootstrap.cc:492] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:58:57.921355  2471 ts_tablet_manager.cc:1403] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.078s	user 0.023s	sys 0.004s
I20260709 12:58:57.924620  2471 raft_consensus.cc:359] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:57.925586  2471 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:58:57.926898  2471 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:57.930356  2471 ts_tablet_manager.cc:1434] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:58:57.933364  1570 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-52b0712953ef42ddb724cd8c29a0ec0b received from {username='slave'} at 127.0.0.1:33810
I20260709 12:58:57.933919  1570 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-52b0712953ef42ddb724cd8c29a0ec0b on tablet 52b0712953ef42ddb724cd8c29a0ec0b with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:58:58.035754  2471 ts_tablet_manager.cc:933] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:58:58.037560  2471 tablet_copy_client.cc:323] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:42699
I20260709 12:58:58.039388  1719 tablet_copy_service.cc:140] P 4f6fa2fd61114dc190d8f9b310696e1a: Received BeginTabletCopySession request for tablet e5f9ac80ae924622bceefdf9814aca1e from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:35632)
I20260709 12:58:58.039989  1719 tablet_copy_service.cc:161] P 4f6fa2fd61114dc190d8f9b310696e1a: Beginning new tablet copy session on tablet e5f9ac80ae924622bceefdf9814aca1e from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:35632: session id = 6b9e73092f6146639bf310a3d18cfe37-e5f9ac80ae924622bceefdf9814aca1e
I20260709 12:58:58.048144  1719 tablet_copy_source_session.cc:215] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:58.052094  2471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f9ac80ae924622bceefdf9814aca1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:58.081353  2471 tablet_copy_client.cc:806] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:58.082124  2471 tablet_copy_client.cc:670] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:58.112905  2471 tablet_copy_client.cc:538] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:58.118788  2328 raft_consensus.cc:1217] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:58.139446  2471 tablet_bootstrap.cc:492] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:58:58.209813  2486 ts_tablet_manager.cc:933] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:58:58.272369  2471 tablet_bootstrap.cc:492] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:58.273280  2471 tablet_bootstrap.cc:492] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:58:58.274022  2471 ts_tablet_manager.cc:1403] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.135s	user 0.021s	sys 0.009s
I20260709 12:58:58.282892  2441 raft_consensus.cc:1064] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:58:58.288146  2441 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:58.289356  2471 raft_consensus.cc:359] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:58.290166  2471 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:58:58.290719  2471 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:58.293406  2471 ts_tablet_manager.cc:1434] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:58:58.296067  1719 tablet_copy_service.cc:342] P 4f6fa2fd61114dc190d8f9b310696e1a: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-e5f9ac80ae924622bceefdf9814aca1e received from {username='slave'} at 127.0.0.1:35632
I20260709 12:58:58.296605  1719 tablet_copy_service.cc:434] P 4f6fa2fd61114dc190d8f9b310696e1a: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-e5f9ac80ae924622bceefdf9814aca1e on tablet e5f9ac80ae924622bceefdf9814aca1e with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:58:58.316284  2328 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:58.317989  2462 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:58.329855  1560 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:58.334965  1628 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:58.342396  2454 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:58.352126  2454 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:58.364416  2486 tablet_copy_client.cc:323] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43887
I20260709 12:58:58.366349  1645 tablet_copy_service.cc:140] P 8106dfc0bda54df0ae10ba13c28ccc18: Received BeginTabletCopySession request for tablet 1242a7b5484b4cc6a066e0c93629550f from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:46120)
I20260709 12:58:58.366914  1645 tablet_copy_service.cc:161] P 8106dfc0bda54df0ae10ba13c28ccc18: Beginning new tablet copy session on tablet 1242a7b5484b4cc6a066e0c93629550f from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:46120: session id = 6b9e73092f6146639bf310a3d18cfe37-1242a7b5484b4cc6a066e0c93629550f
I20260709 12:58:58.372975  2454 raft_consensus.cc:2955] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.382470  1645 tablet_copy_source_session.cc:215] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:58.385334  1634 raft_consensus.cc:2955] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.388342  2486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1242a7b5484b4cc6a066e0c93629550f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:58.387791  2328 raft_consensus.cc:2955] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.452411  1560 raft_consensus.cc:2955] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.436895  1455 catalog_manager.cc:5697] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.500198  2486 tablet_copy_client.cc:806] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:58.501221  2486 tablet_copy_client.cc:670] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:58.508358  2328 raft_consensus.cc:1217] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:58.513860  2486 tablet_copy_client.cc:538] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:58.525039  2486 tablet_bootstrap.cc:492] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:58:58.531068  1707 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:58.537402  2328 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:58.542955  1628 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:58.546643  2495 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:58.552991  2441 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:58.568668  2495 raft_consensus.cc:2955] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.579720  1628 raft_consensus.cc:2955] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.581480  2378 raft_consensus.cc:1064] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:58:58.583837  2378 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:58.569809  2329 raft_consensus.cc:2955] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.586741  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8ceb3afda0646d2b7815d235d107857 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:58.566251  2486 tablet_bootstrap.cc:492] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:58.596010  2486 tablet_bootstrap.cc:492] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:58:58.596765  2486 ts_tablet_manager.cc:1403] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.072s	user 0.029s	sys 0.004s
I20260709 12:58:58.601554  1454 catalog_manager.cc:5697] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:58.601717  2486 raft_consensus.cc:359] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:58.608227  2486 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:58:58.610571  1707 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:58.609118  2486 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:58:58.612917  2329 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:58.613746  1634 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:58.614178  2486 ts_tablet_manager.cc:1434] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 12:58:58.614241  2455 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:58.615984  1645 tablet_copy_service.cc:342] P 8106dfc0bda54df0ae10ba13c28ccc18: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-1242a7b5484b4cc6a066e0c93629550f received from {username='slave'} at 127.0.0.1:46120
I20260709 12:58:58.616452  1645 tablet_copy_service.cc:434] P 8106dfc0bda54df0ae10ba13c28ccc18: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-1242a7b5484b4cc6a066e0c93629550f on tablet 1242a7b5484b4cc6a066e0c93629550f with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:58:58.616523  2455 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:58.620332  2461 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:58.649794  1549 tablet_service.cc:1558] Processing DeleteTablet for tablet e8ceb3afda0646d2b7815d235d107857 with delete_type TABLET_DATA_TOMBSTONED (TS e4c78b411eb34b3d92183a86d34a81f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47896
I20260709 12:58:58.655174  2504 tablet_replica.cc:333] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 12:58:58.656466  2504 raft_consensus.cc:2243] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:58.657328  2504 raft_consensus.cc:2272] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:58.661198  2504 ts_tablet_manager.cc:1916] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:58.661435  2455 raft_consensus.cc:2955] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.661924  1707 raft_consensus.cc:2955] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.679232  1628 raft_consensus.cc:2955] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.681691  2504 ts_tablet_manager.cc:1929] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:58.682345  2504 log.cc:1199] T e8ceb3afda0646d2b7815d235d107857 P e4c78b411eb34b3d92183a86d34a81f1: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root/wals/e8ceb3afda0646d2b7815d235d107857
I20260709 12:58:58.684222  1443 catalog_manager.cc:5028] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): tablet e8ceb3afda0646d2b7815d235d107857 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:58:58.696452  2329 raft_consensus.cc:2955] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.721483  1455 catalog_manager.cc:5697] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.739029  1560 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:58.747300  2329 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:58.749970  2455 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:58.757586  1707 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:58.759503  2470 raft_consensus.cc:2955] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.761330  2328 raft_consensus.cc:2955] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.772878  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 52b0712953ef42ddb724cd8c29a0ec0b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:58.793339  1455 catalog_manager.cc:5697] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.800052  2188 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:58.813593  1619 tablet_service.cc:1558] Processing DeleteTablet for tablet 52b0712953ef42ddb724cd8c29a0ec0b with delete_type TABLET_DATA_TOMBSTONED (TS 8106dfc0bda54df0ae10ba13c28ccc18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60036
I20260709 12:58:58.817719  1705 raft_consensus.cc:2955] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:58.842415  2506 tablet_replica.cc:333] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 12:58:58.848114  2506 raft_consensus.cc:2243] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:58.849092  2506 raft_consensus.cc:2272] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:58.860309  2506 ts_tablet_manager.cc:1916] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:58.883275  2506 ts_tablet_manager.cc:1929] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:58.883955  2506 log.cc:1199] T 52b0712953ef42ddb724cd8c29a0ec0b P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root/wals/52b0712953ef42ddb724cd8c29a0ec0b
I20260709 12:58:58.885921  1445 catalog_manager.cc:5028] TS 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): tablet 52b0712953ef42ddb724cd8c29a0ec0b (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:58:58.918712  2495 raft_consensus.cc:1064] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:58:58.936949  2495 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:58.995693  2328 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:58.997540  1628 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:58.998672  2441 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:59.002902  2454 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.014571  1560 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.016603  2495 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 12:58:59.044685  2507 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:58:59.067135  2495 raft_consensus.cc:2955] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.080883  2329 raft_consensus.cc:2955] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.080224  1560 raft_consensus.cc:2955] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.095186  1634 raft_consensus.cc:2955] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.114626  1455 catalog_manager.cc:5697] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.142470  1702 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:59.151827  2329 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.152364  1634 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.154436  2441 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:59.158100  2495 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:59.176822  2454 raft_consensus.cc:2955] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.178815  2329 raft_consensus.cc:2955] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.187047  2328 raft_consensus.cc:1217] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:59.202442  1628 raft_consensus.cc:2955] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.208544  1454 catalog_manager.cc:5697] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.229686  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e5f9ac80ae924622bceefdf9814aca1e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:59.231244  1549 tablet_service.cc:1558] Processing DeleteTablet for tablet e5f9ac80ae924622bceefdf9814aca1e with delete_type TABLET_DATA_TOMBSTONED (TS e4c78b411eb34b3d92183a86d34a81f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47896
I20260709 12:58:59.261961  2513 tablet_replica.cc:333] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 12:58:59.268559  2513 raft_consensus.cc:2243] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:59.269474  2513 raft_consensus.cc:2272] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:59.274730  2513 ts_tablet_manager.cc:1916] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:59.290279  2513 ts_tablet_manager.cc:1929] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:59.290828  2513 log.cc:1199] T e5f9ac80ae924622bceefdf9814aca1e P e4c78b411eb34b3d92183a86d34a81f1: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root/wals/e5f9ac80ae924622bceefdf9814aca1e
I20260709 12:58:59.293319  1443 catalog_manager.cc:5028] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): tablet e5f9ac80ae924622bceefdf9814aca1e (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:58:59.750109  2487 raft_consensus.cc:1064] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:58:59.752911  2487 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:59.765254  2328 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.766659  1707 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.767365  2167 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.769080  1553 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.771620  2487 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.774281  2487 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.805074  2487 raft_consensus.cc:2955] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.810114  2328 raft_consensus.cc:2955] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.812490  1707 raft_consensus.cc:2955] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.832322  1553 raft_consensus.cc:2955] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.849503  1458 catalog_manager.cc:5697] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.888870  1628 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:58:59.895293  2328 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.895608  1553 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.901382  2487 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:59.903337  2487 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:59.912243  2518 raft_consensus.cc:2955] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.915545  2328 raft_consensus.cc:2955] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.921761  1553 raft_consensus.cc:2955] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:58:59.935621  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1242a7b5484b4cc6a066e0c93629550f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:59.955333  1454 catalog_manager.cc:5697] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:59.972997  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 1242a7b5484b4cc6a066e0c93629550f with delete_type TABLET_DATA_TOMBSTONED (TS 4f6fa2fd61114dc190d8f9b310696e1a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39852
I20260709 12:58:59.981882  2525 tablet_replica.cc:333] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 12:58:59.983206  2525 raft_consensus.cc:2243] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:59.983810  2525 raft_consensus.cc:2272] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:59.986860  2525 ts_tablet_manager.cc:1916] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:59.999207  2525 ts_tablet_manager.cc:1929] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:59.999502  2525 log.cc:1199] T 1242a7b5484b4cc6a066e0c93629550f P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root/wals/1242a7b5484b4cc6a066e0c93629550f
I20260709 12:59:00.000968  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 1242a7b5484b4cc6a066e0c93629550f (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
W20260709 12:59:00.329402  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46673.5us
I20260709 12:59:01.061373  1553 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:01.067924  1632 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.067924  1707 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:01.068605  1523 consensus_peers.cc:597] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6bbedfd642f4fde92dc31fa176c6582. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:01.070066  2455 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:01.071244  2524 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:01.081311  2531 raft_consensus.cc:2955] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:01.082942  1707 raft_consensus.cc:2955] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:01.083500  1632 raft_consensus.cc:2955] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:01.111351  1553 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:01.114929  1454 catalog_manager.cc:5697] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:01.135545  1705 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.135978  1632 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:01.136821  1523 consensus_peers.cc:597] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 327c042262d94ababf63c12c177e29ed. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:01.137065  2524 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.138016  2531 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.150106  2524 raft_consensus.cc:2955] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:01.155395  1632 raft_consensus.cc:2955] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:01.167055  1707 raft_consensus.cc:2955] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:01.188793  1634 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:01.189493  1457 catalog_manager.cc:5697] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:01.222976  1702 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:01.223803  1598 consensus_peers.cc:597] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79c0adefd7b845bb8ddbb72d7edb7bc7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:01.224368  1553 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.224947  2167 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:01.225809  2518 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.237891  2518 raft_consensus.cc:2955] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:01.241590  1702 raft_consensus.cc:2955] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:01.245229  1553 raft_consensus.cc:2955] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:01.265312  1458 catalog_manager.cc:5697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:01.260517  1634 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
W20260709 12:59:01.282079  1598 consensus_peers.cc:597] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 32eb5ab4f2154adb88f8148264914ee9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:01.283978  1702 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.284381  1553 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.287432  2544 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:01.291688  2544 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.301046  2444 raft_consensus.cc:2955] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:01.311199  1560 raft_consensus.cc:2955] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:01.328665  1454 catalog_manager.cc:5697] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:01.329591  1707 raft_consensus.cc:2955] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:01.644708  2548 ts_tablet_manager.cc:933] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:01.647413  2548 tablet_copy_client.cc:323] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:59:01.649561  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet c6bbedfd642f4fde92dc31fa176c6582 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:59:01.650174  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet c6bbedfd642f4fde92dc31fa176c6582 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-c6bbedfd642f4fde92dc31fa176c6582
I20260709 12:59:01.658034  1570 tablet_copy_source_session.cc:215] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:01.662252  2548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bbedfd642f4fde92dc31fa176c6582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:01.679942  2548 tablet_copy_client.cc:806] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:01.680787  2548 tablet_copy_client.cc:670] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:01.685075  2548 tablet_copy_client.cc:538] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:01.695092  2548 tablet_bootstrap.cc:492] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:01.755784  2548 tablet_bootstrap.cc:492] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:01.757066  2548 tablet_bootstrap.cc:492] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:01.757905  2548 ts_tablet_manager.cc:1403] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.063s	user 0.031s	sys 0.032s
I20260709 12:59:01.761332  2548 raft_consensus.cc:359] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:01.762418  2548 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:01.763183  2548 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:01.765002  2551 ts_tablet_manager.cc:933] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:01.773599  2548 ts_tablet_manager.cc:1434] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 12:59:01.781824  1570 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-c6bbedfd642f4fde92dc31fa176c6582 received from {username='slave'} at 127.0.0.1:33810
I20260709 12:59:01.782356  1570 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-c6bbedfd642f4fde92dc31fa176c6582 on tablet c6bbedfd642f4fde92dc31fa176c6582 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:01.785907  2552 ts_tablet_manager.cc:933] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:01.796190  2551 tablet_copy_client.cc:323] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43887
I20260709 12:59:01.798400  1645 tablet_copy_service.cc:140] P 8106dfc0bda54df0ae10ba13c28ccc18: Received BeginTabletCopySession request for tablet 32eb5ab4f2154adb88f8148264914ee9 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:46120)
I20260709 12:59:01.799217  1645 tablet_copy_service.cc:161] P 8106dfc0bda54df0ae10ba13c28ccc18: Beginning new tablet copy session on tablet 32eb5ab4f2154adb88f8148264914ee9 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:46120: session id = 6b9e73092f6146639bf310a3d18cfe37-32eb5ab4f2154adb88f8148264914ee9
I20260709 12:59:01.807484  2552 tablet_copy_client.cc:323] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:59:01.809932  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet 327c042262d94ababf63c12c177e29ed from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:59:01.810518  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet 327c042262d94ababf63c12c177e29ed from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-327c042262d94ababf63c12c177e29ed
I20260709 12:59:01.811570  2548 ts_tablet_manager.cc:933] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:01.817538  1570 tablet_copy_source_session.cc:215] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:01.818857  1645 tablet_copy_source_session.cc:215] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:01.821450  2548 tablet_copy_client.cc:323] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43887
I20260709 12:59:01.821611  2552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327c042262d94ababf63c12c177e29ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:01.823625  2551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32eb5ab4f2154adb88f8148264914ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:01.825884  1645 tablet_copy_service.cc:140] P 8106dfc0bda54df0ae10ba13c28ccc18: Received BeginTabletCopySession request for tablet 79c0adefd7b845bb8ddbb72d7edb7bc7 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:46120)
I20260709 12:59:01.826448  1645 tablet_copy_service.cc:161] P 8106dfc0bda54df0ae10ba13c28ccc18: Beginning new tablet copy session on tablet 79c0adefd7b845bb8ddbb72d7edb7bc7 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:46120: session id = 6b9e73092f6146639bf310a3d18cfe37-79c0adefd7b845bb8ddbb72d7edb7bc7
I20260709 12:59:01.841964  2551 tablet_copy_client.cc:806] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:01.842664  2551 tablet_copy_client.cc:670] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:01.848906  1645 tablet_copy_source_session.cc:215] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:01.850430  2551 tablet_copy_client.cc:538] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:01.865047  2548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c0adefd7b845bb8ddbb72d7edb7bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:01.868842  2551 tablet_bootstrap.cc:492] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:01.872017  2552 tablet_copy_client.cc:806] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:01.881351  2552 tablet_copy_client.cc:670] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:01.890851  2552 tablet_copy_client.cc:538] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:01.913411  2548 tablet_copy_client.cc:806] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:01.914165  2548 tablet_copy_client.cc:670] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:01.916328  2551 tablet_bootstrap.cc:492] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:01.918937  2551 tablet_bootstrap.cc:492] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:01.919145  2548 tablet_copy_client.cc:538] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:01.919909  2551 ts_tablet_manager.cc:1403] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.051s	user 0.029s	sys 0.016s
I20260709 12:59:01.922869  2552 tablet_bootstrap.cc:492] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:01.938030  2551 raft_consensus.cc:359] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:01.939004  2551 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:01.939733  2551 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:01.942097  2551 ts_tablet_manager.cc:1434] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 12:59:01.944666  1645 tablet_copy_service.cc:342] P 8106dfc0bda54df0ae10ba13c28ccc18: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-32eb5ab4f2154adb88f8148264914ee9 received from {username='slave'} at 127.0.0.1:46120
I20260709 12:59:01.945199  1645 tablet_copy_service.cc:434] P 8106dfc0bda54df0ae10ba13c28ccc18: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-32eb5ab4f2154adb88f8148264914ee9 on tablet 32eb5ab4f2154adb88f8148264914ee9 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:01.939743  2548 tablet_bootstrap.cc:492] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:01.982468  2552 tablet_bootstrap.cc:492] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:01.983378  2552 tablet_bootstrap.cc:492] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:01.984126  2552 ts_tablet_manager.cc:1403] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.015s
I20260709 12:59:01.986413  2552 raft_consensus.cc:359] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:01.987068  2552 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:01.987594  2552 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:01.988448  2548 tablet_bootstrap.cc:492] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:01.989626  2552 ts_tablet_manager.cc:1434] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20260709 12:59:01.989701  2548 tablet_bootstrap.cc:492] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:01.992146  2548 ts_tablet_manager.cc:1403] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.053s	user 0.026s	sys 0.013s
I20260709 12:59:01.992946  1570 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-327c042262d94ababf63c12c177e29ed received from {username='slave'} at 127.0.0.1:33810
I20260709 12:59:01.993746  1570 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-327c042262d94ababf63c12c177e29ed on tablet 327c042262d94ababf63c12c177e29ed with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:01.998230  2548 raft_consensus.cc:359] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:01.999316  2548 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:02.000098  2548 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:02.009646  2548 ts_tablet_manager.cc:1434] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:59:02.012192  1645 tablet_copy_service.cc:342] P 8106dfc0bda54df0ae10ba13c28ccc18: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-79c0adefd7b845bb8ddbb72d7edb7bc7 received from {username='slave'} at 127.0.0.1:46120
I20260709 12:59:02.012727  1645 tablet_copy_service.cc:434] P 8106dfc0bda54df0ae10ba13c28ccc18: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-79c0adefd7b845bb8ddbb72d7edb7bc7 on tablet 79c0adefd7b845bb8ddbb72d7edb7bc7 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:02.156257  2328 raft_consensus.cc:1217] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:02.293393  2328 raft_consensus.cc:1217] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:59:02.319975  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 87577.4us
W20260709 12:59:02.322203  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 89766.1us
I20260709 12:59:02.365069  2328 raft_consensus.cc:1217] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:02.376611  2328 raft_consensus.cc:1217] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:02.698781  2568 raft_consensus.cc:1064] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:02.701944  2568 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:02.724967  2328 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.725977  1700 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.726437  2455 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.725067  1628 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.727929  2570 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.728991  2568 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:02.747912  2560 raft_consensus.cc:1064] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:02.753631  2562 raft_consensus.cc:1064] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:02.753702  2560 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:02.757254  2562 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:02.772970  2329 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.773996  2569 raft_consensus.cc:2955] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:02.776875  2564 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:02.782727  1560 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.787683  2564 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:02.793072  1705 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.795122  2564 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.800696  2328 raft_consensus.cc:2955] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:02.832095  2167 raft_consensus.cc:2955] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:02.838174  2327 raft_consensus.cc:2955] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:02.851143  1457 catalog_manager.cc:5697] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:02.850941  1560 raft_consensus.cc:2955] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:02.857941  1705 raft_consensus.cc:2955] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:02.874691  1700 raft_consensus.cc:2955] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:02.876354  1634 raft_consensus.cc:2955] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:02.893594  2329 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.899523  2561 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:02.901283  1558 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.903198  2564 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.920711  1700 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.929162  1458 catalog_manager.cc:5697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:02.938818  2561 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.962200  1700 raft_consensus.cc:2955] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:02.959415  2560 raft_consensus.cc:2955] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:02.984624  2569 raft_consensus.cc:1064] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:02.988330  2569 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:02.999639  2327 raft_consensus.cc:2955] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:02.997334  1558 raft_consensus.cc:2955] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.023938  1629 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:03.032429  2329 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:03.033929  2328 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.036096  2560 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:03.036433  2531 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:03.038532  1560 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.041184  2561 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:03.043184  1454 catalog_manager.cc:5697] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.053596  2564 raft_consensus.cc:2955] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.060297  1553 raft_consensus.cc:2955] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.065340  2327 raft_consensus.cc:2955] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.073434  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 79c0adefd7b845bb8ddbb72d7edb7bc7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:03.077447  1705 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:03.081254  1629 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:03.083665  1455 catalog_manager.cc:5697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.095047  2455 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:03.099239  2531 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:03.101576  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 79c0adefd7b845bb8ddbb72d7edb7bc7 with delete_type TABLET_DATA_TOMBSTONED (TS 4f6fa2fd61114dc190d8f9b310696e1a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39852
I20260709 12:59:03.106748  2591 tablet_replica.cc:333] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 12:59:03.108282  2591 raft_consensus.cc:2243] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:03.109422  2591 raft_consensus.cc:2272] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:03.114287  2591 ts_tablet_manager.cc:1916] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:03.125481  1634 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:03.165575  2591 ts_tablet_manager.cc:1929] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:03.166145  2591 log.cc:1199] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root/wals/79c0adefd7b845bb8ddbb72d7edb7bc7
I20260709 12:59:03.168226  2328 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.171074  2167 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:59:03.172755  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 44965us
I20260709 12:59:03.173029  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 79c0adefd7b845bb8ddbb72d7edb7bc7 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:03.175130  2568 raft_consensus.cc:2955] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.175171  1700 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.182370  1705 raft_consensus.cc:2955] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.183071  1553 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:03.186193  2561 raft_consensus.cc:2955] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.195570  2327 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.196446  2328 raft_consensus.cc:2955] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.201496  2569 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:03.214223  1700 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.218351  1634 raft_consensus.cc:2955] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.220350  2567 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:03.219990  2531 raft_consensus.cc:2955] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.249969  2167 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:03.249680  1705 raft_consensus.cc:2955] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.252302  2327 raft_consensus.cc:2955] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.260955  1454 catalog_manager.cc:5697] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.269837  1458 catalog_manager.cc:5697] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.281095  1702 raft_consensus.cc:2955] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.282694  2328 raft_consensus.cc:2955] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.293977  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c6bbedfd642f4fde92dc31fa176c6582 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:03.294642  1549 tablet_service.cc:1558] Processing DeleteTablet for tablet 32eb5ab4f2154adb88f8148264914ee9 with delete_type TABLET_DATA_TOMBSTONED (TS e4c78b411eb34b3d92183a86d34a81f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47896
I20260709 12:59:03.304988  1553 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:03.306572  2594 tablet_replica.cc:333] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 12:59:03.307734  2594 raft_consensus.cc:2243] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:03.315068  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 32eb5ab4f2154adb88f8148264914ee9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:03.325459  1702 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.326926  2570 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:03.328739  2594 raft_consensus.cc:2272] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:03.332803  2594 ts_tablet_manager.cc:1916] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:03.335685  1454 catalog_manager.cc:5697] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:03.339854  2329 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.340946  2570 raft_consensus.cc:2955] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.343971  2531 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:03.347141  1702 raft_consensus.cc:2955] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.353298  2329 raft_consensus.cc:2955] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:03.360898  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 327c042262d94ababf63c12c177e29ed with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:03.363957  2594 ts_tablet_manager.cc:1929] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:03.364459  2594 log.cc:1199] T 32eb5ab4f2154adb88f8148264914ee9 P e4c78b411eb34b3d92183a86d34a81f1: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root/wals/32eb5ab4f2154adb88f8148264914ee9
I20260709 12:59:03.365985  1619 tablet_service.cc:1558] Processing DeleteTablet for tablet c6bbedfd642f4fde92dc31fa176c6582 with delete_type TABLET_DATA_TOMBSTONED (TS 8106dfc0bda54df0ae10ba13c28ccc18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60036
I20260709 12:59:03.366825  1443 catalog_manager.cc:5028] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): tablet 32eb5ab4f2154adb88f8148264914ee9 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:03.385377  2595 tablet_replica.cc:333] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 12:59:03.386803  2595 raft_consensus.cc:2243] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:03.388051  2595 raft_consensus.cc:2272] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:03.392702  2595 ts_tablet_manager.cc:1916] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:03.396353  1455 catalog_manager.cc:5697] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:03.416735  2595 ts_tablet_manager.cc:1929] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:03.417373  2595 log.cc:1199] T c6bbedfd642f4fde92dc31fa176c6582 P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root/wals/c6bbedfd642f4fde92dc31fa176c6582
I20260709 12:59:03.419754  1445 catalog_manager.cc:5028] TS 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): tablet c6bbedfd642f4fde92dc31fa176c6582 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:03.423646  1619 tablet_service.cc:1558] Processing DeleteTablet for tablet 327c042262d94ababf63c12c177e29ed with delete_type TABLET_DATA_TOMBSTONED (TS 8106dfc0bda54df0ae10ba13c28ccc18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60036
I20260709 12:59:03.424374  2595 tablet_replica.cc:333] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 12:59:03.425150  2595 raft_consensus.cc:2243] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:03.425678  2595 raft_consensus.cc:2272] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:03.428224  2595 ts_tablet_manager.cc:1916] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:03.442085  2595 ts_tablet_manager.cc:1929] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:03.442929  2595 log.cc:1199] T 327c042262d94ababf63c12c177e29ed P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root/wals/327c042262d94ababf63c12c177e29ed
I20260709 12:59:03.444495  1445 catalog_manager.cc:5028] TS 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): tablet 327c042262d94ababf63c12c177e29ed (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:04.828677  1702 consensus_queue.cc:237] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
W20260709 12:59:04.916639  1672 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d906a33e42d4a08ae9d1a9d2e39351c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:04.918434  1629 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.920167  2609 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.935284  1558 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.947885  2603 raft_consensus.cc:2955] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:04.953379  1634 raft_consensus.cc:2955] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:04.971109  2611 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:04.971421  1702 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:04.982297  1558 raft_consensus.cc:2955] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:04.987282  1455 catalog_manager.cc:5697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:05.002122  1634 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:05.002584  1672 consensus_peers.cc:597] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c538f09573cd4214b1d7cab1dddee46f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:05.003955  2603 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:05.008999  1558 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:05.010582  2611 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:05.016251  2603 raft_consensus.cc:2955] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:05.018121  1634 raft_consensus.cc:2955] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:05.036535  1457 catalog_manager.cc:5697] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:05.046186  1554 raft_consensus.cc:2955] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:05.048967  1553 consensus_queue.cc:237] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:05.066551  1702 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:05.066743  1523 consensus_peers.cc:597] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81a2ecbb8bc64b12a8b6f2f3af475103. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:05.068171  2531 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:05.071188  1634 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:05.072932  2531 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:05.078172  2612 raft_consensus.cc:2955] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:05.080183  1707 raft_consensus.cc:2955] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:05.089586  1634 raft_consensus.cc:2955] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:05.098618  1553 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:05.099090  1457 catalog_manager.cc:5697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
W20260709 12:59:05.118482  1523 consensus_peers.cc:597] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03348d9c2a344a6f8e716751b1024647. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:05.120381  1707 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:05.121554  1634 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:05.122040  2531 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:05.124310  2531 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:05.132763  2612 raft_consensus.cc:2955] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:05.138814  1707 raft_consensus.cc:2955] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:05.139076  1634 raft_consensus.cc:2955] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:05.173465  1454 catalog_manager.cc:5697] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:05.380505  2630 ts_tablet_manager.cc:933] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:05.385655  2630 tablet_copy_client.cc:323] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:42699
I20260709 12:59:05.387639  1719 tablet_copy_service.cc:140] P 4f6fa2fd61114dc190d8f9b310696e1a: Received BeginTabletCopySession request for tablet 4d906a33e42d4a08ae9d1a9d2e39351c from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:35632)
I20260709 12:59:05.388180  1719 tablet_copy_service.cc:161] P 4f6fa2fd61114dc190d8f9b310696e1a: Beginning new tablet copy session on tablet 4d906a33e42d4a08ae9d1a9d2e39351c from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:35632: session id = 6b9e73092f6146639bf310a3d18cfe37-4d906a33e42d4a08ae9d1a9d2e39351c
I20260709 12:59:05.396234  1719 tablet_copy_source_session.cc:215] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:05.399923  2630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d906a33e42d4a08ae9d1a9d2e39351c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:05.415829  2630 tablet_copy_client.cc:806] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:05.416457  2630 tablet_copy_client.cc:670] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:05.420701  2630 tablet_copy_client.cc:538] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:05.431998  2630 tablet_bootstrap.cc:492] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:05.439597  2632 ts_tablet_manager.cc:933] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:05.462463  2632 tablet_copy_client.cc:323] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:42699
I20260709 12:59:05.465027  1719 tablet_copy_service.cc:140] P 4f6fa2fd61114dc190d8f9b310696e1a: Received BeginTabletCopySession request for tablet c538f09573cd4214b1d7cab1dddee46f from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:35632)
I20260709 12:59:05.465602  1719 tablet_copy_service.cc:161] P 4f6fa2fd61114dc190d8f9b310696e1a: Beginning new tablet copy session on tablet c538f09573cd4214b1d7cab1dddee46f from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:35632: session id = 6b9e73092f6146639bf310a3d18cfe37-c538f09573cd4214b1d7cab1dddee46f
I20260709 12:59:05.483982  1719 tablet_copy_source_session.cc:215] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:05.493132  2632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c538f09573cd4214b1d7cab1dddee46f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:05.504829  2630 tablet_bootstrap.cc:492] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:05.505880  2630 tablet_bootstrap.cc:492] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:05.506601  2630 ts_tablet_manager.cc:1403] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.075s	user 0.023s	sys 0.004s
I20260709 12:59:05.510021  2630 raft_consensus.cc:359] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:05.511154  2630 raft_consensus.cc:740] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:05.511884  2630 consensus_queue.cc:260] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:05.512985  2632 tablet_copy_client.cc:806] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:05.513823  2632 tablet_copy_client.cc:670] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:05.515053  2630 ts_tablet_manager.cc:1434] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:59:05.519264  2632 tablet_copy_client.cc:538] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:05.519130  1719 tablet_copy_service.cc:342] P 4f6fa2fd61114dc190d8f9b310696e1a: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-4d906a33e42d4a08ae9d1a9d2e39351c received from {username='slave'} at 127.0.0.1:35632
I20260709 12:59:05.520377  1719 tablet_copy_service.cc:434] P 4f6fa2fd61114dc190d8f9b310696e1a: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-4d906a33e42d4a08ae9d1a9d2e39351c on tablet 4d906a33e42d4a08ae9d1a9d2e39351c with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:05.529896  2632 tablet_bootstrap.cc:492] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:05.552822  2632 tablet_bootstrap.cc:492] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:05.553650  2632 tablet_bootstrap.cc:492] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:05.554390  2632 ts_tablet_manager.cc:1403] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 12:59:05.558094  2632 raft_consensus.cc:359] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:05.558832  2632 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:05.560427  2632 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:05.566749  2632 ts_tablet_manager.cc:1434] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:59:05.570325  1719 tablet_copy_service.cc:342] P 4f6fa2fd61114dc190d8f9b310696e1a: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-c538f09573cd4214b1d7cab1dddee46f received from {username='slave'} at 127.0.0.1:35632
I20260709 12:59:05.570797  1719 tablet_copy_service.cc:434] P 4f6fa2fd61114dc190d8f9b310696e1a: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-c538f09573cd4214b1d7cab1dddee46f on tablet c538f09573cd4214b1d7cab1dddee46f with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:05.597764  2632 ts_tablet_manager.cc:933] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:05.599932  2632 tablet_copy_client.cc:323] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:59:05.602058  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet 03348d9c2a344a6f8e716751b1024647 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:59:05.602623  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet 03348d9c2a344a6f8e716751b1024647 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-03348d9c2a344a6f8e716751b1024647
I20260709 12:59:05.605758  2630 ts_tablet_manager.cc:933] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:05.611594  1570 tablet_copy_source_session.cc:215] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:05.613252  2630 tablet_copy_client.cc:323] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:59:05.615036  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet 81a2ecbb8bc64b12a8b6f2f3af475103 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:59:05.615918  2632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03348d9c2a344a6f8e716751b1024647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:05.616443  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet 81a2ecbb8bc64b12a8b6f2f3af475103 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-81a2ecbb8bc64b12a8b6f2f3af475103
I20260709 12:59:05.625044  1570 tablet_copy_source_session.cc:215] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:05.628679  2630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a2ecbb8bc64b12a8b6f2f3af475103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:05.649278  2632 tablet_copy_client.cc:806] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:05.650018  2632 tablet_copy_client.cc:670] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:05.653607  2630 tablet_copy_client.cc:806] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:05.654551  2630 tablet_copy_client.cc:670] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:05.654922  2632 tablet_copy_client.cc:538] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:05.659313  2630 tablet_copy_client.cc:538] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:05.664856  2632 tablet_bootstrap.cc:492] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:05.670646  2630 tablet_bootstrap.cc:492] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
W20260709 12:59:05.695516  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08000fe280 after lost signal to thread 434
W20260709 12:59:05.697253  1656 debug-util.cc:398] Leaking SignalData structure 0x7b0800083680 after lost signal to thread 1492
W20260709 12:59:05.698397  1656 debug-util.cc:398] Leaking SignalData structure 0x7b080031d560 after lost signal to thread 1584
W20260709 12:59:05.701907  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc100 after lost signal to thread 1659
W20260709 12:59:05.703172  1656 debug-util.cc:398] Leaking SignalData structure 0x7b0800235ce0 after lost signal to thread 1733
I20260709 12:59:05.705792  2632 tablet_bootstrap.cc:492] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:05.706804  2632 tablet_bootstrap.cc:492] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:05.707499  2632 ts_tablet_manager.cc:1403] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.043s	user 0.023s	sys 0.004s
I20260709 12:59:05.711386  2632 raft_consensus.cc:359] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:05.712342  2632 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:05.713563  2632 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:05.716667  2632 ts_tablet_manager.cc:1434] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:59:05.725242  2630 tablet_bootstrap.cc:492] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:05.725577  1570 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-03348d9c2a344a6f8e716751b1024647 received from {username='slave'} at 127.0.0.1:33810
I20260709 12:59:05.726214  1570 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-03348d9c2a344a6f8e716751b1024647 on tablet 03348d9c2a344a6f8e716751b1024647 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:05.726394  2630 tablet_bootstrap.cc:492] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:05.727121  2630 ts_tablet_manager.cc:1403] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.004s
W20260709 12:59:05.738670  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08003234c0 after lost signal to thread 2353
I20260709 12:59:05.743968  2630 raft_consensus.cc:359] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:05.745992  2630 raft_consensus.cc:740] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:05.746789  2630 consensus_queue.cc:260] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:05.758247  2630 ts_tablet_manager.cc:1434] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:59:05.772857  1570 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-81a2ecbb8bc64b12a8b6f2f3af475103 received from {username='slave'} at 127.0.0.1:33810
I20260709 12:59:05.773305  1570 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-81a2ecbb8bc64b12a8b6f2f3af475103 on tablet 81a2ecbb8bc64b12a8b6f2f3af475103 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:05.957764  2328 raft_consensus.cc:1217] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:05.971045  2328 raft_consensus.cc:1217] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:06.130971  2328 raft_consensus.cc:1217] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:06.170655  2328 raft_consensus.cc:1217] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:06.410841  2609 raft_consensus.cc:1064] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:06.414353  2609 consensus_queue.cc:237] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:06.433620  2329 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.435993  2609 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.437595  1554 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.440619  2609 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:06.442412  1628 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.444340  2603 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.463201  2611 raft_consensus.cc:1064] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:06.473165  2611 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:06.492249  2328 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.494544  2603 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.506736  1632 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.510746  2609 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.517596  1554 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.531823  2603 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:06.534974  2603 raft_consensus.cc:2955] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.536748  1634 raft_consensus.cc:2955] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.550918  2609 raft_consensus.cc:2955] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.554795  2329 raft_consensus.cc:2955] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.561818  1632 raft_consensus.cc:2955] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.575515  1457 catalog_manager.cc:5697] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.582868  1553 raft_consensus.cc:2955] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.596254  2328 raft_consensus.cc:2955] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.602450  1558 raft_consensus.cc:2955] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.640919  1455 catalog_manager.cc:5697] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.653776  2531 raft_consensus.cc:1064] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:06.683537  2531 consensus_queue.cc:237] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:06.687009  2655 raft_consensus.cc:1064] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:06.689671  2655 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:06.705849  2328 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.716142  2599 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:06.733358  1634 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.740334  1707 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.752990  2654 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:06.766714  1707 consensus_queue.cc:237] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:06.789016  2329 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.791323  2653 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:06.808708  1707 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:06.771304  2328 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.813016  2615 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:06.815655  2652 raft_consensus.cc:2955] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.824131  1628 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.826189  2327 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.828630  2611 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.828400  2329 raft_consensus.cc:2955] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.831308  2611 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.842207  2603 raft_consensus.cc:2955] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.861290  1634 raft_consensus.cc:2955] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.863407  1702 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.864678  1628 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.856261  2612 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:59:06.871719  1554 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.898701  2531 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:06.905473  2609 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.982474  2329 raft_consensus.cc:2955] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:06.985203  2654 raft_consensus.cc:2955] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:06.991211  2647 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.088s	user 0.003s	sys 0.000s
I20260709 12:59:06.993677  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4d906a33e42d4a08ae9d1a9d2e39351c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:06.994494  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c538f09573cd4214b1d7cab1dddee46f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:07.009425  2672 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:59:07.021121  2329 raft_consensus.cc:2955] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.033852  1457 catalog_manager.cc:5697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.036237  1454 catalog_manager.cc:5697] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:07.061620  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 66064.2us
I20260709 12:59:07.077490  1702 raft_consensus.cc:2955] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.079042  1549 tablet_service.cc:1558] Processing DeleteTablet for tablet c538f09573cd4214b1d7cab1dddee46f with delete_type TABLET_DATA_TOMBSTONED (TS e4c78b411eb34b3d92183a86d34a81f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47896
I20260709 12:59:07.088943  1560 raft_consensus.cc:2955] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.100049  1619 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d906a33e42d4a08ae9d1a9d2e39351c with delete_type TABLET_DATA_TOMBSTONED (TS 8106dfc0bda54df0ae10ba13c28ccc18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60036
I20260709 12:59:07.118299  1457 catalog_manager.cc:5697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.165706  2679 tablet_replica.cc:333] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 12:59:07.167830  2679 raft_consensus.cc:2243] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:07.174769  2679 raft_consensus.cc:2272] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:07.187537  2681 tablet_replica.cc:333] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 12:59:07.190336  2681 raft_consensus.cc:2243] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:07.191632  2681 raft_consensus.cc:2272] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:07.256232  2679 ts_tablet_manager.cc:1916] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:59:07.273306  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 123632us
I20260709 12:59:07.282738  1560 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:07.298985  2681 ts_tablet_manager.cc:1916] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:07.302172  2327 raft_consensus.cc:2955] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.295536  2684 raft_consensus.cc:2955] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.321895  1455 catalog_manager.cc:5697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.323005  1702 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:07.324292  2329 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:07.326104  2654 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:07.329830  1703 raft_consensus.cc:2955] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.348412  2682 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:07.352073  1628 raft_consensus.cc:2955] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.375607  2676 raft_consensus.cc:2955] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.388239  2329 raft_consensus.cc:2955] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.403424  2681 ts_tablet_manager.cc:1929] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:07.403913  2681 log.cc:1199] T c538f09573cd4214b1d7cab1dddee46f P e4c78b411eb34b3d92183a86d34a81f1: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root/wals/c538f09573cd4214b1d7cab1dddee46f
I20260709 12:59:07.405375  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 03348d9c2a344a6f8e716751b1024647 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:07.406270  1443 catalog_manager.cc:5028] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): tablet c538f09573cd4214b1d7cab1dddee46f (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:07.411266  2679 ts_tablet_manager.cc:1929] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:07.411748  2679 log.cc:1199] T 4d906a33e42d4a08ae9d1a9d2e39351c P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root/wals/4d906a33e42d4a08ae9d1a9d2e39351c
I20260709 12:59:07.416141  1445 catalog_manager.cc:5028] TS 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): tablet 4d906a33e42d4a08ae9d1a9d2e39351c (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:07.443676  1454 catalog_manager.cc:5697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.450170  1703 raft_consensus.cc:2955] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.454324  1558 consensus_queue.cc:237] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:07.471666  2329 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:07.483897  2599 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:07.500391  1629 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:07.506703  2615 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:07.526269  1619 tablet_service.cc:1558] Processing DeleteTablet for tablet 03348d9c2a344a6f8e716751b1024647 with delete_type TABLET_DATA_TOMBSTONED (TS 8106dfc0bda54df0ae10ba13c28ccc18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60036
I20260709 12:59:07.527529  2679 tablet_replica.cc:333] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 12:59:07.529572  2679 raft_consensus.cc:2243] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:07.530987  2679 pending_rounds.cc:70] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18: Trying to abort 1 pending ops.
I20260709 12:59:07.531440  2679 pending_rounds.cc:77] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305633573634842624 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "03348d9c2a344a6f8e716751b1024647" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } } }
I20260709 12:59:07.532935  2679 raft_consensus.cc:2917] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:59:07.533448  2679 raft_consensus.cc:2889] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:59:07.533823  2679 raft_consensus.cc:2272] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:07.532245  2684 raft_consensus.cc:2955] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.538046  2679 ts_tablet_manager.cc:1916] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:07.545481  2327 raft_consensus.cc:2955] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.561460  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 81a2ecbb8bc64b12a8b6f2f3af475103 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:07.571067  1455 catalog_manager.cc:5697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.583158  1628 raft_consensus.cc:2955] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:07.595242  2679 ts_tablet_manager.cc:1929] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:07.595709  2679 log.cc:1199] T 03348d9c2a344a6f8e716751b1024647 P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root/wals/03348d9c2a344a6f8e716751b1024647
I20260709 12:59:07.608013  1445 catalog_manager.cc:5028] TS 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): tablet 03348d9c2a344a6f8e716751b1024647 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:07.609860  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 81a2ecbb8bc64b12a8b6f2f3af475103 with delete_type TABLET_DATA_TOMBSTONED (TS 4f6fa2fd61114dc190d8f9b310696e1a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39852
I20260709 12:59:07.611727  2685 tablet_replica.cc:333] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 12:59:07.612972  2685 raft_consensus.cc:2243] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:07.614001  2685 raft_consensus.cc:2272] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:07.619125  2685 ts_tablet_manager.cc:1916] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:07.646212  2685 ts_tablet_manager.cc:1929] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:07.646663  2685 log.cc:1199] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root/wals/81a2ecbb8bc64b12a8b6f2f3af475103
I20260709 12:59:07.649313  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 81a2ecbb8bc64b12a8b6f2f3af475103 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:08.700618  1558 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:08.712864  1702 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:08.714682  2615 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.715478  1628 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:08.717837  2615 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:08.719301  1523 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 54abded5f0d34ab1871704bc5a3c1b4a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:08.729550  2615 raft_consensus.cc:2955] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:08.731812  1702 raft_consensus.cc:2955] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:08.733778  1629 raft_consensus.cc:2955] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:08.762667  1703 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:08.772454  1455 catalog_manager.cc:5697] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:08.792498  1672 consensus_peers.cc:597] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4a5771425b14503aa3a070b20d0bf86. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:08.795877  1634 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:08.798285  2653 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.814131  1553 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:08.815963  2652 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.824378  2694 raft_consensus.cc:2955] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:08.836550  1634 raft_consensus.cc:2955] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:08.864923  1558 raft_consensus.cc:2955] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:08.867144  1553 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
W20260709 12:59:08.887610  1523 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1b8e024148f547e4b090c0c8c1155232. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:08.891340  1629 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:08.891327  1703 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:08.893549  2684 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:08.894730  2676 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:08.913050  2615 raft_consensus.cc:2955] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:08.914196  1457 catalog_manager.cc:5697] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:08.931916  1703 raft_consensus.cc:2955] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:08.980535  1457 catalog_manager.cc:5697] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:08.991875  1634 raft_consensus.cc:2955] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:09.015591  1553 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
W20260709 12:59:09.151567  1523 consensus_peers.cc:597] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 076fd1ae95e4457d8361a9b4c963b26f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:09.159564  1707 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:09.189667  1628 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:09.196281  2704 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:59:09.256880  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 49808.9us
I20260709 12:59:09.262626  2707 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:09.281118  2716 ts_tablet_manager.cc:933] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:09.284350  2615 raft_consensus.cc:2955] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:09.285765  2716 tablet_copy_client.cc:323] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:59:09.287757  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet 54abded5f0d34ab1871704bc5a3c1b4a from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:59:09.288247  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet 54abded5f0d34ab1871704bc5a3c1b4a from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-54abded5f0d34ab1871704bc5a3c1b4a
I20260709 12:59:09.298853  1570 tablet_copy_source_session.cc:215] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:09.302409  2716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54abded5f0d34ab1871704bc5a3c1b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:09.305298  1703 raft_consensus.cc:2955] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:09.319074  1634 raft_consensus.cc:2955] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:09.337916  1457 catalog_manager.cc:5697] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.339545  2719 ts_tablet_manager.cc:933] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:09.397564  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 58306.4us
I20260709 12:59:09.482483  2720 ts_tablet_manager.cc:933] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
W20260709 12:59:09.513074  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 55503.6us
W20260709 12:59:09.520576  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 108903us
I20260709 12:59:09.544570  2720 tablet_copy_client.cc:323] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:59:09.543704  2719 tablet_copy_client.cc:323] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:42699
I20260709 12:59:09.554512  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet 1b8e024148f547e4b090c0c8c1155232 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:59:09.559176  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet 1b8e024148f547e4b090c0c8c1155232 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-1b8e024148f547e4b090c0c8c1155232
I20260709 12:59:09.576706  2716 tablet_copy_client.cc:806] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:09.577366  2716 tablet_copy_client.cc:670] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:09.579346  1570 tablet_copy_source_session.cc:215] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:09.598397  2716 tablet_copy_client.cc:538] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:09.600137  2720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8e024148f547e4b090c0c8c1155232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:09.600975  1719 tablet_copy_service.cc:140] P 4f6fa2fd61114dc190d8f9b310696e1a: Received BeginTabletCopySession request for tablet f4a5771425b14503aa3a070b20d0bf86 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:35632)
I20260709 12:59:09.601572  1719 tablet_copy_service.cc:161] P 4f6fa2fd61114dc190d8f9b310696e1a: Beginning new tablet copy session on tablet f4a5771425b14503aa3a070b20d0bf86 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:35632: session id = 6b9e73092f6146639bf310a3d18cfe37-f4a5771425b14503aa3a070b20d0bf86
I20260709 12:59:09.609933  2716 tablet_bootstrap.cc:492] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:09.615422  1719 tablet_copy_source_session.cc:215] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:59:09.624099  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 101691us
I20260709 12:59:09.638916  2719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a5771425b14503aa3a070b20d0bf86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:09.650097  2716 tablet_bootstrap.cc:492] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:09.651310  2716 tablet_bootstrap.cc:492] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:09.653180  2716 ts_tablet_manager.cc:1403] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.044s	user 0.026s	sys 0.001s
I20260709 12:59:09.664865  2716 raft_consensus.cc:359] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:09.666742  2716 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:09.668083  2716 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:09.701124  2716 ts_tablet_manager.cc:1434] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.047s	user 0.023s	sys 0.002s
I20260709 12:59:09.702669  2720 tablet_copy_client.cc:806] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:09.703298  2720 tablet_copy_client.cc:670] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:09.706478  2719 tablet_copy_client.cc:806] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:09.707311  2719 tablet_copy_client.cc:670] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
W20260709 12:59:09.820647  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 147926us
I20260709 12:59:09.850106  1570 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-54abded5f0d34ab1871704bc5a3c1b4a received from {username='slave'} at 127.0.0.1:33810
I20260709 12:59:09.850721  1570 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-54abded5f0d34ab1871704bc5a3c1b4a on tablet 54abded5f0d34ab1871704bc5a3c1b4a with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:09.852546  2720 tablet_copy_client.cc:538] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:09.867497  2720 tablet_bootstrap.cc:492] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:09.969449  2327 raft_consensus.cc:1217] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:09.978408  2716 ts_tablet_manager.cc:933] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:09.999503  2716 tablet_copy_client.cc:323] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:59:10.013592  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet 076fd1ae95e4457d8361a9b4c963b26f from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:59:10.014328  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet 076fd1ae95e4457d8361a9b4c963b26f from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-076fd1ae95e4457d8361a9b4c963b26f
I20260709 12:59:10.064033  2719 tablet_copy_client.cc:538] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:59:10.090387  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 150989us
I20260709 12:59:10.097671  1570 tablet_copy_source_session.cc:215] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:10.121268  2716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076fd1ae95e4457d8361a9b4c963b26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.132018  2719 tablet_bootstrap.cc:492] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:10.159150  2716 tablet_copy_client.cc:806] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:10.161106  2716 tablet_copy_client.cc:670] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:10.167461  2716 tablet_copy_client.cc:538] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:10.184981  2716 tablet_bootstrap.cc:492] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:10.195761  2720 tablet_bootstrap.cc:492] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:10.206450  2720 tablet_bootstrap.cc:492] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:10.207450  2720 ts_tablet_manager.cc:1403] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.340s	user 0.026s	sys 0.010s
I20260709 12:59:10.225649  2720 raft_consensus.cc:359] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:10.226892  2720 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:10.227818  2720 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:10.237759  2720 ts_tablet_manager.cc:1434] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.030s	user 0.011s	sys 0.001s
I20260709 12:59:10.239701  1570 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-1b8e024148f547e4b090c0c8c1155232 received from {username='slave'} at 127.0.0.1:33810
I20260709 12:59:10.240141  1570 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-1b8e024148f547e4b090c0c8c1155232 on tablet 1b8e024148f547e4b090c0c8c1155232 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:10.311966  2328 raft_consensus.cc:1217] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
W20260709 12:59:10.329099  2719 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:59:10.342885  2719 tablet_bootstrap.cc:492] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:10.343823  2719 tablet_bootstrap.cc:492] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:10.344538  2719 ts_tablet_manager.cc:1403] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.213s	user 0.017s	sys 0.012s
I20260709 12:59:10.347607  2719 raft_consensus.cc:359] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:10.375448  2716 tablet_bootstrap.cc:492] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:10.348486  2719 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:10.405993  2719 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:10.408653  2719 ts_tablet_manager.cc:1434] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 12:59:10.409525  2716 tablet_bootstrap.cc:492] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:10.410620  2716 ts_tablet_manager.cc:1403] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.226s	user 0.024s	sys 0.004s
I20260709 12:59:10.412505  1719 tablet_copy_service.cc:342] P 4f6fa2fd61114dc190d8f9b310696e1a: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-f4a5771425b14503aa3a070b20d0bf86 received from {username='slave'} at 127.0.0.1:35632
I20260709 12:59:10.413039  1719 tablet_copy_service.cc:434] P 4f6fa2fd61114dc190d8f9b310696e1a: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-f4a5771425b14503aa3a070b20d0bf86 on tablet f4a5771425b14503aa3a070b20d0bf86 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:10.413822  2716 raft_consensus.cc:359] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:10.414656  2716 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:10.415299  2716 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:10.417794  2716 ts_tablet_manager.cc:1434] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:10.469580  1570 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-076fd1ae95e4457d8361a9b4c963b26f received from {username='slave'} at 127.0.0.1:33810
I20260709 12:59:10.506173  1570 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-076fd1ae95e4457d8361a9b4c963b26f on tablet 076fd1ae95e4457d8361a9b4c963b26f with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:10.510051  2729 raft_consensus.cc:1064] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
W20260709 12:59:10.499706  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 84039.5us
I20260709 12:59:10.613335  2729 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:10.709244  2329 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:10.712172  2708 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:10.730790  1709 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:10.742749  1628 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:10.763686  2704 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:10.779508  2725 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:10.824731  2329 raft_consensus.cc:1217] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:10.828210  2704 raft_consensus.cc:1064] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:10.868599  2329 raft_consensus.cc:1217] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:59:10.873816  2350 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd540 after lost signal to thread 434
W20260709 12:59:10.875454  2350 debug-util.cc:398] Leaking SignalData structure 0x7b08002ddc20 after lost signal to thread 1492
W20260709 12:59:10.878116  2350 debug-util.cc:398] Leaking SignalData structure 0x7b0800344a60 after lost signal to thread 1584
W20260709 12:59:10.880168  2350 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff860 after lost signal to thread 1659
I20260709 12:59:10.880265  2707 raft_consensus.cc:2955] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:10.882184  2350 debug-util.cc:398] Leaking SignalData structure 0x7b080034fd40 after lost signal to thread 1733
W20260709 12:59:10.885872  2350 debug-util.cc:398] Leaking SignalData structure 0x7b0800334020 after lost signal to thread 2353
I20260709 12:59:10.831760  2704 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:10.935876  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 59045.7us
I20260709 12:59:10.963124  1633 raft_consensus.cc:2955] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:10.985667  2329 raft_consensus.cc:2955] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.006368  2327 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:11.010520  2743 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:11.026919  1454 catalog_manager.cc:5697] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.070766  1702 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:11.075291  1629 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:11.074636  1702 raft_consensus.cc:2955] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.130139  2703 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:11.166397  2709 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:11.281466  2703 raft_consensus.cc:2955] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.300323  2327 raft_consensus.cc:2955] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.322757  1633 raft_consensus.cc:2955] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.336395   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:11.355693  1556 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:11.361081  1702 raft_consensus.cc:2955] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.363234  1457 catalog_manager.cc:5697] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.367681  2327 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:11.372196  2707 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:11.381059  2704 raft_consensus.cc:2955] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.395530  2327 raft_consensus.cc:2955] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.411685  1629 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:11.414580  2733 raft_consensus.cc:1064] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:11.417026  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 54abded5f0d34ab1871704bc5a3c1b4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:11.418146  2733 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:11.495884  2676 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 12:59:11.509610  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47467.6us
I20260709 12:59:11.528468  1457 catalog_manager.cc:5697] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.534041  1628 raft_consensus.cc:2955] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.567806  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 54abded5f0d34ab1871704bc5a3c1b4a with delete_type TABLET_DATA_TOMBSTONED (TS 4f6fa2fd61114dc190d8f9b310696e1a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39852
W20260709 12:59:11.577306  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 86617us
I20260709 12:59:11.614814  2743 raft_consensus.cc:1064] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:11.618710  2743 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:11.643970  1630 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.646513  1558 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.648978  2757 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:11.650825  2760 tablet_replica.cc:333] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 12:59:11.652312  2760 raft_consensus.cc:2243] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:11.653079  2760 raft_consensus.cc:2272] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:11.654987  2696 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:11.662187  1558 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:11.669235  2327 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.671205  2744 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:11.679854  2758 raft_consensus.cc:2955] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.695580  2329 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.697271  2756 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:11.687256  2327 raft_consensus.cc:2955] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.724191  1702 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.731197  1627 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.732695  1702 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.755900  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1b8e024148f547e4b090c0c8c1155232 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:11.759274  2328 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.863423  2760 ts_tablet_manager.cc:1916] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:11.883486  2757 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:59:11.900797  2756 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:59:11.901659  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 118305us
I20260709 12:59:11.902195  1457 catalog_manager.cc:5697] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 4 to 5, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New cstate: current_term: 3 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:11.904197  2756 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:11.935170  2707 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:59:11.948292  1619 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b8e024148f547e4b090c0c8c1155232 with delete_type TABLET_DATA_TOMBSTONED (TS 8106dfc0bda54df0ae10ba13c28ccc18 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60036
I20260709 12:59:11.958134  1702 raft_consensus.cc:2955] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.051051  2733 raft_consensus.cc:2955] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.042819  2744 raft_consensus.cc:2955] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.086793  1628 raft_consensus.cc:2955] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.100718  2769 tablet_replica.cc:333] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 12:59:12.102746  2769 raft_consensus.cc:2243] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:12.103556  2769 raft_consensus.cc:2272] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:12.113929  2769 ts_tablet_manager.cc:1916] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:12.116756  2329 raft_consensus.cc:2955] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.114653  1553 raft_consensus.cc:2955] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.129292  1633 raft_consensus.cc:2955] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.114382  1457 catalog_manager.cc:5697] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.158180  1705 raft_consensus.cc:2955] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.195950  1630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:12.196832  1630 raft_consensus.cc:606] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:12.220535  2564 raft_consensus.cc:993] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:12.221135  2564 raft_consensus.cc:1081] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:12.223220  1702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 12:59:12.223822  1702 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.224504  1702 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.232111  2325 raft_consensus.cc:2955] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.242659  2760 ts_tablet_manager.cc:1929] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:12.255752  1702 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:12.255887  1455 catalog_manager.cc:5697] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:12.265478  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 79552.5us
I20260709 12:59:12.273234  2760 log.cc:1199] T 54abded5f0d34ab1871704bc5a3c1b4a P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root/wals/54abded5f0d34ab1871704bc5a3c1b4a
I20260709 12:59:12.288237  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 54abded5f0d34ab1871704bc5a3c1b4a (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:12.308095  1702 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:12.312963  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:12.313733  1627 raft_consensus.cc:3055] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:12.314199  1627 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:12.315363  1627 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:12.321409  1627 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.332512  2769 ts_tablet_manager.cc:1929] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:59:12.337877  1627 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:12.353874  2769 log.cc:1199] T 1b8e024148f547e4b090c0c8c1155232 P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root/wals/1b8e024148f547e4b090c0c8c1155232
I20260709 12:59:12.355363  1675 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:12.351943  1553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:12.357971  1553 raft_consensus.cc:606] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:12.358218  2733 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:12.359246  2733 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:12.360208  2733 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:12.361358  1553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:12.361936  1553 raft_consensus.cc:606] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:12.337532  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:12.362856  1558 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.369078  1445 catalog_manager.cc:5028] TS 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): tablet 1b8e024148f547e4b090c0c8c1155232 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:12.369331  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:12.370285  1627 raft_consensus.cc:606] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Received request to transfer leadership to TS 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:12.371641  2704 raft_consensus.cc:993] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:12.372314  2707 raft_consensus.cc:1081] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:12.373826  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:12.374884  1627 raft_consensus.cc:606] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:12.376735   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:12.378707   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:12.383148  1629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60052
I20260709 12:59:12.383780  1629 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.384322  1629 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.344707  1702 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:12.401731  1558 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:12.400279  1554 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:12.406688  1629 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:12.410264  1629 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:12.412916  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:12.415333  1703 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.411044  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:12.414844  2325 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:12.423951  1558 raft_consensus.cc:3055] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:12.424932  1558 raft_consensus.cc:740] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:12.427697  2325 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:12.430006  2733 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:12.428274  1703 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:12.433704  2744 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:12.436652  1633 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:12.437767  1629 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:12.441414  1457 catalog_manager.cc:5697] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:12.446307  2756 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:12.450852  2773 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:12.457242  1558 consensus_queue.cc:260] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:12.455742  2729 raft_consensus.cc:2955] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.459424  1558 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.462373  2714 raft_consensus.cc:993] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:12.462050  1629 raft_consensus.cc:2955] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.463725  2329 raft_consensus.cc:2955] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.462937  2714 raft_consensus.cc:1081] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:12.459383  2761 raft_consensus.cc:2955] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.468575  1601 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:12.472450  2714 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:12.468103  2325 raft_consensus.cc:2955] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.473008  2714 raft_consensus.cc:697] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:12.473969  2714 consensus_queue.cc:237] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:12.492532  1633 raft_consensus.cc:2955] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.495951  2561 raft_consensus.cc:993] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:12.496467  2561 raft_consensus.cc:1081] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Signalling peer 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:12.498059  1703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 12:59:12.498812  1703 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.499174  1703 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.500166  2327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:58640
I20260709 12:59:12.508131  2327 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.508674  2327 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.574929  1558 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:12.578115  2327 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:12.584071  2327 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:12.590060  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:12.606539  1703 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:12.615012  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:12.615715  1558 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.618788  1457 catalog_manager.cc:5697] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.590829  1627 raft_consensus.cc:3055] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:12.620420  1627 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:12.621121  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:12.621838  1633 raft_consensus.cc:3055] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:12.621289  1627 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:12.622124  1633 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:12.622963  1627 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.622859  1633 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:12.623916  1633 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.628283  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f4a5771425b14503aa3a070b20d0bf86 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:12.630573  1703 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:12.643016  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 076fd1ae95e4457d8361a9b4c963b26f with delete_type TABLET_DATA_TOMBSTONED (TS 4f6fa2fd61114dc190d8f9b310696e1a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39852
I20260709 12:59:12.644219  2760 tablet_replica.cc:333] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 12:59:12.645787  2760 raft_consensus.cc:2243] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:12.646586  2760 raft_consensus.cc:2272] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:12.647173  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:12.647740  1556 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.650724  1455 catalog_manager.cc:5697] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:12.664813  1556 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:12.644531  1633 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:12.667150  1675 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:12.668103  2696 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:12.668334  2760 ts_tablet_manager.cc:1916] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:12.668645  2696 raft_consensus.cc:697] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:12.670614  1558 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:12.693686  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 076fd1ae95e4457d8361a9b4c963b26f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:12.690621  2286 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:12.708619  2732 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:12.693351  2696 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:12.709168  2756 raft_consensus.cc:993] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:12.709700  2756 raft_consensus.cc:1081] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:12.713641  1633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60052
I20260709 12:59:12.697929  1627 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:12.722957  1549 tablet_service.cc:1558] Processing DeleteTablet for tablet f4a5771425b14503aa3a070b20d0bf86 with delete_type TABLET_DATA_TOMBSTONED (TS e4c78b411eb34b3d92183a86d34a81f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47896
I20260709 12:59:12.732481  2732 raft_consensus.cc:697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:12.733850  2732 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:12.743988  1633 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.744169  1454 catalog_manager.cc:5697] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:12.751298  1633 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.745573  2760 ts_tablet_manager.cc:1929] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:12.753401  2760 log.cc:1199] T 076fd1ae95e4457d8361a9b4c963b26f P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root/wals/076fd1ae95e4457d8361a9b4c963b26f
I20260709 12:59:12.756282  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 076fd1ae95e4457d8361a9b4c963b26f (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:12.760077  1455 catalog_manager.cc:5697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:12.762971  2780 tablet_replica.cc:333] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 12:59:12.765380  2780 raft_consensus.cc:2243] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:12.777921  2780 raft_consensus.cc:2272] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:12.786609  1633 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:12.784102  1454 catalog_manager.cc:5697] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.791476  2780 ts_tablet_manager.cc:1916] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:12.797998  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:12.798672  1558 raft_consensus.cc:3055] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:12.798945  1558 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:12.799849  1558 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:12.802241  1558 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.817170  2780 ts_tablet_manager.cc:1929] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:12.817703  2780 log.cc:1199] T f4a5771425b14503aa3a070b20d0bf86 P e4c78b411eb34b3d92183a86d34a81f1: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root/wals/f4a5771425b14503aa3a070b20d0bf86
I20260709 12:59:12.821741  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:12.822479  1705 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.823067  1443 catalog_manager.cc:5028] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): tablet f4a5771425b14503aa3a070b20d0bf86 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:12.824165  1633 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:12.822227  1558 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:12.836862  1599 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:12.837471  1705 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:12.841406  2713 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:12.841956  2713 raft_consensus.cc:697] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:12.843333  2713 consensus_queue.cc:237] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:12.846747  1627 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:12.848843  2773 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:59:13.001048  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 95194.9us
I20260709 12:59:13.015494  1454 catalog_manager.cc:5697] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:13.019301  1558 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:13.023729  2773 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:13.033418  1558 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:13.041013  2713 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:13.101305  1703 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:13.143846  2753 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:13.176637  1556 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:13.181489  1633 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:13.183652  2732 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:13.185802  2757 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:13.207530  1558 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:13.209962  2732 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:13.284015  1633 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:13.290386  2757 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:13.385442   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:13.419255  1558 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:13.421092  2564 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:13.439352  1703 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:13.444291  2713 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:59:13.527040  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 59136.8us
I20260709 12:59:13.608253   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:13.743417  1556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:13.744059  1556 raft_consensus.cc:606] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:13.779148  1705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:13.779918  1705 raft_consensus.cc:606] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:13.784350  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf4201f98c934feca49bae13648b2835"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:13.785045  1627 raft_consensus.cc:606] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:13.790571  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:13.791319  1627 raft_consensus.cc:606] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:13.796222  1705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:13.796940  1705 raft_consensus.cc:606] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Received request to transfer leadership to TS 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:13.806083   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:13.807977   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:13.868358  2696 raft_consensus.cc:993] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:13.868981  2773 raft_consensus.cc:1081] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Signalling peer 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:13.871064  2329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:58616
I20260709 12:59:13.871629  2329 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:13.872073  2329 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.871734  1627 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:13.882308  2329 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:13.922317  2696 raft_consensus.cc:993] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:13.923118  2773 raft_consensus.cc:1081] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:13.925094  1630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60066
I20260709 12:59:13.925738  1630 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:13.926178  1630 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.930253  2329 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:13.931984  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:13.933027  1703 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:13.933597  1703 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:13.934763  1703 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:13.936062  1703 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.944525  2561 raft_consensus.cc:993] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:13.945431  2714 raft_consensus.cc:1081] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:13.947233  1705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf4201f98c934feca49bae13648b2835"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 12:59:13.948218  1705 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:13.948791  1705 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.956555  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:13.957554  1633 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.960210  1705 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:13.966346  1702 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:13.966373  1598 consensus_peers.cc:597] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 193165fa679c4f6c9d6ac6b39ef823bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:13.972316  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:13.973235  1556 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:13.973433  1627 raft_consensus.cc:3055] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:13.973986  1627 raft_consensus.cc:740] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:13.972472  2713 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:59:13.974784  1705 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:13.975620  1627 consensus_queue.cc:260] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:13.979215  1627 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.979480  1630 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:13.988061  1627 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:13.988934  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:13.989578  1554 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.989812  1675 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:13.990834  2696 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:13.991526  2696 raft_consensus.cc:697] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:13.992552  2696 consensus_queue.cc:237] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:13.993724  2561 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:13.996932  1554 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:14.039062  1703 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:14.040616  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:14.041651  2798 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:14.043254  1633 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:14.045094  1630 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:14.046471  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:14.047255  1709 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:14.047580  1709 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:14.048386  1709 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:14.049549  1709 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.052117  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:14.053177  1556 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.054215  2753 raft_consensus.cc:2955] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:14.058192  1709 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:14.059572  1601 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:14.060738  2798 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:14.062148  2564 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:14.062776  2564 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:14.063668  2564 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:14.071687  1554 raft_consensus.cc:2955] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:14.074292  1454 catalog_manager.cc:5697] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:14.061897  2798 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:14.089851  1705 raft_consensus.cc:2955] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:14.102064  1457 catalog_manager.cc:5697] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:14.119451  2561 raft_consensus.cc:993] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:14.119978  2561 raft_consensus.cc:1081] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:14.121703  1703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 12:59:14.122275  1703 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:14.122618  1703 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.097337  1709 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:14.062103  1556 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:14.129710  1703 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:14.139724  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:14.140337  1630 raft_consensus.cc:3055] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:14.140635  1630 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:14.141534  1630 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:14.142635  1630 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.144464  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:14.150563  1556 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.148705  1703 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:14.162902  1630 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:14.165020  1675 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:14.173630  1556 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
W20260709 12:59:14.187198  1672 consensus_peers.cc:597] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a4ce544917f545499da64014539a4ff2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:14.200517  1455 catalog_manager.cc:5697] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 1 to 2, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:14.205452  1458 catalog_manager.cc:5697] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 2, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:14.221674  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 54618.2us
W20260709 12:59:14.225984  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 61033.8us
I20260709 12:59:14.226428  2772 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:14.229605  1630 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:14.235522  2813 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
I20260709 12:59:14.227957  2772 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:14.237649  2772 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:14.237684  2773 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:59:14.270638  1558 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:14.272490  2819 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.307296  2704 raft_consensus.cc:993] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:14.308473  2704 raft_consensus.cc:1081] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:14.310845  1630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60052
I20260709 12:59:14.311498  1630 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:14.311926  1630 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.326460  1455 catalog_manager.cc:5697] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:14.326347  2773 raft_consensus.cc:2955] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:14.339222  1627 raft_consensus.cc:2955] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:14.334550  1630 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:14.361073  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:14.361438  1630 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:14.361763  1556 raft_consensus.cc:3055] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:14.362076  1556 raft_consensus.cc:740] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:14.362928  1556 consensus_queue.cc:260] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:14.364202  1556 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.367622  2824 ts_tablet_manager.cc:933] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:14.369365  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:14.370373  1705 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.384768  1553 raft_consensus.cc:2955] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:14.393151  1705 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:14.394578  1601 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:14.396059  2713 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:14.396637  2713 raft_consensus.cc:697] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:14.397809  2713 consensus_queue.cc:237] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:14.435259  2824 tablet_copy_client.cc:323] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43887
I20260709 12:59:14.437813  1645 tablet_copy_service.cc:140] P 8106dfc0bda54df0ae10ba13c28ccc18: Received BeginTabletCopySession request for tablet 193165fa679c4f6c9d6ac6b39ef823bd from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:46120)
I20260709 12:59:14.438463  1645 tablet_copy_service.cc:161] P 8106dfc0bda54df0ae10ba13c28ccc18: Beginning new tablet copy session on tablet 193165fa679c4f6c9d6ac6b39ef823bd from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:46120: session id = 6b9e73092f6146639bf310a3d18cfe37-193165fa679c4f6c9d6ac6b39ef823bd
I20260709 12:59:14.442610  1556 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:14.458375  1645 tablet_copy_source_session.cc:215] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:14.459043  1458 catalog_manager.cc:5697] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:14.463155  2824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 193165fa679c4f6c9d6ac6b39ef823bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:14.464955  1630 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:14.465314  1455 catalog_manager.cc:5697] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:14.468142  2773 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.472398  1627 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:14.526562  1705 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:14.528676  2561 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:14.538655  1598 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f3f4d9e2c0643f1be1fe0de2078f6da. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:14.542068  1553 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:14.544813  2819 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.549206  1709 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:14.549672  1556 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:14.550789  2564 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.552851  2713 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.583320  2713 raft_consensus.cc:2955] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:14.586071  1709 raft_consensus.cc:2955] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:14.587224  2824 tablet_copy_client.cc:806] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:14.587854  2824 tablet_copy_client.cc:670] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:14.590409  1703 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:14.592270  2798 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:14.607432  2824 tablet_copy_client.cc:538] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:14.609997  1553 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:14.613178  2714 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:14.623350  1630 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:14.626238  1457 catalog_manager.cc:5697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:14.629890  1709 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:59:14.630981  1598 consensus_peers.cc:597] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78990af8f5ef4464b9e3bbb9749e7337. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:14.632269  2561 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.641848  1553 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:14.645345  2714 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.648617  1627 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:14.649889  2696 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.664526  2753 raft_consensus.cc:2955] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:14.666466  1709 raft_consensus.cc:2955] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:14.669277  1558 raft_consensus.cc:2955] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:14.683622  2824 tablet_bootstrap.cc:492] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:14.698813  1553 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:14.706434  1630 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:14.710701  2773 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:14.713666  1458 catalog_manager.cc:5697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:14.756637  2798 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:14.765587  1553 raft_consensus.cc:2955] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:14.793639  2824 tablet_bootstrap.cc:492] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:14.794750  2824 tablet_bootstrap.cc:492] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:14.795617  2824 ts_tablet_manager.cc:1403] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.112s	user 0.025s	sys 0.008s
I20260709 12:59:14.809659   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:14.810846  1709 raft_consensus.cc:1275] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:14.812724  2713 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.821311  2824 raft_consensus.cc:359] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:14.842731  2824 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:14.843493  2824 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:14.847118  2824 ts_tablet_manager.cc:1434] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.007s
I20260709 12:59:14.853935  1645 tablet_copy_service.cc:342] P 8106dfc0bda54df0ae10ba13c28ccc18: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-193165fa679c4f6c9d6ac6b39ef823bd received from {username='slave'} at 127.0.0.1:46120
I20260709 12:59:14.854756  1645 tablet_copy_service.cc:434] P 8106dfc0bda54df0ae10ba13c28ccc18: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-193165fa679c4f6c9d6ac6b39ef823bd on tablet 193165fa679c4f6c9d6ac6b39ef823bd with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:14.861028  2824 ts_tablet_manager.cc:933] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:14.880496  2824 tablet_copy_client.cc:323] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:42699
I20260709 12:59:14.897027  1719 tablet_copy_service.cc:140] P 4f6fa2fd61114dc190d8f9b310696e1a: Received BeginTabletCopySession request for tablet a4ce544917f545499da64014539a4ff2 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:35632)
I20260709 12:59:14.897822  1719 tablet_copy_service.cc:161] P 4f6fa2fd61114dc190d8f9b310696e1a: Beginning new tablet copy session on tablet a4ce544917f545499da64014539a4ff2 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:35632: session id = 6b9e73092f6146639bf310a3d18cfe37-a4ce544917f545499da64014539a4ff2
I20260709 12:59:14.917968  1719 tablet_copy_source_session.cc:215] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:14.931679  2824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ce544917f545499da64014539a4ff2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:14.933745  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 63199.9us
I20260709 12:59:14.955461  1554 raft_consensus.cc:1275] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:14.957664  2564 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:14.969273  2846 ts_tablet_manager.cc:933] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:14.984498  2846 tablet_copy_client.cc:323] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43887
I20260709 12:59:14.989723  1645 tablet_copy_service.cc:140] P 8106dfc0bda54df0ae10ba13c28ccc18: Received BeginTabletCopySession request for tablet 0f3f4d9e2c0643f1be1fe0de2078f6da from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:46120)
I20260709 12:59:14.990653  1645 tablet_copy_service.cc:161] P 8106dfc0bda54df0ae10ba13c28ccc18: Beginning new tablet copy session on tablet 0f3f4d9e2c0643f1be1fe0de2078f6da from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:46120: session id = 6b9e73092f6146639bf310a3d18cfe37-0f3f4d9e2c0643f1be1fe0de2078f6da
I20260709 12:59:15.011322  2824 tablet_copy_client.cc:806] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:15.012575  2824 tablet_copy_client.cc:670] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:15.034305   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:15.046190  1645 tablet_copy_source_session.cc:215] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:15.082001  1556 raft_consensus.cc:1217] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:59:15.121913  2846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3f4d9e2c0643f1be1fe0de2078f6da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:15.125442  2824 tablet_copy_client.cc:538] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:15.200132  2824 tablet_bootstrap.cc:492] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:15.205571  2852 ts_tablet_manager.cc:933] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:15.212710  2852 tablet_copy_client.cc:323] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43887
I20260709 12:59:15.248827  1645 tablet_copy_service.cc:140] P 8106dfc0bda54df0ae10ba13c28ccc18: Received BeginTabletCopySession request for tablet 78990af8f5ef4464b9e3bbb9749e7337 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:46120)
I20260709 12:59:15.249446  1645 tablet_copy_service.cc:161] P 8106dfc0bda54df0ae10ba13c28ccc18: Beginning new tablet copy session on tablet 78990af8f5ef4464b9e3bbb9749e7337 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:46120: session id = 6b9e73092f6146639bf310a3d18cfe37-78990af8f5ef4464b9e3bbb9749e7337
I20260709 12:59:15.259585  1645 tablet_copy_source_session.cc:215] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:15.265812  2852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78990af8f5ef4464b9e3bbb9749e7337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:15.296870  2846 tablet_copy_client.cc:806] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:15.299144  2846 tablet_copy_client.cc:670] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:15.326654  2824 tablet_bootstrap.cc:492] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:15.328292  2824 tablet_bootstrap.cc:492] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:15.339634  2824 ts_tablet_manager.cc:1403] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.140s	user 0.034s	sys 0.027s
I20260709 12:59:15.342281  2327 raft_consensus.cc:1217] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:15.377684  2824 raft_consensus.cc:359] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:15.378640  2824 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:15.379309  2824 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:15.399272  2824 ts_tablet_manager.cc:1434] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.001s
I20260709 12:59:15.429387  1630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:15.430096  1630 raft_consensus.cc:606] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:15.435928  1630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:15.436902  1630 raft_consensus.cc:606] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Received request to transfer leadership to TS 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:15.451858  2846 tablet_copy_client.cc:538] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:15.468948  1707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:15.469692  1707 raft_consensus.cc:606] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Received request to transfer leadership to TS 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:15.478684  1556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:15.479759  1556 raft_consensus.cc:606] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Received request to transfer leadership to TS 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:15.487320  1707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:15.488040  1707 raft_consensus.cc:606] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Received request to transfer leadership to TS 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:15.489769   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:15.490628  2561 raft_consensus.cc:993] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:15.491114  2561 raft_consensus.cc:1081] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Signalling peer 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:15.491777   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:15.493602  2327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:58640
I20260709 12:59:15.494395  2327 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:15.494958  2327 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:15.513022  2325 raft_consensus.cc:1217] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:15.516360  2327 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:15.520459  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:15.521099  1556 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:15.531010  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 129285us
I20260709 12:59:15.533524  2327 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:15.543203  2846 tablet_bootstrap.cc:492] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
W20260709 12:59:15.544873  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 186673us
I20260709 12:59:15.549310  1719 tablet_copy_service.cc:342] P 4f6fa2fd61114dc190d8f9b310696e1a: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-a4ce544917f545499da64014539a4ff2 received from {username='slave'} at 127.0.0.1:35632
I20260709 12:59:15.550204  1719 tablet_copy_service.cc:434] P 4f6fa2fd61114dc190d8f9b310696e1a: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-a4ce544917f545499da64014539a4ff2 on tablet a4ce544917f545499da64014539a4ff2 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:15.600096  2852 tablet_copy_client.cc:806] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:15.603102  2852 tablet_copy_client.cc:670] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
W20260709 12:59:15.601224  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 49188.3us
I20260709 12:59:15.794250  1556 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:15.833047  2852 tablet_copy_client.cc:538] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:15.843426  2852 tablet_bootstrap.cc:492] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:15.912057  2852 tablet_bootstrap.cc:492] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:15.919075  2852 tablet_bootstrap.cc:492] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:15.921133  2852 ts_tablet_manager.cc:1403] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.078s	user 0.024s	sys 0.013s
I20260709 12:59:15.925125  2852 raft_consensus.cc:359] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:15.953622  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:15.958964  1630 raft_consensus.cc:3055] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:15.959411  1630 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:15.962244  1630 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:15.965852  1630 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:15.960139  2852 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
W20260709 12:59:15.980127  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 91570.9us
I20260709 12:59:15.997539  1630 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:16.009255  2288 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:16.012965  2798 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:16.013518  2798 raft_consensus.cc:697] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:16.015177  2564 raft_consensus.cc:1064] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:16.025761  2846 tablet_bootstrap.cc:492] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:16.019878  2564 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:16.032297  2798 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:15.998911  2852 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:16.046691  2852 ts_tablet_manager.cc:1434] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.124s	user 0.007s	sys 0.000s
I20260709 12:59:16.049861  1645 tablet_copy_service.cc:342] P 8106dfc0bda54df0ae10ba13c28ccc18: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-78990af8f5ef4464b9e3bbb9749e7337 received from {username='slave'} at 127.0.0.1:46120
I20260709 12:59:16.050498  1645 tablet_copy_service.cc:434] P 8106dfc0bda54df0ae10ba13c28ccc18: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-78990af8f5ef4464b9e3bbb9749e7337 on tablet 78990af8f5ef4464b9e3bbb9749e7337 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:16.048698  2846 tablet_bootstrap.cc:492] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:16.052131  2846 ts_tablet_manager.cc:1403] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.509s	user 0.049s	sys 0.050s
I20260709 12:59:16.066622  2561 raft_consensus.cc:993] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
W20260709 12:59:16.175920  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 98064.7us
I20260709 12:59:16.186872  1707 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.190444  2773 raft_consensus.cc:993] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:16.198318  2327 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.202538  2327 raft_consensus.cc:1217] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:59:16.204741  2865 raft_consensus.cc:1081] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:16.208840  2773 raft_consensus.cc:1081] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Signalling peer 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:16.209335  2877 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:16.213951  1455 catalog_manager.cc:5697] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:16.218497  2846 raft_consensus.cc:359] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:16.219758  2846 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:16.227473  1709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 12:59:16.247562  1709 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.247984  1709 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.257007  2846 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:16.257489  2864 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.268436  2869 raft_consensus.cc:993] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:16.269124  2707 raft_consensus.cc:1081] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Signalling peer 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:16.274219  1556 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.276674  2846 ts_tablet_manager.cc:1434] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.224s	user 0.011s	sys 0.009s
I20260709 12:59:16.277912  2879 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:16.288080  1645 tablet_copy_service.cc:342] P 8106dfc0bda54df0ae10ba13c28ccc18: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-0f3f4d9e2c0643f1be1fe0de2078f6da received from {username='slave'} at 127.0.0.1:46120
I20260709 12:59:16.288527  1645 tablet_copy_service.cc:434] P 8106dfc0bda54df0ae10ba13c28ccc18: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-0f3f4d9e2c0643f1be1fe0de2078f6da on tablet 0f3f4d9e2c0643f1be1fe0de2078f6da with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:16.274318  1709 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:16.300625  2325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:58616
I20260709 12:59:16.301280  2325 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.303728  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:16.302062  1709 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:16.304448  1552 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.305820  2881 raft_consensus.cc:993] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:16.306376  2881 raft_consensus.cc:1081] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Signalling peer 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:16.302415  2325 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.312737  2329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:58628
I20260709 12:59:16.313328  2329 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.313683  2329 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.316434  2326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:58616
I20260709 12:59:16.320519  2326 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.321179  2326 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.325852  2868 raft_consensus.cc:1064] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:16.326232  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:16.326848  1630 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:16.327142  1630 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:16.327863  1630 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:16.329368  1630 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.335704  2329 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:16.341305  1552 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:16.336845  2868 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:16.347959  1673 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:16.349694  2696 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:16.350276  2696 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:16.351243  2329 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:16.354018  1630 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:16.351102  2696 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:16.362321  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:16.362914  1630 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.386029  2326 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:16.388273  2326 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:16.389065  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:16.389787  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:16.398401  1627 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.398556  1707 raft_consensus.cc:3055] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:16.393008  2325 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:16.393396  1630 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:16.399394  1707 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:16.414431  1627 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:16.418485  2288 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:16.419755  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:16.420686  2798 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:16.394593  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:16.422638  1707 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:16.426357  1707 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.432251  2840 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:16.416222  1709 raft_consensus.cc:2955] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:16.446274  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.460626  2798 raft_consensus.cc:697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:16.438220  1552 raft_consensus.cc:3055] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:16.461977  1552 raft_consensus.cc:740] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:16.462272  2798 consensus_queue.cc:237] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:16.462895  1552 consensus_queue.cc:260] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:16.464757  1458 catalog_manager.cc:5697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.403335  2864 raft_consensus.cc:2955] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:16.467963  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:16.468600  1556 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.492905  1556 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:16.474757  1552 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.504236  1560 raft_consensus.cc:2955] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:16.505936  2325 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:16.513628  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:16.514235  1709 raft_consensus.cc:3055] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:16.514534  1709 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:16.510366  2286 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:16.515580  1709 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:16.522163  1558 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.523272  1709 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.545827  1707 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:16.548913  1627 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.557955  2325 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:16.518689  2840 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:16.564828  2891 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:16.582803  1709 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:16.564883  2855 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:59:16.582135  1458 catalog_manager.cc:5697] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:16.565713  1552 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:16.588670  2880 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:59:16.594877  2857 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:59:16.599677  1707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39852
I20260709 12:59:16.600656  1707 raft_consensus.cc:606] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Received request to transfer leadership
I20260709 12:59:16.617089  2891 raft_consensus.cc:697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:16.638451  1552 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:16.642750  1707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39852
I20260709 12:59:16.643364  1707 raft_consensus.cc:606] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Received request to transfer leadership
I20260709 12:59:16.618129  2891 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:16.643733  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 111756us
I20260709 12:59:16.653160  1634 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:16.655889  1458 catalog_manager.cc:5697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:16.657090  2325 raft_consensus.cc:2955] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:16.659629  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08002f61c0 after lost signal to thread 434
W20260709 12:59:16.660710  1656 debug-util.cc:398] Leaking SignalData structure 0x7b0800208560 after lost signal to thread 1492
W20260709 12:59:16.662262  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5fc0 after lost signal to thread 1584
I20260709 12:59:16.667958  2893 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:59:16.670122  2893 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:59:16.663610  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08000fe260 after lost signal to thread 1659
W20260709 12:59:16.682441  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08003462c0 after lost signal to thread 1733
W20260709 12:59:16.683938  1656 debug-util.cc:398] Leaking SignalData structure 0x7b080033a180 after lost signal to thread 2353
I20260709 12:59:16.710880  1634 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:16.708390  1445 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 0f3f4d9e2c0643f1be1fe0de2078f6da already in progress [suppressed 2 similar messages]
I20260709 12:59:16.649173  2840 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:16.792008  1709 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:16.809669  2564 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:59:16.835644  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 43521.8us
I20260709 12:59:16.846751   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:16.852669  1445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 147039us
I20260709 12:59:16.857969  2864 raft_consensus.cc:1064] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:16.861338  2877 raft_consensus.cc:2955] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:16.888880  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 63975.6us
I20260709 12:59:16.946105  1709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39852
I20260709 12:59:16.946905  1709 raft_consensus.cc:606] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Received request to transfer leadership
I20260709 12:59:16.947497  1556 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:16.943745  2864 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:16.954836  2328 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:59:17.005805  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 44011.3us
W20260709 12:59:17.008112  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 49352.1us
I20260709 12:59:17.020778  1634 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:17.026988  2324 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Advancing to term 2
I20260709 12:59:17.023753  1552 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:17.031036  2325 raft_consensus.cc:2955] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:17.036921  2798 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:17.047803  2881 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.059598  2564 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:17.063289  2868 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:59:17.126200  1632 raft_consensus.cc:2955] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:17.138172   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:17.150717  1556 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:17.154330  2328 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:17.157519  1709 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:17.156045  2879 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:59:17.160841  2324 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:17.164528  1632 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:17.113488  2323 raft_consensus.cc:2955] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:17.169335  2857 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:17.176281  2911 raft_consensus.cc:2955] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:17.189428  1506 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:59:17.189965  1506 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 0f3f4d9e2c0643f1be1fe0de2078f6da already in progress
W20260709 12:59:17.190284  1506 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 0f3f4d9e2c0643f1be1fe0de2078f6da already in progress
I20260709 12:59:17.171489  2864 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:59:17.435359  2879 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:17.437953  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 193165fa679c4f6c9d6ac6b39ef823bd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:17.450314  1455 catalog_manager.cc:5697] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 1 to 2, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.452564  1455 catalog_manager.cc:5697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 1 to 2, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:17.456858  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 112114us
W20260709 12:59:17.419998  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 128285us
I20260709 12:59:17.239343  2891 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 12:59:17.281647  1556 raft_consensus.cc:2955] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:17.492352  1709 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:17.501931  1709 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:17.523952  1709 raft_consensus.cc:2955] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:17.543525  1458 catalog_manager.cc:5697] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.557040  1627 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:17.594477  2921 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:59:17.638974  2891 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:17.610625  2798 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:59:17.647843  2911 raft_consensus.cc:1064] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:17.652179  2856 raft_consensus.cc:993] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:17.652778  2856 raft_consensus.cc:1081] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:17.660017  1627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60066
I20260709 12:59:17.660852  1627 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.661362  1627 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:17.648330  2911 raft_consensus.cc:1068] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a: Unable to promote non-voter 6b9e73092f6146639bf310a3d18cfe37: Service unavailable: leader transfer in progress
I20260709 12:59:17.706450  2564 raft_consensus.cc:2955] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:17.699882  1627 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:17.718359  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:17.719519  1556 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:17.739662  1554 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:17.745643  2894 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:17.766579  1627 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:17.766665  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:17.777948  1556 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
W20260709 12:59:17.990326  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 206042us
I20260709 12:59:18.002144  1558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:18.002939  1558 raft_consensus.cc:606] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:18.005649  2707 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:18.006203  2707 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:18.009421  2707 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:18.011116  1457 catalog_manager.cc:5697] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:18.014753  1700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c1e1be9de68405393292149e41c0724"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:18.015471  1700 raft_consensus.cc:606] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:18.115715  1709 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:18.116281  1709 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:18.117199  1709 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:18.118528  1709 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.107425  1700 raft_consensus.cc:2955] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:18.131402  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 127071us
I20260709 12:59:18.146526  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:18.155630  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:18.179242  1709 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
W20260709 12:59:18.315011  2934 log.cc:927] Time spent T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:59:18.405977  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 263068us
W20260709 12:59:18.407810  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 264902us
I20260709 12:59:18.401674  2873 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 12:59:18.402884  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 248351us
I20260709 12:59:18.423198  1526 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:18.433405  2919 raft_consensus.cc:993] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:18.413290  2873 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:18.443459  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:18.458655  1709 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:18.460005  2707 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:18.440572  2865 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:18.453915  1558 raft_consensus.cc:2955] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:18.464182  2948 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:18.463796  2869 raft_consensus.cc:1081] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:18.482329  2876 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 12:59:18.488547  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.477762  2325 raft_consensus.cc:2955] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:18.473099  2936 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:18.505062  2936 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:18.485972  2948 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:18.508085  1705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf4201f98c934feca49bae13648b2835"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:18.482925  2876 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:18.472784  2865 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:18.509143  1705 raft_consensus.cc:606] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:18.511418  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:18.510699  1701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39878
I20260709 12:59:18.543653  1701 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:18.544082  1701 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.544165  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:18.532895  2873 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:18.559152  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 47225.2us
I20260709 12:59:18.563468  1555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:18.564313  1555 raft_consensus.cc:606] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:18.563354  2865 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:18.583942  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:18.587731  2936 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:18.588950  1706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:18.589901  1706 raft_consensus.cc:606] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Received request to transfer leadership to TS 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:18.591704  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:18.595619   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:18.602923  2876 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:18.550411  2948 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:18.621862  2323 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:18.624217  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:18.624565   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:59:18.630475  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.637303  1549 tablet_service.cc:1558] Processing DeleteTablet for tablet 193165fa679c4f6c9d6ac6b39ef823bd with delete_type TABLET_DATA_TOMBSTONED (TS e4c78b411eb34b3d92183a86d34a81f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47896
I20260709 12:59:18.614511  1701 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:18.641562  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:18.646061  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:18.653510  1560 raft_consensus.cc:3055] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:18.653970  1560 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:18.650221  1701 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:18.661273  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:18.661932  1627 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.663810  1555 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:18.671559  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:18.667488  1560 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:18.680039  1627 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:18.680512  1560 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.676079  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:18.695328  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:18.695330  1601 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:18.697685  1457 catalog_manager.cc:5697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:18.703466  1601 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:18.704515  1633 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:18.681424  2860 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:59:18.718328  1560 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:18.706875  2864 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:18.705307  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:18.719449  2936 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:18.725857  1601 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:18.729126  1673 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:18.704865  2940 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:18.744305  2960 tablet_replica.cc:333] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 12:59:18.746107  2960 raft_consensus.cc:2243] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.747277  2960 raft_consensus.cc:2272] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.749812  2819 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:18.750576  2819 raft_consensus.cc:697] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:18.751564  2819 consensus_queue.cc:237] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:18.753597  2946 raft_consensus.cc:993] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:18.754592  2960 ts_tablet_manager.cc:1916] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:59:18.756996  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 61595.8us
I20260709 12:59:18.763561  2904 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:59:18.737174  2876 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:18.769660  2946 raft_consensus.cc:1081] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:18.770865  2860 raft_consensus.cc:993] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:18.771518  2860 raft_consensus.cc:1081] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:18.773326  2855 raft_consensus.cc:2955] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:18.775833  2327 raft_consensus.cc:2955] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:18.782447  2707 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:18.783216  2707 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:18.791205  2707 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:18.797418  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:18.799083  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:18.802067  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:18.809754  1526 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:18.810472  1627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf4201f98c934feca49bae13648b2835"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60066
I20260709 12:59:18.811221  1627 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:18.811604  1627 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.810547  1633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c1e1be9de68405393292149e41c0724"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60066
I20260709 12:59:18.816901  1633 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:18.817293  1633 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.823383  1627 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:18.826228  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:18.826850  1560 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.829116  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a4ce544917f545499da64014539a4ff2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:18.838958  1454 catalog_manager.cc:5697] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:18.848840  1457 catalog_manager.cc:5697] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 2 to 3, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:18.858152  2960 ts_tablet_manager.cc:1929] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:18.862447  1619 tablet_service.cc:1558] Processing DeleteTablet for tablet a4ce544917f545499da64014539a4ff2 with delete_type TABLET_DATA_TOMBSTONED (TS 8106dfc0bda54df0ae10ba13c28ccc18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60036
I20260709 12:59:18.858816  2960 log.cc:1199] T 193165fa679c4f6c9d6ac6b39ef823bd P e4c78b411eb34b3d92183a86d34a81f1: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root/wals/193165fa679c4f6c9d6ac6b39ef823bd
I20260709 12:59:18.865106  1629 raft_consensus.cc:1240] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:18.868027  2819 consensus_queue.cc:1059] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:18.869091  2819 raft_consensus.cc:3055] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:18.869552  2819 raft_consensus.cc:740] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:18.870219  2707 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:18.870791  1443 catalog_manager.cc:5028] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): tablet 193165fa679c4f6c9d6ac6b39ef823bd (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:18.872141  2819 consensus_queue.cc:260] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:18.873747  2968 tablet_replica.cc:333] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 12:59:18.875102  2968 raft_consensus.cc:2243] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.873868  2819 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.876314  2968 raft_consensus.cc:2272] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.885950  2968 ts_tablet_manager.cc:1916] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:18.895665  1560 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:18.835471  1455 catalog_manager.cc:5697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 3, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:18.909437  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:18.911023  1599 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:18.912325  2876 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:18.913060  2876 raft_consensus.cc:697] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:18.914240  2876 consensus_queue.cc:237] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:18.916289  1627 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:18.925854  2968 ts_tablet_manager.cc:1929] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:18.946254  2860 raft_consensus.cc:993] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:18.950652  2968 log.cc:1199] T a4ce544917f545499da64014539a4ff2 P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root/wals/a4ce544917f545499da64014539a4ff2
I20260709 12:59:18.951119  2860 raft_consensus.cc:1081] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Signalling peer 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:18.953186  1445 catalog_manager.cc:5028] TS 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): tablet a4ce544917f545499da64014539a4ff2 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:18.954115  2327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:58616
I20260709 12:59:18.954795  2327 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:18.955150  2327 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.955619  2704 raft_consensus.cc:993] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:18.956192  2704 raft_consensus.cc:1081] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:18.916946  1633 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:18.958621  1634 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:18.959728  1633 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:18.961964  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:18.974737  1706 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:18.975045  1706 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:18.975790  1706 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:18.965255  1709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39878
I20260709 12:59:18.977197  1709 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:18.977540  1709 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.984872  1706 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.998916  1455 catalog_manager.cc:5697] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 3, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:18.961659  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:19.009480  1560 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.018151  1705 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:19.021157  2327 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:19.024027  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:19.024657  1634 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.025655  1709 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:59:19.034659  1633 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:19.041298  1706 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:19.072217  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:19.072978  1705 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:19.073333  1705 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:19.028940  1709 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:19.049571  1555 raft_consensus.cc:2955] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:19.051297  1560 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:19.051481  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:19.060292  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:19.076628  1627 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.063815  2327 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:19.064312  1634 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:19.074463  1705 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:19.079428  1705 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.079568  1629 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:19.078101  1599 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:19.085548  1709 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:19.089250  2564 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:19.089777  2564 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:19.089615  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:19.090929  2564 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:19.093731  2892 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:19.094300  2892 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:19.099419  1705 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:19.100435  1627 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:19.086885  1552 raft_consensus.cc:3055] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:19.107347  1675 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:19.115638  2327 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:19.117498  1705 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:19.108078  1552 raft_consensus.cc:740] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:19.114005  2860 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:19.119544  2872 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:59:19.114383  2892 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:19.134577  2564 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:19.116659  2936 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:59:19.142226  1552 consensus_queue.cc:260] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:59:19.143684  1552 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.146696  2860 raft_consensus.cc:697] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:19.166142  2323 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Advancing to term 3
I20260709 12:59:19.172000  2860 consensus_queue.cc:237] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:59:19.179854  2323 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:19.180341  2872 raft_consensus.cc:2955] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:19.182557  2327 raft_consensus.cc:2955] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:19.188802  1457 catalog_manager.cc:5697] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 2, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.193993  1455 catalog_manager.cc:5697] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 1 to 2, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.204562  1558 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:19.205754  1552 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:19.217752  1705 raft_consensus.cc:2955] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:19.237480  2864 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.244138  1553 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:19.248020  2855 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:19.248325  2864 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:59:19.291972  1458 catalog_manager.cc:5697] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.320423  2864 raft_consensus.cc:1064] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:19.326694  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78990af8f5ef4464b9e3bbb9749e7337 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:19.341868  1455 catalog_manager.cc:5697] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 4 to 5, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:19.340835  2864 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:19.389400  2324 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:19.391307  1549 tablet_service.cc:1558] Processing DeleteTablet for tablet 78990af8f5ef4464b9e3bbb9749e7337 with delete_type TABLET_DATA_TOMBSTONED (TS e4c78b411eb34b3d92183a86d34a81f1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:47896
I20260709 12:59:19.394850  1627 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:19.396806  1702 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:19.399080  2564 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:19.399709  2855 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:19.406574  2864 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:19.400244  1558 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:19.415449  1702 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:19.419067  2864 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:19.419744  2564 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:19.488794  2981 tablet_replica.cc:333] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
W20260709 12:59:19.506281  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 59431.3us
W20260709 12:59:19.508141  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 55036.4us
I20260709 12:59:19.539132  2948 raft_consensus.cc:2955] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:19.539577  2324 raft_consensus.cc:2955] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:19.548425  1558 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:19.561542  2943 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:19.580880  1553 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:19.581542  1709 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:19.586242  2892 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:59:19.593729  2981 raft_consensus.cc:2243] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:19.594564  2981 raft_consensus.cc:2272] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:19.601824  2981 ts_tablet_manager.cc:1916] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:19.626180  1701 raft_consensus.cc:2955] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:19.629231   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:19.590233  2864 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:59:19.686470  1553 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:19.686333  1454 catalog_manager.cc:5697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 2 to 5, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:19.717660  2944 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:59:19.752378  1705 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:59:19.756124  2985 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.056s	user 0.002s	sys 0.000s
I20260709 12:59:19.757565  2984 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:59:19.781646  1627 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:19.803135  1560 raft_consensus.cc:2955] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:19.811023  1627 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:19.791370  2892 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:59:19.838675  1628 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:59:19.844890  2986 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 12:59:19.851788  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 47169.8us
I20260709 12:59:19.852607  2944 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:19.902578   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:19.859562  2981 ts_tablet_manager.cc:1929] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:59:19.960000  2981 log.cc:1199] T 78990af8f5ef4464b9e3bbb9749e7337 P e4c78b411eb34b3d92183a86d34a81f1: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root/wals/78990af8f5ef4464b9e3bbb9749e7337
I20260709 12:59:19.996469  1560 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:20.000700  2984 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:20.014624  1443 catalog_manager.cc:5028] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): tablet 78990af8f5ef4464b9e3bbb9749e7337 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
W20260709 12:59:20.042630  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 84403.9us
I20260709 12:59:20.008376  2324 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:59:20.083873  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 69679.2us
W20260709 12:59:20.090312  2992 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.188s	user 0.000s	sys 0.002s
I20260709 12:59:20.112555  1555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:20.113711  1555 raft_consensus.cc:606] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:20.151446  2948 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:20.181769  2564 raft_consensus.cc:2955] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:20.200767  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:20.201838  1627 raft_consensus.cc:606] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Received request to transfer leadership to TS 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:20.208827  2323 raft_consensus.cc:2955] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:20.217002  1556 raft_consensus.cc:2955] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:20.219955  1560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:20.240252  1560 raft_consensus.cc:606] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:20.243371  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:20.244557  1627 raft_consensus.cc:606] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:20.246555  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0f3f4d9e2c0643f1be1fe0de2078f6da with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:20.247105  2867 raft_consensus.cc:993] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:20.247632  2867 raft_consensus.cc:1081] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:20.250372  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:20.251150  1627 raft_consensus.cc:606] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:20.252974   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:20.255276   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:20.257694  2990 raft_consensus.cc:993] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
W20260709 12:59:20.258427  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 142080us
I20260709 12:59:20.258749  2990 raft_consensus.cc:1081] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:20.293629  1455 catalog_manager.cc:5697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 5 to 6, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:20.315826  3007 raft_consensus.cc:993] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:20.316903  2564 raft_consensus.cc:1081] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:20.333873  1701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39878
I20260709 12:59:20.334601  1701 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:20.335184  1701 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:20.343547  1705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39878
I20260709 12:59:20.344246  1705 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:20.344362  1707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 12:59:20.344923  1707 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:20.345396  1707 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.344874  1705 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.351138  1701 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:20.361424  1707 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:20.364955  1705 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:20.369063  1705 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:20.369270  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:20.385318  1707 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:20.386150  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:20.387123  1627 raft_consensus.cc:3055] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:20.387424  1627 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:20.379182  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:20.388278  1627 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:20.388973  2324 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:20.389736  1627 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.384083  2323 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.377120  1701 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:20.407260  2324 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:20.408982  1672 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:20.409730  2962 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:20.410193  2962 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:20.411064  2962 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:20.413556  2323 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:20.415639  1672 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:20.402419  1627 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:20.416990  2904 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:20.417732  2904 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:20.418241  1675 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:20.418660  2904 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:20.419389  2855 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:20.419895  2855 raft_consensus.cc:697] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:20.420579  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:20.421224  1560 raft_consensus.cc:3055] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:20.420855  2855 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:20.421502  1560 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:20.420994  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:20.423171  1556 raft_consensus.cc:3055] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:20.423472  1556 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:20.424834  1560 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:20.426115  1560 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:20.424296  1556 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:20.424854  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:20.429251  1556 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.429251  1555 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.439689  1560 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:20.455844  1555 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:20.463114  1556 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:20.474321  1457 catalog_manager.cc:5697] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 3 to 4, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 4 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:20.477775  2864 raft_consensus.cc:993] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:20.478298  2864 raft_consensus.cc:1081] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Signalling peer 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:20.480492  2323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:58640
I20260709 12:59:20.481341  2323 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:20.481928  2323 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.497045  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f3f4d9e2c0643f1be1fe0de2078f6da with delete_type TABLET_DATA_TOMBSTONED (TS 4f6fa2fd61114dc190d8f9b310696e1a not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:39852
I20260709 12:59:20.521775  2323 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:20.533016  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:20.533812  1627 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:20.534303  1627 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:20.535034  1627 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:20.536033  1627 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.536917  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:20.537492  1707 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.564184  1457 catalog_manager.cc:5697] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:20.569353  1627 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:20.524470  2323 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:20.574915  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:20.576766  1457 catalog_manager.cc:5697] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:20.580833  2997 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:20.581604  2997 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:20.588990  1707 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:20.582461  2997 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:20.604465  2564 raft_consensus.cc:993] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:20.605063  2564 raft_consensus.cc:1081] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:20.608268  3014 tablet_replica.cc:333] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 12:59:20.635387  1701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 12:59:20.636330  1701 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:20.636785  1701 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:20.643136  3014 raft_consensus.cc:2243] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.659098  3014 raft_consensus.cc:2272] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.666671  3014 ts_tablet_manager.cc:1916] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:20.717895  1701 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:20.724500  1701 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:20.802150  1454 catalog_manager.cc:5697] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:20.809778  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:20.841872  1556 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:20.823554  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:20.844281  1628 raft_consensus.cc:3055] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:20.844640  1628 raft_consensus.cc:740] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:20.846047  1628 consensus_queue.cc:260] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:20.847147  2323 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:20.849534  2855 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:20.857173  1628 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:20.846518  1633 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:20.873766  2855 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:20.870595  1556 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:20.910597  3014 ts_tablet_manager.cc:1929] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:59:20.911461  3014 log.cc:1199] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root/wals/0f3f4d9e2c0643f1be1fe0de2078f6da
I20260709 12:59:20.914065  1628 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:20.917363  1675 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:20.928119  2962 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:20.930984  2962 raft_consensus.cc:697] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:20.937335  2323 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:20.932503  2962 consensus_queue.cc:237] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:20.941185  2904 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:20.942564  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 0f3f4d9e2c0643f1be1fe0de2078f6da (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:20.958602  1555 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:20.961169  1556 consensus_queue.cc:237] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:20.965888  1555 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:59:20.993773  1523 consensus_peers.cc:597] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48837d0ac86f4664b4bfe442411bc28f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:21.041298  1707 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:21.042047  1629 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:21.043638  3022 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:59:21.038652  1555 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:21.060786  2963 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:21.062251  2819 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:21.064146  2855 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:59:21.064960  3024 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:59:21.068938  1709 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:21.049523  2987 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:21.077615  2997 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:21.080864  2990 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:21.223140  1629 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:21.267766  1457 catalog_manager.cc:5697] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 2 to 3, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:21.352363   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:21.346001  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 55488.7us
I20260709 12:59:21.357789  3000 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
W20260709 12:59:21.376780  3029 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
W20260709 12:59:21.386569  3028 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 12:59:21.390115  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 58832.3us
I20260709 12:59:21.419977  2907 raft_consensus.cc:2955] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:21.442536  1633 raft_consensus.cc:2955] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:21.494048  1556 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:21.504716  1553 raft_consensus.cc:1275] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:21.513406  1701 raft_consensus.cc:2955] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:21.515684  1454 catalog_manager.cc:5697] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:21.538967  1627 raft_consensus.cc:1275] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:59:21.550551  1523 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d71f760473d4219a951e6e5f061bfb5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:21.555490  2962 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:21.558205  3039 ts_tablet_manager.cc:933] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:21.569926  3039 tablet_copy_client.cc:323] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:59:21.587131  2944 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:59:21.600824  3038 log.cc:927] Time spent T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:59:21.616281  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet 48837d0ac86f4664b4bfe442411bc28f from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:59:21.617027  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet 48837d0ac86f4664b4bfe442411bc28f from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-48837d0ac86f4664b4bfe442411bc28f
W20260709 12:59:21.635421  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 51260.3us
I20260709 12:59:21.649547  1707 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:21.651937  1628 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:21.655174  1570 tablet_copy_source_session.cc:215] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:21.662789  2707 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:21.681680  3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48837d0ac86f4664b4bfe442411bc28f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:21.670885  2707 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:59:21.760798  2907 raft_consensus.cc:2955] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:21.772145  1707 raft_consensus.cc:2955] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:21.785706  1632 raft_consensus.cc:2955] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:21.780787  1701 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:21.805136  1457 catalog_manager.cc:5697] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:21.811955  3039 tablet_copy_client.cc:806] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:21.812898  3039 tablet_copy_client.cc:670] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:21.822635  3039 tablet_copy_client.cc:538] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:59:21.892486  1672 consensus_peers.cc:597] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dfc7199563cc4b68b76fa96af21d01c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:21.893132  1632 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:21.895952  2963 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:21.897498   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:21.906200  3039 tablet_bootstrap.cc:492] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:21.932116  1556 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:21.941294  2963 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:21.968966  1556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "327c042262d94ababf63c12c177e29ed"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:21.970350  1556 raft_consensus.cc:606] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Received request to transfer leadership to TS 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:21.978662  2990 raft_consensus.cc:993] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:21.979223  2990 raft_consensus.cc:1081] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Signalling peer 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:21.984359  2324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "327c042262d94ababf63c12c177e29ed"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:58628
I20260709 12:59:21.986317  2324 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:21.986732  2324 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.990581  2962 raft_consensus.cc:2955] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:21.993075  1632 raft_consensus.cc:2955] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:21.994156  1555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "428c176495744009b63bfa690baa17c6"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:21.994742  1555 raft_consensus.cc:606] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:22.003459  1555 raft_consensus.cc:2955] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:22.005259  1707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:22.006215  1707 raft_consensus.cc:606] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:22.012840  1701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:22.013460  1701 raft_consensus.cc:606] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:22.016477   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:22.018471   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:22.020820  2324 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:22.023092  2324 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:22.025131  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:22.025774  1560 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.026075  1560 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:22.026939  1560 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:22.028575  1560 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.030930  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:22.031982  1701 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.040271  1457 catalog_manager.cc:5697] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:22.046809  1560 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:22.051648  2286 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:22.052914  3041 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.053375  3041 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:22.054257  3041 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:22.060083  3039 tablet_bootstrap.cc:492] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:22.065711  1560 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:22.067873  3039 tablet_bootstrap.cc:492] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:22.072427  3039 ts_tablet_manager.cc:1403] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.166s	user 0.034s	sys 0.004s
I20260709 12:59:22.081411  3039 raft_consensus.cc:359] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:22.083734  3039 raft_consensus.cc:740] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:22.085547  3039 consensus_queue.cc:260] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:22.092756  3039 ts_tablet_manager.cc:1434] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:59:22.097903  1570 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-48837d0ac86f4664b4bfe442411bc28f received from {username='slave'} at 127.0.0.1:33810
I20260709 12:59:22.098098  2327 raft_consensus.cc:1217] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:22.098495  1570 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-48837d0ac86f4664b4bfe442411bc28f on tablet 48837d0ac86f4664b4bfe442411bc28f with peer 6b9e73092f6146639bf310a3d18cfe37
W20260709 12:59:22.133667  1523 consensus_peers.cc:597] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08d2a27acc8245ffb64e2f7a75ff92a4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:22.135710  1628 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:22.139364  3039 ts_tablet_manager.cc:933] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:22.148775  2990 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:59:22.156075  1707 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:22.184263  2707 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:59:22.186488  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49485.8us
I20260709 12:59:22.186033  3039 tablet_copy_client.cc:323] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:59:22.197281  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet 4d71f760473d4219a951e6e5f061bfb5 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:59:22.198055  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet 4d71f760473d4219a951e6e5f061bfb5 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-4d71f760473d4219a951e6e5f061bfb5
I20260709 12:59:22.202543  1701 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:22.216137  2819 raft_consensus.cc:993] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:22.225916  2944 raft_consensus.cc:1081] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:22.253818  2907 raft_consensus.cc:993] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:22.253856  1633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60066
I20260709 12:59:22.255043  2707 raft_consensus.cc:2955] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:22.256816  2907 raft_consensus.cc:1081] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:22.258948  1628 raft_consensus.cc:2955] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:22.262751  1701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "428c176495744009b63bfa690baa17c6"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39878
I20260709 12:59:22.263371  1701 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.263697  1701 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.256224  1633 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.264341  1633 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.268652  1570 tablet_copy_source_session.cc:215] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:22.283975  3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d71f760473d4219a951e6e5f061bfb5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:22.293434  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 49461.8us
I20260709 12:59:22.279317  1701 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:22.309340  1701 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:22.308506  1706 raft_consensus.cc:2955] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:22.298024  1458 catalog_manager.cc:5697] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.313380  1633 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:22.320518  1633 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:22.324505  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:22.325475  2324 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.325924  2819 raft_consensus.cc:993] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:22.326967  2944 raft_consensus.cc:1081] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:22.334153  1457 catalog_manager.cc:5697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.337962  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:22.339803  1709 raft_consensus.cc:3055] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.340327  1709 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:22.341331  1709 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:22.342854  1709 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.362214  1628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60066
I20260709 12:59:22.362639  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:22.362833  1628 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.363198  1628 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.363559  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:22.372526  1560 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.373174  1560 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:22.375910  1560 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:22.377130  1560 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.376837  1709 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:22.381421  1628 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:22.388864  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:22.389492  1555 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.402936  1555 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:22.404336  1599 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:22.405413  3055 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.405992  3055 raft_consensus.cc:697] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:22.406879  3055 consensus_queue.cc:237] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:22.363207  1633 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.414479  3051 ts_tablet_manager.cc:933] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:22.415407  1628 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:22.370162  2324 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:22.420219  1598 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:22.421531  3007 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.422309  3007 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:22.423483  3007 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:22.432410  3051 tablet_copy_client.cc:323] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:42699
I20260709 12:59:22.435647  1719 tablet_copy_service.cc:140] P 4f6fa2fd61114dc190d8f9b310696e1a: Received BeginTabletCopySession request for tablet dfc7199563cc4b68b76fa96af21d01c4 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:35632)
I20260709 12:59:22.436228  1719 tablet_copy_service.cc:161] P 4f6fa2fd61114dc190d8f9b310696e1a: Beginning new tablet copy session on tablet dfc7199563cc4b68b76fa96af21d01c4 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:35632: session id = 6b9e73092f6146639bf310a3d18cfe37-dfc7199563cc4b68b76fa96af21d01c4
I20260709 12:59:22.438359  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:22.439013  1709 raft_consensus.cc:3055] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.439433  1709 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:22.440297  1709 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:22.442734  1458 catalog_manager.cc:5697] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 2, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.453732  1709 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:22.456856  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 50620.2us
I20260709 12:59:22.459520  1560 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:22.468015  1633 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:22.475797  1709 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:22.481283  1719 tablet_copy_source_session.cc:215] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:22.484731  3051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc7199563cc4b68b76fa96af21d01c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.485541  1675 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:22.486558  2819 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.487051  2819 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:22.487892  2819 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:22.494998  1458 catalog_manager.cc:5697] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 2, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.483572  3039 tablet_copy_client.cc:806] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:22.522863  3039 tablet_copy_client.cc:670] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:22.530462  3039 tablet_copy_client.cc:538] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:22.547343  1457 catalog_manager.cc:5697] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.552380  3039 tablet_bootstrap.cc:492] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:22.553412  3051 tablet_copy_client.cc:806] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:22.554164  3051 tablet_copy_client.cc:670] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:22.559193  3051 tablet_copy_client.cc:538] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:59:22.584954  3064 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:59:22.594755  3051 tablet_bootstrap.cc:492] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:22.628808  1709 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:22.632174  3060 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:22.656829  3039 tablet_bootstrap.cc:492] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:22.671630  3066 ts_tablet_manager.cc:933] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:22.674837  3039 tablet_bootstrap.cc:492] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:22.677910  1560 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:22.699170  3039 ts_tablet_manager.cc:1403] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.156s	user 0.027s	sys 0.005s
I20260709 12:59:22.700248  3060 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:59:22.722815  3066 tablet_copy_client.cc:323] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:59:22.726610  3039 raft_consensus.cc:359] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:22.733944  2987 raft_consensus.cc:1064] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:22.736626  3039 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:22.744041  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet 08d2a27acc8245ffb64e2f7a75ff92a4 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:59:22.744932  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet 08d2a27acc8245ffb64e2f7a75ff92a4 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-08d2a27acc8245ffb64e2f7a75ff92a4
I20260709 12:59:22.745232  3039 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:22.751402  3039 ts_tablet_manager.cc:1434] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 12:59:22.770501  1569 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-4d71f760473d4219a951e6e5f061bfb5 received from {username='slave'} at 127.0.0.1:33810
I20260709 12:59:22.771054  1569 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-4d71f760473d4219a951e6e5f061bfb5 on tablet 4d71f760473d4219a951e6e5f061bfb5 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:22.761844  2987 consensus_queue.cc:237] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:22.804385  1570 tablet_copy_source_session.cc:215] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:22.811479  3066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d2a27acc8245ffb64e2f7a75ff92a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:22.821620  2324 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:22.835007  3051 tablet_bootstrap.cc:492] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:22.835951  3071 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:22.847307  3051 tablet_bootstrap.cc:492] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:22.848400  1555 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.848431  3051 ts_tablet_manager.cc:1403] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.254s	user 0.028s	sys 0.010s
I20260709 12:59:22.852432  3051 raft_consensus.cc:359] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:22.854468  3007 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:22.866516  3051 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:22.867487  3051 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:22.878531  3051 ts_tablet_manager.cc:1434] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:59:22.886057  1719 tablet_copy_service.cc:342] P 4f6fa2fd61114dc190d8f9b310696e1a: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-dfc7199563cc4b68b76fa96af21d01c4 received from {username='slave'} at 127.0.0.1:35632
I20260709 12:59:22.886678  1719 tablet_copy_service.cc:434] P 4f6fa2fd61114dc190d8f9b310696e1a: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-dfc7199563cc4b68b76fa96af21d01c4 on tablet dfc7199563cc4b68b76fa96af21d01c4 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:22.897552  2327 raft_consensus.cc:1217] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:59:22.899720  1706 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.904896  2936 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:22.899792  1628 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.950749  2819 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:59:22.962631  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 136816us
I20260709 12:59:22.985608  1707 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:22.990490  3007 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:23.001246  1627 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:23.003759  1707 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:23.019423   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:23.024011  3066 tablet_copy_client.cc:806] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:23.024734  3066 tablet_copy_client.cc:670] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:23.041658  3066 tablet_copy_client.cc:538] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:23.055321  1555 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:23.065479  2907 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:23.089612  2707 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:23.097206  2819 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:23.120707  2324 raft_consensus.cc:1217] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:23.139122  3074 raft_consensus.cc:2955] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:23.154194  2324 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:23.147807  1628 raft_consensus.cc:2955] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:23.161056   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:23.186233  2984 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:23.195676  3066 tablet_bootstrap.cc:492] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
W20260709 12:59:23.205951  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 52343.8us
W20260709 12:59:23.255270  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 82776.4us
W20260709 12:59:23.260088  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 89516.8us
W20260709 12:59:23.397341  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 116267us
W20260709 12:59:23.416379  3092 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 12:59:23.431962  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 133289us
I20260709 12:59:23.459470  2819 raft_consensus.cc:1064] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:23.517952  1709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "428c176495744009b63bfa690baa17c6"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:23.518899  1709 raft_consensus.cc:606] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:23.530436  2819 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:23.548344  1560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:23.549082  1560 raft_consensus.cc:606] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:23.550845  1707 raft_consensus.cc:2955] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:23.551047  2324 raft_consensus.cc:2955] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:23.626637  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 72647.2us
I20260709 12:59:23.628340  1628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:23.628997  1628 raft_consensus.cc:606] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:23.653342   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:23.655172   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:23.669011  2987 raft_consensus.cc:1064] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:23.672319  2987 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:23.690940  3099 raft_consensus.cc:993] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 12:59:23.694739  3099 raft_consensus.cc:1081] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Signalling peer e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 12:59:23.706792  1458 catalog_manager.cc:5697] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:23.712728  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 48305.9us
I20260709 12:59:23.784018  2327 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:23.789795  3088 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:59:23.799713  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 61103.5us
I20260709 12:59:23.826822  3074 raft_consensus.cc:993] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:23.827675  3071 raft_consensus.cc:1081] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:23.829133  2324 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:23.830561  3085 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:23.831179  1560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "428c176495744009b63bfa690baa17c6"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:47912
I20260709 12:59:23.831772  1560 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.832151  1560 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.846278  1633 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:23.844094  1709 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:23.857721  1633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60052
I20260709 12:59:23.858515  1560 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:23.859745  1555 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:23.858309  1633 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.863049  1633 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:23.866865  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 55262.5us
I20260709 12:59:23.871611  3093 raft_consensus.cc:993] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:23.872160  3093 raft_consensus.cc:1081] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:23.869721  3074 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:59:23.890050  1560 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:23.891002  3074 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:23.892280  3085 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:23.897121  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:23.897735  1706 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:23.898028  1706 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:23.898777  1706 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:23.903326  1627 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:23.904101  1706 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.899866  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:23.905004  1629 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.909317  1705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 12:59:23.909936  1705 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.910295  1705 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.917133  2819 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:23.922339  1633 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:23.925690  1706 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:23.927076  1633 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:23.927984  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:23.928861  1560 raft_consensus.cc:3055] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.929171  1560 raft_consensus.cc:740] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:23.930886  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:23.931530  1703 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.930121  1560 consensus_queue.cc:260] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:23.936018  1629 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:23.937745  1560 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.974973  1560 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:23.982959  3066 tablet_bootstrap.cc:492] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:23.984215  3066 tablet_bootstrap.cc:492] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:24.021997  1703 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:24.023663  1705 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:24.038205  1705 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:24.040671  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:24.041338  2329 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.048859  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:24.050571  1628 raft_consensus.cc:3055] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:24.053153  1628 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:24.053040  1601 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 12:59:24.057229  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 112312us
I20260709 12:59:24.059510  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:24.063508  2707 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:24.064621  1628 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:24.070679  2707 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:24.072398  2707 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:24.067104  3108 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:24.079977  3108 raft_consensus.cc:697] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:24.080986  3108 consensus_queue.cc:237] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:24.083714  1628 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.074009  3066 ts_tablet_manager.cc:1403] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.879s	user 0.038s	sys 0.012s
I20260709 12:59:24.104362  3105 raft_consensus.cc:2955] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.108322  2329 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:24.110142  1628 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:24.110754  1672 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:24.114573  3071 raft_consensus.cc:2955] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.121328  1630 raft_consensus.cc:2955] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.125319  2819 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:24.125833  2819 raft_consensus.cc:697] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:24.129393  2819 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:24.130261  2327 raft_consensus.cc:2955] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.147011  1628 raft_consensus.cc:2955] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.170840  1556 raft_consensus.cc:2955] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.117901  3066 raft_consensus.cc:359] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:24.235307  3066 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
W20260709 12:59:24.266319  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 50667.2us
I20260709 12:59:24.288128  3066 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:24.318743  3066 ts_tablet_manager.cc:1434] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.209s	user 0.010s	sys 0.000s
W20260709 12:59:24.335902  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 62784.5us
I20260709 12:59:24.333710  1702 raft_consensus.cc:2955] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.371832  2323 raft_consensus.cc:2955] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.381595  1570 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-08d2a27acc8245ffb64e2f7a75ff92a4 received from {username='slave'} at 127.0.0.1:33810
I20260709 12:59:24.383298  1570 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-08d2a27acc8245ffb64e2f7a75ff92a4 on tablet 08d2a27acc8245ffb64e2f7a75ff92a4 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:24.418399  1556 consensus_queue.cc:237] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:24.427464  2327 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:24.429327  2987 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:24.419807  1455 catalog_manager.cc:5697] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.448911  3088 raft_consensus.cc:2955] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.459893  1630 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:24.460058  2327 raft_consensus.cc:2955] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.470016  2987 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:24.474727  1454 catalog_manager.cc:5697] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.477286  1454 catalog_manager.cc:5697] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:24.493227  1457 catalog_manager.cc:5697] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.495668  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 48837d0ac86f4664b4bfe442411bc28f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:24.504217  1630 raft_consensus.cc:2955] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.506585  1705 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:24.512176  2327 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:24.513940  1628 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:24.514249  3132 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:24.516184  3105 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:24.523708  3099 raft_consensus.cc:2955] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.525542  1628 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:24.527412  2707 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.533205  1458 catalog_manager.cc:5697] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 2 to 3, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.542589  1556 raft_consensus.cc:1275] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:24.544759  3134 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:24.546456  1630 raft_consensus.cc:2955] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.531561  2327 raft_consensus.cc:2955] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.561700  2323 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:24.563253  3105 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:24.564044  1455 catalog_manager.cc:5697] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:24.567266  1553 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:24.571113  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dfc7199563cc4b68b76fa96af21d01c4 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:24.574877  1705 raft_consensus.cc:1275] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:24.576737  3097 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:24.579218  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 48837d0ac86f4664b4bfe442411bc28f with delete_type TABLET_DATA_TOMBSTONED (TS 4f6fa2fd61114dc190d8f9b310696e1a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39852
I20260709 12:59:24.581435  1455 catalog_manager.cc:5697] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 4 to 5, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:24.591468  1706 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:24.623096  1549 tablet_service.cc:1558] Processing DeleteTablet for tablet dfc7199563cc4b68b76fa96af21d01c4 with delete_type TABLET_DATA_TOMBSTONED (TS e4c78b411eb34b3d92183a86d34a81f1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:47896
I20260709 12:59:24.634613  2707 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.656275   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:24.671795  3144 tablet_replica.cc:333] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 12:59:24.673144  3144 raft_consensus.cc:2243] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:24.674142  3144 raft_consensus.cc:2272] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:24.634531  2323 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:24.740052  3144 ts_tablet_manager.cc:1916] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:24.795624  3139 tablet_replica.cc:333] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 12:59:24.807163  1633 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:24.873507  3139 raft_consensus.cc:2243] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:24.875823  3139 raft_consensus.cc:2272] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:24.885026  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 65282.6us
I20260709 12:59:24.889407  2944 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:59:24.852710  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 156288us
I20260709 12:59:24.930869  1705 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:24.954670  3088 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:24.956435  3139 ts_tablet_manager.cc:1916] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:59:25.045433  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 75851.4us
W20260709 12:59:25.051277  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 352285us
I20260709 12:59:25.055757  2327 raft_consensus.cc:1217] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:59:25.065261  3125 log.cc:927] Time spent T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.120s	user 0.000s	sys 0.004s
I20260709 12:59:25.085860  3146 raft_consensus.cc:2955] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:25.105888  1701 raft_consensus.cc:2955] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:25.115700  3144 ts_tablet_manager.cc:1929] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:59:25.118515  2707 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:25.148783  3144 log.cc:1199] T dfc7199563cc4b68b76fa96af21d01c4 P e4c78b411eb34b3d92183a86d34a81f1: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root/wals/dfc7199563cc4b68b76fa96af21d01c4
I20260709 12:59:25.104420  3139 ts_tablet_manager.cc:1929] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:25.151288  3139 log.cc:1199] T 48837d0ac86f4664b4bfe442411bc28f P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root/wals/48837d0ac86f4664b4bfe442411bc28f
I20260709 12:59:25.151985  1443 catalog_manager.cc:5028] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): tablet dfc7199563cc4b68b76fa96af21d01c4 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:25.159943  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 48837d0ac86f4664b4bfe442411bc28f (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:25.159083  2327 raft_consensus.cc:2955] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:25.284251  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 93351.8us
W20260709 12:59:25.303040  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 84297.2us
W20260709 12:59:25.314668  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 117771us
I20260709 12:59:25.279920  1455 catalog_manager.cc:5697] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:25.352892  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4d71f760473d4219a951e6e5f061bfb5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:25.357705  2987 raft_consensus.cc:1064] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:25.361820  2987 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:25.371832  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 56160.4us
W20260709 12:59:25.398804  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 103991us
I20260709 12:59:25.421485  2327 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:25.427626  1701 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:25.433806  1628 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:25.431555  2987 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 12:59:25.484506  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 49062.7us
I20260709 12:59:25.489063  2707 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:59:25.499220  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 46239.6us
I20260709 12:59:25.501811   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:25.516229  3071 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 12:59:25.541316  3151 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:59:25.645803  3110 raft_consensus.cc:2955] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:25.651309  3134 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:25.651997  3134 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:25.654260  1628 raft_consensus.cc:2955] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:25.655332  3134 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:25.656948  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:25.657650  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:25.659197  1599 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:25.665777  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:25.682693  1629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ab117f13144a07986c484571fb73a2"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:25.683323  1629 raft_consensus.cc:606] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:25.689890  1706 raft_consensus.cc:2955] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:25.667037  3134 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:25.699232  1701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:25.699928  1701 raft_consensus.cc:606] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:25.701208  1619 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d71f760473d4219a951e6e5f061bfb5 with delete_type TABLET_DATA_TOMBSTONED (TS 8106dfc0bda54df0ae10ba13c28ccc18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60036
I20260709 12:59:25.708159  1556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "428c176495744009b63bfa690baa17c6"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:25.708853  1556 raft_consensus.cc:606] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:25.710467   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:25.712706  1455 catalog_manager.cc:5697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:25.718355   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:25.753434  3159 tablet_replica.cc:333] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 12:59:25.752676  2327 raft_consensus.cc:2955] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:25.754607  3159 raft_consensus.cc:2243] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:25.755353  3159 raft_consensus.cc:2272] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:25.774940  3071 raft_consensus.cc:993] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:25.775642  3071 raft_consensus.cc:1081] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:25.779066  1628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "428c176495744009b63bfa690baa17c6"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60052
I20260709 12:59:25.780017  1628 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:25.780467  1628 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:25.781342  1556 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:25.787595  3159 ts_tablet_manager.cc:1916] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:25.792909  2327 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:25.793640  1706 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:25.795404  3110 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:25.797361  3071 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:25.806365  2987 raft_consensus.cc:2955] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:25.808003  1628 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:25.810027  1628 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:25.814256  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:25.815189  1556 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:25.815478  1556 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:25.823558  2323 raft_consensus.cc:2955] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:25.843142  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 08d2a27acc8245ffb64e2f7a75ff92a4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:25.844483  3159 ts_tablet_manager.cc:1929] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:25.844985  3159 log.cc:1199] T 4d71f760473d4219a951e6e5f061bfb5 P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root/wals/4d71f760473d4219a951e6e5f061bfb5
I20260709 12:59:25.846969  1445 catalog_manager.cc:5028] TS 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): tablet 4d71f760473d4219a951e6e5f061bfb5 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:25.840288  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:25.849747  1701 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:25.816404  1556 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:25.854975  1556 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:25.885816  3153 raft_consensus.cc:993] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 12:59:25.886598  2963 raft_consensus.cc:1081] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Signalling peer e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 12:59:25.880348  1455 catalog_manager.cc:5697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:25.955482  1555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:47912
I20260709 12:59:25.956146  1555 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:25.956554  1555 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.972167  1706 raft_consensus.cc:2955] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:25.985893  1619 tablet_service.cc:1558] Processing DeleteTablet for tablet 08d2a27acc8245ffb64e2f7a75ff92a4 with delete_type TABLET_DATA_TOMBSTONED (TS 8106dfc0bda54df0ae10ba13c28ccc18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60036
I20260709 12:59:25.987351  3159 tablet_replica.cc:333] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 12:59:26.000304  1701 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:26.012542  1601 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:26.013090  3089 raft_consensus.cc:993] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:26.019850  3089 raft_consensus.cc:1081] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:26.023104  3159 raft_consensus.cc:2243] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.024407  3159 raft_consensus.cc:2272] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.028885  1556 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:26.028544  3095 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:26.033866  1706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01ab117f13144a07986c484571fb73a2"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 12:59:26.034439  1706 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.035419  1706 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.045361  1555 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:26.036227  3095 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:26.053032  1706 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:26.058894  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:26.059525  1629 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:26.059867  1629 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:26.060318  3095 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:26.060814  1629 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:26.061404  3159 ts_tablet_manager.cc:1916] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:26.062085  1629 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.058638  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:26.067699  1628 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.069993  1629 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:26.056432  1706 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:26.071262  1555 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:26.076442  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:26.082762  1675 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:26.087338  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:26.092774  1555 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.097764  1455 catalog_manager.cc:5697] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 3 to 4, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.106875  1706 raft_consensus.cc:3055] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:26.107318  1706 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:26.100469  3106 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:26.113925  3106 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:26.114754  1628 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:26.114861  3106 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:26.117340  1555 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:26.108424  1706 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:26.127712  1706 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.135344  1706 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
W20260709 12:59:26.140153  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47571.9us
I20260709 12:59:26.142132  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:26.143450  3071 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:26.143929  3071 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:26.144771  3071 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:26.165365  1455 catalog_manager.cc:5697] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:26.224921  3159 ts_tablet_manager.cc:1929] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:26.226572  3159 log.cc:1199] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root/wals/08d2a27acc8245ffb64e2f7a75ff92a4
I20260709 12:59:26.228852  1445 catalog_manager.cc:5028] TS 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): tablet 08d2a27acc8245ffb64e2f7a75ff92a4 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:26.212920  1455 catalog_manager.cc:5697] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 2 to 3, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.537860  1701 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:26.540723  3161 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:26.612993  1553 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:26.617908  3161 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:26.622690  1628 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:26.627384  1553 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:26.636063  3160 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.637887  2963 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.650869  1706 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:26.653666  3087 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:26.656085  1633 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:26.661638  3087 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:26.719698   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:26.964721   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:27.165234  1628 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:27.203766  1630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:27.206413  1630 raft_consensus.cc:606] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:27.219120  1706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:27.219805  1706 raft_consensus.cc:606] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:27.235818  1701 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:27.237584  3098 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:27.246134  1598 consensus_peers.cc:597] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5299151db28746cf82a5b6d791a71d60. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:27.268961  1630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:27.269765  1630 raft_consensus.cc:606] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Received request to transfer leadership to TS 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:27.270414  1556 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:27.279750  1553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:27.278472  3089 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:59:27.280406  1553 raft_consensus.cc:606] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:27.282394   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:27.284790   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:27.294644  3110 raft_consensus.cc:993] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:27.295439  3110 raft_consensus.cc:1081] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:27.298245  1701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39878
I20260709 12:59:27.299065  1701 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:27.299535  1701 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:27.299244  3161 raft_consensus.cc:2955] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:27.308555  1705 raft_consensus.cc:2955] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:27.327059  1553 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:27.344440  1455 catalog_manager.cc:5697] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.348428  1701 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:27.348333  1555 raft_consensus.cc:2955] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
W20260709 12:59:27.362344  1523 consensus_peers.cc:597] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a2e95946efd462d8cee2bc7302fe094. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:27.362607  1705 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:27.366995  3177 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:27.368891  1630 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:27.372524  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:27.373164  2327 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:27.385226  1701 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:27.391753  3089 raft_consensus.cc:993] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:27.392453  3089 raft_consensus.cc:1081] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Signalling peer 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:27.394519  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:27.394830  2329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:58640
I20260709 12:59:27.395166  1553 raft_consensus.cc:3055] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:27.395345  2329 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:27.395470  1553 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:27.395794  2329 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.396226  1553 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:27.398001  1553 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:27.401990  3110 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:27.444985  2327 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:27.466293  2329 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:27.472056  1672 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:27.474524  3160 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:27.475255  3160 raft_consensus.cc:697] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:27.476478  3160 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:27.481079  1553 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
W20260709 12:59:27.484483  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 56985.5us
I20260709 12:59:27.482386  2329 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:27.488838  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:27.489449  1630 raft_consensus.cc:3055] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:27.489774  1630 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:27.490844  1630 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:27.492009  1630 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.501580  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:27.500348  1630 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:27.502511  1705 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.501667  1633 raft_consensus.cc:2955] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:27.499940  3177 raft_consensus.cc:2955] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:27.511472  1705 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:27.503726  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:27.515373  3131 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:27.518026  3131 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:27.521327  3131 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:27.523907  1701 raft_consensus.cc:2955] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:27.562794  1458 catalog_manager.cc:5697] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:27.571462  1455 catalog_manager.cc:5697] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 2 to 3, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:27.580262  1633 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:27.579926  1457 catalog_manager.cc:5697] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.584088  3089 raft_consensus.cc:993] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:27.586346  3098 raft_consensus.cc:1081] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:27.594432  1701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 12:59:27.595027  1701 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:27.595866  1701 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.605891  1701 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:27.610703  1598 consensus_peers.cc:597] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 234fc17fda8e45db9455b24cfd3939f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:27.611937  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:27.612646  2329 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.611461  1701 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:27.616003  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:27.616719  1630 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:27.617079  1630 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:27.617995  3160 raft_consensus.cc:993] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 12:59:27.617863  1630 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:27.618533  3179 raft_consensus.cc:1081] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Signalling peer e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 12:59:27.619031  1630 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.620290  1555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:47912
I20260709 12:59:27.621116  1555 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:27.621452  1555 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.625519  2329 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:27.625694  1553 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:27.627033  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:27.627226  3089 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:27.630213  3179 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:27.630781  3179 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:27.627197  1630 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:27.632076  3179 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:27.638549  1701 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:27.640924  3098 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:27.644531  1555 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:27.648386  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:27.649627  1633 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.666656  1555 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:27.668232  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:27.667732  3095 raft_consensus.cc:2955] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:27.669571  1705 raft_consensus.cc:3055] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:27.670177  1705 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:27.671379  1705 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:27.672504  1705 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.678594  1556 raft_consensus.cc:2955] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:27.692112  1455 catalog_manager.cc:5697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 2 to 3, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.697284  1701 raft_consensus.cc:2955] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:27.715775  1457 catalog_manager.cc:5697] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:27.707022  1633 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:27.740670  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:27.741852  3176 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:27.742486  3176 raft_consensus.cc:697] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:27.743268  3176 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:27.731875  1556 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:27.772888  1705 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:27.784387  1457 catalog_manager.cc:5697] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 2 to 3, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:27.798888  1523 consensus_peers.cc:597] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1461e6ea3a84192b5ce68699dc52d80. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:27.801923  1705 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:27.802683  1628 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:27.803728  3176 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:27.806440  3110 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:27.847095  3110 raft_consensus.cc:2955] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:27.865223  1705 raft_consensus.cc:2955] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:27.866910  3201 ts_tablet_manager.cc:933] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:27.883476  3201 tablet_copy_client.cc:323] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43887
I20260709 12:59:27.885939  1645 tablet_copy_service.cc:140] P 8106dfc0bda54df0ae10ba13c28ccc18: Received BeginTabletCopySession request for tablet 5299151db28746cf82a5b6d791a71d60 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:46120)
I20260709 12:59:27.886929  1645 tablet_copy_service.cc:161] P 8106dfc0bda54df0ae10ba13c28ccc18: Beginning new tablet copy session on tablet 5299151db28746cf82a5b6d791a71d60 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:46120: session id = 6b9e73092f6146639bf310a3d18cfe37-5299151db28746cf82a5b6d791a71d60
I20260709 12:59:27.895926  1645 tablet_copy_source_session.cc:215] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:27.910130  3201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5299151db28746cf82a5b6d791a71d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:27.912122  1628 raft_consensus.cc:2955] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:27.917860  1457 catalog_manager.cc:5697] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:27.971890  3203 ts_tablet_manager.cc:933] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:27.976647  3201 tablet_copy_client.cc:806] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:27.977495  3201 tablet_copy_client.cc:670] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:27.983621  3201 tablet_copy_client.cc:538] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:27.986660  3203 tablet_copy_client.cc:323] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:59:27.988523  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet 1a2e95946efd462d8cee2bc7302fe094 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:59:27.989250  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet 1a2e95946efd462d8cee2bc7302fe094 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-1a2e95946efd462d8cee2bc7302fe094
I20260709 12:59:27.995941  3201 tablet_bootstrap.cc:492] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:28.001895  1570 tablet_copy_source_session.cc:215] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:28.119607  1628 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:28.121209  3189 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:28.140180  3203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2e95946efd462d8cee2bc7302fe094. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:28.172415  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 45792.3us
I20260709 12:59:28.189401  2329 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:28.194501  3179 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:28.198887  1633 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:28.220546  3071 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:59:28.287564  1629 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:28.296028  2323 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:28.286850   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:28.334908  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 48848.6us
I20260709 12:59:28.338759  1556 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:28.359717  1705 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:59:28.359112  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 63616.7us
I20260709 12:59:28.380627  3225 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:59:28.422680  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 73291.8us
I20260709 12:59:28.400876  3217 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:59:28.440981  2963 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:28.527988  1701 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:59:28.527575  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 112928us
I20260709 12:59:28.531551  3241 ts_tablet_manager.cc:933] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
W20260709 12:59:28.577387  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 68583.1us
I20260709 12:59:28.586614  3241 tablet_copy_client.cc:323] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:59:28.540125  3206 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:59:28.665496  3203 tablet_copy_client.cc:806] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:28.666366  3203 tablet_copy_client.cc:670] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:28.670586  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet d1461e6ea3a84192b5ce68699dc52d80 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:59:28.671731  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet d1461e6ea3a84192b5ce68699dc52d80 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-d1461e6ea3a84192b5ce68699dc52d80
W20260709 12:59:28.689193  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 96403.7us
W20260709 12:59:28.726914  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 195130us
I20260709 12:59:28.732650  3244 ts_tablet_manager.cc:933] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:28.746125  1570 tablet_copy_source_session.cc:215] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:28.749902  3201 tablet_bootstrap.cc:492] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:28.752562  3201 tablet_bootstrap.cc:492] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:28.753724  3201 ts_tablet_manager.cc:1403] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.758s	user 0.045s	sys 0.016s
I20260709 12:59:28.755993  3203 tablet_copy_client.cc:538] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:28.792966  3201 raft_consensus.cc:359] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:28.793936  3201 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:28.794991  3201 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:28.796027  3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1461e6ea3a84192b5ce68699dc52d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:28.806388  3071 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:59:28.838340  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 79026.8us
I20260709 12:59:28.908660  3244 tablet_copy_client.cc:323] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43887
W20260709 12:59:28.933480  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 69352.7us
I20260709 12:59:28.945406  3201 ts_tablet_manager.cc:1434] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.191s	user 0.010s	sys 0.000s
W20260709 12:59:28.986301  3257 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 12:59:28.996451  2288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.010s	sys 0.027s
W20260709 12:59:28.997153  2288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.010s	sys 0.027s
W20260709 12:59:28.997480  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 560818us
W20260709 12:59:29.013106  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 203418us
I20260709 12:59:29.069790  3203 tablet_bootstrap.cc:492] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:29.085825  1644 tablet_copy_service.cc:342] P 8106dfc0bda54df0ae10ba13c28ccc18: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-5299151db28746cf82a5b6d791a71d60 received from {username='slave'} at 127.0.0.1:46120
I20260709 12:59:29.085664  1645 tablet_copy_service.cc:140] P 8106dfc0bda54df0ae10ba13c28ccc18: Received BeginTabletCopySession request for tablet 234fc17fda8e45db9455b24cfd3939f4 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:46120)
I20260709 12:59:29.086400  1644 tablet_copy_service.cc:434] P 8106dfc0bda54df0ae10ba13c28ccc18: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-5299151db28746cf82a5b6d791a71d60 on tablet 5299151db28746cf82a5b6d791a71d60 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:29.087679  1645 tablet_copy_service.cc:161] P 8106dfc0bda54df0ae10ba13c28ccc18: Beginning new tablet copy session on tablet 234fc17fda8e45db9455b24cfd3939f4 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:46120: session id = 6b9e73092f6146639bf310a3d18cfe37-234fc17fda8e45db9455b24cfd3939f4
I20260709 12:59:29.100155  3241 tablet_copy_client.cc:806] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
W20260709 12:59:29.143534  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 199082us
I20260709 12:59:29.137326  3241 tablet_copy_client.cc:670] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:29.181341  1645 tablet_copy_source_session.cc:215] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:29.198843  3241 tablet_copy_client.cc:538] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:29.233662   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:29.238716  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 120511us
I20260709 12:59:29.267935  3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 234fc17fda8e45db9455b24cfd3939f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.284951  2329 raft_consensus.cc:1217] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:59:29.352545  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47874.8us
W20260709 12:59:29.362200  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58251.2us
I20260709 12:59:29.390045  3241 tablet_bootstrap.cc:492] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:29.436277  3203 tablet_bootstrap.cc:492] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:29.436730  1706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:29.437342  1706 raft_consensus.cc:606] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:29.437569  3203 tablet_bootstrap.cc:492] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:29.438349  3203 ts_tablet_manager.cc:1403] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.369s	user 0.042s	sys 0.004s
I20260709 12:59:29.442166  3203 raft_consensus.cc:359] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:29.443854  3203 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:29.445143  3203 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:29.473165  3203 ts_tablet_manager.cc:1434] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.001s
I20260709 12:59:29.480047  1570 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-1a2e95946efd462d8cee2bc7302fe094 received from {username='slave'} at 127.0.0.1:33810
I20260709 12:59:29.480131  3226 raft_consensus.cc:993] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:29.489279  1706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4ce544917f545499da64014539a4ff2"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:29.487871  1570 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-1a2e95946efd462d8cee2bc7302fe094 on tablet 1a2e95946efd462d8cee2bc7302fe094 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:29.490657  1706 raft_consensus.cc:606] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:29.489857  3228 raft_consensus.cc:1081] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:29.530027  1630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60066
I20260709 12:59:29.530829  1630 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:29.531419  1630 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:29.543802  1630 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:29.555019  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:29.555727  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:29.555728  2323 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:29.556066  1630 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:29.556354  1706 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:29.556757  1706 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:29.557431  1706 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:29.558611  1706 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:29.566143  3244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58640 (request call id 349) took 1161 ms. Trace:
I20260709 12:59:29.566663  3244 rpcz_store.cc:276] 0709 12:59:28.404718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.404868 (+   150us) service_pool.cc:224] Handling call
0709 12:59:28.733445 (+328577us) ts_tablet_manager.cc:934] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
0709 12:59:29.266692 (+533247us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:29.418641 (+151949us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:29.418757 (+   116us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:29.565392 (+146635us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:29.565691 (+   299us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:29.565961 (+   270us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:29.566052 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":44688,"tablet-copy.queue_time_us":298500,"thread_start_us":234441,"threads_started":2}
I20260709 12:59:29.568352  3244 tablet_copy_client.cc:806] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:29.570017  3244 tablet_copy_client.cc:670] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:29.574869  1558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:29.575619  1558 raft_consensus.cc:606] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:29.579291   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:29.579579  2323 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:29.581319   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:29.581256  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:29.582286  3238 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:29.582773  3238 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:29.583583  3238 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:29.619433  1706 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:29.578884  3244 tablet_copy_client.cc:538] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:29.634799  1455 catalog_manager.cc:5697] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 3 to 4, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.702471  3272 raft_consensus.cc:993] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 12:59:29.703471  3228 raft_consensus.cc:1081] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Signalling peer e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 12:59:29.705605  1558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4ce544917f545499da64014539a4ff2"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:47912
I20260709 12:59:29.706707  1558 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:29.707324  1558 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:29.727762  1558 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:29.733414  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:29.734163  2323 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:29.734477  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:29.735080  1701 raft_consensus.cc:3055] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:29.735378  1701 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:29.736081  1701 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:29.737125  1701 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:29.740783  1558 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:29.747021  2323 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:29.748837  1523 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:29.749655  3273 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:29.750109  3273 raft_consensus.cc:697] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:29.750957  3273 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:29.766639  1701 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:29.767139  2323 raft_consensus.cc:1217] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:29.783140  3244 tablet_bootstrap.cc:492] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:29.816296  3241 tablet_bootstrap.cc:492] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:29.817363  3241 tablet_bootstrap.cc:492] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:29.818032  3241 ts_tablet_manager.cc:1403] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.428s	user 0.034s	sys 0.013s
I20260709 12:59:29.834775  3241 raft_consensus.cc:359] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:29.837769  3241 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:29.837915  3246 raft_consensus.cc:1064] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:29.838601  3241 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:29.840648  3246 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:29.842264  3241 ts_tablet_manager.cc:1434] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.005s
I20260709 12:59:29.856885  1570 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-d1461e6ea3a84192b5ce68699dc52d80 received from {username='slave'} at 127.0.0.1:33810
I20260709 12:59:29.857393  1570 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-d1461e6ea3a84192b5ce68699dc52d80 on tablet d1461e6ea3a84192b5ce68699dc52d80 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:29.859969  2323 raft_consensus.cc:1217] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:29.870301  1454 catalog_manager.cc:5697] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 1 to 2, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.908951  2323 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:29.910689  3246 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:29.919592  1553 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:29.922459  1701 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:29.945726  3208 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:29.969326  3089 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:29.973634  3244 tablet_bootstrap.cc:492] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:29.982388  2323 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:29.985008  3089 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:29.999892  3244 tablet_bootstrap.cc:492] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:30.001340  3244 ts_tablet_manager.cc:1403] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.219s	user 0.015s	sys 0.016s
I20260709 12:59:30.010180  3273 raft_consensus.cc:993] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:30.010782  3273 raft_consensus.cc:1081] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:30.015604  1701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39878
I20260709 12:59:30.016362  1701 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:30.016779  1701 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.025427  3208 raft_consensus.cc:2955] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:30.036358  2329 raft_consensus.cc:2955] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:30.054240  3244 raft_consensus.cc:359] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:30.055352  3244 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:30.070336  1553 raft_consensus.cc:2955] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:30.080013  1706 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:30.079773  1701 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:30.056260  3244 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:30.085839  1701 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:30.092689  3244 ts_tablet_manager.cc:1434] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.002s
I20260709 12:59:30.106027  1458 catalog_manager.cc:5697] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:30.104620  1645 tablet_copy_service.cc:342] P 8106dfc0bda54df0ae10ba13c28ccc18: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-234fc17fda8e45db9455b24cfd3939f4 received from {username='slave'} at 127.0.0.1:46120
I20260709 12:59:30.121184  3246 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:30.133970  1645 tablet_copy_service.cc:434] P 8106dfc0bda54df0ae10ba13c28ccc18: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-234fc17fda8e45db9455b24cfd3939f4 on tablet 234fc17fda8e45db9455b24cfd3939f4 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:30.124368  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:30.135882  1560 raft_consensus.cc:3055] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:30.136298  1560 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:30.137101  1560 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:30.138840  1560 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.144889  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:30.146906  1633 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.161528  1706 raft_consensus.cc:2955] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:30.239084  1633 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:30.239646  1560 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:30.241739  1675 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:30.246148  3290 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:30.290938  1633 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:30.305768  2325 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:30.314677  3289 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:30.325975  3208 raft_consensus.cc:2955] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:30.329881  2325 raft_consensus.cc:2955] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:30.352977  2329 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:30.354856  3274 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:30.357241  1455 catalog_manager.cc:5697] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:30.360872  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5299151db28746cf82a5b6d791a71d60 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:30.370294  2327 raft_consensus.cc:1217] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:30.374130  3177 raft_consensus.cc:1064] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:30.380251  1549 tablet_service.cc:1558] Processing DeleteTablet for tablet 5299151db28746cf82a5b6d791a71d60 with delete_type TABLET_DATA_TOMBSTONED (TS e4c78b411eb34b3d92183a86d34a81f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47896
I20260709 12:59:30.379359  3177 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:30.396924  3295 tablet_replica.cc:333] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 12:59:30.409264  3290 raft_consensus.cc:697] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:30.410679  3290 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:30.421159  1701 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:59:30.434952  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 72664.1us
I20260709 12:59:30.471632  2329 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:30.473676  3261 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:30.504159  3289 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:59:30.510376  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 54956.9us
I20260709 12:59:30.567108  1705 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:30.582732   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:30.605924  3296 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:59:30.613276  1705 raft_consensus.cc:2955] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:30.641003  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.714324  1455 catalog_manager.cc:5697] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.744360  3295 raft_consensus.cc:2243] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.745285  3295 raft_consensus.cc:2272] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.749289  1628 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:59:30.794862  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 72001.1us
W20260709 12:59:30.801483  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 67297us
W20260709 12:59:30.814061  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 61905.1us
I20260709 12:59:30.842736  1705 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:30.786657  3273 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:59:30.848563  1705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39852
W20260709 12:59:30.849598  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47230.5us
I20260709 12:59:30.850037  1705 raft_consensus.cc:606] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Received request to transfer leadership
I20260709 12:59:30.857234  3295 ts_tablet_manager.cc:1916] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:30.809974  3235 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:59:30.880409  3246 raft_consensus.cc:1064] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:30.898753  3246 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:30.938386  3295 ts_tablet_manager.cc:1929] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:30.939503  3295 log.cc:1199] T 5299151db28746cf82a5b6d791a71d60 P e4c78b411eb34b3d92183a86d34a81f1: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root/wals/5299151db28746cf82a5b6d791a71d60
W20260709 12:59:30.980105  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 176727us
I20260709 12:59:31.014907  1701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39852
I20260709 12:59:31.016445  1701 raft_consensus.cc:606] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Received request to transfer leadership
I20260709 12:59:31.019649  1703 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:59:31.021266  1445 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for d1461e6ea3a84192b5ce68699dc52d80 already in progress
I20260709 12:59:31.028123  2329 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:31.039870  1443 catalog_manager.cc:5028] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): tablet 5299151db28746cf82a5b6d791a71d60 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
W20260709 12:59:31.065073  1445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 43981.7us
I20260709 12:59:31.043146  3089 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:59:31.079403  3312 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:31.131561  1703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39852
I20260709 12:59:31.132375  1703 raft_consensus.cc:606] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Received request to transfer leadership
I20260709 12:59:31.142467  1555 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:59:31.150987  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 85258.8us
I20260709 12:59:31.157202  1549 tablet_service.cc:1558] Processing DeleteTablet for tablet 5299151db28746cf82a5b6d791a71d60 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:47896
I20260709 12:59:31.178299  3302 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:31.187079  1628 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:31.190291  3303 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:31.200940  3316 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:31.207005  1443 catalog_manager.cc:5028] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): tablet 5299151db28746cf82a5b6d791a71d60 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:31.236021   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:31.239526  2329 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Advancing to term 2
I20260709 12:59:31.379925  3305 raft_consensus.cc:993] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:31.380756  3305 raft_consensus.cc:1081] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:31.385301  1630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60066
I20260709 12:59:31.386061  1630 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:31.386436  1630 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:31.391824  1506 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:59:31.392372  1506 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for d1461e6ea3a84192b5ce68699dc52d80 already in progress
W20260709 12:59:31.392694  1506 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for d1461e6ea3a84192b5ce68699dc52d80 already in progress
W20260709 12:59:31.397218  3321 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:59:31.399504  3312 raft_consensus.cc:2955] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.406524  2325 raft_consensus.cc:2955] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.424983  2329 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:31.420141  1630 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:31.438792  3290 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:31.439476  3290 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:31.443272  3290 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:31.446086  1630 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:31.447489  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:31.460687  1555 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:31.463181  3310 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:59:31.474045  1629 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:31.476490  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:31.480058  1703 raft_consensus.cc:2955] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.484694  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:31.495467  3177 raft_consensus.cc:2955] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.500909  3303 consensus_queue.cc:1059] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:31.504118  1555 raft_consensus.cc:2955] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.514631  3310 raft_consensus.cc:3055] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:31.515218  3310 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:31.523494  3310 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:31.525108  3310 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.527165  2325 raft_consensus.cc:2955] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.538295  1455 catalog_manager.cc:5697] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.542924  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:31.545892  1632 raft_consensus.cc:2955] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.586313  1673 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:31.588373  3290 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.589527  1701 raft_consensus.cc:2955] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.597774  1458 catalog_manager.cc:5697] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index 2 to 3, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.619870  1706 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:31.654099  1601 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:31.655953  3312 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:31.657267  3312 raft_consensus.cc:697] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:31.659648  3312 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:31.679951  1555 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:31.687397  1627 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:31.689910  2325 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:31.692049  3316 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:31.704120  3316 raft_consensus.cc:2955] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.708323  1632 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:31.708777  2325 raft_consensus.cc:2955] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.710085  3235 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:31.720381  1706 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:31.716197  1628 raft_consensus.cc:2955] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.729265  3238 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:31.724210  2329 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:31.751353  3309 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:31.763695  1556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:31.765255  1556 raft_consensus.cc:606] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:31.761696  3312 raft_consensus.cc:2955] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.765136  2329 raft_consensus.cc:2955] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.775152  1454 catalog_manager.cc:5697] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 3, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:31.796046  3274 raft_consensus.cc:993] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:31.796556  3177 raft_consensus.cc:1081] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:31.802242  1632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60052
I20260709 12:59:31.802946  1632 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:31.803732  1632 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.807256  1701 raft_consensus.cc:2955] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.810461  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a2e95946efd462d8cee2bc7302fe094 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:31.832827  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 234fc17fda8e45db9455b24cfd3939f4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:31.850198  1628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:31.849967  1455 catalog_manager.cc:5697] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.851524  1628 raft_consensus.cc:606] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:31.857380  1706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:31.857977  1706 raft_consensus.cc:606] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:31.865514   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:31.868556  1632 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:31.873173  3314 raft_consensus.cc:993] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:31.877794  3314 raft_consensus.cc:1081] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:31.879731  1632 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:31.881606  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:31.882402  1706 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.886940  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:31.891876  1632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60066
I20260709 12:59:31.887565  1556 raft_consensus.cc:3055] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:31.893074  1556 raft_consensus.cc:740] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:31.892426  1458 catalog_manager.cc:5697] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 3 to 4, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:31.893822  1556 consensus_queue.cc:260] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:31.895047  1556 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.892623  1632 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:31.896780  1632 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.902973   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:31.906742  1632 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:31.907953  3316 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.917237  3316 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:31.919459  1549 tablet_service.cc:1558] Processing DeleteTablet for tablet 234fc17fda8e45db9455b24cfd3939f4 with delete_type TABLET_DATA_TOMBSTONED (TS e4c78b411eb34b3d92183a86d34a81f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47896
I20260709 12:59:31.919632  1632 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:31.920432  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:31.920881  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:31.921931  1701 raft_consensus.cc:3055] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:31.922235  1701 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:31.922448  3335 tablet_replica.cc:333] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 12:59:31.921099  1555 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.910967  1556 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:31.923177  1701 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:31.923578  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:31.924331  1701 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.925549  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:31.926481  1703 raft_consensus.cc:2393] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:31.926676  1599 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:31.928665  3238 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:31.929419  3238 raft_consensus.cc:697] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:31.934787  1701 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:31.936457  1601 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:31.937377  3238 consensus_queue.cc:237] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:31.938288  3312 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:31.938865  3312 raft_consensus.cc:697] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:31.939709  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:31.939828  3312 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:31.940780  3177 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.950786  1555 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:31.925796  3335 raft_consensus.cc:2243] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:31.954128  3335 raft_consensus.cc:2272] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:31.950862  3177 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.954974  3316 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:31.913305  1706 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:31.961416  3335 ts_tablet_manager.cc:1916] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:31.983078  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a2e95946efd462d8cee2bc7302fe094 with delete_type TABLET_DATA_TOMBSTONED (TS 4f6fa2fd61114dc190d8f9b310696e1a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39852
I20260709 12:59:31.998194  3335 ts_tablet_manager.cc:1929] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:31.999277  3335 log.cc:1199] T 234fc17fda8e45db9455b24cfd3939f4 P e4c78b411eb34b3d92183a86d34a81f1: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root/wals/234fc17fda8e45db9455b24cfd3939f4
I20260709 12:59:32.008786  1443 catalog_manager.cc:5028] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): tablet 234fc17fda8e45db9455b24cfd3939f4 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:32.009351  3338 tablet_replica.cc:333] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 12:59:32.011624  3338 raft_consensus.cc:2243] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.012970  3338 raft_consensus.cc:2272] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.010965  1457 catalog_manager.cc:5697] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:32.014575  1457 catalog_manager.cc:5697] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 3, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:32.050093  3338 ts_tablet_manager.cc:1916] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:32.056476  1556 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:32.059724  3312 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:32.100270  3338 ts_tablet_manager.cc:1929] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:32.106441  3338 log.cc:1199] T 1a2e95946efd462d8cee2bc7302fe094 P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root/wals/1a2e95946efd462d8cee2bc7302fe094
I20260709 12:59:32.111588  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 1a2e95946efd462d8cee2bc7302fe094 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:32.136415  2329 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Advancing to term 3
I20260709 12:59:32.158429  1703 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:32.162890  3238 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:32.173586  2329 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:32.196224  3309 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:32.231103  3249 raft_consensus.cc:1064] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:32.235214  3249 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:32.245508  2323 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:32.247064  3238 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:32.269397  1555 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:32.271315  3238 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:32.271792  1706 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:32.281745  3238 raft_consensus.cc:2955] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:32.299337  3312 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:59:32.309495  1555 raft_consensus.cc:2955] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:32.322924  1701 raft_consensus.cc:2955] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:32.328011  3249 raft_consensus.cc:993] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:32.328665  3249 raft_consensus.cc:1081] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:32.330667  1703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 12:59:32.331234  1703 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:32.331524  1703 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:32.348630  1703 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:32.351480  1703 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:32.352123  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:32.352843  2325 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:32.345024  1457 catalog_manager.cc:5697] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index 2 to 5, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:32.354689  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:32.355347  1627 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:32.355690  1627 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:32.356537  1627 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:32.357718  1627 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:32.365280  2325 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 12:59:32.366051  2323 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:32.369771  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:32.371101  3344 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:32.371608  3344 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:32.372545  3344 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:32.400661  1627 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 12:59:32.404855  2323 raft_consensus.cc:2955] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:32.439611  1627 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:32.453755  1701 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:32.455513  3089 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:32.456663  1555 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:32.459293  3309 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:32.464295  1555 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:32.466442  3089 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:32.487906  1556 raft_consensus.cc:2955] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:32.499560  1703 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:32.502521  3309 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:32.506255  3238 raft_consensus.cc:2955] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:32.527630  1554 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:32.532738  3309 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:32.655748  2325 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:32.659035  3302 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:32.668933  2325 raft_consensus.cc:2955] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:32.699318  1455 catalog_manager.cc:5697] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 5 to 6, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:32.710760  1457 catalog_manager.cc:5697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 4 to 5, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 5 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:32.712004  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet d1461e6ea3a84192b5ce68699dc52d80 with delete_type TABLET_DATA_TOMBSTONED (TS 4f6fa2fd61114dc190d8f9b310696e1a not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:39852
I20260709 12:59:32.722087  3350 tablet_replica.cc:333] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 12:59:32.783571  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d1461e6ea3a84192b5ce68699dc52d80 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:32.788795  3350 raft_consensus.cc:2243] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.789902  3350 raft_consensus.cc:2272] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.794744  3350 ts_tablet_manager.cc:1916] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:32.836249  3350 ts_tablet_manager.cc:1929] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:59:32.837553  3350 log.cc:1199] T d1461e6ea3a84192b5ce68699dc52d80 P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root/wals/d1461e6ea3a84192b5ce68699dc52d80
I20260709 12:59:32.840232  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet d1461e6ea3a84192b5ce68699dc52d80 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 12:59:32.841696  1627 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:59:32.846570  3290 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:32.851688  2325 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:59:32.857594  3310 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:32.904276   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:33.245421  1703 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:33.267378  1554 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:33.269564  1632 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:33.270059  3290 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:33.271188  3305 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:33.276603  1672 consensus_peers.cc:597] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4ee010e653949d581d35eb9b09d59dd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:33.297926  3305 raft_consensus.cc:2955] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:33.299479  1554 raft_consensus.cc:2955] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:33.301544  1632 raft_consensus.cc:2955] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:33.320941  1454 catalog_manager.cc:5697] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:33.345868  1627 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
W20260709 12:59:33.356998  1598 consensus_peers.cc:597] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c1e1be9de68405393292149e41c0724. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:33.358980  1703 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:33.360790  3238 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:33.367750  1554 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:33.378988  3302 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:33.409996  3312 raft_consensus.cc:2955] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:33.439692  1553 consensus_queue.cc:237] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:33.444533  1703 raft_consensus.cc:2955] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:33.435467  1457 catalog_manager.cc:5697] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.468943  1554 raft_consensus.cc:2955] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
W20260709 12:59:33.503875  1523 consensus_peers.cc:597] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6325e0281aa547efa677c29cabdf5de4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:33.514966  1627 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:33.518230  3177 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:33.521780  1706 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:33.539677  3316 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:33.556962  3177 raft_consensus.cc:2955] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:33.561669  1627 raft_consensus.cc:2955] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:33.563539  1703 raft_consensus.cc:2955] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:33.588909  1455 catalog_manager.cc:5697] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:33.623724  1706 consensus_queue.cc:237] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:33.679795  1627 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:33.681986  1553 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:33.683552  3310 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:33.687471  1672 consensus_peers.cc:597] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b6551a6ae764e24a141aa53353df444. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:33.690122  3310 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:33.695658  3290 raft_consensus.cc:2955] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:33.704118  1554 raft_consensus.cc:2955] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:33.703775  1627 raft_consensus.cc:2955] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:33.723351  1455 catalog_manager.cc:5697] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 2, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 12:59:33.724560  3370 ts_tablet_manager.cc:933] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:33.794384  3370 tablet_copy_client.cc:323] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:42699
I20260709 12:59:33.796684  1719 tablet_copy_service.cc:140] P 4f6fa2fd61114dc190d8f9b310696e1a: Received BeginTabletCopySession request for tablet f4ee010e653949d581d35eb9b09d59dd from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:35632)
I20260709 12:59:33.797277  1719 tablet_copy_service.cc:161] P 4f6fa2fd61114dc190d8f9b310696e1a: Beginning new tablet copy session on tablet f4ee010e653949d581d35eb9b09d59dd from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:35632: session id = 6b9e73092f6146639bf310a3d18cfe37-f4ee010e653949d581d35eb9b09d59dd
I20260709 12:59:33.819060  1719 tablet_copy_source_session.cc:215] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:33.826210  3372 ts_tablet_manager.cc:933] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:33.826524  3370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4ee010e653949d581d35eb9b09d59dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:33.828665  3372 tablet_copy_client.cc:323] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43887
I20260709 12:59:33.831408  1645 tablet_copy_service.cc:140] P 8106dfc0bda54df0ae10ba13c28ccc18: Received BeginTabletCopySession request for tablet 5c1e1be9de68405393292149e41c0724 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:46120)
I20260709 12:59:33.831979  1645 tablet_copy_service.cc:161] P 8106dfc0bda54df0ae10ba13c28ccc18: Beginning new tablet copy session on tablet 5c1e1be9de68405393292149e41c0724 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:46120: session id = 6b9e73092f6146639bf310a3d18cfe37-5c1e1be9de68405393292149e41c0724
I20260709 12:59:33.840818  1645 tablet_copy_source_session.cc:215] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:33.845633  3372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c1e1be9de68405393292149e41c0724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:33.848275  3370 tablet_copy_client.cc:806] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:33.849064  3370 tablet_copy_client.cc:670] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:33.853749  3370 tablet_copy_client.cc:538] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:33.868654  3372 tablet_copy_client.cc:806] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:33.869400  3372 tablet_copy_client.cc:670] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:33.874675  3372 tablet_copy_client.cc:538] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:33.886762  3372 tablet_bootstrap.cc:492] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:33.896242  3370 tablet_bootstrap.cc:492] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:33.947585  3370 tablet_bootstrap.cc:492] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:33.948628  3370 tablet_bootstrap.cc:492] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:33.949424  3370 ts_tablet_manager.cc:1403] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.053s	user 0.030s	sys 0.010s
I20260709 12:59:33.952822  3370 raft_consensus.cc:359] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:33.954133  3370 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:33.955016  3370 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:33.958169  3370 ts_tablet_manager.cc:1434] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:59:33.962775  1719 tablet_copy_service.cc:342] P 4f6fa2fd61114dc190d8f9b310696e1a: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-f4ee010e653949d581d35eb9b09d59dd received from {username='slave'} at 127.0.0.1:35632
I20260709 12:59:33.963341  1719 tablet_copy_service.cc:434] P 4f6fa2fd61114dc190d8f9b310696e1a: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-f4ee010e653949d581d35eb9b09d59dd on tablet f4ee010e653949d581d35eb9b09d59dd with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:33.973564  3372 tablet_bootstrap.cc:492] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:33.974735  3372 tablet_bootstrap.cc:492] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:33.980640  3372 ts_tablet_manager.cc:1403] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.094s	user 0.023s	sys 0.022s
I20260709 12:59:33.984788  3372 raft_consensus.cc:359] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:33.985752  3372 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:33.986459  3372 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:33.989531  3372 ts_tablet_manager.cc:1434] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:59:33.991488  1645 tablet_copy_service.cc:342] P 8106dfc0bda54df0ae10ba13c28ccc18: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-5c1e1be9de68405393292149e41c0724 received from {username='slave'} at 127.0.0.1:46120
I20260709 12:59:33.991991  1645 tablet_copy_service.cc:434] P 8106dfc0bda54df0ae10ba13c28ccc18: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-5c1e1be9de68405393292149e41c0724 on tablet 5c1e1be9de68405393292149e41c0724 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:34.026671   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:34.056947  3372 ts_tablet_manager.cc:933] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
W20260709 12:59:34.218253  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 84843.5us
I20260709 12:59:34.226677  2325 raft_consensus.cc:1217] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:59:34.278007  3370 ts_tablet_manager.cc:933] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:34.325758  3372 tablet_copy_client.cc:323] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43439
I20260709 12:59:34.328022  1570 tablet_copy_service.cc:140] P e4c78b411eb34b3d92183a86d34a81f1: Received BeginTabletCopySession request for tablet 6325e0281aa547efa677c29cabdf5de4 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:33810)
I20260709 12:59:34.328732  1570 tablet_copy_service.cc:161] P e4c78b411eb34b3d92183a86d34a81f1: Beginning new tablet copy session on tablet 6325e0281aa547efa677c29cabdf5de4 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:33810: session id = 6b9e73092f6146639bf310a3d18cfe37-6325e0281aa547efa677c29cabdf5de4
I20260709 12:59:34.345765  1570 tablet_copy_source_session.cc:215] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:34.356726  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:34.362205  1627 raft_consensus.cc:606] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Received request to transfer leadership to TS 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:34.412737  2323 raft_consensus.cc:1217] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:59:34.478999  3370 tablet_copy_client.cc:323] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:42699
I20260709 12:59:34.485714  3372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6325e0281aa547efa677c29cabdf5de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:34.491695  1719 tablet_copy_service.cc:140] P 4f6fa2fd61114dc190d8f9b310696e1a: Received BeginTabletCopySession request for tablet 7b6551a6ae764e24a141aa53353df444 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:35632)
I20260709 12:59:34.492470  1719 tablet_copy_service.cc:161] P 4f6fa2fd61114dc190d8f9b310696e1a: Beginning new tablet copy session on tablet 7b6551a6ae764e24a141aa53353df444 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:35632: session id = 6b9e73092f6146639bf310a3d18cfe37-7b6551a6ae764e24a141aa53353df444
I20260709 12:59:34.518347  1719 tablet_copy_source_session.cc:215] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:34.530416  3370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b6551a6ae764e24a141aa53353df444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:34.542371  1628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "428c176495744009b63bfa690baa17c6"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:34.543176  1628 raft_consensus.cc:606] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:34.570451  1703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:34.571259  1703 raft_consensus.cc:606] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:34.591346  1628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:34.591988  1628 raft_consensus.cc:606] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:34.593353   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:34.594971   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:34.602337  3238 raft_consensus.cc:993] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:34.603032  3238 raft_consensus.cc:1081] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:34.610311  3372 tablet_copy_client.cc:806] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:34.611487  3372 tablet_copy_client.cc:670] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:34.618662  1703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "428c176495744009b63bfa690baa17c6"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 12:59:34.619303  1703 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:34.619663  1703 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:34.644686  3370 tablet_copy_client.cc:806] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:34.645769  3370 tablet_copy_client.cc:670] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:34.658535  3370 tablet_copy_client.cc:538] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:34.665261  3238 raft_consensus.cc:993] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:34.665769  3372 tablet_copy_client.cc:538] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:34.665825  3238 raft_consensus.cc:1081] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 12:59:34.667867  1706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 12:59:34.671914  1706 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:34.672338  1706 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.685379  3370 tablet_bootstrap.cc:492] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:34.693184  1703 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:34.696106  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:34.696770  1554 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:34.705658  3384 raft_consensus.cc:1064] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:34.710043  3384 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:34.704566  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:34.712304  1628 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:34.712659  1628 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:34.713991  1628 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:34.716351  1628 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:34.729303  1554 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 12:59:34.730732  1673 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:34.731668  3310 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:34.732187  3310 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:34.733278  3238 raft_consensus.cc:993] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:34.733819  3249 raft_consensus.cc:1081] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Signalling peer 6b9e73092f6146639bf310a3d18cfe37 to start an election
I20260709 12:59:34.733279  3310 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:34.736406  2323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:58640
I20260709 12:59:34.737035  2323 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:34.737357  2323 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.740976  1628 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 12:59:34.744663  2323 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:34.746628  1703 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:34.748611  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:34.749317  1554 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.697297  1706 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:34.755833  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:34.756726  1555 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.757790  1554 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:34.760251  1706 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:34.764642  2323 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:34.764851  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:34.765537  1627 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:34.765827  1627 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:34.766491  1627 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:34.767695  1627 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.771807  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:34.772243  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:34.772650  1628 raft_consensus.cc:3055] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:34.773177  1628 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:34.773193  3319 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:34.773837  3319 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:34.774211  1628 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:34.774802  3319 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:34.775866  1628 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.794159  3344 raft_consensus.cc:993] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 12:59:34.794744  3344 raft_consensus.cc:1081] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Signalling peer e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 12:59:34.802426  1628 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:34.803436  1555 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:34.806435  1627 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:34.813917  1555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:47912
I20260709 12:59:34.814857  1555 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:34.815312  1555 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:34.823208  1675 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:34.828805  3305 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:34.832432  1554 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:34.836840  3372 tablet_bootstrap.cc:492] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 12:59:34.848042  3385 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:34.847576  1555 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:34.837962  1455 catalog_manager.cc:5697] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 4 to 5, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 5 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:34.870553  1457 catalog_manager.cc:5697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 3 to 4, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:34.893636  1627 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:34.896059  1555 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:34.897928  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:34.898605  1627 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:34.911142  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 80951.2us
I20260709 12:59:34.913704  2329 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:34.920986  1627 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:34.922297  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:34.922649  3249 raft_consensus.cc:1064] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:34.927371  3177 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:34.928149  3177 raft_consensus.cc:697] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:34.929059  3177 consensus_queue.cc:237] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:34.938704  3249 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:34.919541  3290 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:59:34.915107  3305 raft_consensus.cc:697] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 12:59:35.116111  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 158416us
I20260709 12:59:35.128418  3384 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:35.144662  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:35.150208  3370 tablet_bootstrap.cc:492] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:35.168135  1703 raft_consensus.cc:3055] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:35.168526  1703 raft_consensus.cc:740] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 12:59:35.169001  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 212041us
I20260709 12:59:35.169425  1703 consensus_queue.cc:260] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:35.169608  3370 tablet_bootstrap.cc:492] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:35.073038  3305 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:35.170879  1703 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:35.191515  1703 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:35.193107  1627 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:35.231146  2323 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:35.170879  3370 ts_tablet_manager.cc:1403] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.486s	user 0.032s	sys 0.045s
W20260709 12:59:35.330113  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 95455.6us
W20260709 12:59:35.346099  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 54675.9us
W20260709 12:59:35.358323  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 88542.6us
W20260709 12:59:35.370051  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 133347us
W20260709 12:59:35.407805  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 169103us
I20260709 12:59:35.404371  1454 catalog_manager.cc:5697] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 1 to 2, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:35.374943  3385 raft_consensus.cc:2955] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:35.545024  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 200846us
I20260709 12:59:35.433502  3390 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 12:59:35.605542  1706 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:35.584815  3312 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:59:35.626519  1556 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:35.633605  3421 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:35.605881  3370 raft_consensus.cc:359] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:35.645799  3370 raft_consensus.cc:740] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:35.646601  3370 consensus_queue.cc:260] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:35.650606  1627 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:35.666070  3370 ts_tablet_manager.cc:1434] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.348s	user 0.018s	sys 0.003s
I20260709 12:59:35.671329  3372 tablet_bootstrap.cc:492] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:59:35.688308  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 134021us
W20260709 12:59:35.692344  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 284207us
W20260709 12:59:35.699699  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 282987us
I20260709 12:59:35.702703  3406 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:35.712211  1556 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:35.737893  3372 tablet_bootstrap.cc:492] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 12:59:35.738798  3372 ts_tablet_manager.cc:1403] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.918s	user 0.027s	sys 0.007s
I20260709 12:59:35.743927  1628 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:59:35.768503  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 344475us
I20260709 12:59:35.795630  2328 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Advancing to term 2
I20260709 12:59:35.836199  3267 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:35.881165  1703 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:35.890628  1555 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:59:35.906494  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 143507us
I20260709 12:59:35.874766  1719 tablet_copy_service.cc:342] P 4f6fa2fd61114dc190d8f9b310696e1a: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-7b6551a6ae764e24a141aa53353df444 received from {username='slave'} at 127.0.0.1:35632
I20260709 12:59:35.914906  1719 tablet_copy_service.cc:434] P 4f6fa2fd61114dc190d8f9b310696e1a: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-7b6551a6ae764e24a141aa53353df444 on tablet 7b6551a6ae764e24a141aa53353df444 with peer 6b9e73092f6146639bf310a3d18cfe37
W20260709 12:59:35.916699  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 85603.5us
I20260709 12:59:35.917650  1553 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:35.922492  1555 raft_consensus.cc:2955] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:35.806025  1630 raft_consensus.cc:2955] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:35.940757   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:35.970093  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 80617.5us
I20260709 12:59:35.983949  1553 raft_consensus.cc:2955] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:35.998307  2329 raft_consensus.cc:2955] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:35.946066  3305 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:59:35.951676  3407 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:59:35.958940  3390 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 12:59:36.066502  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 104033us
W20260709 12:59:36.086282  3400 log.cc:927] Time spent T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:59:36.129424  2328 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:36.177315  3430 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:36.211462  1455 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41166 (request call id 322) took 1386 ms. Trace:
W20260709 12:59:36.258374  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 184410us
W20260709 12:59:36.261861  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 318706us
I20260709 12:59:36.265264  3422 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 12:59:36.289808  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 200870us
I20260709 12:59:36.212007  1455 rpcz_store.cc:276] 0709 12:59:34.825198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.831686 (+  6488us) service_pool.cc:224] Handling call
0709 12:59:36.211390 (+1379704us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:35.151791 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:35.152418 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:35.152470 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:59:35.152494 (+    24us) tablet.cc:662] Decoding operations
0709 12:59:35.152921 (+   427us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:35.153006 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:35.153041 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:35.153242 (+   201us) tablet.cc:701] Row locks acquired
0709 12:59:35.153260 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:59:35.153409 (+   149us) write_op.cc:270] Start()
0709 12:59:35.153535 (+   126us) write_op.cc:276] Timestamp: P: 1783601975153366 usec, L: 0
0709 12:59:35.153560 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:59:35.154372 (+   812us) log.cc:844] Serialized 541 byte log entry
0709 12:59:35.559886 (+405514us) op_driver.cc:464] REPLICATION: finished
0709 12:59:35.937040 (+377154us) write_op.cc:301] APPLY: starting
0709 12:59:35.937160 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:35.937296 (+   136us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:35.937447 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:35.937806 (+   359us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:35.938032 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:35.938076 (+    44us) write_op.cc:312] APPLY: finished
0709 12:59:35.973159 (+ 35083us) log.cc:844] Serialized 23 byte log entry
0709 12:59:35.990711 (+ 17552us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:35.990788 (+    77us) write_op.cc:454] Released schema lock
0709 12:59:35.990827 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:35.991200 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:35.991225 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":370470,"apply.run_cpu_time_us":2464,"apply.run_wall_time_us":54161,"num_ops":1,"prepare.queue_time_us":246801,"prepare.run_cpu_time_us":9557,"prepare.run_wall_time_us":87507,"raft.queue_time_us":282865,"raft.run_cpu_time_us":38979,"raft.run_wall_time_us":402081,"replication_time_us":383253,"spinlock_wait_cycles":59846912,"thread_start_us":605900,"threads_started":4,"wal-append.queue_time_us":78964}]]}
I20260709 12:59:36.300748  3316 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:36.275825  3372 raft_consensus.cc:359] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:36.316779  3372 raft_consensus.cc:740] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 12:59:36.353778  1627 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:36.373286  3404 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:36.373904  3404 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:36.376178  3177 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:36.384407  3177 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:36.382174  3372 consensus_queue.cc:260] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:36.396207  2327 raft_consensus.cc:2955] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:36.397909  3177 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:36.399264  3372 ts_tablet_manager.cc:1434] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.660s	user 0.017s	sys 0.022s
I20260709 12:59:36.375903  3404 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:36.399766  3372 ts_tablet_manager.cc:1467] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Tablet startup took 660ms
W20260709 12:59:36.407585  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 110087us
I20260709 12:59:36.431006  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:36.431007  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:36.432612  3443 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:59:36.431288  3436 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:59:36.439790  3440 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:36.440402  3440 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:36.442538  3440 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:36.443815  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:36.447445  2326 raft_consensus.cc:1217] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:59:36.452951  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 130025us
I20260709 12:59:36.457407  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:36.463935  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:36.466842  3417 raft_consensus.cc:2955] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:36.489022  3446 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 12:59:36.496516  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 124889us
I20260709 12:59:36.489789  3446 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:36.515501  3430 raft_consensus.cc:1064] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
W20260709 12:59:36.516047  3430 raft_consensus.cc:1068] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: Unable to promote non-voter 6b9e73092f6146639bf310a3d18cfe37: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:36.527487  1457 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57414 (request call id 187) took 1663 ms. Trace:
I20260709 12:59:36.529541  3384 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:36.541606  1454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41156 (request call id 257) took 1308 ms. Trace:
I20260709 12:59:36.545913  1702 raft_consensus.cc:2955] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:36.528065  1457 rpcz_store.cc:276] 0709 12:59:34.863726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.863867 (+   141us) service_pool.cc:224] Handling call
0709 12:59:36.527420 (+1663553us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:35.344915 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:35.517268 (+172353us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:35.538175 (+ 20907us) write_op.cc:435] Acquired schema lock
0709 12:59:35.538213 (+    38us) tablet.cc:662] Decoding operations
0709 12:59:35.588229 (+ 50016us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:35.597624 (+  9395us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:35.612536 (+ 14912us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:35.637922 (+ 25386us) tablet.cc:701] Row locks acquired
0709 12:59:35.637944 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:59:35.638102 (+   158us) write_op.cc:270] Start()
0709 12:59:35.638239 (+   137us) write_op.cc:276] Timestamp: P: 1783601975638037 usec, L: 0
0709 12:59:35.638263 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:59:35.995823 (+357560us) log.cc:844] Serialized 536 byte log entry
0709 12:59:36.169324 (+173501us) op_driver.cc:464] REPLICATION: finished
0709 12:59:36.169754 (+   430us) write_op.cc:301] APPLY: starting
0709 12:59:36.169852 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:36.169954 (+   102us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:36.170044 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:36.170252 (+   208us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:36.170860 (+   608us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:36.170900 (+    40us) write_op.cc:312] APPLY: finished
0709 12:59:36.171102 (+   202us) log.cc:844] Serialized 23 byte log entry
0709 12:59:36.171267 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:36.171342 (+    75us) write_op.cc:454] Released schema lock
0709 12:59:36.171384 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:36.220241 (+ 48857us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b540029f754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a80e28 00007f0edd4bb581 00007f0edd4bad58 00007f0edd4bf9f1 00007f0edd4bf9a9 00007f0edd4bf939 00007f0edd4bf901 00007f0edd4beb2d 000000000038f354 000000000038f199
0709 12:59:36.220467 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:36.220495 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":37260,"reported_tablets":1,"spinlock_wait_cycles":711936,"child_traces":[["op",{"apply.queue_time_us":221,"apply.run_cpu_time_us":1900,"apply.run_wall_time_us":1899,"num_ops":1,"prepare.queue_time_us":426881,"prepare.run_cpu_time_us":9821,"prepare.run_wall_time_us":877765,"replication_time_us":530908,"spinlock_wait_cycles":690780032}]]}
I20260709 12:59:36.542547  1454 rpcz_store.cc:276] 0709 12:59:35.233550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.233894 (+   344us) service_pool.cc:224] Handling call
0709 12:59:35.357690 (+123796us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b540029f754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ef090 00007f0ed9a8df3a 00007f0edf8441cc 00007f0edf94237e 00007f0edde032a4 00007f0edde03232 00007f0edde03161 00007f0edde030dc 00007f0edde02392 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:36.541516 (+1183826us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:36.220974 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:36.221468 (+   494us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:36.221498 (+    30us) write_op.cc:435] Acquired schema lock
0709 12:59:36.221519 (+    21us) tablet.cc:662] Decoding operations
0709 12:59:36.221968 (+   449us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:36.222021 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:36.222045 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:36.222220 (+   175us) tablet.cc:701] Row locks acquired
0709 12:59:36.222237 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:36.222366 (+   129us) write_op.cc:270] Start()
0709 12:59:36.222467 (+   101us) write_op.cc:276] Timestamp: P: 1783601976222324 usec, L: 0
0709 12:59:36.222492 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:59:36.223079 (+   587us) log.cc:844] Serialized 599 byte log entry
0709 12:59:36.259180 (+ 36101us) op_driver.cc:464] REPLICATION: finished
0709 12:59:36.287430 (+ 28250us) write_op.cc:301] APPLY: starting
0709 12:59:36.287514 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:36.291361 (+  3847us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:36.300760 (+  9399us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:36.301023 (+   263us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:36.301238 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:36.301309 (+    71us) write_op.cc:312] APPLY: finished
0709 12:59:36.301569 (+   260us) log.cc:844] Serialized 23 byte log entry
0709 12:59:36.301780 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:36.353133 (+ 51353us) write_op.cc:454] Released schema lock
0709 12:59:36.356291 (+  3158us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:36.394433 (+ 38142us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:36.395827 (+  1394us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":150289,"reported_tablets":1,"spinlock_wait_cycles":4704640,"child_traces":[["op",{"apply.queue_time_us":25341,"apply.run_cpu_time_us":7719,"apply.run_wall_time_us":94655,"num_ops":1,"prepare.queue_time_us":796974,"prepare.run_cpu_time_us":2464,"prepare.run_wall_time_us":29859,"replication_time_us":32642}]]}
W20260709 12:59:36.400239  3372 ts_tablet_manager.cc:1469] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Trace:
0709 12:59:34.056009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.056320 (+   311us) service_pool.cc:224] Handling call
0709 12:59:34.057349 (+  1029us) ts_tablet_manager.cc:934] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
0709 12:59:34.484251 (+426902us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:34.536937 (+ 52686us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:34.537338 (+   401us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:34.609124 (+ 71786us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:34.609449 (+   325us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:34.609779 (+   330us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:34.609850 (+    71us) inbound_call.cc:177] Queueing success response
0709 12:59:34.817246 (+207396us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:59:35.739168 (+921922us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:59:35.882188 (+143020us) tablet_replica.cc:261] Starting instrumentation
0709 12:59:35.892020 (+  9832us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":243,"mutex_wait_us":33073,"raft.queue_time_us":3372,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":188,"tablet-copy.queue_time_us":165,"tablet-download-pool.queue_time_us":161,"tablet-download-pool.run_cpu_time_us":1228,"tablet-download-pool.run_wall_time_us":5498,"thread_start_us":267528,"threads_started":1}
I20260709 12:59:36.799754  3408 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:36.800415  3408 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:59:36.802563  3408 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:36.803726  1570 tablet_copy_service.cc:342] P e4c78b411eb34b3d92183a86d34a81f1: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-6325e0281aa547efa677c29cabdf5de4 received from {username='slave'} at 127.0.0.1:33810
I20260709 12:59:36.810007  1570 tablet_copy_service.cc:434] P e4c78b411eb34b3d92183a86d34a81f1: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-6325e0281aa547efa677c29cabdf5de4 on tablet 6325e0281aa547efa677c29cabdf5de4 with peer 6b9e73092f6146639bf310a3d18cfe37
W20260709 12:59:37.039059  3417 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.000s
I20260709 12:59:37.025266  3446 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:37.044996  3411 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:37.053681  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:37.056524  3411 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:37.061789  3411 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:37.070945  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:37.076506  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:37.102983  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 288172us
I20260709 12:59:37.443620  3460 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:37.444621  3460 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:37.460770  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:37.470216  3462 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:37.471065  3462 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:37.475920  3462 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:37.485687  3408 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:37.486321  3408 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:37.501907  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 427007us
I20260709 12:59:37.494155  3408 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:37.505090  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:37.506662  3465 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 12:59:37.551098  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 256355us
I20260709 12:59:37.616330  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:37.622641  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 116885us
I20260709 12:59:37.645689  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:37.662333  3412 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:37.664783  3412 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:37.667726  3412 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:37.661672  3460 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:37.690320  3319 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:37.691072  3319 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:37.696000  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 50431.5us
I20260709 12:59:37.697268  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:37.698539  3422 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.697748  3408 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:37.699911  3408 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:37.702128  3408 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:37.703855  3319 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:37.715225  3177 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:37.716821  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:37.709412  1455 catalog_manager.cc:5697] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 3 to 4, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 4 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:37.721042  1455 catalog_manager.cc:5697] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:37.715848  3177 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:37.737121  3382 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.741493  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:37.742602  3440 raft_consensus.cc:1064] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:37.749959  3177 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:37.750748  3382 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:37.795009  3177 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:37.805450  3177 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:37.810087   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:37.815567  3238 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:37.816228  3238 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:59:37.817101  3177 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:37.815886  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 453584us
I20260709 12:59:37.789176  3382 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:37.858811  3238 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:37.858789  3461 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 12:59:37.874449  1674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.025s	sys 0.076s
W20260709 12:59:37.875135  1674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.025s	sys 0.076s
W20260709 12:59:37.885407  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 166380us
I20260709 12:59:37.892656  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:37.893329  1554 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 1.
W20260709 12:59:37.904095  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 283368us
W20260709 12:59:37.905079  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 121099us
I20260709 12:59:37.912076  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:37.914135  2285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.036s	sys 0.095s
W20260709 12:59:37.914551  2285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.036s	sys 0.095s
I20260709 12:59:37.918634  3448 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.960340  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:37.965391  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 60023.1us
I20260709 12:59:37.979588  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:37.874986  3461 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:38.028756  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 148566us
I20260709 12:59:38.063074  3457 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:38.063994  3457 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.067077  3457 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:38.072316  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 145000us
I20260709 12:59:38.040385  3384 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:38.058650  3267 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:38.071620  3446 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:38.058719  3483 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:38.073616  3424 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:38.322522  3380 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:38.322852  3446 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.323202  3380 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.325299  3446 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:38.333976  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 261745us
I20260709 12:59:38.336645  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:38.336911  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:38.337822  1630 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.016s	sys 0.007s
W20260709 12:59:38.343364  1630 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.017s	sys 0.007s
W20260709 12:59:38.342516  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 382884us
I20260709 12:59:38.346050  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:38.346577  3480 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:38.347388  3480 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.350466  3480 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:38.325371  3469 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:38.325315  3380 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:38.353907  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1627) took 1200 ms. Trace:
W20260709 12:59:38.361230  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 264187us
I20260709 12:59:38.335210  3382 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:38.366988  3409 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:38.366998  3476 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:38.365828  1630 rpcz_store.cc:276] 0709 12:59:37.143912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.213744 (+ 69832us) service_pool.cc:224] Handling call
0709 12:59:37.214092 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:37.214292 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:37.312151 (+ 97859us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.725484 (+413333us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b1800084c40. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6912c0a 00007f0ee0052219 00007f0ed699aa40 00007f0ed69954e4 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a8f716 00007f0ed9aa0287 00007f0ed9aa0208
0709 12:59:38.343944 (+618460us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:38.344014 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:38.344083 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.344172 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:38.344325 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17417,"prepare.queue_time_us":17520,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":16054,"raft.queue_time_us":414357,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":131,"spinlock_wait_cycles":8913664,"thread_start_us":613616,"threads_started":1}
I20260709 12:59:38.367667  3409 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.361428  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:38.330057  3384 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:38.366412  3487 log.cc:927] Time spent T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 12:59:38.367784  3476 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:38.370680  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1588) took 1455 ms. Trace:
W20260709 12:59:38.353693  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 369501us
I20260709 12:59:38.372126  3476 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:38.371197  1556 rpcz_store.cc:276] 0709 12:59:36.915417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.102191 (+186774us) service_pool.cc:224] Handling call
0709 12:59:37.102496 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:37.305510 (+203014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:37.305555 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:37.306215 (+   660us) log.cc:844] Serialized 26 byte log entry
0709 12:59:37.692467 (+386252us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b1800295ea0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 12:59:37.898644 (+206177us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:37.898680 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.898740 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:38.370362 (+471622us) raft_consensus.cc:1685] finished
0709 12:59:38.370385 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:38.370591 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":202474,"raft.queue_time_us":202592,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":18255,"spinlock_wait_cycles":14485760,"thread_start_us":205984,"threads_started":1,"wal-append.queue_time_us":709182}
I20260709 12:59:38.333789  3305 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:38.320122  3267 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.383819  3420 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.385197  3420 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:38.390743  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 53490us
W20260709 12:59:38.391152  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 52139us
I20260709 12:59:38.370738  3384 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:38.400980  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:38.408730  3492 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:38.409614  3492 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:38.410914  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:38.413367  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:38.414816  3482 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:38.417452  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:38.419615  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 336723us
W20260709 12:59:38.421940  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 55127.1us
I20260709 12:59:38.429744  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:38.415709  3482 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.424866  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:38.442920  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:38.444136  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:38.445372  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:38.423316  3492 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:38.329193  3483 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:38.419515  3457 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:38.422122  3476 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:38.453332  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:38.334645  3424 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.460260  1701 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:38.469746  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:38.472771  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:38.475116  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:38.475520  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:38.396028  3305 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:38.478489  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:38.457803  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 85798.6us
I20260709 12:59:38.447762  3267 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:38.482985  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:38.490083  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:38.462025  3461 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:38.495378  1706 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:38.480896  3418 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:38.511433  3491 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:38.485153  3446 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:38.517499  3481 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:38.491882  3405 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:38.524760  3503 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:38.525040  3392 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:38.515015  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:38.468243  3457 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.501036  3432 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:38.392061  3469 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.485419  3476 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.525743  3503 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:38.512635  3491 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:38.487087  3478 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:38.529233  3418 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.525949  3392 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:38.526656  3446 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.554553  3409 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:38.557121  3305 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:38.626384  2328 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:59:38.677150  3402 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:38.691790  3483 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:38.603948  3424 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:38.640434  3418 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:38.544406  3405 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.559162  3432 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.716922  3476 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:38.698938  3483 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:38.721484  3479 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:38.706903  3503 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:38.544761  3481 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:38.677794  3402 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.680744  3440 consensus_queue.cc:237] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.713822  3409 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:38.609474  3478 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:38.721937  3483 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:38.717806  3421 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:38.716495  3392 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:38.734875  3409 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:38.732860  3491 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:38.740233  3476 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:38.773672  3469 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:38.759268  3482 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:38.747934  3421 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.796442  3432 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:38.779708  3457 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:38.779193  3406 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:38.788668  3409 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:38.764039  3476 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:38.794212  3446 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:38.858108  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 428807us
I20260709 12:59:38.860984  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:38.737911  3479 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:38.816823  3482 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:38.812510  3466 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:38.814833  3478 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:38.824075  3402 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:39.223316  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:39.228394  3442 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.232827  1672 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:39.229812  3463 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.061654  3390 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:39.233994  3463 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:39.037495  3449 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.235242  3449 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.225257  3417 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:39.233140  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:38.895164  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:38.864133  1706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ab117f13144a07986c484571fb73a2"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:56242
W20260709 12:59:38.893486  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 399134us
I20260709 12:59:39.222148  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:38.992794  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.006s	sys 0.018s
W20260709 12:59:39.248149  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.016s	sys 0.024s
I20260709 12:59:39.105449  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:38.918062  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.236302  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 324) took 1296 ms. Trace:
I20260709 12:59:38.866173  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:38.960357  3483 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:39.249820  1632 rpcz_store.cc:276] 0709 12:59:37.939501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.939634 (+   133us) service_pool.cc:224] Handling call
0709 12:59:37.939940 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.060262 (+120322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.060292 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:38.060340 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:38.060375 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.968552 (+908177us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000c8fd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:39.236125 (+267573us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.236246 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276208896}
I20260709 12:59:39.129679  3476 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:39.248605  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 848746us
I20260709 12:59:39.229734  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:39.260164  3238 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:39.260020  1706 raft_consensus.cc:606] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:39.256956  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:39.224565  3461 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:38.841329  3457 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.230786  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:39.096400  3493 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:38.836138  3406 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:38.986816  3497 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:59:39.266319  1703 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 1.
I20260709 12:59:39.274052  3238 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:38.966060  3495 raft_consensus.cc:1064] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 12:59:39.230531  3380 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:38.899664  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:39.339834  2286 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.674s (SENT)
I20260709 12:59:39.061653  3312 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.234637  3390 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.426218  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:39.426218  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:39.325913  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:39.295313  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:38.889827  3391 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.252599  3466 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:39.286571  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:39.339318  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:39.328900  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:39.437284  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 179351us
W20260709 12:59:39.440830  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 192865us
I20260709 12:59:39.507319  2323 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:59:39.253625  3409 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:39.089564  3464 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:39.236369  3463 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:38.973822  3481 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:39.233052  3442 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.275372  3407 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:39.259270  3421 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:39.283016  3402 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.282740  3476 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.330715  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:39.433113  3493 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.439765  3290 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:39.323877  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 463) took 1193 ms. Trace:
I20260709 12:59:39.516165  3409 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:39.282182  3482 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:39.529944  3505 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:59:39.517309  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 284486us
I20260709 12:59:39.399591  3461 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.341100  3457 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:39.510883  3391 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:39.392098  3484 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.462772  3517 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:39.453013  3469 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.516687  3513 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:39.522413  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:39.529340  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 55719us
I20260709 12:59:39.468915  3380 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:39.254854  3417 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.508375  1626 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 1.
I20260709 12:59:39.863278  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:39.657192  3177 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:39.896406  3177 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:39.657994  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.669133  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:39.826843  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 486953us
I20260709 12:59:39.666252  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.666252  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.552356  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:39.875038  3238 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:39.666587  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.751497  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2256) took 1053 ms. Trace:
W20260709 12:59:39.888732  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.899991  2288 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:39.900338  2323 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:59:39.624828  3420 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:39.871884  2325 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 12:59:39.899986  1554 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:39.751827  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.501406  3312 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.516438  3499 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.888379  3290 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.925994  3515 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.926383  3457 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:39.901557  3473 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:39.926887  3457 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:39.926628  3515 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:39.927642  3290 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:39.927341  3473 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.883158  3407 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.883396  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:39.822384  3405 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:39.536695  3468 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.666301  3434 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:39.568133  3477 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.921355  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.921553  3177 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:39.922369  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.942751  1556 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:39.943626  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.943799  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.944968  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.666467  3392 raft_consensus.cc:993] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a: : Instructing follower 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:39.924832  3390 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:39.551774  3464 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.925401  3423 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:39.883963  3402 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.734630  3411 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:39.751024  3470 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.924834  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.889537  3503 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:39.668097  3498 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:39.624194  3440 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:39.931941  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.887965  3476 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:39.888331  3505 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.892156  3504 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:39.930648  3238 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 12:59:39.942159  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 301747us
I20260709 12:59:39.945595  1554 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:39.900110  1709 rpcz_store.cc:276] 0709 12:59:38.451846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.452025 (+   179us) service_pool.cc:224] Handling call
0709 12:59:38.454979 (+  2954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.497734 (+ 42755us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:38.523162 (+ 25428us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.105330 (+582168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:39.105378 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:39.105418 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.440437 (+335019us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b1800356620. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69662a6 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419
0709 12:59:39.504994 (+ 64557us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b5400265a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:39.505044 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.505173 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180417,"prepare.queue_time_us":28870,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":116,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":117161,"spinlock_wait_cycles":151610880,"thread_start_us":468891,"threads_started":1,"wal-append.queue_time_us":953281}
I20260709 12:59:39.925024  3267 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:39.891827  3484 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.951910  3415 raft_consensus.cc:1081] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Signalling peer 8106dfc0bda54df0ae10ba13c28ccc18 to start an election
I20260709 12:59:39.953572  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.927455  3457 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.890724  3469 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.928876  3515 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:39.667840  3506 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:39.968577  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:39.973495  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:39.943991  3479 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:39.979619  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.981113  1629 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:39.982261  3525 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:39.982534  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:39.983805  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:39.887154  3513 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.896766  3517 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.929025  3420 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:39.948655  3468 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.984171  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:40.335505  1633 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:59:39.875478  2326 rpcz_store.cc:276] 0709 12:59:38.073905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.076520 (+  2615us) service_pool.cc:224] Handling call
0709 12:59:38.322344 (+245824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.596070 (+273726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.598468 (+  2398us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:38.619720 (+ 21252us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:38.623302 (+  3582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.969687 (+346385us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400111554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:39.244744 (+275057us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.267578 (+ 22834us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576592640}
I20260709 12:59:40.336944  3238 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:39.985836  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 85933.9us
I20260709 12:59:39.985623  3440 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:40.356945  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:40.168879  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 238099us
I20260709 12:59:39.973129  3423 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:40.359081  2325 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:40.137017  3466 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.186422  3385 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:40.352788  1627 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:59:40.362404  3423 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.360455  3440 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.362391  3506 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:40.363410  3440 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:40.364089  3440 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:40.102895  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.953905  3391 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:40.361863  1556 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:59:40.004627  3177 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:40.360527  3385 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:40.371417  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:40.350535  1598 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:40.372152  1705 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:40.375288  3512 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 12:59:40.250393  3511 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.475s	user 0.000s	sys 0.001s
I20260709 12:59:40.380693  3177 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:40.250546  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:40.385632  3466 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:40.385944  3464 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:40.386270  3177 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:40.386793  3519 log.cc:927] Time spent T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:59:40.388023  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:40.386391  3466 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:40.382874  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:40.391973  1599 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:40.338918  3473 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:40.399766  1557 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
W20260709 12:59:40.391992  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 51861.3us
W20260709 12:59:40.393127  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 211341us
I20260709 12:59:39.985309  3505 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:40.394160  1634 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 12:59:40.340514  3500 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:40.395738  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:40.349638  3479 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:40.025127  3526 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 12:59:40.400002  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.022828  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:40.387477  3455 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:40.137791  3412 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:40.407078  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:40.257579  3482 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:40.392627  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:39.984759  3495 consensus_queue.cc:237] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:40.349896  3267 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:40.452455  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 45199.5us
I20260709 12:59:40.383399  3380 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.453673  1556 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:39.950497  3499 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:40.423450  3406 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.379848  3525 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:40.455024  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:40.392273  3483 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:39.964761  3434 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:40.124192  3448 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:40.391705  3391 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 12:59:40.460696  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 77892.2us
I20260709 12:59:40.520954  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:40.522676  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:39.984424  3503 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:40.402592  3475 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:40.467859  1523 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 12:59:40.533453  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 65697.4us
I20260709 12:59:40.535653  3177 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:40.536079  3177 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:40.469180  3433 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:40.536414  3177 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:40.472117  2321 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
W20260709 12:59:40.477288  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 79305.6us
I20260709 12:59:40.425005  3473 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:40.349735  3504 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:39.975260  3411 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:40.491061  3484 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.023262  3498 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:40.502136  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 95130.6us
I20260709 12:59:40.457707  3405 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:40.472851  1554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:40.537999  2329 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:40.564495  1554 raft_consensus.cc:606] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:40.161994  3470 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:40.476357  3493 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:39.985073  3477 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:40.452071  3479 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:40.546725  3492 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:40.563102  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 76971.8us
I20260709 12:59:40.474949  3412 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:59:40.569630  1553 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:40.492239  3525 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:40.544925  3475 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:40.560158  3415 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:40.571265  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 215946us
I20260709 12:59:40.540323  3406 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:40.518735  3402 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:40.590269  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.482160  3506 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.590195  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:40.595938  2288 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:40.517453  3483 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:40.551496  3391 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:40.509245  3455 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:40.456146  3512 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:40.426249  3500 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:40.470176  3526 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:40.600855  1558 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:59:40.670840  3537 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:40.653200  3267 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.671937  3500 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.672032  2286 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:40.649295  3468 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:40.593163  3475 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:40.591777  3415 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:40.617815  3478 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:59:40.621132  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:40.631116  3434 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.673076  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:40.659018  3412 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.659376  3407 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.675093  3513 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:40.664882  3457 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:40.675925  3391 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:40.677631  3512 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:40.677824  3455 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:40.601469  3420 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.574554  3405 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:40.694725  3177 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:40.633416  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:40.776957  2326 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:59:40.777571  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 327) took 1448 ms. Trace:
I20260709 12:59:40.778231  1632 rpcz_store.cc:276] 0709 12:59:39.329096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.329535 (+   439us) service_pool.cc:224] Handling call
0709 12:59:39.478157 (+148622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.337403 (+859246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.337445 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:40.337497 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:40.337539 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.777140 (+439601us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b5400204754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:40.777198 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.777483 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1166648576}
I20260709 12:59:40.585299  3476 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.757026  3500 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:40.737206  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 389116us
I20260709 12:59:40.558256  3448 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:40.746421  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 60653.9us
I20260709 12:59:40.682613  3385 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:40.595054  3406 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:40.682906  3440 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:40.700940  3537 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 12:59:40.758033  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 149707us
W20260709 12:59:40.758078  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 45241.9us
W20260709 12:59:40.762349  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 184686us
I20260709 12:59:40.912249  2286 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:40.914348  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:40.765894  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:40.751859  3415 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.735117  3466 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.773111  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:40.934464  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1598) took 1048 ms. Trace:
I20260709 12:59:40.775058  3405 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.905350  3177 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:40.819422  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:40.736501  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 200058us
I20260709 12:59:40.921001  3267 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:40.921300  3411 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:40.913748  3406 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:40.928251  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:40.908221  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:40.759434  3517 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:40.938380  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.009298  1629 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:40.682760  3469 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:40.934893  1555 rpcz_store.cc:276] 0709 12:59:39.885648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.933552 (+1047904us) service_pool.cc:224] Handling call
0709 12:59:40.933859 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.934049 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.934080 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:40.934121 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:40.934158 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.934219 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.934405 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:40.946765  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:40.948104  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:40.953331  1633 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:41.011145  1554 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:41.007117  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:40.785362  3499 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:41.013289  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.026839  1629 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:40.952198  3267 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 12:59:41.011507  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 71742.2us
I20260709 12:59:41.013999  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.014179  1633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 12:59:41.011356  1632 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:41.014374  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:41.017467  3455 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:41.017968  3385 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:41.021024  1554 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:41.023036  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:41.079732  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.053773  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 145603us
I20260709 12:59:41.055907  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.028162  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:40.914631  3537 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:40.933984  3476 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:41.133234  1633 raft_consensus.cc:606] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:41.134214  1627 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 1.
I20260709 12:59:40.934267  3498 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:41.142313  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:41.136171  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 121865us
I20260709 12:59:41.144330  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.008083  3503 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:41.118832  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.156275  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.157485  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.075124  3542 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:41.130074  3479 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:41.174145  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.175030  1555 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 12:59:41.172276  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:41.173055  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.140194  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.143309  3484 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:41.176198  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.179085  1554 raft_consensus.cc:2393] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 2: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:41.076639  3504 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:41.183333  3470 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:41.159476  3477 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:41.184087  3542 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:41.184921  3238 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:41.202634  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.203460  1555 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:59:41.189921  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.180708  3484 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:41.157409  3267 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.079559  3530 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 12:59:41.196880  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46975.8us
I20260709 12:59:41.198649  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.204901  1629 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:41.208508  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.207120  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.139820  3455 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.201052  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.139878  3385 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:41.195994  3526 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:41.213007  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:41.214399  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.225135  1554 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:41.206760  3484 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.227250  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:41.229235  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:41.231411  1526 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:41.233469  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.234511  1629 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:59:41.208822  3510 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:41.242000  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:41.219164  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.206625  3542 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.245957  3177 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:41.217584  3504 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:59:41.246361  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:41.303380  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.640204  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.640280  1628 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:41.333235  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.642323  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:41.635577  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.636260  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.649840   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:41.650718  1551 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:41.653249  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.289724  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:41.654968  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 408484us
I20260709 12:59:41.658011  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.658170  1635 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01ab117f13144a07986c484571fb73a2"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:60066
I20260709 12:59:41.659070  1635 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:41.318719  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.329279  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.659533  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.661015  1627 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:59:41.661099  1631 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:41.661536  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.661661  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.662973  1551 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:41.663609  1523 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:41.663734  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.664320  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.665512  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.667552  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:41.674439  1552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 1845) took 1846 ms (client timeout 1573 ms). Trace:
I20260709 12:59:41.359154  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:41.675848  1552 rpcz_store.cc:269] 0709 12:59:39.827461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.673963 (+1846502us) service_pool.cc:211] Skipping call since client already timed out
0709 12:59:41.674211 (+   248us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:59:41.342124  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1862) took 2245 ms. Trace:
I20260709 12:59:41.677503  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.678053  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.677595  1708 rpcz_store.cc:276] 0709 12:59:39.057778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.057944 (+   166us) service_pool.cc:224] Handling call
0709 12:59:39.219428 (+161484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.897123 (+677695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.897152 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:39.897243 (+    91us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:39.897277 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.303181 (+1405904us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b540012c5d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:41.303237 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.303415 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1557949312}
I20260709 12:59:41.679759  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.679967  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.370640  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.680918  1709 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:41.462075  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.466238  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.678617  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:41.683290  1553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 1839) took 2027 ms (client timeout 1797 ms). Trace:
I20260709 12:59:41.400453  3267 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.446561  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.415030  3312 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:41.448962  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:41.411464  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 475) took 1054 ms. Trace:
I20260709 12:59:41.406623  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 634) took 1471 ms. Trace:
I20260709 12:59:41.686630  2288 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:41.687230  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:41.692258  1557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1604) took 1753 ms (client timeout 1689 ms). Trace:
I20260709 12:59:41.659873  1635 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:41.697470  1557 rpcz_store.cc:269] 0709 12:59:39.938671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.943388 (+  4717us) service_pool.cc:224] Handling call
0709 12:59:41.691751 (+1748363us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54002f49d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:41.692006 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1047362944}
I20260709 12:59:41.342614  3385 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:41.698639  3478 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:41.698917  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.342617  3442 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:41.700064  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.659065  1700 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
W20260709 12:59:41.693899  1558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1607) took 1732 ms (client timeout 1895 ms). Trace:
I20260709 12:59:41.304986  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.674314  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:41.696038  1553 rpcz_store.cc:269] 0709 12:59:39.655381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.657541 (+  2160us) service_pool.cc:224] Handling call
0709 12:59:41.682768 (+2025227us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b5400027e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:41.683054 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1540971520}
I20260709 12:59:41.664697  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.710217  3506 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:41.703331  1558 rpcz_store.cc:269] 0709 12:59:39.961378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.979337 (+ 17959us) service_pool.cc:224] Handling call
0709 12:59:41.693422 (+1714085us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54001c89d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:41.693686 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609633664}
I20260709 12:59:41.711803  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.713033  1704 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:59:41.713912  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.713544  2329 rpcz_store.cc:276] 0709 12:59:40.356619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.356718 (+    99us) service_pool.cc:224] Handling call
0709 12:59:41.411210 (+1054492us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400566654. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:41.411353 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413222784}
I20260709 12:59:41.714092  2328 rpcz_store.cc:276] 0709 12:59:39.935554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.935902 (+   348us) service_pool.cc:224] Handling call
0709 12:59:39.940464 (+  4562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.374571 (+434107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.374601 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:40.374640 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:40.374675 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.406300 (+1031625us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54005c0154. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:41.406359 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.406540 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":997774080}
I20260709 12:59:41.717185  3468 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:41.338303  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.717761  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.728276  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.427687  3483 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:41.314287  3510 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:41.245103  3503 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:41.236516  3495 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:41.440096  3469 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:41.712210  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1602) took 1806 ms. Trace:
I20260709 12:59:41.284260  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 637) took 1183 ms. Trace:
I20260709 12:59:41.442588  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 640) took 1028 ms. Trace:
I20260709 12:59:41.728533  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.735735  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.726738  3506 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:41.738189  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.732107  1557 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
I20260709 12:59:41.740126  2321 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:41.714699  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.414114  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 265) took 1345 ms. Trace:
I20260709 12:59:41.742583  1560 rpcz_store.cc:276] 0709 12:59:39.905481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.392201 (+486720us) service_pool.cc:224] Handling call
0709 12:59:40.410094 (+ 17893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.569392 (+159298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.569424 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:40.569476 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:40.569507 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.711697 (+1142190us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540033ccd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:41.711767 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.711988 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365841152}
I20260709 12:59:41.745949  3506 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.749014  1558 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:41.750501  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.753044  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.753245  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.752863  3468 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.756055  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.396310  3406 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.749037  1551 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:41.402591  3449 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:41.752034  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:41.762753  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 76586.7us
I20260709 12:59:41.763875  1630 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:41.744863  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 86054.6us
W20260709 12:59:41.301515  3475 consensus_meta.cc:287] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.544s	user 0.025s	sys 0.011s
W20260709 12:59:41.373723  3505 consensus_meta.cc:287] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.916s	user 0.017s	sys 0.005s
I20260709 12:59:41.238022  3498 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:41.765303  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.763383  3479 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:41.768363  2323 rpcz_store.cc:276] 0709 12:59:40.103096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.103217 (+   121us) service_pool.cc:224] Handling call
0709 12:59:40.123899 (+ 20682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.403255 (+279356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.403285 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:40.403327 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:40.403362 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.283937 (+880575us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400431f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:41.284053 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.284195 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641915136}
I20260709 12:59:41.769358  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:41.773051  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.415901  3409 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:41.773828  1707 rpcz_store.cc:276] 0709 12:59:40.069225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.127119 (+ 57894us) service_pool.cc:224] Handling call
0709 12:59:40.127506 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.676670 (+549164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.676700 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:40.676740 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:40.676770 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.413859 (+737089us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b5400265554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:41.413910 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.414052 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262326528}
W20260709 12:59:41.760927  1559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1597) took 1875 ms (client timeout 2053 ms). Trace:
I20260709 12:59:41.791502  3479 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:41.373260  3461 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:41.775120  1706 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:41.775032  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.441033  3417 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:41.778756  3483 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:41.780011  3528 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:41.246610  3411 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:41.780696  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.368180  3455 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:41.410858  3525 consensus_meta.cc:287] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.803s	user 0.007s	sys 0.012s
I20260709 12:59:41.785102  1556 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:41.798496  3483 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.803973  3483 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:41.785531  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.804960  1704 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:41.806005  3528 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:41.806334  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.807837  3380 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 12:59:41.791404  1559 rpcz_store.cc:269] 0709 12:59:39.885280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.673673 (+1788393us) service_pool.cc:224] Handling call
0709 12:59:41.747381 (+ 73708us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:41.793249  3479 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:41.785712  3505 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.244855  3526 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:41.785157  2325 rpcz_store.cc:276] 0709 12:59:40.424435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.567947 (+143512us) service_pool.cc:224] Handling call
0709 12:59:41.441900 (+873953us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b5800003c98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 12:59:41.442096 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.442286 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.442313 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:41.442353 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:41.442391 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.442445 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.442539 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41085824}
I20260709 12:59:41.809027  3380 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.808485  3528 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:41.819842  3380 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:41.820789  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.444643  3448 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:41.815261  3526 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.822134  1628 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:41.823891  3526 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:41.824739  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 54575.5us
I20260709 12:59:41.817309  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.827257  3468 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:41.831598  3505 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:41.400480  3537 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.833822  3406 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:41.835098  3469 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.837004  3537 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:41.840279  3469 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:41.841181  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 46181.7us
I20260709 12:59:41.845676  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:41.846899  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.847417  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:41.848924  3478 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:41.849162  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.849354  3478 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:41.849471  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.848205  1454 catalog_manager.cc:5697] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 3 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:41.849876  2327 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:59:41.850446  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:41.849850  3478 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:41.847054  1458 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41160 (request call id 294) took 5335 ms. Trace:
I20260709 12:59:41.851972   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:41.855013  3411 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:41.855444  3503 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:41.855618  3411 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:41.855998  3503 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:41.856207  3411 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:41.856477  3503 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.859392  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.859793  1635 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:41.224848  3530 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:41.852200  1458 rpcz_store.cc:276] 0709 12:59:36.511407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.511552 (+   145us) service_pool.cc:224] Handling call
0709 12:59:37.312186 (+800634us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b5400230690. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed69610b2 00007f0edf8daa89 00007f0edf872da6 00007f0edf844088 00007f0edf94237e 00007f0edde032a4 00007f0edde03232 00007f0edde03161 00007f0edde030dc
0709 12:59:41.846764 (+4534578us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41225,"reported_tablets":3,"spinlock_wait_cycles":82521472}
I20260709 12:59:41.870201  3510 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:41.871119  3267 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:41.864326  3448 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:59:41.422106  3484 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.876817  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.878858  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.879936  1630 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:41.875248  1672 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:41.881101  1635 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:41.882688  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:41.885581  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 222334us
I20260709 12:59:41.887521  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.887885  2324 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:41.888734  1709 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 1.
I20260709 12:59:41.889282  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.889642  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.841006  3525 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.890287  1555 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:41.403841  3415 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.891633  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:41.899878  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.903043  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:41.903775  3484 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:41.903930  1704 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 1.
W20260709 12:59:41.905249  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 54978.7us
I20260709 12:59:41.897768  3510 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:41.913580  1706 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 1.
I20260709 12:59:41.919833  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:41.919693  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.919612  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:41.920928  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.922770  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.915804  1672 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:41.933254  3411 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:41.934298  3526 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:41.934785  3526 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:41.935310  3526 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:41.917157  3510 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:41.946781  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.942921  3510 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.952877  3411 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:41.965818  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:41.969527  2325 raft_consensus.cc:2393] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 2: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:41.971431  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.974263  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.975062  1630 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:59:41.942945  3475 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.961355  3455 consensus_queue.cc:1059] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:59:41.978248  1704 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:41.985076  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:41.989210  3469 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:41.989418  1630 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:59:41.990231  3469 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:41.997213  3469 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.003501  1455 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41166 (request call id 323) took 5571 ms. Trace:
I20260709 12:59:42.010442  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.004263  1455 rpcz_store.cc:276] 0709 12:59:36.401281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.401428 (+   147us) service_pool.cc:224] Handling call
0709 12:59:41.970228 (+5568800us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:38.354170 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:38.515740 (+161570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:38.523987 (+  8247us) write_op.cc:435] Acquired schema lock
0709 12:59:38.527277 (+  3290us) tablet.cc:662] Decoding operations
0709 12:59:38.681390 (+154113us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:38.689132 (+  7742us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:38.690093 (+   961us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:38.725567 (+ 35474us) tablet.cc:701] Row locks acquired
0709 12:59:38.725597 (+    30us) write_op.cc:260] PREPARE: finished
0709 12:59:38.739559 (+ 13962us) write_op.cc:270] Start()
0709 12:59:38.747772 (+  8213us) write_op.cc:276] Timestamp: P: 1783601978736634 usec, L: 0
0709 12:59:38.747813 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:59:38.826005 (+ 78192us) log.cc:844] Serialized 987 byte log entry
0709 12:59:41.063995 (+2237990us) op_driver.cc:464] REPLICATION: finished
0709 12:59:41.240230 (+176235us) write_op.cc:301] APPLY: starting
0709 12:59:41.247618 (+  7388us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:41.304324 (+ 56706us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:41.335685 (+ 31361us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:41.361543 (+ 25858us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:41.369896 (+  8353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:59:41.371227 (+  1331us) write_op.cc:312] APPLY: finished
0709 12:59:41.371449 (+   222us) log.cc:844] Serialized 29 byte log entry
0709 12:59:41.371631 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:41.371733 (+   102us) write_op.cc:454] Released schema lock
0709 12:59:41.371776 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:41.372098 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:41.372126 (+    28us) write_op.cc:454] Released schema lock
0709 12:59:41.423170 (+ 51044us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b540029f754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a8232a 00007f0ed9a07f14 00007f0ed9a07ec3 00007f0ed9a07e38 00007f0ed9a07df3 00007f0ed9a070dc 00007f0ed9a30e16 00007f0ed9a18cbb 00007f0ed9a0339d 00007f0ed9a06d75
Metrics: {"mutex_wait_us":132721,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":151172,"apply.run_cpu_time_us":2594,"apply.run_wall_time_us":147502,"num_ops":2,"prepare.queue_time_us":526752,"prepare.run_cpu_time_us":111739,"prepare.run_wall_time_us":1096184,"raft.queue_time_us":442650,"raft.run_cpu_time_us":13584,"raft.run_wall_time_us":494135,"replication_time_us":2261739,"spinlock_wait_cycles":30914944,"thread_start_us":890625,"threads_started":4,"wal-append.queue_time_us":1042333}]]}
I20260709 12:59:42.012903  1633 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 2: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:42.014030  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.017817  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.018102  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.018818  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.019465  1630 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:42.022418  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.023239  1633 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:59:42.026486  3312 consensus_queue.cc:1059] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:42.028267  3481 raft_consensus.cc:3055] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:42.028694  3481 raft_consensus.cc:740] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:42.030911  3481 consensus_queue.cc:260] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.036324  3481 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:42.038482  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 12:59:42.039582  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 66883.6us
I20260709 12:59:42.040854  3406 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:42.041271  3406 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:42.041589  3406 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:42.043133  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.043823  1700 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 1.
I20260709 12:59:42.044167  3526 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.045543  1598 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:42.052740  1704 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 2: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:42.054034  3542 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.055454  1553 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:42.055998  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.057133  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.057868  1707 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:59:42.058272  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.059746  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.060290  3475 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:42.060565  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:42.061226  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.063410  3312 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:42.063721  3312 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:42.064010  3312 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.061849  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.067443  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:42.070506  3542 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:42.067696  3526 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:42.071446  3530 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.072602  3525 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.074040  3528 raft_consensus.cc:3055] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:42.074496  3528 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:42.074923  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:42.075711  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:42.075464  3528 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.076854  1599 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:42.077009  3528 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.089054  3312 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.092075  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:42.097446  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:42.098276  2286 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.100858  3525 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:42.100829  2286 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:42.103219  3417 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:42.103603  3469 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:42.103929  3417 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:42.074097  3415 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:42.104178  3469 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:42.104981  3469 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.098506  3406 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.104130  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:59:42.107898  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 62660.1us
I20260709 12:59:42.110103  2325 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 LEARNER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:42.111171  3417 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.114312  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.117013  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:42.117520  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:42.117013  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.119995  3550 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:42.122133  3312 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:42.121006  3550 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:42.124069  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.124486  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:42.125248  2328 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 2: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:42.127207  2323 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:42.127851  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:42.127128  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.124083  2320 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:42.132769  1599 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:42.128410  3550 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.136384  3525 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:42.137974  2325 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:42.140693  1599 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:42.142592  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.144876  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.147548  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.148612  1633 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:59:42.148919  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.150043  3475 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:42.148161  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:42.150483  3475 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:42.150936  3475 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:42.151621  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 47492.6us
I20260709 12:59:42.152040  3484 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:42.153005  2286 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.155364  3267 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:42.157703  2288 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.160130  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:42.162416  2325 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 3: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:42.165095  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.165326  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.165083  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:42.167627  1709 raft_consensus.cc:2393] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 2: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:42.122040  3478 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:42.168982  3525 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:42.169505  3525 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:42.169600  3406 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:42.170060  3525 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.170532  3479 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.171020  3478 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.171772  2329 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 2: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:42.173202  2327 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:42.165134  1700 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.033269  3506 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.183939  3469 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.187147  2327 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:42.188556  3469 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.187071  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:42.192931  2286 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:42.197741  3312 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:42.198700  3312 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:42.191123  2288 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.199509  3312 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:42.190354  3479 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:42.206223  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:42.194293  3503 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:42.202806  3406 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:42.213847  3461 consensus_queue.cc:1059] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:59:42.203701  3484 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:42.190992  3415 consensus_queue.cc:1059] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:59:42.221812  2286 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:42.212419  3469 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:42.224252  3312 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:42.228441  2288 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.243829  1706 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:42.246443  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.252112  3434 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:42.252321  3177 consensus_queue.cc:1059] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:59:42.250849  3468 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:42.253592  3411 raft_consensus.cc:3055] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:42.253939  3468 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:42.254061  3411 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:42.254523  3468 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.255242  3411 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.225020  3484 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:42.256868  3484 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.257040  3411 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:42.258100  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.227944  3415 raft_consensus.cc:3055] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:42.249181  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:42.226637  3461 raft_consensus.cc:3055] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:42.265130  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.268527  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.225893  3506 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:42.270202  3312 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.272110  1555 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 2: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:42.273864  1704 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:42.274233  3503 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.276561  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.279184  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.215749  3406 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:42.277326  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.282333  2288 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.284432  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.285027  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.286561  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.211385  3417 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:42.268469  3461 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:42.289841  3461 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.290426  3417 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.286553  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.291131  3461 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:42.288661  3406 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.285080  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.300987  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.302194  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.296048  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.303051  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.304606  1557 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:42.303601  1701 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:42.306032  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.306317  3525 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.262367  3542 consensus_queue.cc:1059] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:59:42.296404  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.296770  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.310736  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.302528  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.312552  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.320065  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.320324  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:42.263166  3415 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 12:59:42.312934  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 65172.1us
I20260709 12:59:42.308887  3542 raft_consensus.cc:3055] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:42.228657  3550 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.104s
W20260709 12:59:42.328073  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 59169.4us
W20260709 12:59:42.325577  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 44290.1us
I20260709 12:59:42.308447  3525 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.326189  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:42.331243  1635 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:42.327533  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.341691  1704 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:42.340814  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.344273  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:42.344625  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.346712  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.347621  1552 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.347829  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.348706  1557 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.349900  3406 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.353605  3406 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:42.356282  1599 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.359681  1557 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:42.325625  3542 raft_consensus.cc:740] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:42.364976  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:42.365108  3542 consensus_queue.cc:260] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.365696  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.368793  3469 consensus_queue.cc:1059] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:42.369196  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.370366  3469 raft_consensus.cc:3055] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:42.370923  3469 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:42.370466  3415 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.372035  3415 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.372169  3469 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.373780  3469 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.357636  3479 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:42.379050  3479 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:42.379539  3479 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:42.412250  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.425163  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.427560  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.428401  1554 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:42.428767  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.393563  3542 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:42.432389  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.432466  2325 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:42.433079  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 103520us
I20260709 12:59:42.433367  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.427906  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.438143  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.439505  1599 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:42.439935  1559 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:42.443640  3530 consensus_queue.cc:1059] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:42.445863  3530 raft_consensus.cc:3055] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:42.446270  3530 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 12:59:42.446671  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 84668.5us
I20260709 12:59:42.447289  3530 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.449206  3530 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:42.449390  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:42.462823  1707 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:42.468109  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:42.473184  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:42.473884  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 46343.7us
I20260709 12:59:42.476720  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:42.474236  3468 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.478611  3526 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:42.479040  3526 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:42.479426  3526 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.480800  1675 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:42.483687  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.483928  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.488739  1557 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:42.489276  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.486697  1454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57414 (request call id 188) took 5411 ms. Trace:
W20260709 12:59:42.494107  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 54771.1us
I20260709 12:59:42.494172  3312 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:42.494989  3312 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:42.495780  3312 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:42.497897  1552 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:42.498195  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.490155  1454 rpcz_store.cc:276] 0709 12:59:37.075583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.075740 (+   157us) service_pool.cc:224] Handling call
0709 12:59:42.486603 (+5410863us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:42.000697 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:42.001535 (+   838us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:42.001598 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:59:42.001637 (+    39us) tablet.cc:662] Decoding operations
0709 12:59:42.009715 (+  8078us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:42.011219 (+  1504us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:42.011250 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:42.011660 (+   410us) tablet.cc:701] Row locks acquired
0709 12:59:42.014584 (+  2924us) write_op.cc:260] PREPARE: finished
0709 12:59:42.030879 (+ 16295us) write_op.cc:270] Start()
0709 12:59:42.031128 (+   249us) write_op.cc:276] Timestamp: P: 1783601982030810 usec, L: 0
0709 12:59:42.031152 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:59:42.036059 (+  4907us) log.cc:844] Serialized 599 byte log entry
0709 12:59:42.213811 (+177752us) op_driver.cc:464] REPLICATION: finished
0709 12:59:42.382941 (+169130us) write_op.cc:301] APPLY: starting
0709 12:59:42.383082 (+   141us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:42.383251 (+   169us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:42.383433 (+   182us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:42.383833 (+   400us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:42.384140 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:42.384184 (+    44us) write_op.cc:312] APPLY: finished
0709 12:59:42.427100 (+ 42916us) log.cc:844] Serialized 23 byte log entry
0709 12:59:42.427473 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:42.427565 (+    92us) write_op.cc:454] Released schema lock
0709 12:59:42.427624 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:42.428160 (+   536us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:42.428192 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":62082,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":168701,"apply.run_cpu_time_us":2999,"apply.run_wall_time_us":45161,"num_ops":1,"prepare.queue_time_us":68616,"prepare.run_cpu_time_us":4334,"prepare.run_wall_time_us":67817,"replication_time_us":178650,"thread_start_us":135479,"threads_started":2}]]}
I20260709 12:59:42.499552  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.495229  1557 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:42.431591  3406 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:42.495095  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:42.502951  1558 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:42.494796  3525 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:59:42.506328  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 57000.6us
I20260709 12:59:42.507273  2288 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.480386  3468 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.515563  3417 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:42.516170  3417 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:42.516513  3515 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:42.516639  3417 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:42.518580  3510 consensus_meta.cc:287] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.552s	user 0.013s	sys 0.009s
I20260709 12:59:42.519194  3510 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.523201  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.523524  2286 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:42.525507  1630 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:42.526255  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:42.526928  1709 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:42.527218  1709 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:42.528995  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:42.535442  3312 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:42.537809  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:42.538267  3510 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:42.538725  1701 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 3: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:42.541692  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:42.506227  3525 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:42.521217  3515 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:59:42.558604  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 63564.8us
I20260709 12:59:42.560065  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.561527  3495 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:42.562546  3495 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:42.528627  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.568456  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.549891  1709 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:42.571385  1599 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.572341  3312 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:42.572837  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 65604.4us
I20260709 12:59:42.547324  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.576786  3558 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:42.586131  3558 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:42.586530  2325 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:42.552201  3525 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:42.588879  1709 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.576689  3495 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.577080  1559 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:42.565645  3469 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:42.597092  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.598026  1557 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:59:42.528431  3475 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:42.602073  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 81370.8us
I20260709 12:59:42.607115  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.613111  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.608538  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.617797  1558 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:42.616530  1457 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41156 (request call id 258) took 2530 ms. Trace:
I20260709 12:59:42.586722  3558 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:42.638710  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:42.640273  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.624853  1556 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:42.629675  2323 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:42.630065  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.646948  1558 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:42.630291  3526 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.632413  3483 consensus_queue.cc:1059] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:42.621184  3469 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:42.637693  3380 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:42.650574  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.620079  1457 rpcz_store.cc:276] 0709 12:59:40.086368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.134387 (+ 48019us) service_pool.cc:224] Handling call
0709 12:59:40.642672 (+508285us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5400230690. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed69610b2 00007f0edf8daa89 00007f0edf872da6 00007f0edf844088 00007f0edf94237e 00007f0edde032a4 00007f0edde03232 00007f0edde03161 00007f0edde030dc
0709 12:59:42.616265 (+1973593us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":8,"spinlock_wait_cycles":23339904}
I20260709 12:59:42.663270  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:42.640619  1553 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 3: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:42.613523  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.655867  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.656224  3526 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:42.656810  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.657059  3483 raft_consensus.cc:3055] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:42.661624  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.661504  3469 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.662580  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.668092  3506 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:59:42.669553  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.673064  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.677160  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.694528  1555 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:42.693961  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:42.680330  1675 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:42.707687  1557 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:42.697506  1556 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:42.710799  3455 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:42.711261  3455 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:42.712205  3455 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.713680  3455 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:42.718339  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 131641us
I20260709 12:59:42.718806  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:42.719975  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:42.721560  2288 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.679535  3483 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:42.660296  3484 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.723173  1700 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:42.727310  1557 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:42.728816  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 78063.2us
I20260709 12:59:42.729755  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.728119  1554 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:59:42.738991  1707 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:42.739140  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:42.741714  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.645566  3479 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:42.744520  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.745455  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:42.746205  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:42.745277  3434 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:42.748477  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:42.749541  1552 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:42.749382  3483 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.750792  3483 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.730664  3468 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:42.747197  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:42.746255  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.758513  2288 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.760111  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:42.761229  2327 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:42.749348  1702 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:59:42.768016  2325 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:42.770505  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:42.764503  3510 consensus_queue.cc:1059] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:59:42.723831  3525 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.783787  1675 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:42.786211  3267 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:42.786793  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:42.751538  3468 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:42.788131  1709 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:42.793634  3267 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:42.798169  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:59:42.808207  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 67215.4us
I20260709 12:59:42.812016  2323 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:42.813282  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47537.8us
I20260709 12:59:42.815774  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:42.816672  3562 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:42.817219  1635 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:42.817047  3479 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.820830  1675 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.781816  3550 raft_consensus.cc:3055] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:42.825068  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.785336  3481 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:42.784235  3528 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:42.817133  3562 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:42.833060  1633 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:42.771080  3564 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:42.794618  3468 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:42.834170  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.840256  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.844256  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:42.846494  1632 raft_consensus.cc:2393] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:42.848747  1599 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.853428  1630 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:42.820886  3380 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:42.828738  3550 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:42.868615   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:42.838656  3562 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:42.866444  3561 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:59:42.844156  3559 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:42.863086  3415 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:42.873696  3525 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.861222  1560 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:42.855157  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:59:42.876549  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 60940.4us
W20260709 12:59:42.859313  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 52102us
W20260709 12:59:42.874258  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 97172.6us
W20260709 12:59:42.854467  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 56403.6us
I20260709 12:59:42.889166  2288 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.831471  3411 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:59:42.856755  3564 raft_consensus.cc:697] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:42.874202  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:42.918004  3503 raft_consensus.cc:3055] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:42.918251  1626 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:42.925055  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:42.941215  3550 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.943262  3550 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:42.899248  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 59402.8us
I20260709 12:59:42.901894  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:42.902940  3505 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:42.854557  3571 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:42.905695  3415 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:42.906531  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.958096  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:42.918520  3503 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:42.852497  3417 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.887043  3461 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:42.914680  1673 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:42.890547  3475 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:42.906330  3449 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 12:59:42.961107  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 60954.5us
I20260709 12:59:42.856635  3515 consensus_queue.cc:1059] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:59:42.921157  3479 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:42.859201  3569 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:42.961256  3415 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:42.985770  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 79303.2us
I20260709 12:59:42.985351  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:42.957154  3571 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 12:59:43.005380  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 112491us
I20260709 12:59:42.997709  3505 consensus_queue.cc:1059] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:59:42.965600  3558 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:42.983665  3569 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:43.023289  1675 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:43.024824  3468 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:43.027110  3468 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:43.031435  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:43.034082  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:43.034631  2327 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:43.034514  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 119885us
W20260709 12:59:43.046111  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 82747.2us
I20260709 12:59:42.995741  3571 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.055275  3528 raft_consensus.cc:3055] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:43.055802  3528 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:43.056831  3528 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:43.058188  3528 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:43.061986  3380 raft_consensus.cc:3055] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:43.062422  3380 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:43.063295  3380 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:43.065124  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 58529.4us
I20260709 12:59:43.069561  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:43.070848  3576 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.072688  3380 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.074141  1526 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:43.075305  3550 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:43.075924  3550 raft_consensus.cc:697] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:43.077214  3550 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:43.006111  3504 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:43.098254  1599 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.100847  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:43.036334  3569 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.103883  3559 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:43.105201  2325 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:43.105650  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 99439us
I20260709 12:59:43.106604  1675 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:43.107774  1601 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:43.014397  3417 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:43.112797  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 66907.7us
I20260709 12:59:43.018206  3566 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.113463  1673 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.032635  3510 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.104347  1626 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:43.117240  3312 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:43.120312  3312 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:43.120707  3312 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:43.096681  3484 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:43.121084  2323 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:43.112177  3406 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:43.101224  3526 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.125342  3406 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:43.128949  3495 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:43.129388  3406 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:43.129594  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.129690  3495 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:43.130211  3495 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:43.117661  2321 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:43.104615  3411 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:59:43.160889  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:59:43.159870  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 61830.7us
I20260709 12:59:43.118088  3461 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:43.160866  3312 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:43.100841  3475 consensus_queue.cc:1059] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 12:59:43.168427  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 190916us
I20260709 12:59:43.169441  1601 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:59:43.175216  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 61795.9us
I20260709 12:59:43.128820  3515 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:43.125211  3505 raft_consensus.cc:3055] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:43.183573  3312 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:43.183584  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 57262.7us
I20260709 12:59:43.185305  1599 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.184806  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:43.190729  3312 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:43.191820  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.185559  3505 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:43.199338  3562 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:43.101547  3564 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:43.200021  3505 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:43.201162  1599 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:43.201701  3505 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.175242  3566 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.203182  3312 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:43.210243  1601 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:43.210837  3312 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:43.185420  3525 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:43.184861  3417 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:43.211238  3312 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:43.182312  3515 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:43.183836  3510 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:43.213251  3380 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:59:43.232712  3584 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:59:43.233886  1673 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:43.169014  3576 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:59:43.236299  1599 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.238420  3562 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:59:43.215680  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 143003us
W20260709 12:59:43.221102  3455 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 12:59:43.221233  3583 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.221400  3574 raft_consensus.cc:3055] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:43.221873  3577 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:43.224637  3515 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:43.241894  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.244860  3312 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:43.253186  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 152540us
I20260709 12:59:43.281616  3312 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:43.217801  3417 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 12:59:43.287212  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 45392.1us
I20260709 12:59:43.289322  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:43.290772  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:43.288057  3417 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.302093  3585 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:43.302217  2321 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:43.262671  3574 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:43.272121  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:43.263275  3526 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:59:43.305011  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 198470us
I20260709 12:59:43.309152  3526 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:43.310977  3580 raft_consensus.cc:2955] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:43.312148  3526 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.312690  3565 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:43.313171  3565 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:43.313536  3565 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:43.309489  3542 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:43.310313  3380 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:43.282972  3584 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:43.293725  3455 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:43.315613  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:43.292268  3461 raft_consensus.cc:3055] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:43.267293  3577 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:43.292151  3566 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:43.256868  3525 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:43.260231  3411 consensus_queue.cc:1059] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:59:43.316227  3542 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:43.331977  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:43.292218  3406 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:43.350247  3515 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:43.336906  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 95853.7us
I20260709 12:59:43.323299  3574 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:43.353776  1601 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.326560  3461 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:43.361167  3461 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:43.361692  3449 raft_consensus.cc:3055] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:43.362150  3449 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:43.362449  3461 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.363022  3449 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:43.363413  3495 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:43.329744  3558 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:43.359807  3566 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:43.360267  3570 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:43.291323  3503 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:43.355626  1673 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:43.327373  3577 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.353042  3542 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:43.377256  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 141005us
I20260709 12:59:43.379849  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:43.385991  3503 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.387720  1601 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:43.388926  3589 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:43.389600  3589 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:43.390030  3589 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:43.390215  3583 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:43.392360  1601 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 12:59:43.393493  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 61591.9us
I20260709 12:59:43.396428  3481 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.399613  2321 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:43.400326  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 12:59:43.401335  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 45770.7us
I20260709 12:59:43.401461  3475 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:43.401769  3406 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:43.403108  3406 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:43.403571  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.404928  3483 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.406136  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:43.407527  3525 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:43.412609  3411 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.412770  1599 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.403633  3406 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:43.414180  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:43.415110  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:43.414667  3406 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:43.514582  1675 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:43.517817  1701 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 12:59:43.521097  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:43.375249  3574 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:43.526724  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:43.531616  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:43.533880  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:43.329115  3584 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:43.534600  1701 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:43.535835  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:43.390913  3583 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:43.540303  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:43.542008  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:43.543303  1703 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:43.542781  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.352487  3515 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:59:43.550539  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:43.550872  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:43.551236  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.553747  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:59:43.555078  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:43.557533  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 165134us
I20260709 12:59:43.558857  1675 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:43.559072  1599 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.557569  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:43.563024  1707 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 3: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:43.542529  3583 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:43.567878  1701 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:43.573014  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:43.574107  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:43.578838  1701 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:43.552762  3585 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:43.584156  2288 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.586429  3537 consensus_queue.cc:1059] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:43.586287  3585 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:43.588124  3537 raft_consensus.cc:3055] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:43.588497  3537 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:43.589000  3380 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:43.589452  3537 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:43.590165  3380 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:43.586282  3434 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.593019  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:43.594553  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:43.595620  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:43.596865  2288 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.590798  3537 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:43.582018  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:43.589131  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:43.606133  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:59:43.606433  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47643us
I20260709 12:59:43.611678  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:59:43.611482  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 52466.5us
I20260709 12:59:43.605923  1707 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:43.570762  3506 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.572906  3515 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:43.575227  3562 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.614290  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.629922  1704 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:43.640153  1702 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:43.615631  1703 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
W20260709 12:59:43.632503  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.617360  2288 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.657961  1599 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:43.659132  1708 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
W20260709 12:59:43.616683  3569 consensus_meta.cc:287] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.512s	user 0.002s	sys 0.011s
W20260709 12:59:43.662585  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 88726.7us
I20260709 12:59:43.669638  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:43.606950  3434 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:43.670934  3312 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:43.671072  1705 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:43.671893  3312 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:43.672643  3312 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:43.614174  3592 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:43.674068  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:43.675220  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.632647  3587 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:43.675721  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:43.676187  3587 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:43.617151  3481 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.618929  3589 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:43.678648  3589 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:43.622344  3590 raft_consensus.cc:3055] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:43.632717  3588 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:43.679445  3415 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.002s
I20260709 12:59:43.642685  3495 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:43.680320  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:43.668788  3558 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:43.675354  1633 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:43.653388  3570 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.679466  3590 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:43.676621  3587 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.637705  3577 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:43.692449  1630 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:43.698392  3577 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:43.671702  3380 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:43.700382  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:43.700840  1633 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:43.702395  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.702901  2288 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:43.704109  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:43.667160  3475 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:43.706075  3588 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:43.707039  3449 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.623198  3417 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:43.680049  3415 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:43.705859  3591 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:43.710071  3312 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:43.708289  3558 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:43.697988  3542 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:43.730095  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:43.730321  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:43.732336  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:43.727710  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:43.737201  1633 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:43.738682  3417 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:43.708160  3434 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:43.739931  3434 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:43.740002  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:43.741020  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:43.741223  2321 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:43.708711  3380 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:43.725509  3589 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:43.742826  3589 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:43.743261  3589 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.747937  1553 raft_consensus.cc:2393] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:43.751157  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:43.753925  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:43.694098  3569 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:43.740394  3434 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:43.708389  3565 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.057765  3579 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:44.058931  3565 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:44.059793  3415 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:44.058969  3579 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:44.061172  3542 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:44.062767  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.064324  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 12:59:43.821439  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 73565.1us
W20260709 12:59:44.066149  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.751350  3558 raft_consensus.cc:697] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 12:59:43.928428  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 173132us
W20260709 12:59:44.074128  1673 leader_election.cc:336] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.750s (SENT)
W20260709 12:59:44.033071  3580 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.709s	user 0.009s	sys 0.015s
I20260709 12:59:44.033584  3406 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 12:59:44.103113  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.034627  3587 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:44.036212  3594 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.745358  3590 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.113565  3590 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.037914  1632 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:43.733866  1626 raft_consensus.cc:1240] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:43.728505  3506 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:44.039731  1557 raft_consensus.cc:1240] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:44.041935  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:44.118242  1633 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:44.055680  3526 consensus_meta.cc:287] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.743s	user 0.012s	sys 0.020s
I20260709 12:59:44.056344  3434 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.068473  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:44.069520  1630 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 3: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:44.061928  3562 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.062059  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 12:59:44.071712  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 330705us
I20260709 12:59:44.134039  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:44.029997  3312 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:44.033577  3571 consensus_meta.cc:287] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.920s	user 0.015s	sys 0.007s
I20260709 12:59:44.106304  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 12:59:44.108101  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.111898  3599 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:44.113996  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:44.037612  3596 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:44.121404  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.072503  3515 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 12:59:44.130367  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.090263  3588 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:44.155467  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:44.155817  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:44.157758  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:44.131632  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:44.125895  3591 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.158272  1708 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 2: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:44.140542  1601 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:44.164736  3312 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:44.165313  3312 raft_consensus.cc:697] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:44.163363  1631 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:44.169152  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:44.167385  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:44.172853  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:44.173019  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:44.114670  3406 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:44.175514  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:44.176241  1558 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 4: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:44.061414  3579 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.177762  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:44.180680  1704 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 3: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:44.181231  2323 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:44.176976  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:44.181933  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:44.153458  1551 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.184818  1598 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:44.186612  2286 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:44.167785  3503 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.132680  3526 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:44.189458  3267 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.200212  1634 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.151130  3585 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:59:44.142401  3562 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.199263  3312 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:44.186328  1552 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:44.154316  3571 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:44.187739  3596 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.119012  3594 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.167346  3515 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.158772  3599 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.194679  3455 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:59:44.220785  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:44.217309  1709 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:44.238363  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.245926  3267 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:44.246034  1633 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:44.244366  3565 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:44.248066  3583 consensus_meta.cc:287] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.667s	user 0.016s	sys 0.000s
I20260709 12:59:44.248266  3565 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:44.248517  3583 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:44.249347  3565 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.251171  3583 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:44.170223  3591 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.253131  3571 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:59:44.254377  3589 consensus_meta.cc:287] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.004s
I20260709 12:59:44.254874  3589 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.259608  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:44.262413  1634 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
W20260709 12:59:44.263944  1673 leader_election.cc:336] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.895s (SENT)
I20260709 12:59:44.264438  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:44.266656  3599 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:59:44.267028  3597 log.cc:927] Time spent T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.175s	user 0.002s	sys 0.000s
I20260709 12:59:44.234382  3380 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:44.269023  3380 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:44.270040  3380 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.271044  3526 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:44.268281  1627 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:44.273598  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:44.273829  3562 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:44.274443  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:44.275604  1559 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 2: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:44.204457  3558 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.174858  3588 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:59:44.278218  3588 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:44.279177  1629 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 2: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:44.281885  3594 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:44.282596  3515 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:44.284001  3406 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:44.246505  3267 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.248718  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:44.286352  1633 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:44.287546  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:44.272365  3574 consensus_meta.cc:287] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.731s	user 0.018s	sys 0.006s
I20260709 12:59:44.294937  2323 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:44.297365  1598 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:44.298354  1632 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:44.299355  1633 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:44.300513  1700 raft_consensus.cc:2410] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:59:44.231410  3592 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.313165  1627 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:44.323416  3564 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:59:44.330587  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.330929  3267 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:44.275636  3570 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:44.332305  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 111695us
W20260709 12:59:44.307660  3461 consensus_meta.cc:287] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.945s	user 0.018s	sys 0.007s
I20260709 12:59:44.324504  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:44.309185  3481 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:44.309379  3506 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:44.350816  3267 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:44.352238  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 215155us
I20260709 12:59:44.329121  3526 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:44.352766  3267 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.353416  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:59:44.354643  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 177706us
I20260709 12:59:44.357997  1601 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:44.331566  3587 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:44.362819  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:44.345440  3571 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.345757  3570 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 12:59:44.359177  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 212192us
I20260709 12:59:44.361163  1601 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:44.375960  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:44.376792  2325 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 2: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:44.354748  3481 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.354357  3564 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.381100  1599 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:44.383134  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:44.383409  3593 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:44.383769  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:44.384028  2323 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 2: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:44.385237  3594 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:44.385391  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:44.386241  3593 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.386593  1599 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:44.387276  3593 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:44.360565  3569 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:44.396898  3550 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.379498  3461 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:44.397462  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:44.401751  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:44.402845  3267 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:44.372157  3406 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:44.404896  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:44.405807  1553 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:44.372923  3580 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:44.404973  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:44.376147  3589 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:44.406363  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:44.416199  2325 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:44.363554  3574 consensus_queue.cc:1059] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:59:44.395124  3481 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:44.418764  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:44.414749  3550 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.420738  1551 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:44.422278  1523 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:44.422382  1601 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:44.422916  3312 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.429040  3574 raft_consensus.cc:3055] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:44.428905  3588 consensus_queue.cc:1059] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:44.429476  3574 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:44.430296  3594 raft_consensus.cc:3055] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:44.430750  3594 raft_consensus.cc:740] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:44.430574  3574 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:44.425714  3406 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:44.431883  3594 consensus_queue.cc:260] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:44.432732  3406 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.419695  2321 raft_consensus.cc:2955] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:44.434056  1601 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:44.434970  3589 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:44.435612  3589 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:44.437018  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:44.437830  3593 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:44.438663  3584 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:44.439687  3593 consensus_queue.cc:1059] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:44.402484  3564 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.439530  3570 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:44.440820  3593 raft_consensus.cc:3055] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:44.441244  3593 raft_consensus.cc:740] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:44.441351  3570 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:44.441942  3564 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:44.379812  3515 consensus_queue.cc:1059] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:59:44.443931  3515 raft_consensus.cc:3055] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:44.444284  3515 raft_consensus.cc:740] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:44.445281  3515 consensus_queue.cc:260] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:44.447310  3515 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.398412  3526 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:44.448932  3526 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.451406  3526 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:44.458964  3455 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:44.459426  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:44.460259  2329 raft_consensus.cc:2393] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 2: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:44.462018  1675 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:44.375262  3583 consensus_queue.cc:1059] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:59:44.451431  3550 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:44.483666  3583 raft_consensus.cc:3055] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:44.484124  3583 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:44.484905  3583 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:44.485462  3575 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:44.485834  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:44.486124  3583 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.475911  3579 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.485492  1702 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:44.470785  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:44.378867  3571 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.473301  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:44.474350  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:44.475273  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:44.493076  2288 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:44.466217  1701 raft_consensus.cc:1240] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:44.488814  1629 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:44.461223  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 46591.1us
I20260709 12:59:44.493600  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:44.495162  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:59:44.466976  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.489171  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:44.489938  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.490841  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:44.496006  1703 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:44.496150  1634 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:44.491003  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:44.497071  1627 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.476917  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:44.442553  3593 consensus_queue.cc:260] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:44.459843  3455 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.421370  3506 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.493687  1709 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:59:44.498306  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.498622  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:44.498658  1704 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 12:59:44.500880  1628 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:44.500065  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:44.508019  3267 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:44.505771  1635 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:44.506204  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 12:59:44.474920  3611 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.055s	user 0.001s	sys 0.001s
I20260709 12:59:44.509397  1633 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 2: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:44.509538  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:44.425323  3461 raft_consensus.cc:697] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:44.504895  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:44.507892  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:44.508528  3267 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:44.515404  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:44.519358  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.520777  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.507335  1553 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:44.500845  3550 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:44.473906  3526 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:44.556337  3455 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:44.558708  3415 consensus_queue.cc:1059] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:59:44.560971  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:44.561566  3594 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.510320  3584 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:44.563300  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:44.564234  1705 raft_consensus.cc:2393] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 2: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:44.439685  1631 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:44.565795  3593 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.472966  3585 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:44.569990  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 62946.7us
I20260709 12:59:44.472851  3503 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:44.575940  1629 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:44.561990  1558 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:44.569989  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:44.114481  3576 consensus_queue.cc:1175] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6b9e73092f6146639bf310a3d18cfe37" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:59:44.567308  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49897.8us
W20260709 12:59:44.572041  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64546.1us
I20260709 12:59:44.580457  1675 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:44.566617  1630 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:59:44.572830  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64144.2us
I20260709 12:59:44.572059  3580 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:44.516178  1632 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 1.
I20260709 12:59:44.574031  3267 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.592514  1627 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:44.593492  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:44.594041  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:44.595000  1627 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:44.595975  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:44.596051  1706 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:44.597908  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:44.608073  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:44.631695  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:44.630955  3581 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.561143  3571 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:44.632947  3559 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:44.633605  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:44.633656  3584 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.584539  3580 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:44.640208  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:44.609113  1632 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:44.616797  1629 raft_consensus.cc:2393] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:44.572302  3585 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.673244  2329 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 12:59:44.692010  1629 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:44.669538  1555 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:44.671010  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:44.596966  3455 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.694128  1629 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:44.697968  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:44.634553  3601 consensus_queue.cc:1059] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:59:44.706310  3558 raft_consensus.cc:3055] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:44.706725  3558 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:44.711165  2288 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:44.711911  3481 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.695935  3584 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.704998  3607 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:44.759079  3607 raft_consensus.cc:697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:44.760282  3434 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:44.760124  3607 consensus_queue.cc:237] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:44.697016  3585 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:44.657178  3526 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:44.658018  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:44.633594  3506 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.770112  3506 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:44.772133  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.701218  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:44.773319  1629 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:44.597160  3566 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 12:59:44.712904  3461 consensus_queue.cc:237] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:44.712571  3581 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:44.596834  3417 consensus_queue.cc:1059] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
I20260709 12:59:44.744560  2288 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:44.780267  1629 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:44.782073  1629 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:44.749830  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:44.755987  1627 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:59:44.635298  3550 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:44.689692  3580 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.779248  1552 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:44.760160  3584 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:44.786506  3506 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:44.707945  3558 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.758308  1599 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:44.692317  3575 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:59:44.769080  3526 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:44.795800  1629 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.783262  1705 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:44.798756  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:44.799523  1555 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:44.782675  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:44.767431  3599 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:44.799485  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:44.787949  1627 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:44.790777  1634 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:44.800391  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 219993us
I20260709 12:59:44.807940  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:44.808857  1703 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:59:44.809628  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:44.791218  1635 raft_consensus.cc:2955] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:44.817375  3609 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:44.817590  1708 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:44.817950  3609 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.818379  3609 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:44.819943  1555 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 12:59:44.790699  3601 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:44.811939  1675 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:44.825271  1675 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:44.791759  3581 raft_consensus.cc:697] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:44.780467  3406 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:59:44.830614  3312 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:44.833859  3312 raft_consensus.cc:697] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:44.794312  3525 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:59:44.807242  3481 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:44.842965  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.836676  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:44.853991  3581 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.851788  3312 consensus_queue.cc:237] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:44.822512  3571 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:44.874346  3617 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:44.829367  3601 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:44.831585  3558 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.830804  3569 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:59:44.884047  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 101593us
I20260709 12:59:44.830976  3455 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:44.802507  3550 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:44.908613  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.876187  3415 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:44.909595  1673 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.996s (SENT) [suppressed 44 similar messages]
W20260709 12:59:44.927575  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 116003us
I20260709 12:59:44.862397  3593 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.889683  3601 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.941740  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:44.942492  1627 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 2: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:44.943308  2288 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:44.945797  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:44.947638  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:44.885179  3571 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:44.948923  1553 raft_consensus.cc:1240] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:44.952770  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:44.967037  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:44.967178  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:44.968221  1553 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:44.969483  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:44.970620  1553 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:44.972014  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:44.928555  3415 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.927704  3590 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:44.919219  3559 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:59:44.973212  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:44.950407  3593 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:45.070559  3590 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.071096  1634 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 12:59:44.973299  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:45.072875  3593 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:45.028371  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 118780us
W20260709 12:59:45.073975  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.007160  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:45.079298  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:45.080024  2325 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:45.082223  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:45.083024  1523 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:45.086110  1701 raft_consensus.cc:1240] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:45.092815  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:45.093559  2325 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:45.097400  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:45.098034  1701 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:59:45.105008  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:45.108220  3596 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:45.109427  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:45.110426  1701 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:45.112269  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:45.112282  1700 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:45.114054  1558 raft_consensus.cc:2393] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 2: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:44.960320  3571 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.113862  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:44.959540  3506 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:45.124215  1700 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:45.118544  2327 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:45.126402  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:45.041276  3602 raft_consensus.cc:3055] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:45.043365  3475 raft_consensus.cc:3055] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:45.017994  3525 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:45.094489  3415 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:45.065526  1551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 1899) took 1334 ms (client timeout 1630 ms). Trace:
I20260709 12:59:45.096514  3504 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:45.046973  1626 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:45.145084  1523 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:45.151573  1560 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:45.069193  3618 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.112458  3592 consensus_queue.cc:1059] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:59:45.056385  3591 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:45.118487  3380 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:45.116418  3569 raft_consensus.cc:697] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:45.139892  3602 raft_consensus.cc:740] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:45.141826  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:45.155535   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:45.146780  3525 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:45.068953  3606 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.167s
I20260709 12:59:45.143639  3475 raft_consensus.cc:740] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:45.138183  3559 consensus_queue.cc:1243] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer 8106dfc0bda54df0ae10ba13c28ccc18 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:45.163190  1523 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:45.143178  3506 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:45.165645  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 219939us
I20260709 12:59:45.146786  3455 raft_consensus.cc:697] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:45.153529  3504 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:45.168706  3583 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.682s	user 0.013s	sys 0.000s
W20260709 12:59:45.208135  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 45083.4us
W20260709 12:59:45.150988  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 351517us
I20260709 12:59:45.200361  3525 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:45.220148  3591 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:45.238148  3591 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.238560  3591 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.242877  1707 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:59:45.149865  1551 rpcz_store.cc:269] 0709 12:59:43.731465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.734220 (+  2755us) service_pool.cc:224] Handling call
0709 12:59:45.065268 (+1331048us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b54001d74d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:45.065435 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34625280}
I20260709 12:59:45.234256  1599 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 12:59:45.208935  3515 consensus_meta.cc:287] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.761s	user 0.015s	sys 0.000s
W20260709 12:59:45.244335  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.252250  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:45.239671  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:45.230348  3267 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.250116  3312 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:45.359962  3312 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:45.239096  3624 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:45.201702  3579 consensus_queue.cc:1059] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 12:59:45.323896  3434 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.001s
I20260709 12:59:45.218062  3484 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:59:45.320812  3628 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.253973  3576 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:45.251147  3583 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.311564  1632 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:45.315253  3638 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 12:59:45.335886  3626 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:59:45.239496  3622 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:45.315958  3596 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:45.293074  3515 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:45.330742  3569 consensus_queue.cc:237] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:45.243413  3620 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:45.346005  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 237566us
I20260709 12:59:45.274740  3475 consensus_queue.cc:260] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:45.293467  2324 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:45.249689  1599 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:45.231870  3504 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.280999  2323 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:45.205958  3380 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:45.360433  3312 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.360134  3267 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.374832  3640 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.303159  3506 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:45.331200  3602 consensus_queue.cc:260] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:45.376075  1700 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:45.662979  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2303) took 1058 ms. Trace:
I20260709 12:59:45.664834  1707 rpcz_store.cc:276] 0709 12:59:44.592494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.594781 (+  2287us) service_pool.cc:224] Handling call
0709 12:59:44.595119 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.243299 (+648180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.650235 (+406936us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b540012d9d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:45.650522 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1473285376}
I20260709 12:59:45.379328  2327 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:59:45.604140  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:45.668272  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 418589us
I20260709 12:59:45.669981  3641 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:45.670691  3641 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:45.363309  3580 consensus_meta.cc:287] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.001s
W20260709 12:59:45.640410  3623 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.464s	user 0.000s	sys 0.006s
W20260709 12:59:45.647585  3570 consensus_meta.cc:287] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.206s	user 0.000s	sys 0.012s
I20260709 12:59:45.490389  3592 raft_consensus.cc:3055] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:45.707756  3591 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.377864  3537 raft_consensus.cc:3055] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:45.491005  3632 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:59:45.706080  3267 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:45.707640  3644 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.648471  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1707) took 1158 ms. Trace:
I20260709 12:59:45.598582  3564 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:45.596312  3550 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:45.695619  3620 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:45.676194  3596 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:45.759584  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:45.759756  3596 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:45.688894  3576 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.761363  3576 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.766636  1673 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:45.646070  3542 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:45.666910  3622 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.698633  3449 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:45.711499  3571 consensus_meta.cc:287] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.000s
I20260709 12:59:45.676045  3628 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.703963  3580 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:45.698408  3617 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:45.708426  3592 raft_consensus.cc:740] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:45.753867  3515 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:45.675173  3434 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.676373  3583 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.776512  3633 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:45.814471  3417 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:45.815057  3417 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:45.815717  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.815773  3504 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.801019  3449 raft_consensus.cc:697] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:45.817606  3449 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.818790  3504 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:45.778954  3585 consensus_meta.cc:287] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.017s	user 0.008s	sys 0.005s
I20260709 12:59:45.725517  3643 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:59:45.410629  3624 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:45.790602  3609 consensus_meta.cc:287] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.972s	user 0.010s	sys 0.003s
I20260709 12:59:45.724220  3537 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:45.416474  3601 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.797353  3641 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:45.801199  2324 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:45.846235  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 150081us
I20260709 12:59:45.846428  2324 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:45.846582  2323 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 12:59:45.797927  3649 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.715049  3631 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.473899  3455 consensus_queue.cc:237] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:45.727427  1626 rpcz_store.cc:276] 0709 12:59:44.489812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.492524 (+  2712us) service_pool.cc:224] Handling call
0709 12:59:45.648176 (+1155652us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54001bb554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:45.648349 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804646656}
I20260709 12:59:45.813637  3591 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:45.814304  3633 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.780427  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:45.737845  3564 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:45.705217  3640 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.818835  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 1915) took 1306 ms. Trace:
I20260709 12:59:45.812249  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:59:45.823398  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.781148  3483 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.791225  3562 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.810052  3569 consensus_queue.cc:1059] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:45.813491  3380 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:45.870141  3558 consensus_meta.cc:287] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.978s	user 0.011s	sys 0.002s
I20260709 12:59:45.799146  3570 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:45.789948  3622 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.857832  2325 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:45.819989  3585 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.847478  2324 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.821601  3583 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:45.866146  3506 consensus_queue.cc:1059] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:45.866340  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:45.905987  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:45.866916  3634 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:45.866994  3537 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.794682  3542 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.845709  3434 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.799695  3571 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.874289  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2293) took 1216 ms. Trace:
W20260709 12:59:45.863298  3415 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.698s	user 0.013s	sys 0.001s
I20260709 12:59:45.733664  3644 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.928193  3644 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:45.884841  3312 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:59:45.880896  1554 rpcz_store.cc:276] 0709 12:59:44.512615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.512761 (+   146us) service_pool.cc:224] Handling call
0709 12:59:44.513138 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.817501 (+1304363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.818000 (+   499us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:45.818045 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:45.818077 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.818626 (+   549us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000569d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:45.818668 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.818782 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2998988544}
I20260709 12:59:45.704152  3638 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.872543  3636 raft_consensus.cc:3055] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:45.852936  3641 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:59:45.856151  3584 consensus_queue.cc:1059] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:59:45.867195  3631 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.886070  3515 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:45.895120  3483 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:45.904729  3564 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.909412  3603 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:45.916107  2324 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.847632  3609 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.921109  1632 rpcz_store.cc:276] 0709 12:59:44.657896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.697717 (+ 39821us) service_pool.cc:224] Handling call
0709 12:59:45.874053 (+1176336us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b5400204c54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:45.874207 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403399936}
I20260709 12:59:45.922870  3415 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:45.881544  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 69373.3us
W20260709 12:59:45.950678  3526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.011s	sys 0.019s
I20260709 12:59:45.895973  3592 consensus_queue.cc:260] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:45.952672  3526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.011s	sys 0.019s
I20260709 12:59:45.928462  3601 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:45.897687  3562 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:45.953397  3592 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:45.954325  3588 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:45.955070  3562 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:45.953416  1704 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:45.912814  3580 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:45.946913  3312 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:45.895119  3617 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.956243  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:45.917868  3503 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:45.921962  3550 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.913128  3417 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:45.961409  3617 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:45.963028  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:45.904121  3570 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:45.979607  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 12:59:45.982087  3647 consensus_queue.cc:1175] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" responder_term: 2 status { last_received { term: 1 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: [1.3-1.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:59:45.985757  3638 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:45.944926  3537 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:45.992934  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:45.950361  3624 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:45.946198  3636 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:45.995096  1673 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:45.949659  3644 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:46.000679  3628 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.013176  3628 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.013736  3628 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:45.999564  1673 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.046s (SENT)
I20260709 12:59:46.000243  3515 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:46.015259  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:45.990259  3564 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.023944  3655 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:46.025242  3542 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.015327  3583 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:46.021934  3515 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:45.989530  3526 consensus_queue.cc:1059] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:59:46.034650  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 294) took 1695 ms. Trace:
W20260709 12:59:46.037524  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.978348  3506 consensus_queue.cc:1059] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:59:45.989984  3569 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:46.036502  1557 rpcz_store.cc:276] 0709 12:59:44.339647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.339873 (+   226us) service_pool.cc:224] Handling call
0709 12:59:44.349841 (+  9968us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.351203 (+  1362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.351231 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:44.447221 (+ 95990us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b2c00000658. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2
0709 12:59:44.447802 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.672480 (+224678us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:44.673465 (+   985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.034037 (+1360572us) spinlock_profiling.cc:243] Waited 997 us on lock 0x7b54001d79d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:46.034089 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.034145 (+    56us) raft_consensus.cc:1685] finished
0709 12:59:46.034159 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.034576 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":362,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":9914,"spinlock_wait_cycles":4662784,"thread_start_us":205328,"threads_started":1,"wal-append.queue_time_us":315209,"wal-append.run_cpu_time_us":2551,"wal-append.run_wall_time_us":1088017}
I20260709 12:59:45.951687  3620 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:46.041217  3638 raft_consensus.cc:3055] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:46.036003  3562 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:46.035964  3624 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:46.040978  3569 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.039422  3515 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:46.063807  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:46.069396  3312 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.072291  2323 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:46.072343  3312 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.071096  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:46.042112  3655 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:46.070255  1675 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:46.046085  3631 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.091272  3312 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:46.091138  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:46.048523  3638 raft_consensus.cc:740] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:46.094465  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:46.028245  3644 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.113600  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:46.114804  1634 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 2: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:46.067816  3417 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.106814  3415 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.061417  3641 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:46.097697  1598 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:45.947533  3634 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:46.131822  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.086208  3655 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:46.136919  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 337589us
I20260709 12:59:46.092881  3633 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.109889  3562 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.125597  3607 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:46.148277  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:46.149187  1700 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:46.085983  3380 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:59:46.001068  3603 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.122390  3596 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:46.085764  3624 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.153200  1702 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:46.129979  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:46.132205  3585 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.138607  3631 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:46.130180  3619 raft_consensus.cc:3055] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:46.170186  3634 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:46.170715  3590 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.142802  3571 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.190989  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:46.130554  3417 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.200095  1554 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:46.201256  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 12:59:46.171409  3525 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.922s	user 0.010s	sys 0.002s
I20260709 12:59:46.190358  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:46.197968  1703 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:59:46.164868  3594 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.202322  3312 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.211104  3312 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.212173  3569 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:46.213366  3312 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:46.213469  1551 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:46.213824  3624 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.165354  3638 consensus_queue.cc:260] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.157058  3415 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:46.172305  3542 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.171132  3576 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.207980  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:46.142163  3641 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.177997  3631 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.221824  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:46.214900  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:46.228302  1705 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:46.177377  3643 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.190552  3619 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:46.156432  3562 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.191429  3609 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:46.232075  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:46.150756  3640 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.233814  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:46.205166  3570 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.205766  3620 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.200138  3628 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:46.235203  1634 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:46.232136  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:46.209733  3607 raft_consensus.cc:697] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:46.173321  3596 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.224499  3585 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:46.226907  3631 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:46.253765  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.228498  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:46.258425  2327 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:46.250703  1702 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:46.225157  3594 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.239212  1551 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:46.226342  3415 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.221154  3525 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.174321  3636 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.245858  3380 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.237445  3643 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.274556  3666 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:46.228473  3542 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:46.277478  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.192915  3566 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:59:46.246572  3599 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:46.275312  3619 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.248896  3620 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.259419  3585 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.286857  3380 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:46.303951  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.295753  2324 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:59:46.339447  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 419033us
I20260709 12:59:46.355543  3312 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.356323  3312 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.364110  3658 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 12:59:46.336985  3663 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.122s	user 0.000s	sys 0.002s
W20260709 12:59:46.318969  3661 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:59:46.337138  3449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.054s	sys 0.038s
I20260709 12:59:46.372718  1705 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:46.369807  3417 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.375069  3312 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.326162  3619 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.324338  3617 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:59:46.298386  3620 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:46.399953  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:46.298451  3525 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:46.361456  3581 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:59:46.381613  3562 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.385623  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:46.375440  3647 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:59:46.365648  3624 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.364933  3590 consensus_queue.cc:1059] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:59:46.475190  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.327116  3644 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:46.392139  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:46.476009  1705 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 12:59:46.392139  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:46.477872  1635 raft_consensus.cc:2393] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:46.479017  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:46.479250  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:46.470963  3662 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:46.479842  1701 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.479902  3580 raft_consensus.cc:3055] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:46.396318  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:46.398171  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:46.400839  1700 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:46.481072  1709 raft_consensus.cc:2410] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:59:46.342926  3603 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:46.438987  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:46.328876  3654 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 12:59:46.489718  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:46.388901  3449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.054s	sys 0.038s
I20260709 12:59:46.433868  1633 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:46.325760  3622 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.310875  3515 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.374756  3665 consensus_queue.cc:1059] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:59:46.435541  3649 raft_consensus.cc:3055] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:46.470649  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:46.441888  1627 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:46.472460  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:46.472834  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:46.473519  3483 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:46.473450  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:46.474200  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:46.477100  1556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1654) took 1529 ms (client timeout 2009 ms). Trace:
I20260709 12:59:46.480024  1705 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.329288  3656 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.304181  3599 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.481846  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:46.337236  3576 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.309587  3596 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:46.388147  3641 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:46.480189  3662 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.485726  3590 raft_consensus.cc:3055] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:46.480542  3580 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:46.399798  3558 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 12:59:46.406401  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.561299  1705 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 12:59:46.333914  3607 consensus_queue.cc:237] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.321040  3666 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.504196  1559 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.567665  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:46.568455  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.525877  3542 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:46.577986  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.504220  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:46.578918  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:46.517760  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:46.579967  1634 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:46.518684  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:46.520215  1557 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 12:59:46.364773  3658 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.561101  1631 raft_consensus.cc:2393] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:46.582820  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 680) took 1464 ms. Trace:
I20260709 12:59:46.583611  2325 rpcz_store.cc:276] 0709 12:59:45.106635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.107582 (+   947us) service_pool.cc:224] Handling call
0709 12:59:45.107887 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.901877 (+793990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.570090 (+668213us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54004551d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:46.570282 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1723901824}
I20260709 12:59:46.524327  1627 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:46.524783  1552 raft_consensus.cc:2368] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 3. Current term is 4.
I20260709 12:59:46.521337  1626 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:46.504451  3654 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.591125  3643 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.492396  3592 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:46.601969  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:46.534876  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1942) took 1176 ms. Trace:
I20260709 12:59:46.501690  3504 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:46.535370  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:46.509326  3415 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:46.609864  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:46.610535  2323 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
W20260709 12:59:46.547818  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.617228  3657 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.617241  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:46.617267  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:46.623837  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2307) took 1560 ms. Trace:
I20260709 12:59:46.625345  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:46.507503  3649 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:46.527010  3506 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:46.564754  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:46.522766  3594 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:46.488492  3624 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.504843  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:46.658308  1560 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:46.572171  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:46.659245  1707 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.581248  1633 raft_consensus.cc:2393] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 2: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 12:59:46.522266  1556 rpcz_store.cc:269] 0709 12:59:44.947571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.959341 (+ 11770us) service_pool.cc:224] Handling call
0709 12:59:45.054698 (+ 95357us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960eee 0000000000375939 00007f0ede9d41e0 00007f0edea9d0c4 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 12:59:46.385504 (+1330806us) spinlock_profiling.cc:243] Waited 958 us on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960f8c 00007f0ed6960ef6 0000000000375939 00007f0ede9d41e0 00007f0edea9d0c4 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 12:59:46.477040 (+ 91536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5918848}
I20260709 12:59:46.538345  3590 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:46.600932  1701 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:46.602774  2327 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:46.602839  1708 rpcz_store.cc:276] 0709 12:59:45.358820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.358981 (+   161us) service_pool.cc:224] Handling call
0709 12:59:45.374938 (+ 15957us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.844795 (+469857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.844838 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.851819 (+  6981us) log.cc:844] Serialized 26 byte log entry
0709 12:59:46.136203 (+284384us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:46.136245 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.298566 (+162321us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b54002535d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:46.298619 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.534397 (+235778us) raft_consensus.cc:1685] finished
0709 12:59:46.534509 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.534793 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22441,"raft.queue_time_us":25944,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":4986,"spinlock_wait_cycles":1027890560,"thread_start_us":263055,"threads_started":1,"wal-append.queue_time_us":312480}
I20260709 12:59:46.608134  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:46.624284  1704 rpcz_store.cc:276] 0709 12:59:45.063809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.084732 (+ 20923us) service_pool.cc:224] Handling call
0709 12:59:45.116674 (+ 31942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.956078 (+839404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.623614 (+667536us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54003ec6d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:46.623780 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1923419520}
I20260709 12:59:46.607259  3630 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.591676  3559 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.646833  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:46.549141  3631 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.570395  3558 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.649626  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:46.666051  2323 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.667346  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:46.650310  3666 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.609354  3380 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:46.587137  3609 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.615875  3504 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:59:46.617848  3657 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.661157  3506 raft_consensus.cc:697] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:46.582768  3656 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.665988  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:46.670184  3515 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.644755  3592 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.670498  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:46.604799  3585 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.685676  1558 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:46.644209  3580 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.699769  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:46.709918  2321 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.719521  2326 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:46.712894  2327 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:59:46.665681  3630 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.750771  3506 consensus_queue.cc:237] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.688902  3609 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.742086  1707 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
W20260709 12:59:46.743468  2329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.097s	sys 0.105s
I20260709 12:59:46.672386  3559 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:46.751181  3654 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.879745  3585 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:46.774452  2323 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 12:59:46.863642  3622 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:46.880668  3585 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.881856  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:46.792845  3455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.001s	sys 0.049s
I20260709 12:59:46.862191  3579 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.887321  3579 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:46.886535  3455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.001s	sys 0.061s
I20260709 12:59:46.889726  3602 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.722357  3658 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:46.832188  2321 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
W20260709 12:59:46.880029  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:46.820653  1673 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.011s	sys 0.041s
W20260709 12:59:46.879739  2329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.105s	sys 0.107s
I20260709 12:59:46.750773  3662 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:46.893906  1673 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.018s	sys 0.045s
I20260709 12:59:46.894094  3580 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:46.828708  3660 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:46.886011  3574 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:46.894732  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 694540us
I20260709 12:59:46.882681  3609 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:46.938535  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:46.916704  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.703265  1631 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.960669  3585 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:46.973423  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:46.986099  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:46.986883  2325 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:46.762125  3537 consensus_meta.cc:287] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.769s	user 0.009s	sys 0.002s
I20260709 12:59:47.124477  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:46.908916  3579 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.989399  3585 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:47.114904  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.113093  3631 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:46.710909  3590 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:46.902323  3660 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.149832  3660 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:46.886637  3630 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:47.162313  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:47.172170  3657 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:47.173626  3599 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:47.182855  3558 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:47.185187  3564 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.146s	user 0.016s	sys 0.000s
I20260709 12:59:47.186251  2323 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 12:59:47.132853  3643 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.187505  3643 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.163975  3585 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.194293  3585 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:47.203620  3656 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:47.136907  3592 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:47.212764  3624 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:47.216423  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.221987  3504 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:47.226955  1631 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
W20260709 12:59:47.235005  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.197304  3643 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:47.250975  1709 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 12:59:47.253156  2322 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:46.791698  3649 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:47.244534  3655 consensus_meta.cc:287] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.095s	user 0.014s	sys 0.000s
W20260709 12:59:47.247316  3619 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.858s	user 0.006s	sys 0.006s
W20260709 12:59:47.241117  1559 consensus_meta.cc:287] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.664s	user 0.012s	sys 0.000s
I20260709 12:59:47.267940  3636 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:47.279098  3434 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:47.288188  3590 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:47.294592  3631 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:47.473528  2328 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:47.309899  3576 raft_consensus.cc:3055] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:47.311134  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:47.100070  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 192611us
W20260709 12:59:47.386214  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.390681  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:47.408263  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.347s	user 0.026s	sys 0.088s
W20260709 12:59:47.408861  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.322s	user 0.025s	sys 0.092s
W20260709 12:59:47.489116  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.489251  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.403s	user 0.025s	sys 0.096s
I20260709 12:59:47.489308  1634 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:47.329427  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:47.372849  2325 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:47.355621  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 520) took 1397 ms. Trace:
I20260709 12:59:47.328871  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:47.489133  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.447s	user 0.029s	sys 0.092s
W20260709 12:59:47.450839  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.335479  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 12:59:47.316438  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.389914  3606 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.388764  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:47.506294  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:47.506757  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:47.507397  2320 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:47.507773  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.329993  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:47.499280  1709 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:47.508543  3633 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:47.501091  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:47.503660  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 168236us
I20260709 12:59:47.509378  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:47.509150  3633 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.508431  2322 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.509987  1702 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 12:59:47.501324  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:47.511600  1701 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:47.333680  3537 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:47.507450  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:47.512274  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:47.512727  2328 raft_consensus.cc:2393] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 3: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:47.491750  2329 rpcz_store.cc:276] 0709 12:59:45.957739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.957935 (+   196us) service_pool.cc:224] Handling call
0709 12:59:45.958285 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.958859 (+   574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.958886 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.959459 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:59:46.894210 (+934751us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:46.894250 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.894333 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.355314 (+460981us) raft_consensus.cc:1685] finished
0709 12:59:47.355342 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.355533 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1944,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":142,"thread_start_us":934357,"threads_started":1,"wal-append.queue_time_us":1393083}
I20260709 12:59:47.476990  3475 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.526175  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:47.477315  3647 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.535876  1700 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.542178  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:47.477806  3576 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:47.494208  3649 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.492166  3603 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:47.553787  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.545509  1708 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:47.548269  1523 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:47.502148  3559 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:47.558276  1523 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:47.560659  1523 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:47.511700  1559 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:47.504947  3602 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.565718  1523 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:47.513947  3434 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:47.513743  3606 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:47.486035  3631 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.584785  1700 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
W20260709 12:59:47.586901  1632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.341s	user 0.046s	sys 0.093s
W20260709 12:59:47.587337  1632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.341s	user 0.047s	sys 0.093s
I20260709 12:59:47.568487  1523 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 12:59:47.581766  1599 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.387s	user 0.193s	sys 0.340s
I20260709 12:59:47.576916  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:47.511488  3574 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:47.588321  1599 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.394s	user 0.194s	sys 0.341s
W20260709 12:59:47.588860  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 1.39418e+06us
I20260709 12:59:47.591303  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:47.592334  1556 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 12:59:47.491542  1673 connection.cc:256] RPC call timeout handler was delayed by -1.2621865920000346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 12:59:47.597237  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1721865920000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
W20260709 12:59:47.598594  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.331286  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.342697  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.559372  1626 raft_consensus.cc:2393] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:47.547174  3675 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:47.541128  3575 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:47.587421  3434 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.585155  3624 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:47.615576  3657 consensus_queue.cc:1059] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:47.620970  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:47.642872  1556 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.568778  3504 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:47.584239  3643 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:47.512928  2324 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:47.614997  3631 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:47.646401  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:47.569227  3619 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:47.610240  3592 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:47.563989  3596 consensus_queue.cc:1059] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:59:47.568195  3603 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.658004  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:47.327194  3622 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:47.552762  3647 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:47.546838  3537 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.648288  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2312) took 1029 ms. Trace:
I20260709 12:59:47.624691  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 300) took 1827 ms. Trace:
I20260709 12:59:47.390774  3638 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.626886  3575 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:47.633771  3599 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:59:47.669831  3631 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.641723  3624 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:47.685802  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:47.610535  3585 consensus_queue.cc:1059] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:59:47.394899  3591 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:47.617787  3574 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:47.700228  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:47.684171  1627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.023s	user 0.061s	sys 0.090s
I20260709 12:59:47.669262  3504 raft_consensus.cc:697] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:47.585772  3602 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.672145  3619 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:47.668030  3592 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:47.669560  3643 raft_consensus.cc:697] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:47.648694  3576 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:47.775101  3584 raft_consensus.cc:3055] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:47.715099  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:47.619938  3655 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.721650  3624 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.724973  3631 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.786983  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:47.716926  2327 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:47.765098  3592 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:47.725251  1703 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.480s	user 0.123s	sys 0.262s
I20260709 12:59:47.684613  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 682) took 1062 ms. Trace:
I20260709 12:59:47.723702  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:47.791124  2328 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
W20260709 12:59:47.734889  1627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.062s	sys 0.091s
I20260709 12:59:47.691087  3633 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:47.711483  3575 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:47.756805  1633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.086s	user 0.010s	sys 0.015s
W20260709 12:59:47.795076  1633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.011s	sys 0.015s
I20260709 12:59:47.762389  3619 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:47.787663  1558 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:47.636106  3675 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:47.790592  1703 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.545s	user 0.123s	sys 0.262s
I20260709 12:59:47.743613  3591 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:47.815259  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.311s	user 0.004s	sys 0.013s
W20260709 12:59:47.815796  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.323s	user 0.004s	sys 0.013s
W20260709 12:59:47.816444  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 1.3773e+06us
I20260709 12:59:47.698813  1626 rpcz_store.cc:276] 0709 12:59:46.618438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.648075 (+ 29637us) service_pool.cc:224] Handling call
0709 12:59:47.310900 (+662825us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b5800153f98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 12:59:47.638927 (+328027us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8375168}
I20260709 12:59:47.796823  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:47.699306  3622 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.780418  3584 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:47.823871  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:47.826550  2323 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:47.839212  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:47.839869  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:47.810305  3576 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.847990  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:47.854719  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:47.855595  1628 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:47.858734  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:47.859823  1558 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
W20260709 12:59:47.863531  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.889796  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:47.891215  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:47.892122  1631 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:47.893479  3631 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:47.894248  3631 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.894796  3631 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.896967  3584 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.898326  3584 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:47.901211  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 381) took 1732 ms. Trace:
I20260709 12:59:47.902302  2329 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:59:47.897274  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:47.907284  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.901661  1632 rpcz_store.cc:276] 0709 12:59:46.174183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.174366 (+   183us) service_pool.cc:224] Handling call
0709 12:59:46.198083 (+ 23717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.198519 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.198548 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:46.216657 (+ 18109us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.587842 (+1371185us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:47.587884 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.587953 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.900941 (+312988us) raft_consensus.cc:1685] finished
0709 12:59:47.900962 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.901123 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":635,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":7984,"thread_start_us":1341696,"threads_started":1,"wal-append.queue_time_us":1591114}
I20260709 12:59:47.926988  3675 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:47.829566  3504 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:47.929500  3655 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:47.933707  3574 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:47.846366  3606 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:47.941524  3606 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.942130  3606 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:47.794921  2326 rpcz_store.cc:276] 0709 12:59:46.605487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.609236 (+  3749us) service_pool.cc:224] Handling call
0709 12:59:47.650053 (+1040817us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b5400783a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:47.667484 (+ 17431us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85795200}
I20260709 12:59:47.946513  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:47.947654  2326 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 4: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:47.856739  3643 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:47.955322  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.957434  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.006s	sys 0.029s
W20260709 12:59:47.958745  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.006s	sys 0.029s
I20260709 12:59:47.703733  1559 rpcz_store.cc:276] 0709 12:59:45.791191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.794337 (+  3146us) service_pool.cc:224] Handling call
0709 12:59:46.488769 (+694432us) spinlock_profiling.cc:243] Waited 9.76 ms on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 12:59:46.504058 (+ 15289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.569116 (+1065058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.618814 (+ 49698us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22445952}
I20260709 12:59:47.970808  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:47.961340  2323 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 12:59:47.971705  2324 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 2: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:47.984457  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:48.006186  1598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.004s	sys 0.022s
I20260709 12:59:48.010003  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:47.986325  2286 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:48.008939  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:48.010392  1598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.005s	sys 0.022s
I20260709 12:59:48.012543  1558 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:47.936247  2322 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:48.012660  1553 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:48.013748  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:48.016896  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.004s	sys 0.033s
W20260709 12:59:48.018307  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.004s	sys 0.033s
I20260709 12:59:48.020663  1672 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 12:59:47.972457  3607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.009s	sys 0.016s
I20260709 12:59:48.047709  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:48.055305  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.008s	sys 0.034s
I20260709 12:59:48.016687  3564 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:48.048614  3580 consensus_meta.cc:287] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.153s	user 0.012s	sys 0.002s
W20260709 12:59:48.033784  3607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.010s	sys 0.020s
I20260709 12:59:48.033020  3647 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:48.039664  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:48.109362  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.006s	sys 0.027s
W20260709 12:59:48.175159  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.006s	sys 0.027s
W20260709 12:59:48.016672  3506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.011s	sys 0.019s
I20260709 12:59:48.054008  3537 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:48.026227  3633 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:48.055672  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.008s	sys 0.034s
I20260709 12:59:48.071702  3564 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.142359  3602 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:48.025408  1672 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 12:59:48.153210  1554 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.012s	sys 0.034s
I20260709 12:59:48.021267  3656 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.153751  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.149180  3574 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:48.153404  3606 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:48.185004  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.186702  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.204042  1556 consensus_meta.cc:287] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.561s	user 0.016s	sys 0.004s
I20260709 12:59:48.205513  1556 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
W20260709 12:59:48.205621  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 180273us
W20260709 12:59:48.192628  1554 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.013s	sys 0.034s
W20260709 12:59:48.201331  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.194509  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.221824  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:48.177811  3506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.011s	sys 0.020s
I20260709 12:59:48.246176  1557 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:48.207806  3682 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.198453  3564 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.183740  3633 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.254375  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.255286  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.207841  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1671) took 1773 ms. Trace:
I20260709 12:59:48.265583  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.265609  1551 rpcz_store.cc:276] 0709 12:59:46.434405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.435275 (+   870us) service_pool.cc:224] Handling call
0709 12:59:46.435618 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.508864 (+1073246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.508904 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:47.508948 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:47.508998 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.183630 (+674632us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000b81d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:48.190278 (+  6648us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.201829 (+ 11551us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19312,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":33939,"spinlock_wait_cycles":2386608896}
I20260709 12:59:48.267653  3687 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.244230  3602 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:48.268944  3506 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.268491  3602 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:48.269593  3602 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.269706  3506 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:48.271940  3506 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:48.261178  1705 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:48.261559  3683 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.275226  3564 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.276396  2325 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:48.176986  3631 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:48.263108  2320 consensus_meta.cc:287] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.755s	user 0.016s	sys 0.004s
I20260709 12:59:48.278196  2320 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:48.263926  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.200338  3656 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.260529  3682 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.207907  3574 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.272637  3655 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:48.273432  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 316) took 2074 ms. Trace:
W20260709 12:59:48.274430  3590 consensus_meta.cc:287] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.782s	user 0.007s	sys 0.012s
I20260709 12:59:48.245654  3606 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:48.279484  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:48.262465  3681 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:59:48.281891  1672 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:48.274893  3683 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.286139  3684 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.245344  3679 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:48.268253  3687 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:48.284024  3633 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.289112  3581 raft_consensus.cc:3055] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:48.289273  3564 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:48.293643  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1679) took 1855 ms. Trace:
I20260709 12:59:48.294602  3596 raft_consensus.cc:3055] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:48.309891  1702 raft_consensus.cc:2393] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:48.305382  1703 rpcz_store.cc:276] 0709 12:59:46.198531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.206346 (+  7815us) service_pool.cc:224] Handling call
0709 12:59:46.206574 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:46.206750 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:47.803688 (+1596938us) log.cc:844] Serialized 14 byte log entry
0709 12:59:48.272399 (+468711us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:48.272454 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:48.272508 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.273253 (+   745us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.273378 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21253,"prepare.queue_time_us":1774078,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":22629,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":2000012,"threads_started":2}
I20260709 12:59:48.378437  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:48.377592  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 394195us
W20260709 12:59:48.379289  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.379567  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.312515  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:48.315315  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.310993  3591 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:48.380712  1705 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:48.323521  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:48.324795  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 280273us
I20260709 12:59:48.324903  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.326315  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:48.377661  1557 rpcz_store.cc:276] 0709 12:59:46.438631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.581286 (+142655us) service_pool.cc:224] Handling call
0709 12:59:46.582570 (+  1284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.247452 (+1664882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.293408 (+ 45956us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54002206d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:48.293583 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3824741760}
W20260709 12:59:48.383019  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 56766.4us
W20260709 12:59:48.340492  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.372771  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 196759us
I20260709 12:59:48.381953  1700 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
W20260709 12:59:48.332368  3636 consensus_meta.cc:287] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.866s	user 0.010s	sys 0.014s
I20260709 12:59:48.380153  1703 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:48.376320  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.394431  1706 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:48.380018  1523 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 12:59:48.385697  1673 connection.cc:256] RPC call timeout handler was delayed by -1.0764359480000394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2217s for a response
I20260709 12:59:48.397900  1700 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:48.400359  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:59:48.377976  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 113156us
I20260709 12:59:48.383493  1454 catalog_manager.cc:5697] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 2 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 12:59:48.389106  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 76650.5us
W20260709 12:59:48.405026  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.407385  1526 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:48.383749  1672 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:59:48.418054  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.419091  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:48.420194  2325 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 2: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:48.402726  1454 catalog_manager.cc:5697] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 4 to 5, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.323652  3689 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:48.310603  3655 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.440164  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.441531  1700 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 3: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 12:59:48.432981  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 53079.1us
I20260709 12:59:48.431345  1454 catalog_manager.cc:5697] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 3, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.372668  3603 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:48.445349  1454 catalog_manager.cc:5697] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 3, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.373682  3581 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:48.451454  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:48.443334  1523 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 12:59:48.444777  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 129868us
I20260709 12:59:48.456643  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.416165  3662 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.400627  3607 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:48.431278  3685 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.388465  3596 raft_consensus.cc:740] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:48.323719  3606 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.432415  3689 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:48.334656  3684 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:48.457190  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:48.448009  3643 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:48.463725  1523 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 12:59:48.467860  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.457859  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 75344.6us
I20260709 12:59:48.482731  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.483507  1673 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:48.463577  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:48.437909  3591 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:48.457556  3564 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.472039  3592 consensus_meta.cc:287] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.669s	user 0.006s	sys 0.006s
W20260709 12:59:48.546386  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 82926.3us
I20260709 12:59:48.445549  3692 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:48.547297  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:48.374847  3679 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:48.549746  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 66320.3us
I20260709 12:59:48.559767  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:48.464650  2321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 524) took 1136 ms. Trace:
I20260709 12:59:48.557633  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:48.428567  3631 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:59:48.561548  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:48.565471  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.572034  1704 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:48.572953  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.495409  2320 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.472671  3590 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:48.555619  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 91934.7us
I20260709 12:59:48.577263  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.525765  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:48.579687  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.597803  1702 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
W20260709 12:59:48.556071  3575 consensus_meta.cc:287] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.744s	user 0.005s	sys 0.005s
W20260709 12:59:48.555774  3677 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.409s	user 0.000s	sys 0.002s
I20260709 12:59:48.581401  1706 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 3: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:48.472074  3690 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:48.562115  3576 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:48.579030  1673 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:48.568349  3585 raft_consensus.cc:2764] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:59:48.558506  3636 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:48.600669  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:48.615557  1706 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.567797  3643 raft_consensus.cc:697] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:48.558736  3688 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:59:48.619675  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.526273  3607 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:48.493619  3689 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.556500  3692 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:48.655838  1706 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:48.485299  3662 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:48.575114  3674 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:48.596547  3619 consensus_meta.cc:287] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.775s	user 0.005s	sys 0.005s
I20260709 12:59:48.558861  3580 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:48.616976  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:48.594730  3475 consensus_meta.cc:287] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.050s	user 0.008s	sys 0.004s
W20260709 12:59:48.601850  3649 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.035s	user 0.012s	sys 0.000s
I20260709 12:59:48.559468  3564 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.602445  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:48.558404  3592 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.606312  3690 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.596999  3647 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:48.722522  1708 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 12:59:48.613003  2286 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 12:59:48.658308  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 113225us
I20260709 12:59:48.609313  3576 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:48.634407  3584 consensus_meta.cc:287] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.735s	user 0.017s	sys 0.006s
W20260709 12:59:48.663450  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 84487.2us
I20260709 12:59:48.563367  2321 rpcz_store.cc:276] 0709 12:59:47.328677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.328799 (+   122us) service_pool.cc:224] Handling call
0709 12:59:47.329163 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.329652 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.329684 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:47.330666 (+   982us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.792648 (+461982us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:47.795287 (+  2639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.821846 (+ 26559us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:48.432317 (+610471us) raft_consensus.cc:1685] finished
0709 12:59:48.435838 (+  3521us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.460649 (+ 24811us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1913,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"thread_start_us":446650,"threads_started":1,"wal-append.queue_time_us":758155}
I20260709 12:59:48.733405  1673 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:48.734424  3622 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:48.663988  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 203197us
I20260709 12:59:48.735075  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.735745  1598 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 12:59:48.665632  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.618461  3590 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:48.615193  3636 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:48.657398  2326 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:48.680354  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:48.683223  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 80854.3us
I20260709 12:59:48.663174  3504 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:48.739223  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:48.652851  3673 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:48.723395  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 110437us
I20260709 12:59:48.723572  1599 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:48.597012  3596 consensus_queue.cc:260] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.659020  3692 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.632769  3603 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:59:48.663328  3574 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:48.607265  3575 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.680467  3654 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.661761  3704 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:48.729615  3537 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:48.731748  3592 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:48.737042  3631 consensus_queue.cc:1059] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 12:59:48.673765  3619 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.736122  1708 raft_consensus.cc:2410] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:59:48.664052  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:48.743319  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:48.872822  2325 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:48.872766  1706 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:48.744908  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 12:59:48.874212  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 129355us
I20260709 12:59:48.794931  3649 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:48.875648  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:48.745910  1702 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
W20260709 12:59:48.754719  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.793376  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 356622us
I20260709 12:59:48.737341  1703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ab117f13144a07986c484571fb73a2"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:48.749405  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2311) took 2131 ms. Trace:
I20260709 12:59:48.721966  3690 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.681811  3656 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:48.858105  3624 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.060s	user 0.012s	sys 0.000s
I20260709 12:59:48.800256  3682 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:48.747618  3691 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
W20260709 12:59:48.746371  3638 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.022s	user 0.000s	sys 0.015s
I20260709 12:59:48.734364  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:48.723511  3688 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.855578  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.811955  3654 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:48.856552  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.845882  3684 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:48.844707  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:48.871269  2327 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
W20260709 12:59:48.901229  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 166938us
W20260709 12:59:48.902697  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.903239  1673 leader_election.cc:400] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 3. Current term is 4.
I20260709 12:59:48.749428  3636 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.796955  3584 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:48.729334  3647 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:48.877422  1703 raft_consensus.cc:606] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:48.911254  1703 raft_consensus.cc:614] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:48.871829  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 130396us
I20260709 12:59:48.913136  2286 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:48.878019  1633 rpcz_store.cc:276] 0709 12:59:46.618153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.664181 (+ 46028us) service_pool.cc:224] Handling call
0709 12:59:46.669789 (+  5608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.670145 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.670173 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:46.670677 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.795520 (+1124843us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:47.795561 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.795627 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:48.749185 (+953558us) raft_consensus.cc:1685] finished
0709 12:59:48.749216 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.749346 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4243,"raft.queue_time_us":10017,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":22345,"thread_start_us":1124447,"threads_started":1,"wal-append.queue_time_us":1350913}
I20260709 12:59:48.691627  3585 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:48.800889  3504 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:48.735026  3622 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.738735  3590 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.892915  1556 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:48.928838  1630 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:48.893108  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:48.856714  3537 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.893796  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:48.888527  3687 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:48.810309  3710 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.895493  1555 raft_consensus.cc:2393] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 2: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:48.857460  3696 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:48.899097  3679 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:48.844441  3655 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:48.847632  3707 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:48.809916  3434 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:48.876049  3704 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.903565  1673 leader_election.cc:403] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:59:48.942843  1673 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:48.905669  1560 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:48.883942  3649 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:48.898514  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 153561us
I20260709 12:59:48.888267  3596 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.915251  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:48.891050  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:48.928227  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:48.894583  1708 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:59:48.888509  3631 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:59:48.738919  3576 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.912465  3688 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.899917  3606 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:48.944233  1673 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:48.946710  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:48.905113  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:48.899622  3714 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:48.815413  3607 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.947273  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:48.927877  3647 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.799857  3643 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.931264  3592 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:48.951077  1557 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:59:48.970794  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:49.033409  3580 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 12:59:49.033684  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 63019us
I20260709 12:59:49.033993  3580 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:49.034663  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:48.945245  3675 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.968708  3584 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.935313  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:48.911927  2321 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:48.998471  2325 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:48.996973  3714 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.945775  1554 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:48.925662  3585 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:48.899078  3624 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:48.997485  3713 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:48.933841  3537 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:49.032433  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 88268.8us
W20260709 12:59:48.935824  3602 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.663s	user 0.008s	sys 0.004s
I20260709 12:59:48.970938  1598 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:48.948459  3711 raft_consensus.cc:3055] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:49.005367  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:48.945264  3710 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:48.982108  3699 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
W20260709 12:59:49.079249  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 194346us
W20260709 12:59:49.042233  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.968544  3655 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 3. Current term is 4.
I20260709 12:59:49.114662  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:48.948498  3649 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:49.005927  3676 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.056s	user 0.006s	sys 0.000s
I20260709 12:59:48.994726  3434 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:49.087750  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 345771us
I20260709 12:59:48.997483  3707 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:48.981436  3673 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:49.031824  3702 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.391s	user 0.001s	sys 0.000s
W20260709 12:59:49.001302  3701 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:59:49.083207  3714 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:49.090708  3575 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:49.104975  2324 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
W20260709 12:59:49.104988  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 70407.1us
I20260709 12:59:48.982993  3683 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:49.004866  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:49.036413  1552 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
W20260709 12:59:49.083928  3694 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.019s	sys 0.022s
I20260709 12:59:48.999017  3591 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:49.088848  3713 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:49.137423  3713 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:49.083369  3585 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:49.082926  3506 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:49.001346  3712 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.121s
W20260709 12:59:49.005053  3693 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 12:59:48.934746  3622 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:49.124027  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.104532  3711 raft_consensus.cc:740] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 12:59:49.128676  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 163670us
I20260709 12:59:49.132296  1601 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:49.133219  1526 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:49.133644  3706 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:49.134718  3704 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:49.151407  3706 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.145429  3564 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:49.134996  3696 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:49.157722  3706 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:49.091434  3675 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.172664  3707 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.173305  3636 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:49.147923  3619 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:49.152619  3580 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:49.138479  3434 raft_consensus.cc:697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:49.105204  1559 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:49.144135  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:49.187911  1708 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 12:59:49.122467  3673 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.146242  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:49.189411  1708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
new_leader_uuid: "6b9e73092f6146639bf310a3d18cfe37"
 from {username='slave'} at 127.0.0.1:56242
I20260709 12:59:49.105743  3602 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.135264  3690 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.130673  3721 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:49.140478  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:49.221341  2321 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:49.222292  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:49.223551  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:49.225805  3710 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:49.173170  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:49.228382  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2309) took 2575 ms. Trace:
I20260709 12:59:49.118816  1599 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:59:49.229905  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 111202us
W20260709 12:59:49.230355  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 317277us
I20260709 12:59:49.231290  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:49.179987  3622 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:49.185513  3729 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:49.186450  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 53316.9us
W20260709 12:59:49.180312  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48067.3us
I20260709 12:59:49.241461  1601 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:49.181736  1598 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:49.176481  3636 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:49.234514  1599 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:49.215193  2325 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:49.228964  1627 rpcz_store.cc:276] 0709 12:59:46.617486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.618573 (+  1087us) service_pool.cc:224] Handling call
0709 12:59:46.618862 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.619231 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.619259 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:46.619664 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.795884 (+1176220us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:47.795932 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.796013 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:48.900161 (+1104148us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 12:59:49.181362 (+281201us) raft_consensus.cc:1685] finished
0709 12:59:49.181381 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.193177 (+ 11796us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":23079,"spinlock_wait_cycles":51351936,"thread_start_us":1134763,"threads_started":1,"wal-append.queue_time_us":1301513}
I20260709 12:59:49.247493  3622 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.248208  3622 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.198194  3694 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:49.249454  3694 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:49.220244  3697 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.647s	user 0.000s	sys 0.003s
W20260709 12:59:49.248765  3674 consensus_meta.cc:287] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.000s
I20260709 12:59:49.255122  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:49.179430  3711 consensus_queue.cc:260] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.258543  1700 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:49.260389  3727 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:49.261202  3622 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:49.249652  3706 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.262851  3537 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.266719  3688 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:49.267097  3675 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:49.272994  3434 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.275933  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:49.180511  3591 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 12:59:49.317688  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.282212  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:49.283205  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:49.284622  3504 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:49.193096  3673 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:49.329299  3581 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.330436  3581 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:49.287487  2320 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.000s
W20260709 12:59:49.332863  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.335417  2320 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 12:59:49.338603  2320 pending_rounds.cc:85] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 2
I20260709 12:59:49.338996  2320 pending_rounds.cc:107] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:59:49.339438  2320 raft_consensus.cc:2917] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:59:49.339882  2320 raft_consensus.cc:2889] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:49.308096  3475 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:49.336503  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:49.341055  3475 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.341514  3475 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:49.342654  2324 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:49.346145  3537 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:49.258579  3729 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:49.347059  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1958) took 1846 ms. Trace:
I20260709 12:59:49.349623  3729 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:49.349112  3584 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:49.292086  3690 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:49.229298  3619 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:49.351897  3619 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:49.352438  3619 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:49.352576  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.355046  3602 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:49.252748  3696 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:59:49.292537  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2301) took 2894 ms (client timeout 2091 ms). Trace:
W20260709 12:59:49.357018  1630 rpcz_store.cc:269] 0709 12:59:46.397600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.397922 (+   322us) service_pool.cc:224] Handling call
0709 12:59:49.292169 (+2894247us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b5400246b54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:49.292421 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5628474752}
I20260709 12:59:49.294785  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:49.360138  1704 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:49.360942  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:49.360746  3673 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.361373  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:49.289891  3624 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:49.296361  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 61901.5us
I20260709 12:59:49.363903  1599 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:49.368774  3727 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:49.370733  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:49.371739  1559 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:49.372962  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:49.373798  1558 raft_consensus.cc:2410] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:49.297082  3712 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:49.374202  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:49.374411  3576 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.375007  1554 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:49.299018  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:49.376251  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:49.376837  2329 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 12:59:49.377038  1553 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
W20260709 12:59:49.337792  1555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 312) took 1541 ms (client timeout 1603 ms). Trace:
W20260709 12:59:49.378399  1555 rpcz_store.cc:269] 0709 12:59:47.796367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.796522 (+   155us) service_pool.cc:224] Handling call
0709 12:59:49.337476 (+1540954us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001d6ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:49.337706 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2469992704}
I20260709 12:59:49.379789  3576 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:49.379979  3688 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:49.380627  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:49.347667  1707 rpcz_store.cc:276] 0709 12:59:47.500237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.500980 (+   743us) service_pool.cc:224] Handling call
0709 12:59:47.527009 (+ 26029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:48.009379 (+482370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:48.009412 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:48.009896 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:59:48.317432 (+307536us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:48.317487 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.317585 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:49.219331 (+901746us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 12:59:49.346711 (+127380us) raft_consensus.cc:1685] finished
0709 12:59:49.346738 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.346990 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4118,"raft.queue_time_us":180655,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":11481,"spinlock_wait_cycles":52089088,"thread_start_us":743819,"threads_started":2,"wal-append.queue_time_us":410550}
I20260709 12:59:49.314754  3674 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:49.335438  3662 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:49.384492  3709 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:49.385428  3709 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.388175  3709 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:49.300417  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 118744us
I20260709 12:59:49.391482  1598 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 12:59:49.301363  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 60005.8us
I20260709 12:59:49.392381  1601 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:49.249826  3694 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:49.305032  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 50037.4us
I20260709 12:59:49.295228  3647 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:49.312898  3506 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:49.313515  3718 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:49.319605  1703 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 3: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:49.318131  3591 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:49.427311  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:49.427858  1633 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:49.302819  3704 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:49.317855  2321 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:49.321640  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:49.325765  2327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 525) took 1994 ms (client timeout 2291 ms). Trace:
I20260709 12:59:49.403692  3705 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:49.326665  1560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 310) took 1696 ms (client timeout 2035 ms). Trace:
W20260709 12:59:49.433884  1560 rpcz_store.cc:269] 0709 12:59:47.630757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.674046 (+ 43289us) service_pool.cc:224] Handling call
0709 12:59:49.326394 (+1652348us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540017edd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:49.326600 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2706553216}
W20260709 12:59:49.346797  1673 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.813s (SENT)
W20260709 12:59:49.435473  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 88680.2us
W20260709 12:59:49.288076  3633 consensus_meta.cc:287] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.897s	user 0.011s	sys 0.000s
I20260709 12:59:49.359398  3706 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:49.298072  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 12:59:49.298979  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.386787  3475 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:49.389137  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:49.390235  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:49.390456  3727 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:49.468524  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.307540  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.493407  1557 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
W20260709 12:59:49.398744  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.496320  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:49.497735  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:49.498181  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:49.499071  1703 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:49.500106  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:49.402822  3682 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:49.506523  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:49.403825  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:49.406280  3592 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.300163  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:49.513453  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:49.422225  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:49.514227  2325 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:49.416965  3506 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.426152  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:49.430989  1598 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 12:59:49.433207  2327 rpcz_store.cc:269] 0709 12:59:47.331616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.955515 (+623899us) service_pool.cc:224] Handling call
0709 12:59:49.325553 (+1370038us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b5400729054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:49.325693 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963079552}
W20260709 12:59:49.485327  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 43970.8us
I20260709 12:59:49.480890  1628 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:49.490479  1555 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:49.395078  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:49.422576  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:49.535727  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:49.536134  1627 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:49.525403  1673 leader_election.cc:336] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.009s (SENT)
I20260709 12:59:49.513155  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:49.449041  3689 consensus_meta.cc:287] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.774s	user 0.009s	sys 0.003s
I20260709 12:59:49.537698  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:49.538832  1554 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:49.514894  1672 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:49.536527  1553 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:49.545327  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:49.546838  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:49.549535  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:49.549642  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:49.432966  3704 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.448511  3705 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.432827  3591 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:49.410638  3585 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.429049  3713 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:49.918473  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.788676  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.022s	sys 0.041s
W20260709 12:59:49.926259  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.038s	sys 0.047s
I20260709 12:59:49.578045  1703 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 12:59:49.863721  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 338293us
I20260709 12:59:49.843501  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:49.928992  1673 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.023s (SENT) [suppressed 42 similar messages]
I20260709 12:59:49.826211  1708 raft_consensus.cc:606] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Received request to transfer leadership to TS 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:49.930171  1708 raft_consensus.cc:614] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:49.782301  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:49.911744  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.870271  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 274678us
I20260709 12:59:49.646549  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:49.863432  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 468357us
I20260709 12:59:49.714169  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:49.646242  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:49.506702  3685 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.011s	user 0.004s	sys 0.009s
I20260709 12:59:49.925664  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:49.939741  1707 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 3: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:49.923888  1556 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:49.940327  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1688) took 1047 ms. Trace:
I20260709 12:59:49.938077  1628 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:49.592729  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:49.941792  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:49.506979  3682 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:49.942371  1700 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:49.938202  1634 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:49.539856  3592 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.940762  1556 rpcz_store.cc:276] 0709 12:59:48.893060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.929477 (+ 36417us) service_pool.cc:224] Handling call
0709 12:59:49.297907 (+368430us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 12:59:49.940269 (+642362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14508800}
I20260709 12:59:49.946110  2288 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 12:59:49.714533  3707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.021s	sys 0.038s
I20260709 12:59:49.552570  3727 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.947619  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:49.928642  1557 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:49.956213  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:49.948762  3725 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:49.937990  3656 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:49.714690  3603 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.306s
I20260709 12:59:49.592391  3689 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.644804  3606 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.021581  1627 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 12:59:50.071521  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.071899  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:49.550624  3706 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.552500  3506 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:49.764930  3687 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.010s	sys 0.010s
I20260709 12:59:50.030570  1601 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 12:59:50.077207  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46702.8us
I20260709 12:59:50.078421  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:50.078521  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:50.031036  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 85037.6us
I20260709 12:59:50.079151  1627 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:50.030588  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:50.080036  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 12:59:49.866261  3649 consensus_meta.cc:287] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.713s	user 0.006s	sys 0.005s
I20260709 12:59:49.810019  3679 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:49.646626  3662 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:50.087080  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:50.097276  1557 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 12:59:50.086526  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.095029  1709 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:50.037708  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:50.036458  1633 consensus_meta.cc:287] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.608s	user 0.015s	sys 0.013s
I20260709 12:59:49.593034  3674 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:50.051501  1630 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:49.809257  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:49.603236  3704 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:49.864753  3647 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:50.054399  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 115987us
I20260709 12:59:49.480238  3633 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:49.857992  3673 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:49.940819  3705 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:49.644690  1631 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:49.592351  3688 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.066896  1523 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:49.550832  1552 raft_consensus.cc:2376] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2. Re-sending same reply.
W20260709 12:59:50.082684  3687 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.013s	sys 0.018s
I20260709 12:59:49.949249  3685 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:50.029461  3682 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:50.050594  3707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.031s	sys 0.059s
I20260709 12:59:50.080811  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:50.081353  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.083518  2288 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:50.053720  3434 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.055968  3732 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:50.073004  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.032s	sys 0.042s
I20260709 12:59:50.086649  3590 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.082072  3606 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:50.059728  3725 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:50.060725  3727 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:50.086584  3679 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.083755  3706 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:50.096756  3649 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:50.102576  1633 raft_consensus.cc:2410] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:50.177704  1701 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 12:59:50.195297  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.033s	sys 0.042s
W20260709 12:59:50.190006  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 106580us
I20260709 12:59:50.235808  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:50.177119  1627 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:50.254894  2288 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:50.107857  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:50.115585  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 48788.7us
I20260709 12:59:50.123878  1628 raft_consensus.cc:1240] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:50.260829  1630 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:50.184931  1632 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:50.177150  1556 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:50.189373  1706 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:50.117213  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 12:59:50.120127  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:50.111568  3714 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.981s	user 0.012s	sys 0.000s
I20260709 12:59:50.104202  3585 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:50.178252  3696 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:50.272856  1627 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:50.288627  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.195182  3732 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:50.285646  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 49990.9us
I20260709 12:59:50.103020  3674 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.286825  1700 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:59:50.271055  1628 raft_consensus.cc:1275] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:59:50.288961  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.172278  3707 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:50.311451  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.197690  3564 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:50.312165  3564 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:50.198856  3434 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:50.312624  3564 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.314461  3727 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:50.281366  3649 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:50.315192  3434 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:59:50.316476  3737 log.cc:927] Time spent T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:59:50.316965  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:50.317559  1628 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:50.122428  3688 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:50.320902  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:50.321647  1634 raft_consensus.cc:2368] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7.
I20260709 12:59:50.322412  3688 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:50.322477  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:50.279632  3739 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:59:50.323176  1634 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 1.
I20260709 12:59:50.281479  3662 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:50.125998  1552 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:50.282786  3725 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:59:50.132035  3619 consensus_meta.cc:287] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.779s	user 0.007s	sys 0.000s
W20260709 12:59:50.326917  3740 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:59:50.326275  3619 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:50.328030  3654 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:50.293354  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:50.293943  3696 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.240026  3590 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:50.329260  3696 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:50.283174  3713 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:59:50.331744  3743 log.cc:927] Time spent T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.188s	user 0.001s	sys 0.001s
W20260709 12:59:50.338075  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44792.9us
I20260709 12:59:50.290047  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.282089  3633 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:50.142261  3475 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:50.280223  3606 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:50.303601  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 332) took 1848 ms. Trace:
I20260709 12:59:50.280921  3706 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:50.438235  1702 rpcz_store.cc:276] 0709 12:59:48.455610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.886764 (+431154us) service_pool.cc:224] Handling call
0709 12:59:48.887221 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:48.887623 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:48.887665 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:49.239750 (+352085us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b2c000f3418. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2
0709 12:59:49.256908 (+ 17158us) log.cc:844] Serialized 26 byte log entry
0709 12:59:49.826005 (+569097us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:49.826063 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.837270 (+ 11207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:50.283762 (+446492us) raft_consensus.cc:1685] finished
0709 12:59:50.283789 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.303526 (+ 19737us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2289,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":12449,"spinlock_wait_cycles":3030272,"thread_start_us":462186,"threads_started":1,"wal-append.queue_time_us":885368}
I20260709 12:59:50.279479  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:50.308796  3692 consensus_meta.cc:287] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.455s	user 0.010s	sys 0.004s
I20260709 12:59:50.309257  3585 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:50.309561  3711 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:50.281713  3506 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:50.315410  3649 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:50.132506  3673 consensus_queue.cc:1059] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.193s
I20260709 12:59:50.255273  3679 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:50.100518  1554 consensus_meta.cc:287] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.000s
I20260709 12:59:50.697012  1554 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:50.697806  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 1951) took 1284 ms. Trace:
I20260709 12:59:50.192849  3685 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:50.366801  1627 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 2: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:50.699095  3685 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:50.699765  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:50.700336  1627 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:50.382938  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:50.698203  1554 rpcz_store.cc:276] 0709 12:59:49.413614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.537365 (+123751us) service_pool.cc:224] Handling call
0709 12:59:50.697723 (+1160358us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:50.411356  1598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.011s	sys 0.024s
W20260709 12:59:50.702020  1598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.011s	sys 0.024s
W20260709 12:59:50.702605  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 1.27147e+06us
I20260709 12:59:50.324044  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.266839  3709 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.175644  3591 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:50.292667  3622 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:50.456314  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:50.297443  3732 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:50.296566  3723 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.320212  3704 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:50.421155  3734 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.371s	user 0.002s	sys 0.000s
W20260709 12:59:50.547390  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.355266  3674 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.341455  3745 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.408896  3713 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:50.452903  3735 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.372s	user 0.000s	sys 0.002s
W20260709 12:59:50.636492  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 334053us
I20260709 12:59:50.739769  3622 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.287686  3714 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:50.587428  3585 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 12:59:50.657560  1551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1682) took 1766 ms (client timeout 2003 ms). Trace:
I20260709 12:59:50.589687  3692 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:50.408223  3643 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.235s
I20260709 12:59:50.444161  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.673866  3673 raft_consensus.cc:3055] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:50.772956  3434 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:50.677525  3633 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:50.682760  3592 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.627s	user 0.005s	sys 0.002s
W20260709 12:59:50.709929  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:50.692230  3705 consensus_meta.cc:287] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.002s
W20260709 12:59:50.738068  1598 connection.cc:256] RPC call timeout handler was delayed by -1.3487026060000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2291s for a response
I20260709 12:59:50.740435  1702 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 12:59:50.744910  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 485506us
W20260709 12:59:50.891360  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 43629us
I20260709 12:59:50.747668  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.895969  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:50.737279  3728 raft_consensus.cc:2764] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:59:50.755820  1635 raft_consensus.cc:2368] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 12:59:50.291910  3746 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 12:59:50.756439  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:50.760339  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 643132us
W20260709 12:59:50.761066  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.022s	sys 0.052s
W20260709 12:59:50.923132  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.023s	sys 0.052s
W20260709 12:59:50.923655  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 832253us
W20260709 12:59:50.767016  3694 consensus_meta.cc:287] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.374s	user 0.010s	sys 0.001s
I20260709 12:59:50.768081  2288 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:59:50.819800  1703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.012s	sys 0.100s
W20260709 12:59:50.822077  1628 consensus_meta.cc:287] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.504s	user 0.003s	sys 0.005s
I20260709 12:59:50.804428  1627 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
W20260709 12:59:50.830910  1675 leader_election.cc:336] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.603s (SENT)
I20260709 12:59:50.835497  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.773730  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 1950) took 1340 ms. Trace:
I20260709 12:59:50.779438  3622 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:50.928308  1703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.012s	sys 0.100s
W20260709 12:59:50.826071  1551 rpcz_store.cc:269] 0709 12:59:48.891310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.894209 (+  2899us) service_pool.cc:224] Handling call
0709 12:59:50.279345 (+1385136us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960eee 0000000000375939 00007f0ede9d41e0 00007f0edea9d0c4 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 12:59:50.657465 (+378120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11117184}
I20260709 12:59:50.931825  1628 raft_consensus.cc:2410] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:50.931950  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:50.932793  1631 raft_consensus.cc:2368] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7.
W20260709 12:59:50.929726  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 98831us
I20260709 12:59:50.933784  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:50.934124  1675 leader_election.cc:336] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.632s (SENT)
I20260709 12:59:50.935004  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.742251  3709 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:50.936551  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.937757  3643 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:50.930655  3694 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:50.938792  3643 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:50.839286  1557 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:50.447484  3619 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:50.805950  3736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.003s	sys 0.017s
W20260709 12:59:50.940778  3736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.003s	sys 0.018s
I20260709 12:59:50.895040  3592 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:50.940964  1629 raft_consensus.cc:2393] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 12:59:50.759680  3687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.003s	sys 0.012s
W20260709 12:59:50.941642  3687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.003s	sys 0.013s
I20260709 12:59:50.821755  3585 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:50.825572  3713 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:50.841845  3673 raft_consensus.cc:740] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:50.744012  3591 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:50.942979  3713 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:50.944034  3673 consensus_queue.cc:260] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:59:50.945222  3713 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:50.940338  3619 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.945982  3694 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:50.927227  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1974) took 1185 ms. Trace:
I20260709 12:59:50.946285  3619 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:50.918911  3633 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:50.930800  1552 rpcz_store.cc:276] 0709 12:59:49.413292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.325836 (+912544us) service_pool.cc:224] Handling call
0709 12:59:50.542868 (+217032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.656434 (+113566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.713326 (+ 56892us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.740139 (+ 26813us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:50.743506 (+  3367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.745371 (+  1865us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.754054 (+  8683us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.946972  1700 rpcz_store.cc:276] 0709 12:59:49.741714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.010947 (+269233us) service_pool.cc:224] Handling call
0709 12:59:50.067945 (+ 56998us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:50.295120 (+227175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.926837 (+631717us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54003d95d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:50.927123 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502563200}
I20260709 12:59:50.900400  1554 raft_consensus.cc:2368] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3.
I20260709 12:59:50.748466  3723 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:50.950022  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:50.950595  1554 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 12:59:50.951385  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:50.951886  3723 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:50.949059  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.954033  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.954795  1632 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:50.939208  3709 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:50.956254  3682 consensus_meta.cc:287] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.801s	user 0.006s	sys 0.001s
I20260709 12:59:50.949098  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:50.932816  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.949115  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:50.957713  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:50.841971  3685 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:50.932914  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:50.937361  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:59:51.000566  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64033us
I20260709 12:59:50.988551  3713 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:50.990865  3585 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:51.021965  3585 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:50.775255  3745 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:50.992722  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 12:59:51.024734  1709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 324) took 2596 ms (client timeout 2094 ms). Trace:
W20260709 12:59:51.052261  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 115129us
I20260709 12:59:51.041380  1554 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:51.022902  3622 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:50.962481  3746 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:50.897322  3705 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:50.898303  3434 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:50.958357  3682 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:51.109144  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:51.129374  1675 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:51.130618  1700 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.080440  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1972) took 1433 ms. Trace:
I20260709 12:59:51.132066  1675 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 12:59:51.132725  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 169420us
W20260709 12:59:51.134269  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.132545  1703 rpcz_store.cc:276] 0709 12:59:49.646990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.943621 (+296631us) service_pool.cc:224] Handling call
0709 12:59:49.943914 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:49.944126 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:50.175936 (+231810us) log.cc:844] Serialized 14 byte log entry
0709 12:59:51.079962 (+904026us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:51.080039 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:51.080109 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.080199 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.080360 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":504519,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":14713,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":1042504,"threads_started":3,"wal-append.queue_time_us":938623}
W20260709 12:59:51.135470  1673 leader_election.cc:336] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.632s (SENT)
I20260709 12:59:51.135437  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.136122  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:51.136505  3746 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:51.136538  1703 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:51.138546  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:51.139272  1601 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:51.141414  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:51.057734  1709 rpcz_store.cc:269] 0709 12:59:48.401445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.577010 (+175565us) service_pool.cc:224] Handling call
0709 12:59:50.998154 (+2421144us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400265554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:50.998258 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3450292608}
I20260709 12:59:51.142251  1628 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 2: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:51.143318  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.144325  1554 raft_consensus.cc:2393] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 2: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:51.139161  1703 raft_consensus.cc:2376] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4. Re-sending same reply.
I20260709 12:59:51.141804  1601 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:51.148830  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.149991  1675 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:51.069741  1552 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 3: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:51.043207  3685 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:51.153293  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:51.165421  3685 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:51.165583  1554 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 3: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 12:59:51.140944  3711 consensus_meta.cc:287] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.000s
I20260709 12:59:51.156746  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:51.158069  3764 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:51.157765  3723 consensus_queue.cc:1059] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:51.159852  3434 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:51.160194  3757 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:51.143496  3752 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:51.160934  3713 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.191526  3704 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:51.143232  3649 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.161176  3756 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.192775  3732 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:51.195335  3732 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.155507  3709 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:51.196839  3709 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.197188  3709 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.161576  3705 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.162918  1633 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:51.162973  3728 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.201506  3728 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:51.204021  3728 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.163296  3682 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:51.072377  3745 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:51.152433  3564 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.839s	user 0.008s	sys 0.002s
I20260709 12:59:51.157836  3647 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.153533  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.166616  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.215731  1703 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:51.215775  1554 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:51.217557  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.217689  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.218993  1703 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 12:59:51.219216  1554 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 1.
I20260709 12:59:51.052902  3633 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:51.179018  1632 raft_consensus.cc:2410] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:51.178776  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.176889  1700 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
W20260709 12:59:51.155093  3696 consensus_meta.cc:287] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.825s	user 0.010s	sys 0.001s
I20260709 12:59:51.184057  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:51.153270  3746 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:51.186049  3622 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.187105  3674 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:51.189220  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.189807  3434 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:51.209781  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:51.213871  3679 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.004s
I20260709 12:59:51.220496  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:51.401990  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 403) took 1089 ms. Trace:
I20260709 12:59:51.395088  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:51.400990  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 632918us
I20260709 12:59:51.403916  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 346) took 1092 ms. Trace:
I20260709 12:59:51.404350  1700 rpcz_store.cc:276] 0709 12:59:50.311330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.064229 (+752899us) service_pool.cc:224] Handling call
0709 12:59:51.403857 (+339628us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:51.404794  2288 connection.cc:256] RPC call timeout handler was delayed by -1.103322119999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260709 12:59:51.406252  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:51.403636  1560 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:51.403324  1709 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
W20260709 12:59:51.405970  1556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.028s	sys 0.061s
I20260709 12:59:51.404976  1628 rpcz_store.cc:276] 0709 12:59:50.312110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.149081 (+836971us) service_pool.cc:224] Handling call
0709 12:59:51.401939 (+252858us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:51.407478  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 272010us
I20260709 12:59:51.312424  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:56242 (request call id 18) took 2152 ms. Trace:
I20260709 12:59:51.409802  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:51.410290  1673 leader_election.cc:336] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.704s (SENT)
W20260709 12:59:51.409554  1556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.029s	sys 0.061s
I20260709 12:59:51.408710  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:51.409045  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:51.411361  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:51.410275  1708 rpcz_store.cc:276] 0709 12:59:49.151279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.189286 (+ 38007us) service_pool.cc:224] Handling call
0709 12:59:51.303033 (+2113747us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54003f2854. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a7f853 00007f0edea4d60a 00007f0ed7fd37d4 00007f0ed7fd3762 00007f0ed7fd3691 00007f0ed7fd360c 00007f0ed7fd28c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:51.303175 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1462423936}
I20260709 12:59:51.412884  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:51.412623  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:51.413604  1700 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.411059  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.413684  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.414685  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:59:51.412464  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:51.415108  1673 leader_election.cc:336] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.924s (SENT)
I20260709 12:59:51.405910  3746 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.416301  3746 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.417384  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.417658  3585 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:51.418125  3585 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:51.418651  3585 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:51.413180  3638 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:51.419728  3638 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:51.420147  3638 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.226900  3756 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:51.422268  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:51.419816  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.418111  1708 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:51.423218  1555 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:51.422840  1554 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.423695  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:51.423698  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.424418  1703 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:51.425390  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.427177  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 12:59:51.428010  1673 leader_election.cc:336] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.043s (SENT)
I20260709 12:59:51.225581  3723 raft_consensus.cc:3055] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:51.427554  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 277578us
I20260709 12:59:51.442488  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:51.442373  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.460983  1673 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:51.440690  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.376148  3728 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:51.462710  1599 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:51.463199  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.390288  3643 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.224865  3719 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.465844  1703 raft_consensus.cc:1813] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Handling vote request from an unknown peer 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:51.466490  1703 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 12:59:51.465386  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.460904  1560 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:51.428956  2288 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:51.401465  3434 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 12:59:51.470492  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.470467  1554 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:51.470842  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:51.471757  1628 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:51.472226  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.473075  1554 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:51.473337  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:51.474159  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:51.474897  1554 raft_consensus.cc:2368] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3.
I20260709 12:59:51.475622  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:51.476468  1709 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
W20260709 12:59:51.477427  1673 leader_election.cc:336] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.104s (SENT)
I20260709 12:59:51.412977  3633 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:51.478000  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.482015  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.479187  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:51.469621  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:51.486424  1703 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.479969  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.468043  1552 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 3: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:51.418195  3758 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:51.226768  3564 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:51.482800  1709 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 12:59:51.479322  3728 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:51.463093  3723 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:51.478878  1700 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:51.410895  3696 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:51.489913  1554 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:51.226559  3647 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:51.483476  3705 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:51.468391  3649 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.216040  3757 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:51.496812  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.533332  1709 raft_consensus.cc:2393] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:51.497099  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:51.489259  1555 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:51.498697  3756 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.534075  1700 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:51.534636  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.535202  1555 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:51.535854  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.536484  1555 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:51.468464  3656 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:59:51.468719  3682 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:51.477486  3685 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:51.481283  3763 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:51.505682  3564 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.476169  3434 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:51.510105  3674 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:51.490931  3687 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.511622  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.515641  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 1949) took 2102 ms. Trace:
I20260709 12:59:51.566218  1556 rpcz_store.cc:276] 0709 12:59:49.412983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.282297 (+869314us) service_pool.cc:224] Handling call
0709 12:59:50.282821 (+   524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:50.752205 (+469384us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:50.842745 (+ 90540us) log.cc:844] Serialized 14 byte log entry
0709 12:59:51.411899 (+569154us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:51.461238 (+ 49339us) log.cc:844] Serialized 26 byte log entry
0709 12:59:51.461402 (+   164us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:51.461436 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.461503 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:51.515341 (+ 53838us) raft_consensus.cc:1685] finished
0709 12:59:51.515370 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.515549 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":143654,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1782,"raft.queue_time_us":38236,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":4907,"thread_start_us":1064457,"threads_started":3,"wal-append.queue_time_us":610151}
W20260709 12:59:51.567525  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 154976us
I20260709 12:59:51.473026  3713 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:59:51.519415  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:51.494288  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:51.552977  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:51.569518  1628 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.569897  1555 raft_consensus.cc:2393] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 2: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:51.481165  3764 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:51.411332  3679 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:51.562105  3763 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.522784  3696 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.530278  3705 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.531399  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:51.476747  3719 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:51.545295  1703 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:51.491200  3758 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:51.546612  3622 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:51.562018  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 118699us
W20260709 12:59:51.569798  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 140917us
I20260709 12:59:51.481361  3711 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:51.590768  2288 leader_election.cc:336] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.572s (SENT)
I20260709 12:59:51.571372  1673 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:51.571799  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:59:51.521515  1599 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:46120 dropped due to backpressure: service queue is full with 50 items
I20260709 12:59:51.591373  2288 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:51.573602  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.525835  3714 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.594461  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:51.595920  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:51.581634  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.597204  1703 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:51.598476  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:51.562819  3682 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:51.576714  3763 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.603736  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.582067  1700 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 12:59:51.568526  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.604642  1555 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:51.580814  3705 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.600387  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.605376  1628 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:51.601485  1554 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:51.604982  1556 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 3: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:51.591952  1709 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:51.605502  3685 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.524654  1600 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:60052 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 411)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2336)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2326)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2329)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 416)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2334)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2338)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2342)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2333)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1752)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1754)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1759)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1755)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1761)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1756)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2330)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2345)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2328)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2331)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2335)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2337)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1741)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 383)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 384)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 393)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2323)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2327)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2339)
I20260709 12:59:51.606370  3751 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:51.606756  3674 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:51.606833  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:51.600661  1673 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:51.615211  1673 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:51.616052  1673 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:51.547605  3649 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:51.583937  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:51.612797  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.614893  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.583082  3758 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.617311  1556 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:51.590809  3711 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.571069  3746 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:51.577337  3764 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:51.619400  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:51.570182  3723 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:51.587927  3709 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:51.665282  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.619676  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:51.693789  1556 raft_consensus.cc:2368] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3.
I20260709 12:59:51.639779  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 1943) took 2252 ms. Trace:
W20260709 12:59:51.642483  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1725) took 2217 ms (client timeout 1872 ms). Trace:
I20260709 12:59:51.694619  1557 rpcz_store.cc:276] 0709 12:59:49.387373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.098033 (+710660us) service_pool.cc:224] Handling call
0709 12:59:50.123765 (+ 25732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.939744 (+815979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.639386 (+699642us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54001f7054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:51.639676 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644791552}
I20260709 12:59:51.609659  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.694828  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.649751  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:51.698104  1556 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
W20260709 12:59:51.695509  1629 rpcz_store.cc:269] 0709 12:59:49.424812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.481068 (+ 56256us) service_pool.cc:224] Handling call
0709 12:59:51.642160 (+2161092us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400204254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:51.642371 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3190266240}
W20260709 12:59:51.692744  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 73415.1us
I20260709 12:59:51.700475  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:51.697834  1554 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:51.699426  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.702395  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.703107  1556 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:51.703805  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.617102  1555 raft_consensus.cc:2376] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4. Re-sending same reply.
I20260709 12:59:51.702224  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:51.860560  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 321) took 3460 ms. Trace:
I20260709 12:59:51.887208  1706 rpcz_store.cc:276] 0709 12:59:48.400542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.883789 (+483247us) service_pool.cc:224] Handling call
0709 12:59:48.884141 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.263156 (+1379015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.860155 (+1596999us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400398854. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:51.860425 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3000572288}
I20260709 12:59:51.887907  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:51.849819  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.888995  1558 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:51.887323  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:51.889848  2326 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.890113  1558 raft_consensus.cc:1240] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:51.859795  3689 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:51.891803  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:51.892418  2323 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:51.894382  3506 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:51.864003  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1732) took 2361 ms (client timeout 1691 ms). Trace:
I20260709 12:59:51.663786  3647 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:51.620011  3537 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:51.611790  3751 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.897013  1553 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:51.897272  3751 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.643190  3633 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:51.898000  3633 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.898216  1553 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:51.898365  3633 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.720929  3756 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:51.901269  3709 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.901384  3756 raft_consensus.cc:697] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:51.902554  3756 consensus_queue.cc:237] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:51.903169  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:51.662108  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.903589  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:51.903918  2325 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:51.648864  3685 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.636744  3714 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:51.905006  3689 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.905674  3714 raft_consensus.cc:697] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 12:59:51.895651  1635 rpcz_store.cc:269] 0709 12:59:49.502425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.506252 (+  3827us) service_pool.cc:224] Handling call
0709 12:59:51.863684 (+2357432us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000d8ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:51.863886 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2870584192}
I20260709 12:59:51.907069  3714 consensus_queue.cc:237] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:51.907508  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:51.907989  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:51.908207  1635 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:51.908612  2321 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.636894  3656 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:51.709697  3679 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:51.909456  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1734) took 2406 ms. Trace:
I20260709 12:59:51.790701  1560 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:51.909947  1630 rpcz_store.cc:276] 0709 12:59:49.502992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.104039 (+601047us) service_pool.cc:224] Handling call
0709 12:59:50.104505 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.262010 (+157505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.909088 (+1647078us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54002d7b54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:51.909366 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358555520}
I20260709 12:59:51.911207  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:51.792440  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:51.911903  1630 raft_consensus.cc:2368] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4.
I20260709 12:59:51.621246  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:51.832233  3752 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.913010  1700 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:51.913122  3752 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:59:51.914314  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:51.914482  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:51.914992  2323 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:51.618201  3674 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:51.915495  3752 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:51.915635  3674 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.917016  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:51.918922  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:51.919269  3591 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:51.919581  2329 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:51.858439  3758 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:51.912366  1557 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:51.922755  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:51.923570  2322 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:51.704456  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:51.924461  1556 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:51.927183  3673 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.928215  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:51.909490  1709 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:51.929136  2322 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:51.931146  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:51.932742  3732 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:51.924499  3761 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.530s	user 0.000s	sys 0.003s
I20260709 12:59:51.933544  3732 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:51.935858  2329 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 12:59:51.939563  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:51.946853  2323 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:51.929145  3692 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.937613  1553 raft_consensus.cc:1275] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:51.905330  1552 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:51.929271  1598 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:51.938252  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:52.519771  1557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.001s	sys 0.000s
I20260709 12:59:51.909476  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:51.968978  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:52.527086  2322 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:51.900444  2326 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:51.729554  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 535) took 2984 ms. Trace:
I20260709 12:59:51.981671  3537 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.716977  3585 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:52.712242  3585 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.613668  3622 raft_consensus.cc:697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:51.670245  3638 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:51.706768  3649 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:51.705183  3682 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.905014  3685 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:51.977777  3689 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:52.734427  3685 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:52.729168  3638 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:52.735369  3689 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:51.861919  3705 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:52.729146  3622 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:52.737421  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:52.738934  3705 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:51.698261  3711 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.721014  3728 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.936245  3732 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.710165  3746 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:51.707713  3757 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.833428  3763 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:51.726254  3764 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:52.751678  2325 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:51.636441  3767 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:52.752681  3767 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:52.753180  3767 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.707887  3768 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:52.757424  3768 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.757989  3768 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:51.619611  2288 leader_election.cc:336] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.594s (SENT)
I20260709 12:59:52.760931  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:59:52.762662  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 1.14285e+06us
I20260709 12:59:51.981968  2321 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:52.766153  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:52.767860  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:51.823954  1559 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:51.895666  3434 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:52.022311  3751 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:52.002250  3758 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:52.120421  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 319) took 3720 ms (client timeout 1594 ms). Trace:
I20260709 12:59:52.780694  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 322) took 1888 ms. Trace:
I20260709 12:59:52.781612  1559 rpcz_store.cc:276] 0709 12:59:50.892370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.823199 (+930829us) service_pool.cc:224] Handling call
0709 12:59:51.823687 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.779909 (+956222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.780297 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.783380  3751 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:52.783882  3714 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:52.784763  3714 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:52.787143  3714 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:52.234531  3719 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:52.281702  2323 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:52.790153  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:52.791020  2323 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:52.294476  3777 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.792520  3777 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:52.794142  1554 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:52.309777  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1697) took 1140 ms. Trace:
I20260709 12:59:52.795296  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1696) took 1626 ms. Trace:
I20260709 12:59:52.795358  1552 rpcz_store.cc:276] 0709 12:59:51.169474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.904667 (+735193us) service_pool.cc:224] Handling call
0709 12:59:51.904970 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.309052 (+404082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.309534 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.795737  1554 rpcz_store.cc:276] 0709 12:59:51.169051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.703573 (+534522us) service_pool.cc:224] Handling call
0709 12:59:52.320172 (+616599us) spinlock_profiling.cc:243] Waited 90.6 ms on lock 0x7b5400050e28. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf862924 00007f0edea4b227 00007f0edea4aab8 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:52.795072 (+474900us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b5400050fd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:52.795224 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296853632}
I20260709 12:59:52.796984  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:52.797425  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:52.798789  1554 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:52.798693  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:52.799479  1552 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:52.315623  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 386252us
I20260709 12:59:52.800251  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:52.801918  3434 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:52.802457  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:52.316537  3679 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:52.475386  3656 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.804809  3679 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.804917  3656 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.805330  3679 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:52.326040  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1695) took 1157 ms. Trace:
W20260709 12:59:52.388500  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.808799  1553 rpcz_store.cc:276] 0709 12:59:51.168641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.899910 (+731269us) service_pool.cc:224] Handling call
0709 12:59:51.936823 (+ 36913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.303972 (+367149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.305814 (+  1842us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b54001d88d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:52.325773 (+ 19959us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84264320}
I20260709 12:59:52.810608  1553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:59:52.811453  1553 raft_consensus.cc:606] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:52.378931  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:52.404881  1704 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:59:52.405117  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 342) took 3125 ms (client timeout 1569 ms). Trace:
I20260709 12:59:52.812424  3751 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.381032  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 323) took 1488 ms. Trace:
W20260709 12:59:52.812841  1701 rpcz_store.cc:269] 0709 12:59:49.279005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.321351 (+ 42346us) service_pool.cc:224] Handling call
0709 12:59:52.403612 (+3082261us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b54003d9ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:52.403933 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1609953152}
I20260709 12:59:52.813071  1555 rpcz_store.cc:276] 0709 12:59:50.892700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.832463 (+939763us) service_pool.cc:224] Handling call
0709 12:59:51.832894 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:52.323309 (+490415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:52.323379 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:52.325276 (+  1897us) log.cc:844] Serialized 26 byte log entry
0709 12:59:52.355851 (+ 30575us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:52.355992 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.356116 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:52.356192 (+    76us) raft_consensus.cc:1685] finished
0709 12:59:52.356208 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.380825 (+ 24617us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"thread_start_us":11682,"threads_started":1,"wal-append.queue_time_us":26550}
I20260709 12:59:52.814543  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:52.815219  1701 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.815744  1555 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:52.329916  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1721) took 1116 ms. Trace:
I20260709 12:59:52.294189  3756 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.418992  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:52.817553  1706 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.817132  3751 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:59:52.817598  3764 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.819159  3764 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:52.819878  3751 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:52.821593  1551 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 3: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:52.821767  3656 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:52.823450  1555 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:52.454420  3590 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:52.426826  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1973) took 2708 ms. Trace:
W20260709 12:59:52.449930  3564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.031s	sys 0.014s
I20260709 12:59:52.414466  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2338) took 1491 ms. Trace:
I20260709 12:59:52.826807  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1971) took 3283 ms. Trace:
W20260709 12:59:52.500411  3674 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.584s	user 0.013s	sys 0.000s
I20260709 12:59:52.501749  1454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41160 (request call id 295) took 5178 ms. Trace:
I20260709 12:59:52.827159  1709 rpcz_store.cc:276] 0709 12:59:50.922846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.649408 (+726562us) service_pool.cc:224] Handling call
0709 12:59:52.414035 (+764627us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b540012c0d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:52.414272 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485107584}
I20260709 12:59:52.827749  3674 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:52.828884  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:52.829612  1709 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:52.830143  3674 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:52.831241  1703 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:52.827999  1454 rpcz_store.cc:276] 0709 12:59:47.323124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.323300 (+   176us) service_pool.cc:224] Handling call
0709 12:59:52.501533 (+5178233us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:48.595993 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:48.844633 (+248640us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:48.844677 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:59:48.844691 (+    14us) tablet.cc:662] Decoding operations
0709 12:59:48.845531 (+   840us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:48.845587 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:48.845618 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:59:48.845995 (+   377us) tablet.cc:701] Row locks acquired
0709 12:59:48.846011 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:59:48.846145 (+   134us) write_op.cc:270] Start()
0709 12:59:48.846263 (+   118us) write_op.cc:276] Timestamp: P: 1783601988846097 usec, L: 0
0709 12:59:48.846285 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:59:48.904262 (+ 57977us) log.cc:844] Serialized 1759 byte log entry
0709 12:59:49.186682 (+282420us) op_driver.cc:464] REPLICATION: finished
0709 12:59:49.932675 (+745993us) write_op.cc:301] APPLY: starting
0709 12:59:49.942606 (+  9931us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:50.054215 (+111609us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:50.115605 (+ 61390us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:50.132612 (+ 17007us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:50.191784 (+ 59172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:59:50.191837 (+    53us) write_op.cc:312] APPLY: finished
0709 12:59:50.192114 (+   277us) log.cc:844] Serialized 41 byte log entry
0709 12:59:50.941179 (+749065us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:50.941281 (+   102us) write_op.cc:454] Released schema lock
0709 12:59:50.941323 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:50.941847 (+   524us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:50.941884 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":664653,"apply.run_cpu_time_us":33501,"apply.run_wall_time_us":1069493,"num_ops":4,"prepare.queue_time_us":112416,"prepare.run_cpu_time_us":13931,"prepare.run_wall_time_us":491032,"raft.queue_time_us":35398,"raft.run_cpu_time_us":23244,"raft.run_wall_time_us":382184,"replication_time_us":296567,"thread_start_us":1195528,"threads_started":5,"wal-append.queue_time_us":1002588,"wal-append.run_cpu_time_us":4370,"wal-append.run_wall_time_us":2019980}]]}
I20260709 12:59:52.832367  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2360) took 1261 ms. Trace:
I20260709 12:59:52.832778  1703 rpcz_store.cc:276] 0709 12:59:51.571333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.600092 (+ 28759us) service_pool.cc:224] Handling call
0709 12:59:52.832089 (+1231997us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400266454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:52.832295 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2811961216}
I20260709 12:59:52.834038  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:52.834900  1703 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:52.826583  1707 rpcz_store.cc:276] 0709 12:59:49.718415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.944733 (+226318us) service_pool.cc:224] Handling call
0709 12:59:49.949037 (+  4304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.284951 (+335914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.284982 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.285020 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:50.285051 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.426112 (+2141061us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b5400398d54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:52.426197 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.426624 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":771941760}
I20260709 12:59:52.835960  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:52.530071  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 12:59:52.530853  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2329) took 1376 ms (client timeout 1622 ms). Trace:
I20260709 12:59:52.836301  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:59:52.837463  1630 rpcz_store.cc:269] 0709 12:59:51.140139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.937971 (+797832us) service_pool.cc:224] Handling call
0709 12:59:52.516420 (+578449us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:52.520440  1557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.001s	sys 0.000s
I20260709 12:59:52.838762  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:52.839648  1707 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:52.840144  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1723) took 1263 ms. Trace:
I20260709 12:59:52.547497  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:51.591750  1599 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:46120 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 411)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2336)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2326)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2329)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 416)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2334)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2338)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2342)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2333)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1752)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1754)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1759)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1755)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1761)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1756)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2330)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2345)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2328)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2331)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2335)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2337)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1741)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 383)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 384)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 393)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2323)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2327)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2339)
W20260709 12:59:52.595058  1600 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60052 dropped due to backpressure: service queue is full with 50 items [suppressed 1 similar messages]
I20260709 12:59:52.841665  1629 raft_consensus.cc:2410] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:52.840617  1557 rpcz_store.cc:276] 0709 12:59:51.576131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.922063 (+345932us) service_pool.cc:224] Handling call
0709 12:59:51.922352 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:51.922842 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.922870 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:51.923320 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:59:52.839596 (+916276us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:52.839675 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.839776 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:52.839821 (+    45us) raft_consensus.cc:1685] finished
0709 12:59:52.839833 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.839990 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10554,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":915200,"threads_started":1,"wal-append.queue_time_us":91238}
I20260709 12:59:52.556020  1457 catalog_manager.cc:5697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 2 to 3, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:52.838774  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 412) took 2143 ms (client timeout 2120 ms). Trace:
W20260709 12:59:52.843876  1630 rpcz_store.cc:269] 0709 12:59:50.695043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.838530 (+2143487us) service_pool.cc:211] Skipping call since client already timed out
0709 12:59:52.838695 (+   165us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:59:52.602365  3633 consensus_meta.cc:287] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.703s	user 0.012s	sys 0.009s
I20260709 12:59:52.844348  1457 catalog_manager.cc:5697] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 2 to 3, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.623512  3704 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:52.827243  1704 rpcz_store.cc:276] 0709 12:59:49.543891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.737988 (+194097us) service_pool.cc:224] Handling call
0709 12:59:52.404217 (+2666229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:52.825001 (+420784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.826587 (+  1586us) spinlock_profiling.cc:243] Waited 2.6 s on lock 0x7b54003d9ad0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:52.826748 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5969492864}
I20260709 12:59:52.846477  3704 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:52.634307  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 12:59:52.827112  3564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.161s	user 0.032s	sys 0.014s
I20260709 12:59:52.849205  1628 raft_consensus.cc:2410] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:59:52.849757  1628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2336) took 1689 ms (client timeout 1528 ms). Trace:
I20260709 12:59:52.850088  3764 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:52.847211  1457 catalog_manager.cc:5697] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 2 to 3, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:52.848203  3777 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:52.850312  1628 rpcz_store.cc:269] 0709 12:59:51.165325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.629184 (+1463859us) service_pool.cc:224] Handling call
0709 12:59:52.849667 (+220483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.636023  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 12:59:52.650516  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.713557  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 395) took 1404 ms. Trace:
I20260709 12:59:52.851533  1632 rpcz_store.cc:276] 0709 12:59:50.309416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.956615 (+647199us) service_pool.cc:224] Handling call
0709 12:59:51.713324 (+756709us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400125554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:51.713465 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495291648}
I20260709 12:59:51.619977  1631 raft_consensus.cc:2393] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 12:59:52.650959  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 44013.1us
I20260709 12:59:52.852525  1703 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:52.853449  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 413) took 2158 ms (client timeout 1777 ms). Trace:
I20260709 12:59:51.836776  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:59:52.666505  2324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.008s	sys 0.006s
I20260709 12:59:52.678212  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:52.684737  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:52.864485  1626 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 12:59:52.865108  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2325) took 1905 ms (client timeout 1871 ms). Trace:
W20260709 12:59:52.865562  1630 rpcz_store.cc:269] 0709 12:59:50.959585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.864868 (+1905283us) service_pool.cc:211] Skipping call since client already timed out
0709 12:59:52.865026 (+   158us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:59:52.866714  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:52.867349  1703 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:52.867623  1630 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:52.689188  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:52.868309  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1764) took 1729 ms (client timeout 1733 ms). Trace:
W20260709 12:59:52.692183  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 989786us
I20260709 12:59:52.871236  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:52.873061  1556 raft_consensus.cc:2393] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 3: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:52.873500  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:52.874652  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 12:59:52.875650  1632 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2338) took 1709 ms (client timeout 1756 ms). Trace:
W20260709 12:59:52.876084  1632 rpcz_store.cc:269] 0709 12:59:51.165999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.874240 (+1708241us) service_pool.cc:224] Handling call
0709 12:59:52.875578 (+  1338us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.697695  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1736) took 3193 ms. Trace:
I20260709 12:59:52.876724  1633 rpcz_store.cc:276] 0709 12:59:49.503714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.259863 (+756149us) service_pool.cc:224] Handling call
0709 12:59:50.260177 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.201127 (+940950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.697172 (+1496045us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54000e6854. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:52.697485 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2075377024}
I20260709 12:59:52.877715  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:52.878502  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:52.879323  1633 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
W20260709 12:59:52.879850  1633 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1765) took 1741 ms (client timeout 1800 ms). Trace:
I20260709 12:59:51.713845  3619 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:52.861244  3704 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:52.719434  3537 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:52.740170  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:52.750460  3763 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:51.710642  1708 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:52.770769  1635 raft_consensus.cc:2368] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3.
I20260709 12:59:52.771610  3732 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:52.764128  2288 leader_election.cc:336] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.636s (SENT)
I20260709 12:59:52.778941  2320 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:52.779191  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:52.891463  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:52.891966  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:52.892326  2326 raft_consensus.cc:2368] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 12:59:52.892820  2325 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEARNER]: Advancing to term 3
I20260709 12:59:52.893841  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:52.895823  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:52.780346  1705 rpcz_store.cc:269] 0709 12:59:48.399993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.400112 (+   119us) service_pool.cc:224] Handling call
0709 12:59:52.119755 (+3719643us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54003d9fd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:52.120103 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082026368}
I20260709 12:59:52.896716  3619 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:52.897241  3619 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.897751  3619 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.897948  1705 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:59:52.898844  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1976) took 3042 ms. Trace:
I20260709 12:59:52.899269  1705 rpcz_store.cc:276] 0709 12:59:49.859052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.897056 (+3038004us) service_pool.cc:224] Handling call
0709 12:59:52.897489 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:52.898516 (+  1027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.898755 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.169303  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:52.901449  2329 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:52.902559  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 12:59:52.811942  1673 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.003s (SENT)
W20260709 12:59:52.904832  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 93044.2us
I20260709 12:59:52.906729  1598 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:52.907868  1598 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:52.812405  1553 raft_consensus.cc:614] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:52.908798  2321 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:52.909319  3590 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:52.909857  1558 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:52.913606  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 407) took 2220 ms (client timeout 2042 ms). Trace:
W20260709 12:59:52.914099  1635 rpcz_store.cc:269] 0709 12:59:50.693439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.909248 (+1215809us) service_pool.cc:224] Handling call
0709 12:59:52.913358 (+1004110us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54002c7ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:52.913530 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519694720}
I20260709 12:59:52.915310  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:52.888558  3537 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:52.916301  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1760) took 1778 ms (client timeout 1867 ms). Trace:
I20260709 12:59:52.817207  3756 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
W20260709 12:59:52.918331  1635 rpcz_store.cc:269] 0709 12:59:51.138081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.914994 (+1776913us) service_pool.cc:224] Handling call
0709 12:59:52.916234 (+  1240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:52.510044  2327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.009s	sys 0.011s
I20260709 12:59:52.836521  3768 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:52.919607  2327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.010s	sys 0.011s
I20260709 12:59:52.919771  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:52.808348  3767 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:52.920379  3756 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:52.816744  1560 rpcz_store.cc:276] 0709 12:59:51.213497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.910296 (+696799us) service_pool.cc:224] Handling call
0709 12:59:51.910601 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:51.910810 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.910837 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:51.911278 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 12:59:52.329185 (+417907us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:52.329281 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.329428 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:52.329493 (+    65us) raft_consensus.cc:1685] finished
0709 12:59:52.329505 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.329732 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":417302,"threads_started":1,"wal-append.queue_time_us":101713}
W20260709 12:59:52.842315  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 411) took 2147 ms (client timeout 1993 ms). Trace:
I20260709 12:59:52.844851  3633 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:52.921118  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 544) took 1033 ms. Trace:
I20260709 12:59:52.622041  3723 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:52.922305  3767 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:52.922673  3633 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:52.604202  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:52.687934  1523 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:52.923612  3768 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:52.924166  3756 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:52.924461  1700 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:52.847234  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:52.924731  1672 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 12:59:52.921134  1629 rpcz_store.cc:269] 0709 12:59:50.694731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.546690 (+1851959us) service_pool.cc:224] Handling call
0709 12:59:52.842135 (+295445us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:52.925522  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 45017.3us
I20260709 12:59:52.925432  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 1982) took 1785 ms. Trace:
I20260709 12:59:52.926142  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:52.927538  1629 raft_consensus.cc:2368] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6.
W20260709 12:59:52.928077  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2333) took 1768 ms (client timeout 1910 ms). Trace:
I20260709 12:59:52.861222  1702 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:52.861881  2324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.009s	sys 0.006s
I20260709 12:59:52.841811  1600 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60052 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2334)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2338)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2342)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2333)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1752)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1754)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1759)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1755)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1761)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1756)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2330)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2345)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2328)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2331)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2335)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2337)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1741)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 383)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 384)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 393)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2323)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2327)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2339)
I20260709 12:59:52.863301  1627 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
W20260709 12:59:52.689244  2286 connection.cc:256] RPC call timeout handler was delayed by -1.3717201110000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
I20260709 12:59:52.868983  1706 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
W20260709 12:59:52.869475  1675 leader_election.cc:336] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.733s (SENT)
I20260709 12:59:52.869705  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:52.865141  1626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 416) took 2168 ms (client timeout 2094 ms). Trace:
W20260709 12:59:52.935688  1629 rpcz_store.cc:269] 0709 12:59:51.159555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.925577 (+1766022us) service_pool.cc:224] Handling call
0709 12:59:52.927989 (+  2412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.880766  3674 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:52.704356  2328 rpcz_store.cc:276] 0709 12:59:48.745381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.745549 (+   168us) service_pool.cc:224] Handling call
0709 12:59:48.747512 (+  1963us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:49.185246 (+437734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:49.185281 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:49.185810 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:59:49.472545 (+286735us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:49.474173 (+  1628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.729010 (+2254837us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b540064fd54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:51.729076 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:51.729140 (+    64us) raft_consensus.cc:1685] finished
0709 12:59:51.729161 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.729428 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4330,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":996692736,"thread_start_us":286140,"threads_started":1,"wal-append.queue_time_us":697404,"wal-append.run_cpu_time_us":16086,"wal-append.run_wall_time_us":2018287}
I20260709 12:59:52.783298  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:52.880370  1633 rpcz_store.cc:269] 0709 12:59:51.138824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.878169 (+1739345us) service_pool.cc:224] Handling call
0709 12:59:52.879786 (+  1617us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:52.882869  1630 rpcz_store.cc:269] 0709 12:59:51.138689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.866342 (+1727653us) service_pool.cc:224] Handling call
0709 12:59:52.868232 (+  1890us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.884173  1703 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:52.231405  3592 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:52.917543  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:52.917799  1558 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
W20260709 12:59:52.917826  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2359) took 1492 ms (client timeout 1739 ms). Trace:
I20260709 12:59:52.926272  1704 rpcz_store.cc:276] 0709 12:59:51.140418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.846893 (+1706475us) service_pool.cc:224] Handling call
0709 12:59:52.925356 (+ 78463us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:52.853921  1631 rpcz_store.cc:269] 0709 12:59:50.695519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.936312 (+240793us) service_pool.cc:224] Handling call
0709 12:59:52.853072 (+1916760us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54000f4bd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:52.853241 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1490444544}
I20260709 12:59:52.928736  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 1981) took 1959 ms. Trace:
I20260709 12:59:52.929273  3633 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:52.923785  1634 raft_consensus.cc:2368] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3.
I20260709 12:59:52.857121  1709 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:52.947024  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 353) took 1467 ms. Trace:
W20260709 12:59:52.943102  1708 rpcz_store.cc:269] 0709 12:59:51.425032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.425166 (+   134us) service_pool.cc:224] Handling call
0709 12:59:52.917356 (+1492190us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54002f2454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:52.917662 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653856512}
I20260709 12:59:52.947425  1709 rpcz_store.cc:276] 0709 12:59:51.479505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.828539 (+1349034us) service_pool.cc:224] Handling call
0709 12:59:52.946960 (+118421us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.929970  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 12:59:52.923830  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 236274us
I20260709 12:59:52.840473  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:52.804364  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:52.933611  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:52.935895  1628 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:52.878752  2323 raft_consensus.cc:2368] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6.
I20260709 12:59:52.949527  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 708) took 1031 ms. Trace:
I20260709 12:59:52.950595  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:52.951628  1631 raft_consensus.cc:2376] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7. Re-sending same reply.
W20260709 12:59:52.935091  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 397) took 2625 ms (client timeout 2035 ms). Trace:
I20260709 12:59:52.941144  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1975) took 3187 ms. Trace:
I20260709 12:59:52.945353  1704 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:52.944867  1700 rpcz_store.cc:276] 0709 12:59:50.969532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.914252 (+944720us) service_pool.cc:224] Handling call
0709 12:59:52.928487 (+1014235us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002cbd54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:52.928683 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2319850240}
W20260709 12:59:52.957297  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 87921.4us
I20260709 12:59:52.953063  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1979) took 2687 ms. Trace:
I20260709 12:59:52.958751  1704 rpcz_store.cc:276] 0709 12:59:50.265585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.944349 (+2678764us) service_pool.cc:224] Handling call
0709 12:59:52.945217 (+   868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.952791 (+  7574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.952983 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:52.953125  1628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2334) took 1789 ms (client timeout 1717 ms). Trace:
W20260709 12:59:52.960572  1628 rpcz_store.cc:269] 0709 12:59:51.159857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.869325 (+1709468us) service_pool.cc:224] Handling call
0709 12:59:52.949189 (+ 79864us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.953220  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:52.949842  2323 rpcz_store.cc:276] 0709 12:59:51.918009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.877306 (+959297us) service_pool.cc:224] Handling call
0709 12:59:52.949474 (+ 72168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.955788  1700 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:52.956610  1523 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 12:59:52.962977  1675 leader_election.cc:336] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.800s (SENT)
I20260709 12:59:52.924640  3756 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.966926  1635 raft_consensus.cc:2368] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7.
W20260709 12:59:52.952373  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1754) took 1820 ms (client timeout 1999 ms). Trace:
I20260709 12:59:52.968319  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:52.968463  3704 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:52.968570  1631 rpcz_store.cc:269] 0709 12:59:51.132446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.946274 (+1813828us) service_pool.cc:224] Handling call
0709 12:59:52.952291 (+  6017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.969228  3704 raft_consensus.cc:697] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:52.969852  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:52.970242  3763 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:52.970703  1631 raft_consensus.cc:2368] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 12:59:52.970526  3704 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:52.971184  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1753) took 1839 ms (client timeout 2000 ms). Trace:
I20260709 12:59:52.971549  1672 leader_election.cc:400] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 12:59:52.971952  1672 leader_election.cc:403] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:52.956867  3633 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:52.972725  3633 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:52.952488  1627 rpcz_store.cc:269] 0709 12:59:50.310081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.929036 (+618955us) service_pool.cc:224] Handling call
0709 12:59:52.601633 (+1672597us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b5800153f98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 12:59:52.677935 (+ 76302us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b5800153f98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960e9c 00007f0ed6960a5b 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 12:59:52.935016 (+257081us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21057152}
I20260709 12:59:52.976764  3756 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:52.977576  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:52.978762  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1759) took 1841 ms (client timeout 1996 ms). Trace:
W20260709 12:59:52.979166  1627 rpcz_store.cc:269] 0709 12:59:51.137764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.977133 (+1839369us) service_pool.cc:224] Handling call
0709 12:59:52.978699 (+  1566us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.980189  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:52.950642  2286 connection.cc:256] RPC call timeout handler was delayed by -1.1242259899999567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 12:59:52.984369  2286 connection.cc:256] RPC call timeout handler was delayed by -1.0470424700000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 12:59:52.984794  2328 raft_consensus.cc:2393] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:52.985517  2286 leader_election.cc:400] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3.
I20260709 12:59:52.985836  2286 leader_election.cc:403] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:52.987092  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:52.987460  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:52.988037  1556 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:52.939031  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:52.989310  2320 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:52.989216  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:52.984740  1627 raft_consensus.cc:2410] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:52.990691  1555 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 12:59:52.991408  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1755) took 1858 ms (client timeout 2003 ms). Trace:
W20260709 12:59:52.991753  1627 rpcz_store.cc:269] 0709 12:59:51.136876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.979862 (+1842986us) service_pool.cc:224] Handling call
0709 12:59:52.991333 (+ 11471us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:52.936937  1626 rpcz_store.cc:269] 0709 12:59:50.717108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.676142 (+1959034us) service_pool.cc:224] Handling call
0709 12:59:52.865062 (+188920us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.945495  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 721) took 1019 ms. Trace:
I20260709 12:59:52.992690  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:52.993610  1627 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:52.944774  3590 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.966199  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 347) took 2654 ms. Trace:
I20260709 12:59:52.964641  2329 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:52.995016  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1977) took 2730 ms. Trace:
I20260709 12:59:52.946447  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 541) took 1060 ms. Trace:
W20260709 12:59:52.969261  1632 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2342) took 1668 ms (client timeout 1700 ms). Trace:
I20260709 12:59:52.977903  3746 raft_consensus.cc:1064] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
W20260709 12:59:52.952903  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 410) took 2258 ms (client timeout 1651 ms). Trace:
I20260709 12:59:52.995515  1700 rpcz_store.cc:276] 0709 12:59:50.311615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.954752 (+2643137us) service_pool.cc:224] Handling call
0709 12:59:52.955374 (+   622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.962319 (+  6945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.966151 (+  3832us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:52.996505  1632 rpcz_store.cc:269] 0709 12:59:51.301150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.933028 (+1631878us) service_pool.cc:224] Handling call
0709 12:59:52.969209 (+ 36181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.921746  2327 rpcz_store.cc:276] 0709 12:59:51.887433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.889236 (+  1803us) service_pool.cc:224] Handling call
0709 12:59:51.889538 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.889748 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:51.890045 (+   297us) log.cc:844] Serialized 14 byte log entry
0709 12:59:52.920149 (+1030104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:52.920269 (+   120us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:52.920344 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.920456 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.921058 (+   602us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":165,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":12982,"spinlock_wait_cycles":12672,"thread_start_us":1029632,"threads_started":1,"wal-append.queue_time_us":132069}
I20260709 12:59:52.981406  3592 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:52.954226  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1980) took 2688 ms. Trace:
I20260709 12:59:52.998347  1709 rpcz_store.cc:276] 0709 12:59:50.265898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.952937 (+2687039us) service_pool.cc:224] Handling call
0709 12:59:52.953380 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.953621 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:52.953769 (+   148us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:52.953815 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:52.953893 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.953952 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.954052 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:52.968463  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2344) took 1500 ms (client timeout 1612 ms). Trace:
I20260709 12:59:52.963814  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:59:52.999126  1635 rpcz_store.cc:269] 0709 12:59:51.468261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.929613 (+1461352us) service_pool.cc:224] Handling call
0709 12:59:52.968372 (+ 38759us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.952647  1703 rpcz_store.cc:276] 0709 12:59:49.753513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.881454 (+3127941us) service_pool.cc:224] Handling call
0709 12:59:52.881900 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.940843 (+ 58943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.941057 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.983526  1523 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:52.986105  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:52.995725  1705 rpcz_store.cc:276] 0709 12:59:50.264281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.939319 (+2675038us) service_pool.cc:224] Handling call
0709 12:59:52.972277 (+ 32958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.972490 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:52.972517 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:52.972568 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:52.994751 (+ 22183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.994831 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.994957 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.963793  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1978) took 2699 ms. Trace:
I20260709 12:59:53.004978  1702 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 12:59:52.992902  2322 rpcz_store.cc:276] 0709 12:59:51.926471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.919414 (+992943us) service_pool.cc:224] Handling call
0709 12:59:52.943078 (+ 23664us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.005973  1489 debug-util.cc:398] Leaking SignalData structure 0x7b08002786c0 after lost signal to thread 434
W20260709 12:59:53.006525  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1761) took 1868 ms (client timeout 2017 ms). Trace:
I20260709 12:59:53.023084  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:53.007206  2328 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:53.024298  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:53.007766  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 12:59:52.971611  1631 rpcz_store.cc:269] 0709 12:59:51.132153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.969497 (+1837344us) service_pool.cc:224] Handling call
0709 12:59:52.971113 (+  1616us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.004832  1706 rpcz_store.cc:276] 0709 12:59:50.265245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.941818 (+2676573us) service_pool.cc:224] Handling call
0709 12:59:52.963037 (+ 21219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.963430 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:52.963454 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:52.963492 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:52.963541 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.963609 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.963713 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.010093  3746 raft_consensus.cc:1068] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a: Unable to promote non-voter 6b9e73092f6146639bf310a3d18cfe37: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:53.034379  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:53.034255  3619 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:53.035076  1560 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:53.036237  1706 raft_consensus.cc:1240] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:53.037248  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2357) took 1631 ms. Trace:
I20260709 12:59:52.958081  3705 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:53.038057  3705 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:53.038403  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:53.039124  1635 raft_consensus.cc:2368] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5.
I20260709 12:59:53.039005  3705 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:53.039549  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2330) took 1896 ms (client timeout 2103 ms). Trace:
W20260709 12:59:53.039913  1635 rpcz_store.cc:269] 0709 12:59:51.143296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.038107 (+1894811us) service_pool.cc:224] Handling call
0709 12:59:53.039497 (+  1390us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.014390  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:53.014422  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 51490.8us
I20260709 12:59:53.006311  3763 raft_consensus.cc:2764] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:59:53.014887  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.014437  3751 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:53.049777  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:53.007930  3590 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:52.993634  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.015600  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:53.016024  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.008397  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:53.019656  1673 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.092s (SENT)
I20260709 12:59:53.022812  1704 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:53.015619  3768 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:53.024256  1559 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
W20260709 12:59:53.025388  1627 rpcz_store.cc:269] 0709 12:59:51.138263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.992365 (+1854102us) service_pool.cc:224] Handling call
0709 12:59:53.006449 (+ 14084us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:52.997315  1634 rpcz_store.cc:269] 0709 12:59:50.694406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.930401 (+235995us) service_pool.cc:224] Handling call
0709 12:59:52.600509 (+1670108us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b5800153f98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 12:59:52.952815 (+352306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15607040}
I20260709 12:59:53.007669  1709 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:53.026247  1598 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:53.056212  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2353) took 1862 ms. Trace:
I20260709 12:59:53.056634  1709 rpcz_store.cc:276] 0709 12:59:51.193413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.007167 (+1813754us) service_pool.cc:224] Handling call
0709 12:59:53.007514 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.055971 (+ 48457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.056160 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.029368  1701 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 12:59:53.030578  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:53.032258  3719 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:53.033303  2327 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.996089  2324 rpcz_store.cc:276] 0709 12:59:51.886520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.887548 (+  1028us) service_pool.cc:224] Handling call
0709 12:59:51.887972 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:51.888204 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.888228 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:51.888714 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:59:52.944352 (+1055638us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:52.944432 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.946094 (+  1662us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:52.946137 (+    43us) raft_consensus.cc:1685] finished
0709 12:59:52.946149 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.946377 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32256,"thread_start_us":1045445,"threads_started":1,"wal-append.queue_time_us":111212}
I20260709 12:59:53.034098  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.012387  1707 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:53.041332  1706 rpcz_store.cc:276] 0709 12:59:51.406801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.035559 (+1628758us) service_pool.cc:224] Handling call
0709 12:59:53.036043 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.036994 (+   951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.037197 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.062997  1628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1766) took 1923 ms (client timeout 2076 ms). Trace:
W20260709 12:59:53.063230  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 43682.6us
I20260709 12:59:53.048480  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 352) took 1569 ms. Trace:
I20260709 12:59:53.049373  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.028002  1552 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 12:59:53.059252  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:53.061868  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 348) took 2749 ms. Trace:
W20260709 12:59:53.063409  1628 rpcz_store.cc:269] 0709 12:59:51.139012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.015701 (+1876689us) service_pool.cc:224] Handling call
0709 12:59:53.062856 (+ 47155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.067716  1630 raft_consensus.cc:2410] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:59:53.065656  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:53.064463  1702 rpcz_store.cc:276] 0709 12:59:51.479242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.836433 (+357191us) service_pool.cc:224] Handling call
0709 12:59:53.032090 (+1195657us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.072561  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 12:59:53.073205  1489 debug-util.cc:398] Leaking SignalData structure 0x7b0800278c00 after lost signal to thread 1492
I20260709 12:59:53.074404  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:52.976565  3711 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:53.075474  1629 raft_consensus.cc:2410] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:52.990788  3633 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:53.077831  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.085435  1700 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:53.086083  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 135877us
I20260709 12:59:53.031914  2326 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:53.062774  1551 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:53.087492  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:53.088519  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1990) took 1892 ms. Trace:
I20260709 12:59:53.060036  3767 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
W20260709 12:59:53.091147  1489 debug-util.cc:398] Leaking SignalData structure 0x7b0800293500 after lost signal to thread 1584
W20260709 12:59:53.076860  1633 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2324) took 2155 ms (client timeout 2194 ms). Trace:
I20260709 12:59:53.082154  2323 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:53.092036  1633 rpcz_store.cc:269] 0709 12:59:50.921666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.940488 (+2018822us) service_pool.cc:224] Handling call
0709 12:59:53.076799 (+136311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.068805  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:53.050904  3764 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:53.074803  1708 rpcz_store.cc:276] 0709 12:59:50.311859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.966810 (+2654951us) service_pool.cc:224] Handling call
0709 12:59:52.968649 (+  1839us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:52.969239 (+   590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:52.969263 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:52.969754 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:59:53.046566 (+ 76812us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:53.046612 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.048901 (+  2289us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:53.057298 (+  8397us) raft_consensus.cc:1685] finished
0709 12:59:53.057310 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.061712 (+  4402us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3595,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":168,"thread_start_us":76443,"threads_started":1,"wal-append.queue_time_us":73791}
I20260709 12:59:53.080209  2325 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEARNER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:59:53.094179  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:53.094861  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:53.081074  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.091210  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:53.095844  1553 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:53.082763  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1752) took 1950 ms (client timeout 1981 ms). Trace:
I20260709 12:59:53.036525  3619 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:53.088937  1700 rpcz_store.cc:276] 0709 12:59:51.196210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.025344 (+1829134us) service_pool.cc:224] Handling call
0709 12:59:53.074378 (+ 49034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.088258 (+ 13880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.088453 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.075932  1560 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:53.091156  1555 raft_consensus.cc:2368] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6.
W20260709 12:59:53.097675  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 333673us
W20260709 12:59:53.096746  1629 rpcz_store.cc:269] 0709 12:59:51.131885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.945404 (+1813519us) service_pool.cc:224] Handling call
0709 12:59:53.082693 (+137289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.098809  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 720) took 1172 ms. Trace:
W20260709 12:59:53.098945  1489 debug-util.cc:398] Leaking SignalData structure 0x7b080039db00 after lost signal to thread 1659
I20260709 12:59:53.100703  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.030733  3674 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:53.099699  1489 debug-util.cc:398] Leaking SignalData structure 0x7b08003d3dc0 after lost signal to thread 1660
I20260709 12:59:53.101867  1632 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:53.102720  1703 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:53.106109  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2341) took 1958 ms. Trace:
I20260709 12:59:53.099673  2325 rpcz_store.cc:276] 0709 12:59:51.926189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.891691 (+965502us) service_pool.cc:224] Handling call
0709 12:59:53.098741 (+207050us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.104104  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2331) took 1956 ms (client timeout 2404 ms). Trace:
W20260709 12:59:53.108126  1634 rpcz_store.cc:269] 0709 12:59:51.147932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.055993 (+1908061us) service_pool.cc:224] Handling call
0709 12:59:53.104041 (+ 48048us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.093521   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:53.109758  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:53.106701  1704 rpcz_store.cc:276] 0709 12:59:51.147945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.971452 (+1823507us) service_pool.cc:224] Handling call
0709 12:59:53.022565 (+ 51113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.059741 (+ 37176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.105801 (+ 46060us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b54003ec1d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:53.105960 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116637440}
I20260709 12:59:53.066939  3592 consensus_queue.cc:1059] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:59:53.076242  3768 raft_consensus.cc:697] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:53.109867  2324 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:53.104995  1557 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 12:59:53.115172  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 722) took 1188 ms. Trace:
I20260709 12:59:53.107553  1635 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:53.110935  1628 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:53.115530  2324 rpcz_store.cc:276] 0709 12:59:51.926730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.075926 (+1149196us) service_pool.cc:224] Handling call
0709 12:59:53.109700 (+ 33774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.114930 (+  5230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.115119 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.115880  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2345) took 1623 ms (client timeout 1827 ms). Trace:
W20260709 12:59:53.116262  1628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2335) took 1956 ms (client timeout 2397 ms). Trace:
W20260709 12:59:53.116431  1635 rpcz_store.cc:269] 0709 12:59:51.492846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.041270 (+1548424us) service_pool.cc:224] Handling call
0709 12:59:53.115828 (+ 74558us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.116670  1628 rpcz_store.cc:269] 0709 12:59:51.160142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.071197 (+1911055us) service_pool.cc:224] Handling call
0709 12:59:53.116210 (+ 45013us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.111711  1489 debug-util.cc:398] Leaking SignalData structure 0x7b08002b9e20 after lost signal to thread 1733
W20260709 12:59:53.117482  1489 debug-util.cc:398] Leaking SignalData structure 0x7b080029a840 after lost signal to thread 1734
I20260709 12:59:53.114404  1523 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:53.111845  1558 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:53.104681  1675 leader_election.cc:336] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.981s (SENT)
W20260709 12:59:53.093255  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1763) took 1954 ms (client timeout 2092 ms). Trace:
I20260709 12:59:53.124306  3768 consensus_queue.cc:237] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:53.124802  1631 rpcz_store.cc:269] 0709 12:59:51.138554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.033783 (+1895229us) service_pool.cc:224] Handling call
0709 12:59:53.093190 (+ 59407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.126209  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.127244  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2337) took 1961 ms. Trace:
I20260709 12:59:53.127588  1631 rpcz_store.cc:276] 0709 12:59:51.165661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.125798 (+1960137us) service_pool.cc:224] Handling call
0709 12:59:53.127135 (+  1337us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.128187  1599 connection.cc:256] RPC call timeout handler was delayed by -1.4209790489999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24060000000000004s for a response
I20260709 12:59:53.129693  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:53.130754  3746 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:53.130976  3711 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:53.130473   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:59:53.132093  1675 leader_election.cc:336] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.999s (SENT)
I20260709 12:59:53.133299  3674 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:53.133642  1675 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.003s (SENT)
I20260709 12:59:53.134171  2322 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:53.134120  1675 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:53.134920  2328 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:53.135752  2322 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:59:53.135819  1675 leader_election.cc:336] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.023s (SENT)
I20260709 12:59:53.136185  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 714) took 1216 ms. Trace:
I20260709 12:59:53.110517  3537 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEARNER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3.
W20260709 12:59:53.136957  2288 leader_election.cc:336] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.651s (SENT)
I20260709 12:59:53.137722  2324 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:53.091179  3723 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:53.122812  1489 debug-util.cc:398] Leaking SignalData structure 0x7b08003e2cc0 after lost signal to thread 2353
I20260709 12:59:53.096308  3719 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:53.072662  3751 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:53.123795  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 76311.5us
I20260709 12:59:53.137734  1700 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:53.144040  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 570) took 1172 ms. Trace:
I20260709 12:59:53.158054  2325 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:53.158418  2324 rpcz_store.cc:276] 0709 12:59:51.971589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.116431 (+1144842us) service_pool.cc:224] Handling call
0709 12:59:53.137440 (+ 21009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.143786 (+  6346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.143986 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.159022  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 569) took 1231 ms. Trace:
I20260709 12:59:53.121681  1556 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
W20260709 12:59:53.144488  1489 debug-util.cc:398] Leaking SignalData structure 0x7b08003787c0 after lost signal to thread 2354
I20260709 12:59:53.136572  2328 rpcz_store.cc:276] 0709 12:59:51.919417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.073410 (+1153993us) service_pool.cc:224] Handling call
0709 12:59:53.134716 (+ 61306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.135398 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.136012 (+   614us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b54006446d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:53.136131 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69537024}
I20260709 12:59:53.159449  2325 rpcz_store.cc:276] 0709 12:59:51.971149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.110890 (+1139741us) service_pool.cc:224] Handling call
0709 12:59:53.157889 (+ 46999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.158768 (+   879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.158968 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.161367  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:53.163403  2327 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:53.097239  1626 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:53.165731  3679 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:53.166383  1553 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
W20260709 12:59:53.166769  1675 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.092s (SENT)
I20260709 12:59:53.167304  1675 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:53.168309  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.168769  3689 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:53.169138  1629 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
W20260709 12:59:53.169802  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 399) took 2859 ms (client timeout 3309 ms). Trace:
W20260709 12:59:53.170181  1629 rpcz_store.cc:269] 0709 12:59:50.310796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.105475 (+2794679us) service_pool.cc:224] Handling call
0709 12:59:53.169739 (+ 64264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.173928  3777 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:53.172057  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2343) took 1750 ms. Trace:
I20260709 12:59:53.176899  1633 rpcz_store.cc:276] 0709 12:59:51.421900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.108538 (+1686638us) service_pool.cc:224] Handling call
0709 12:59:53.171992 (+ 63454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.177417  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 355) took 1583 ms. Trace:
I20260709 12:59:53.170405  3689 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:53.177989  1709 rpcz_store.cc:276] 0709 12:59:51.594015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.078333 (+1484318us) service_pool.cc:224] Handling call
0709 12:59:53.110247 (+ 31914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.176935 (+ 66688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.176977 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.177040 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:53.177106 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.177191 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.177344 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.180851  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 66537.8us
I20260709 12:59:53.183462  1523 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:53.144104  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.191836  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.190835  1598 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:53.136545  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 573) took 1164 ms. Trace:
I20260709 12:59:53.197039  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:53.198309  2323 raft_consensus.cc:2410] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:53.202400  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 572) took 1230 ms. Trace:
I20260709 12:59:53.202770  2323 rpcz_store.cc:276] 0709 12:59:51.972245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.030892 (+1058647us) service_pool.cc:224] Handling call
0709 12:59:53.202342 (+171450us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.165786  1626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1756) took 2028 ms (client timeout 2023 ms). Trace:
I20260709 12:59:53.179018  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:53.209093  1633 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:53.206501  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:53.188789  3619 raft_consensus.cc:3055] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:59:53.209529  1599 leader_election.cc:336] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.630s (SENT)
W20260709 12:59:53.211539  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 74643.5us
I20260709 12:59:53.214793  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:53.194074  3723 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:53.209311  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 12:59:53.207784  1626 rpcz_store.cc:269] 0709 12:59:51.137127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.993267 (+1856140us) service_pool.cc:224] Handling call
0709 12:59:53.165690 (+172423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.211418  3711 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:53.221836  3711 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.228968  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.221874  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.234373  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1758) took 2096 ms. Trace:
I20260709 12:59:53.222651  1599 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:53.236487  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:53.237900  1629 rpcz_store.cc:276] 0709 12:59:51.137547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.177942 (+2040395us) service_pool.cc:224] Handling call
0709 12:59:53.234289 (+ 56347us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.239265  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 47363.1us
I20260709 12:59:53.212225  3619 raft_consensus.cc:740] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:53.205955  1631 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:53.222357  3711 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:53.202000  2322 rpcz_store.cc:276] 0709 12:59:51.972620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.134949 (+1162329us) service_pool.cc:224] Handling call
0709 12:59:53.135370 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.136272 (+   902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.136479 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.246217  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1757) took 2108 ms (client timeout 1986 ms). Trace:
I20260709 12:59:53.247557  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:53.253381  3758 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:53.255110  3728 consensus_queue.cc:1059] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:53.264564  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2321) took 2344 ms. Trace:
I20260709 12:59:53.327492  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.328174  1631 rpcz_store.cc:276] 0709 12:59:50.920671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.128268 (+2207597us) service_pool.cc:224] Handling call
0709 12:59:53.264476 (+136208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.247375  3622 raft_consensus.cc:2764] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:59:53.329347  1627 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
W20260709 12:59:53.330090  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2347) took 1806 ms (client timeout 1992 ms). Trace:
W20260709 12:59:53.330540  1627 rpcz_store.cc:269] 0709 12:59:51.524047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.055694 (+1531647us) service_pool.cc:224] Handling call
0709 12:59:53.330031 (+274337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.260957  1601 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:53.252609  3746 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 12:59:53.274565  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 83838.9us
W20260709 12:59:53.274432  1630 rpcz_store.cc:269] 0709 12:59:51.137374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.945087 (+1807713us) service_pool.cc:224] Handling call
0709 12:59:53.245646 (+300559us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b54002d6c54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:53.246091 (+   445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88101760}
I20260709 12:59:53.287115  1633 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:53.224519  3679 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:53.241747  2326 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:53.344696  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.263906  2321 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:53.247008  1626 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:53.364008  3756 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:53.344339  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:53.336794  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:53.348003  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.287573  3758 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.353082  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.351056  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:53.350857  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 79918us
I20260709 12:59:53.354799  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 723) took 1427 ms. Trace:
I20260709 12:59:53.355358  3777 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:53.348560  3704 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:53.386103  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:53.386003  2326 rpcz_store.cc:276] 0709 12:59:51.927012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.112412 (+1185400us) service_pool.cc:224] Handling call
0709 12:59:53.200979 (+ 88567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.344172 (+143193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.354723 (+ 10551us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.356956  3679 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:53.387416  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.387606  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.388288  1629 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:53.389341  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:53.390897  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.392875  1634 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 12:59:53.394305  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.394965  1634 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:53.396073  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.385910  3633 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:53.398435  3592 raft_consensus.cc:3055] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:53.398809  3592 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:53.399657  3592 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:53.397903  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.401484  1633 raft_consensus.cc:2393] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 3: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:53.402372  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.402562  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.403209  1633 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:53.347999  3764 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.405133  3592 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:53.404927  3764 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:53.407769  3764 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:53.408679  3758 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:53.404335  1633 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:53.366566  3723 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:53.410550  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 383) took 3149 ms. Trace:
I20260709 12:59:53.410773  1628 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:53.410923  1633 rpcz_store.cc:276] 0709 12:59:50.261181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.403820 (+3142639us) service_pool.cc:224] Handling call
0709 12:59:53.404086 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.410087 (+  6001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.410310 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.368189  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 163359us
W20260709 12:59:53.414752  1599 connection.cc:256] RPC call timeout handler was delayed by -1.1302790489999666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27290000000000003s for a response
I20260709 12:59:53.414844  3590 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:53.350962  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.417480  1630 raft_consensus.cc:1240] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:53.417917  1626 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:53.418309  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 386) took 3156 ms. Trace:
I20260709 12:59:53.418783  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 392) took 3154 ms. Trace:
I20260709 12:59:53.369385  3751 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:53.419453  1626 rpcz_store.cc:276] 0709 12:59:50.263877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.416949 (+3153072us) service_pool.cc:224] Handling call
0709 12:59:53.417382 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.418461 (+  1079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.418714 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.266671  3656 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:59:53.385169  1632 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2328) took 2251 ms (client timeout 2248 ms). Trace:
W20260709 12:59:53.420956  1632 rpcz_store.cc:269] 0709 12:59:51.134161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.041896 (+1907735us) service_pool.cc:224] Handling call
0709 12:59:53.384980 (+343084us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b5400302ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:53.385102 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85403904}
I20260709 12:59:53.422875  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 396) took 3113 ms. Trace:
I20260709 12:59:53.423355  1632 rpcz_store.cc:276] 0709 12:59:50.309761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.421809 (+3112048us) service_pool.cc:224] Handling call
0709 12:59:53.422150 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.422524 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.422551 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.422602 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:53.422647 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.422708 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.422818 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.356251  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 183947us
I20260709 12:59:53.348116  2286 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:53.425300  1601 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 12:59:53.425593  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 138816us
I20260709 12:59:53.397848  3777 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:53.389364  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:53.443138  1632 raft_consensus.cc:1240] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:53.443356  3777 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:53.444007  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2323) took 2522 ms. Trace:
I20260709 12:59:53.444473  1632 rpcz_store.cc:276] 0709 12:59:50.921357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.424397 (+2503040us) service_pool.cc:224] Handling call
0709 12:59:53.426388 (+  1991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.443713 (+ 17325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.443919 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.411574  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1741) took 3906 ms. Trace:
W20260709 12:59:53.447453  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 229361us
I20260709 12:59:53.446501  1628 rpcz_store.cc:276] 0709 12:59:49.505164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.403394 (+3898230us) service_pool.cc:224] Handling call
0709 12:59:53.403722 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.411309 (+  7587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.411516 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.382838  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:53.455271  1700 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:53.367040  3719 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:53.418960  1630 rpcz_store.cc:276] 0709 12:59:50.262109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.416704 (+3154595us) service_pool.cc:224] Handling call
0709 12:59:53.417194 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.417943 (+   749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.418215 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.460985  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.446887  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 713) took 1527 ms. Trace:
I20260709 12:59:53.459793  1634 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:53.464811  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.482339  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:53.482398  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:53.483068  1554 raft_consensus.cc:2368] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 3. Current term is 4.
I20260709 12:59:53.421643  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 393) took 3130 ms. Trace:
I20260709 12:59:53.484447  1627 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:53.463446  2329 rpcz_store.cc:276] 0709 12:59:51.919156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.050440 (+1131284us) service_pool.cc:224] Handling call
0709 12:59:53.072656 (+ 22216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.083345 (+ 10689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.083391 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:53.114883 (+ 31492us) log.cc:844] Serialized 26 byte log entry
0709 12:59:53.191456 (+ 76573us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:53.191494 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.191544 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:53.426402 (+234858us) raft_consensus.cc:1685] finished
0709 12:59:53.426422 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.446800 (+ 20378us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14804,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":2958,"thread_start_us":26113,"threads_started":1,"wal-append.queue_time_us":107461}
W20260709 12:59:53.484504  1675 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.019s (SENT)
I20260709 12:59:53.446014  3777 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:53.441267  2321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 568) took 1458 ms (client timeout 1821 ms). Trace:
I20260709 12:59:53.460568  3622 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:53.492498  1635 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:53.425364  3751 consensus_queue.cc:1059] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:59:53.509385  1632 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:53.530862  1628 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:59:53.534334  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 1984) took 2339 ms. Trace:
I20260709 12:59:53.534951  1703 rpcz_store.cc:276] 0709 12:59:51.194657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.016179 (+1821522us) service_pool.cc:224] Handling call
0709 12:59:53.016540 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.103233 (+ 86693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.531030 (+427797us) spinlock_profiling.cc:243] Waited 85.9 ms on lock 0x7b540012d4d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:53.534250 (+  3220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197684480}
I20260709 12:59:53.468787  3719 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:53.541589  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1762) took 2393 ms. Trace:
I20260709 12:59:53.545234  1628 rpcz_store.cc:276] 0709 12:59:51.138408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.463840 (+2325432us) service_pool.cc:224] Handling call
0709 12:59:53.530428 (+ 66588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.531504 (+  1076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.531756 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.543556  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2327) took 2397 ms. Trace:
I20260709 12:59:53.546918  1632 rpcz_store.cc:276] 0709 12:59:51.133307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.446436 (+2313129us) service_pool.cc:224] Handling call
0709 12:59:53.509228 (+ 62792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.530257 (+ 21029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.530465 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:53.548679  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 183247us
I20260709 12:59:53.466408  3728 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:53.459784  3537 consensus_queue.cc:1059] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
W20260709 12:59:53.542757  2320 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.552s	user 0.012s	sys 0.002s
I20260709 12:59:53.562505  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 12:59:53.564021  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 138929us
I20260709 12:59:53.483870  3763 consensus_queue.cc:1059] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:59:53.544356  3656 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:53.574427  1673 leader_election.cc:336] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.821s (SENT)
I20260709 12:59:53.576083  1673 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:53.552695  1634 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:53.593335  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 120336us
W20260709 12:59:53.508178  2321 rpcz_store.cc:269] 0709 12:59:51.927670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.767494 (+839824us) service_pool.cc:224] Handling call
0709 12:59:53.385545 (+618051us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.595157  1599 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:53.596729  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:59:53.606166  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 43774.1us
I20260709 12:59:53.568501  2320 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 12:59:53.610914  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2358) took 2198 ms. Trace:
I20260709 12:59:53.611749  2286 leader_election.cc:400] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6.
I20260709 12:59:53.613746  2286 leader_election.cc:403] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:59:53.617092  1601 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:53.551442  3719 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:53.562382  3728 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:53.492540  1626 rpcz_store.cc:276] 0709 12:59:50.291004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.420555 (+3129551us) service_pool.cc:224] Handling call
0709 12:59:53.421043 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.421280 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.421309 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.421372 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:53.421420 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.421476 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.421589 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.614442  1705 rpcz_store.cc:276] 0709 12:59:51.412256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.054303 (+1642047us) service_pool.cc:224] Handling call
0709 12:59:53.088367 (+ 34064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.110395 (+ 22028us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:53.209026 (+ 98631us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.609778 (+400752us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.609847 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:53.609927 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.610702 (+   775us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.610855 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1191,"prepare.queue_time_us":229749,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":9969,"thread_start_us":465072,"threads_started":3}
I20260709 12:59:53.613013  3674 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:53.642666  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 48593.1us
I20260709 12:59:53.623369  2320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 575) took 1449 ms. Trace:
I20260709 12:59:53.607787  3656 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:53.619529  3799 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:53.639765  3763 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:53.656106  3537 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:53.656545  3537 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:53.657392  3537 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:53.658967  3793 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.659523  3793 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:53.669106  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 94703.3us
I20260709 12:59:53.683720  1628 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:53.658631  3537 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:53.655443  3799 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.650676  2320 rpcz_store.cc:276] 0709 12:59:52.170380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.896392 (+726012us) service_pool.cc:224] Handling call
0709 12:59:53.619980 (+723588us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.769308  1673 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:53.661728  3808 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:59:53.775945  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.770326  3799 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:53.840499  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 358148us
I20260709 12:59:54.046254  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:54.046695  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 12:59:53.771647  3798 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:59:53.760918  3711 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.049185  1626 raft_consensus.cc:3055] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:54.049727  1626 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:54.051072  3711 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:54.052088  1629 raft_consensus.cc:2368] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 3. Current term is 4.
I20260709 12:59:54.051222  1626 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:54.052958  1626 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:54.054728  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 419) took 1104 ms. Trace:
I20260709 12:59:54.055169  1629 rpcz_store.cc:276] 0709 12:59:52.950697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.389038 (+438341us) service_pool.cc:224] Handling call
0709 12:59:54.054486 (+665448us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b5400125554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:54.054663 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1522077056}
I20260709 12:59:53.864025  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2339) took 2672 ms. Trace:
W20260709 12:59:53.972644  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 355618us
I20260709 12:59:54.057150  1601 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:54.057451  3537 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:54.056743  1630 rpcz_store.cc:276] 0709 12:59:51.166314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.463545 (+2297231us) service_pool.cc:224] Handling call
0709 12:59:53.532645 (+ 69100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.546475 (+ 13830us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:53.593745 (+ 47270us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.838324 (+244579us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.838414 (+    90us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:53.838496 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.838576 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.838750 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41024,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":7852,"raft.queue_time_us":69281,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":1525888,"thread_start_us":139897,"threads_started":1,"wal-append.queue_time_us":424162}
I20260709 12:59:54.059486  1601 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:54.060935  3711 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:54.061486  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1774) took 1074 ms. Trace:
I20260709 12:59:54.062892  1601 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:54.063469  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:54.063792  3763 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:54.065523  3704 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:54.066082  3704 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.066538  3704 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.067884  3819 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:59:54.034684  3758 consensus_meta.cc:287] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.625s	user 0.018s	sys 0.002s
I20260709 12:59:54.058495  3799 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:53.864061  3806 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:59:54.017148  3590 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:53.972829  3809 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:54.017690  3689 raft_consensus.cc:3055] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:54.070924  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:54.071280  3689 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:54.072268  3689 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.073135  2326 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:54.073220  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:53.788420  3619 consensus_queue.cc:260] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.074342  3619 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:54.074630  3809 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:54.074784  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:54.075166  3809 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:54.018095  3633 raft_consensus.cc:3055] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:54.018843  3810 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:54.076423  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:54.076987  3810 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.078202  3810 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:53.776312  3723 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:54.079692  3723 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:54.080739  3723 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:54.081092  2288 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:54.079921  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:54.084851  2320 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 2: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:54.018014  2286 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 12:59:54.085852  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 67938.4us
W20260709 12:59:54.086062  2288 leader_election.cc:336] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 12:59:54.086601  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:59:54.021891  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 252627us
I20260709 12:59:53.776744  3682 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:54.029049  3756 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:54.022534  3793 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:54.030375  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:54.031898  1700 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:54.033509  1709 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:54.034634  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:54.035017  3805 raft_consensus.cc:3055] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:53.746886  3714 raft_consensus.cc:3055] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:54.035920  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:53.771451  3592 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:59:53.779637  3807 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6.
I20260709 12:59:54.039115  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:54.040071  3746 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:54.040302  3794 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.445s	user 0.002s	sys 0.009s
W20260709 12:59:53.904070  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 328548us
I20260709 12:59:54.061602  3711 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 12:59:54.014474  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.069033  3819 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:54.069049  3801 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:54.073354  3689 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:54.076786  3633 raft_consensus.cc:740] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:54.015836  3751 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:54.029259  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:54.013602  3719 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:54.088528  2288 leader_election.cc:400] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3.
I20260709 12:59:54.108984  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:54.089486  2326 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:54.020166  3728 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:54.111194  3768 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.013s	sys 0.013s
I20260709 12:59:54.111271  2329 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:54.111925  3768 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.013s	sys 0.013s
I20260709 12:59:54.112622  3656 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:54.125175  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1772) took 1139 ms. Trace:
I20260709 12:59:54.125715  1631 rpcz_store.cc:276] 0709 12:59:52.986172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.471203 (+485031us) service_pool.cc:224] Handling call
0709 12:59:53.512016 (+ 40813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:54.016748 (+504732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:54.016785 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:54.017352 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:59:54.124777 (+107425us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:54.124829 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.124894 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.124948 (+    54us) raft_consensus.cc:1685] finished
0709 12:59:54.124966 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.125110 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71603,"raft.queue_time_us":115359,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":13369,"thread_start_us":481724,"threads_started":2,"wal-append.queue_time_us":95763}
I20260709 12:59:54.129166  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:54.131896  3820 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.132647  3820 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.133821  3719 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:54.135113  3820 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:59:54.135919  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.136407  2288 connection.cc:256] RPC call timeout handler was delayed by -1.953768953000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 12:59:54.138772  2288 connection.cc:256] RPC call timeout handler was delayed by -1.1504952809999622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
I20260709 12:59:54.140264  3820 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:54.142987  2288 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:54.145354  3820 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:54.146032  3820 raft_consensus.cc:697] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:54.146960  3820 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.154830  3719 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.155983  3719 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.157579  2288 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:54.090655  1673 leader_election.cc:400] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3.
I20260709 12:59:54.115832  3763 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:54.093098  3805 raft_consensus.cc:740] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 12:59:54.160486  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 130527us
I20260709 12:59:54.161531  3805 consensus_queue.cc:260] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.162765  3805 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:54.093573  1702 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 12:59:54.164449  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:54.094242  1601 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 12:59:54.165700  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 71563.6us
I20260709 12:59:54.091109  3682 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:54.069154  3758 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.096817  3711 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:54.095718  3746 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.099092  1599 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:54.119781  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:54.174671  1633 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 6. Ops: []
I20260709 12:59:54.099493  3819 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:54.101557  3633 consensus_queue.cc:260] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.102085  1705 raft_consensus.cc:2368] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7.
I20260709 12:59:54.100432  3806 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:54.094360  3807 consensus_queue.cc:1059] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:54.095137  3714 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:54.179515  2324 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:54.158684  3821 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:59:54.183972  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:54.122241  2323 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEARNER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:54.099304  3793 consensus_queue.cc:1059] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:59:54.119643  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:54.121170  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:54.095439  1707 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:54.119794  2326 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:54.124104  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:54.187824  2325 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 12:59:54.099121  3704 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
W20260709 12:59:54.089519  2286 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.035s (SENT)
I20260709 12:59:54.089768  3537 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:54.115345  3799 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:54.191838  2328 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:54.159773  1673 leader_election.cc:403] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:59:54.158766  3719 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:54.165163  1553 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:54.200611  3719 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:54.164521  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:54.201207  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:54.201363  3719 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:54.201897  2324 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:54.177745  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 384) took 3916 ms. Trace:
I20260709 12:59:54.160455  3803 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.203121  1633 rpcz_store.cc:276] 0709 12:59:50.261454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.411925 (+3150471us) service_pool.cc:224] Handling call
0709 12:59:53.412244 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.175207 (+762963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.177448 (+  2241us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54000f4bd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:54.177662 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1752755456}
I20260709 12:59:54.203568  3803 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.204344  3633 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:54.062426  1627 rpcz_store.cc:276] 0709 12:59:52.986894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.508630 (+521736us) service_pool.cc:224] Handling call
0709 12:59:53.508938 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.569313 (+ 60375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.569344 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:53.607851 (+ 38507us) log.cc:844] Serialized 26 byte log entry
0709 12:59:53.972516 (+364665us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:53.972573 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.976400 (+  3827us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.061212 (+ 84812us) raft_consensus.cc:1685] finished
0709 12:59:54.061235 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.061390 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31182,"raft.queue_time_us":100666,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":8053,"thread_start_us":333372,"threads_started":1,"wal-append.queue_time_us":424454}
I20260709 12:59:54.186852  3619 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.195114  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:54.196694  3705 consensus_queue.cc:1059] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.197120  3704 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:54.178823  3820 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:54.199033  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:54.198827  3810 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.199712  2328 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:54.196720  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 97692.2us
I20260709 12:59:54.200529  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:54.207544  1554 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:54.191882  2286 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:54.177018  3728 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:54.224120  2323 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:54.178508  3801 raft_consensus.cc:697] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:54.208209  3803 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:54.253683  1555 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:54.254551  1599 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:54.261767  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:54.262499  2323 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.266232  2328 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:54.274761  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:54.241560  3811 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:54.278910  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 92868.1us
W20260709 12:59:54.281642  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 191200us
I20260709 12:59:54.256660  3689 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3.
I20260709 12:59:54.256292  2322 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.259434  3820 raft_consensus.cc:697] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:54.314555  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:54.315742  1558 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 12:59:54.306855  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 217315us
I20260709 12:59:54.317538  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:54.189635  3682 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.314177  1672 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:54.319491  1553 raft_consensus.cc:2410] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:59:54.345301  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 90796.4us
I20260709 12:59:54.256704  3728 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:54.256212  3619 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.260303  3799 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:59:54.262979  3679 consensus_queue.cc:1059] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:59:54.357211  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:54.358166  1556 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:54.304665  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:54.354940  1558 raft_consensus.cc:1240] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:54.347317  2286 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:54.200484  3819 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.393498  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:54.349638  1626 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:54.400485  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:54.394343  1556 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:54.354259  3689 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:54.399505  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 12:59:54.403928  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 123932us
I20260709 12:59:54.405223  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:54.406131  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:54.372169  3704 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.344547  3777 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:59:54.327886  3751 consensus_queue.cc:1059] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:59:54.409283  3811 raft_consensus.cc:697] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:54.421289  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:54.394356  1559 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:54.402534  3689 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.429697  1558 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:54.433208  2323 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
W20260709 12:59:54.427520  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 138159us
I20260709 12:59:54.435215  1598 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:54.437319  3837 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:54.440079  3830 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:59:54.441260  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:54.441937  2321 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.442588  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:54.403076  3801 consensus_queue.cc:237] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:54.445550  2322 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
W20260709 12:59:54.437829  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 56886.1us
I20260709 12:59:54.352504  3714 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.479877  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:54.481012  2323 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
W20260709 12:59:54.479961  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.482049  1598 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:54.428495  3705 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 12:59:54.433369  3821 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
W20260709 12:59:54.482347  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 99464us
W20260709 12:59:54.523135  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 271510us
I20260709 12:59:54.513116  1599 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:54.491113  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 12:59:54.560376  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.607048  1558 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
W20260709 12:59:54.630429  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 424707us
I20260709 12:59:54.628069  2286 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:54.569310  3811 consensus_queue.cc:237] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:54.526568  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 44587.8us
I20260709 12:59:54.438467  3689 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.438995  3758 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:54.658488  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.659955  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:54.660148  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:54.474062  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:54.648380  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:54.662509  1553 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:54.624650  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:54.577589  3714 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.478799  3819 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.439059  3723 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:54.667444  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.682679  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.670044  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 181363us
I20260709 12:59:54.523912  3807 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:54.560242  3622 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:54.694562  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 203567us
I20260709 12:59:54.668625  1556 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 3: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 12:59:54.684156  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.567373  3746 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:54.688707  3815 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:59:54.689539  3845 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:54.691921  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:54.686023  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:54.698292  1555 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 12:59:54.747397  1553 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 12:59:54.679752  3719 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:54.661976  3751 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:54.680154  3809 consensus_meta.cc:287] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.605s	user 0.017s	sys 0.000s
I20260709 12:59:54.666149  3821 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:54.747378  1707 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:54.756075  1706 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:54.760877  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 82051.3us
I20260709 12:59:54.695429  3723 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:54.785027  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 152230us
I20260709 12:59:54.761780  3821 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.742235  3619 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:54.479955  3820 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:54.940088  1709 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:59:54.898157  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.906486  3838 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
W20260709 12:59:54.898833  3633 consensus_meta.cc:287] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.694s	user 0.007s	sys 0.002s
W20260709 12:59:54.880607  3711 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.004s
I20260709 12:59:54.901479  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:54.965195  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:54.883014  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 58737.9us
W20260709 12:59:55.039502  1675 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.697s (SENT) [suppressed 56 similar messages]
W20260709 12:59:54.910560  3836 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
W20260709 12:59:55.039995  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 264235us
I20260709 12:59:54.795547  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.043609  1633 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.905130  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.045130  1627 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:54.900218  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:54.746845  3845 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.785454  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:59:54.940891  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 189026us
I20260709 12:59:54.913879  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:54.901062  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:59:55.106427  2288 leader_election.cc:336] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.897s (SENT)
I20260709 12:59:55.114972  1629 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:55.115309  1702 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:54.701433  3858 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:55.142792  1599 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:54.785900  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:55.116043  1703 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.145242  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:55.117051  1526 connection.cc:256] RPC call timeout handler was delayed by -1.7865818070000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
I20260709 12:59:55.118974  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.145638  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:55.141535  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:54.790256  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 12:59:54.905649  3805 consensus_meta.cc:287] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.742s	user 0.014s	sys 0.000s
I20260709 12:59:54.685276  2322 raft_consensus.cc:2376] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6. Re-sending same reply.
I20260709 12:59:55.118450  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:54.745504  3807 raft_consensus.cc:697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:55.160866  1631 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:55.160007  1526 connection.cc:256] RPC call timeout handler was delayed by -1.7379818070000397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
I20260709 12:59:55.160904  1630 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
W20260709 12:59:55.167769  1526 connection.cc:256] RPC call timeout handler was delayed by -1.7217280530000494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 12:59:55.168188  1526 connection.cc:256] RPC call timeout handler was delayed by -1.6741925979999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
I20260709 12:59:55.160027  1707 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:54.881888  3758 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.761561  3751 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:55.157886  1705 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:55.165277  1628 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:55.042400  3821 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:54.879971  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:55.033628  3852 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:59:54.882187  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:55.120848  3633 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.761416  3809 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:54.776422  3723 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:54.774950  3746 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:54.939865  3810 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:55.191509  3807 consensus_queue.cc:237] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:55.207480  1675 leader_election.cc:336] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.598s (SENT)
I20260709 12:59:55.116803  3845 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.177067  1700 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:55.182271  1627 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 12:59:55.261924  1523 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:54.914371  3801 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.260s
I20260709 12:59:55.186614  3867 consensus_queue.cc:1059] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:55.188079  1626 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:55.190016  1703 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 12:59:55.178966  3751 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:55.179801  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58472.5us
I20260709 12:59:55.036873  3711 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:55.170181  3865 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.170472  3860 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:55.214795  3810 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.220801  3805 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.223990  3799 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:55.229259  3656 raft_consensus.cc:3055] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:55.230259   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:55.235281  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.250428  3622 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:55.256423  3828 raft_consensus.cc:3055] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:55.247666  2326 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:59:55.257957  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.268421  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 61063.3us
I20260709 12:59:55.285400  3867 consensus_queue.cc:1243] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 1.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:59:55.290311  3861 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:59:55.228323  3728 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:55.302490  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.308089  3835 raft_consensus.cc:3055] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:55.321419  3763 raft_consensus.cc:3055] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:55.339947  3866 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 12:59:55.355580  3851 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.196s	user 0.000s	sys 0.003s
I20260709 12:59:55.178777  3758 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:55.273603  3619 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:55.360299  3711 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:55.360921  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 570763us
I20260709 12:59:55.193532  3864 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:55.185206  3633 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:55.371711  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 71534us
I20260709 12:59:55.405750  3656 raft_consensus.cc:740] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 12:59:55.372614  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 209054us
I20260709 12:59:55.203464  3746 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:55.408671  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 228966us
I20260709 12:59:55.410739  3828 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 12:59:55.410118  1675 leader_election.cc:336] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.867s (SENT)
I20260709 12:59:55.466478  1675 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:59:55.269701  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 163318us
W20260709 12:59:55.408141  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.417548  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.419670  1633 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 12:59:55.422763  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:55.470810  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:55.471968  2324 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:55.421789  1672 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:55.423281  3835 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:55.473469  3809 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:55.430085  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:55.474152  3809 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:59:55.474521  2321 consensus_meta.cc:287] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.032s	user 0.012s	sys 0.002s
W20260709 12:59:55.432317  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.474953  2321 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 12:59:55.475504  2321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 739) took 1037 ms. Trace:
I20260709 12:59:55.475849  2321 rpcz_store.cc:276] 0709 12:59:54.438015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.440958 (+  2943us) service_pool.cc:224] Handling call
0709 12:59:55.475435 (+1034477us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:55.477527  3689 consensus_meta.cc:287] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.809s	user 0.011s	sys 0.000s
I20260709 12:59:55.478111  3746 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:55.477941  3689 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:55.480126  3633 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:55.428471  3837 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.432710  3854 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.418488  3860 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:55.427558  3763 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:55.496083  1631 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
W20260709 12:59:55.428774  3719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.007s	sys 0.007s
I20260709 12:59:55.410894  3622 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.476481  3809 consensus_queue.cc:1059] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:59:55.454707  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 737) took 1166 ms. Trace:
I20260709 12:59:55.489789  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:55.372741  3799 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:55.484120  1599 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:55.408095  3810 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:55.443110  3793 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:55.499301  2288 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.035s (SENT)
I20260709 12:59:55.403931  3805 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:55.455369  3619 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.513038  3758 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:55.513660  3793 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:55.516080  3793 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:55.480551  3689 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:55.540234  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 740) took 1026 ms. Trace:
I20260709 12:59:55.543449  2323 rpcz_store.cc:276] 0709 12:59:54.513756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.559182 (+ 45426us) service_pool.cc:224] Handling call
0709 12:59:54.616357 (+ 57175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:54.616669 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:54.616707 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:54.627999 (+ 11292us) log.cc:844] Serialized 26 byte log entry
0709 12:59:55.049245 (+421246us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:55.049288 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.049373 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:55.539916 (+490543us) raft_consensus.cc:1685] finished
0709 12:59:55.539946 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:55.540148 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":369239,"threads_started":1,"wal-append.queue_time_us":490004}
I20260709 12:59:55.551437  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:55.552354  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:55.553344  1706 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 12:59:55.554544  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:55.555312  1703 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.555649  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.556368  1633 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:55.556970  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:55.557186  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.557942  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:55.558699  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:55.559172  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.559901  1629 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:55.560196  1627 raft_consensus.cc:2410] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:59:55.558564  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.558708  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 12:59:55.565286  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.498603  3719 raft_consensus.cc:697] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:55.516789  3619 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:55.537767  3704 consensus_meta.cc:287] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.105s	user 0.011s	sys 0.001s
I20260709 12:59:55.582439  1707 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:59:55.586525  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 102514us
I20260709 12:59:55.584676  1704 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:55.590014  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:55.529589  2322 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:55.482473  3837 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:55.591991  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 181881us
I20260709 12:59:55.593710  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:55.594300  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:55.594806  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:55.612898  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.611078  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:59:55.614897  1675 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.865s (SENT)
I20260709 12:59:55.598567  1705 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:55.574258  3815 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:55.614140  1700 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.626680  1706 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
W20260709 12:59:55.616394  1675 leader_election.cc:336] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.986s (SENT)
I20260709 12:59:55.618052  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.628701  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.629423  1628 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 3: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:55.548516  3746 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:55.615976  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:55.482865  3854 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:55.632725  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 367491us
I20260709 12:59:55.673774  1523 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:55.652863  1675 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:55.653539  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:55.595789  3869 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:55.677101  3869 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 12:59:55.592182  3848 raft_consensus.cc:670] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
W20260709 12:59:55.594512  3714 consensus_meta.cc:287] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.909s	user 0.010s	sys 0.003s
I20260709 12:59:55.678887  3714 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:55.679605  3714 raft_consensus.cc:697] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:55.680990  3714 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:55.683122  1554 raft_consensus.cc:2410] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:59:55.683488  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 67120.7us
I20260709 12:59:55.685385  3881 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:55.666591  1703 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:55.483359  3828 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:55.687552  3828 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:55.688908  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 214883us
I20260709 12:59:55.594435  3704 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:55.610292  3689 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:55.722429  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 223145us
I20260709 12:59:55.473470  3835 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:55.684386  1675 leader_election.cc:336] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.996s (SENT)
I20260709 12:59:55.724123  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.615556  3711 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.502538  2326 rpcz_store.cc:276] 0709 12:59:54.281641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.313855 (+ 32214us) service_pool.cc:224] Handling call
0709 12:59:55.246585 (+932730us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b5800003c98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960eee 0000000000375939 00007f0ede9d41e0 00007f0edea9d0c4 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 12:59:55.247060 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:55.414470 (+167410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.447755 (+ 33285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14337408}
W20260709 12:59:55.727116  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 71312.3us
W20260709 12:59:55.732903  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 77724.8us
I20260709 12:59:55.756652  1599 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:55.757198  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:55.758071  2288 leader_election.cc:336] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.094s (SENT)
W20260709 12:59:55.741487  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 319748us
I20260709 12:59:55.624910  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:55.503938  3656 consensus_queue.cc:260] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:55.725982  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:55.762358  1631 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:55.699365  3758 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:55.770181  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 44324.4us
I20260709 12:59:55.771152  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:55.774266  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:55.750003  3846 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.748365  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:55.770732  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:55.805651  2288 leader_election.cc:336] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.248s (SENT)
W20260709 12:59:55.805567  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 121224us
I20260709 12:59:55.750186  3868 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 12:59:55.807268  1675 leader_election.cc:336] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.000s (SENT)
I20260709 12:59:55.653836  3799 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:55.757675  3711 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:55.818334  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 61809.1us
I20260709 12:59:55.811898  1629 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:55.825462  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.826726  1631 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 12:59:55.825661  1675 leader_election.cc:336] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.017s (SENT)
I20260709 12:59:55.820348  1599 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:55.766781  3815 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:55.834654  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.625422  3763 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:55.742802  3689 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:55.843375  3870 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.228s
I20260709 12:59:55.778378  3758 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:55.846980  3862 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.395s	user 0.000s	sys 0.002s
I20260709 12:59:55.847412  3656 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.836129  3711 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:55.785120  3704 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 12:59:55.812966  3845 consensus_meta.cc:287] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 12:59:55.858024  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.859210  1631 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:55.721675  3860 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:55.861071  3835 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.862025  3837 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:59:55.864724  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 44476.2us
I20260709 12:59:55.865685  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:55.874939  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 103844us
I20260709 12:59:55.836241  3810 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:55.792682  3840 consensus_queue.cc:1059] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.371s
I20260709 12:59:55.883466  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:59:55.887701  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 102933us
I20260709 12:59:55.784391  3719 consensus_queue.cc:237] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:55.853466  3891 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:55.900362  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.901613  1631 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:55.873402  3805 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:55.908677  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 70717.5us
I20260709 12:59:55.880824  3763 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.911105  3689 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:55.909364  2288 leader_election.cc:336] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 3.309s (SENT)
I20260709 12:59:55.866170  3845 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:55.919060  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.913439  2288 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:55.836030  3868 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:55.921857  1675 leader_election.cc:336] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.076s (SENT)
I20260709 12:59:55.831995  3846 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:55.928907  1526 connection.cc:256] RPC call timeout handler was delayed by -1.6038818069999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2397s for a response
W20260709 12:59:55.930565  1526 connection.cc:256] RPC call timeout handler was delayed by -1.59758180700004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2404s for a response
I20260709 12:59:55.941141  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.933878  3689 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:55.943408  3855 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:55.947214  3854 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:59:55.942212  3875 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:59:55.949339  1702 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.952059  1700 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:55.955039  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:55.927714  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:55.962136  1635 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.934720  3805 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:55.965344  1526 connection.cc:256] RPC call timeout handler was delayed by -1.4590925979999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
W20260709 12:59:55.962639  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 86057.8us
I20260709 12:59:55.966976  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:55.941242  3891 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:55.974740  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.971163  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:55.974275  1526 connection.cc:256] RPC call timeout handler was delayed by -1.2781925979999755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2432s for a response
I20260709 12:59:55.955093  3870 raft_consensus.cc:2764] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:59:55.979645  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0845818070000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29740000000000005s for a response
I20260709 12:59:55.869571  3869 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:55.980355  1702 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:55.989982  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:55.989039  1673 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:55.992952  1626 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:55.972777  3619 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:55.999174  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:56.001912  1630 raft_consensus.cc:2410] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:55.991606  3891 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.005566  3891 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:55.977566  3819 consensus_meta.cc:287] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.276s	user 0.011s	sys 0.003s
I20260709 12:59:56.013397  1633 raft_consensus.cc:2410] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:55.982626  3840 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.022862  1673 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:56.023397  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:56.025144  1555 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:56.023948  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:56.037246  1628 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 12:59:56.037678  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 136722us
I20260709 12:59:56.044111  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:56.050535  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.001960  3868 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:56.052114  1558 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 3: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:56.054702  1555 raft_consensus.cc:2410] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:56.052557  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:59:56.053465  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.053880  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:56.059399  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:56.060298  1557 raft_consensus.cc:2368] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4.
W20260709 12:59:56.064005  2288 leader_election.cc:336] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.569s (SENT)
W20260709 12:59:56.064970  2288 leader_election.cc:336] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.569s (SENT)
I20260709 12:59:56.065343  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:56.022493  3891 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:56.072093  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:56.073165  1557 raft_consensus.cc:2376] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4. Re-sending same reply.
W20260709 12:59:56.058566  3865 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.696s	user 0.010s	sys 0.006s
I20260709 12:59:56.079656  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:56.085333  1557 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:56.076268  3746 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:56.087772  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:56.060730  3656 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:56.092227  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:56.093034  1555 raft_consensus.cc:2368] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3.
I20260709 12:59:56.090062  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:56.094148  1558 raft_consensus.cc:2376] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4. Re-sending same reply.
I20260709 12:59:56.095382  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:56.074604  3837 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.037076  3689 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:59:56.079419  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:56.097734  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:56.094698  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:56.074949  3805 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:56.109185  1556 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:59:56.076982  3877 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.113359  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:56.113983  1555 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:56.104372  1554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1734) took 1847 ms (client timeout 1953 ms). Trace:
I20260709 12:59:56.105141  1552 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:56.114889  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:56.116101  1560 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:56.091526  3865 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:56.106670  3809 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.074820  3891 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:56.080569  3860 raft_consensus.cc:3055] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:56.109772  1556 pending_rounds.cc:85] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 4
I20260709 12:59:56.059610  3714 consensus_queue.cc:1059] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
W20260709 12:59:56.114862  1554 rpcz_store.cc:269] 0709 12:59:54.256777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.256954 (+   177us) service_pool.cc:224] Handling call
0709 12:59:56.104138 (+1847184us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54001aa4d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:56.104310 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3234547584}
I20260709 12:59:56.093000  3820 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:56.130187  3898 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:59:56.110085  3837 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.076635  3868 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:59:56.132051  1557 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:56.132189  1673 connection.cc:256] RPC call timeout handler was delayed by -1.4958117470000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260709 12:59:56.095697  3810 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.147370  1635 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
W20260709 12:59:56.169862  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1311787430000209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 12:59:56.150152  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 65533.2us
W20260709 12:59:56.151165  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 61306.7us
I20260709 12:59:56.098637  3892 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.177942  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:56.153849  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44940us
I20260709 12:59:56.156420  1552 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:56.179320  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:56.179940  1557 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:59:56.118834  3622 consensus_meta.cc:287] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.607s	user 0.004s	sys 0.008s
I20260709 12:59:56.158731  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:56.170933  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:56.118451  3711 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:56.151502  1556 pending_rounds.cc:107] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:59:56.191031  1552 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:56.191031  1556 raft_consensus.cc:2889] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:56.177380  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:56.192232  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:56.183198  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:56.098327  3633 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:59:56.195921  1700 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:56.150350  3656 raft_consensus.cc:697] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 12:59:56.196278  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.196784  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.200065  1555 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:56.189703  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:56.151258  3860 raft_consensus.cc:740] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:56.150033  3891 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:56.194494  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:56.206377  1632 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:56.154713  3867 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:56.201040  1628 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 12:59:56.203147  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 105494us
I20260709 12:59:56.187562  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:56.167290  3888 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:56.119699  3805 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.220546  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:56.209959  1599 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:56.211678  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:56.212661  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:56.191156  1559 raft_consensus.cc:1240] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:56.149509  3809 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:56.190361  3711 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:56.212528  3806 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.218011  3839 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:56.219280  1557 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:56.194759  3897 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.056s	user 0.001s	sys 0.001s
I20260709 12:59:56.289223  3873 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:56.262427  1554 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:56.254715  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:56.203996  3807 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 12:59:56.268451  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47979us
I20260709 12:59:56.193904  3622 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.214654  3854 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:56.277112  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 67311.3us
I20260709 12:59:56.270747  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:56.279096  3900 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:56.280752  3689 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:56.281427  3860 consensus_queue.cc:260] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:56.284245  1673 leader_election.cc:336] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.076s (SENT)
I20260709 12:59:56.319697  1673 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:56.284722  3839 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.286166  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:56.324707  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:56.326277  1701 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:56.286914  3847 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 12:59:56.287722  3723 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.020s	user 0.010s	sys 0.003s
I20260709 12:59:56.253906  3819 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:59:56.287961  3806 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.189742  3892 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.132426  3877 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.291939  1675 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:56.224505  3846 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:56.187361  3810 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.291213  1707 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:56.354339  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:56.354483  1707 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:56.354490  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:56.354972  1554 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:56.204873  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:56.222338  3882 raft_consensus.cc:3055] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:56.303215  1599 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:56.273286  3711 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:56.223035  3619 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:56.343335  3900 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:56.376757  1709 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:56.366751  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 63666.6us
I20260709 12:59:56.374886  3809 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:56.373909  3839 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:56.376240  3868 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:56.258911  3865 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:59:56.382457  1599 leader_election.cc:400] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4.
I20260709 12:59:56.345194  1560 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:56.365619  3810 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:56.388152  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:56.388806  1560 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
W20260709 12:59:56.369637  3751 consensus_meta.cc:287] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.080s	user 0.015s	sys 0.000s
I20260709 12:59:56.387234  1554 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:56.389688  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:56.341257  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 110491us
I20260709 12:59:56.221655  3656 consensus_queue.cc:237] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:56.351212  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:56.357389  1706 raft_consensus.cc:2393] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 12:59:56.357436  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 65601.5us
W20260709 12:59:56.396510  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.381705  3821 consensus_meta.cc:287] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.115s	user 0.009s	sys 0.004s
W20260709 12:59:56.343935  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 59711.4us
I20260709 12:59:56.383064  1599 leader_election.cc:403] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:56.368012  3892 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:56.397279  3821 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.399641  1599 leader_election.cc:400] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3.
I20260709 12:59:56.399756  3821 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:56.400112  1599 leader_election.cc:403] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:59:56.364079  3910 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:59:56.368054  3806 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:56.300400  3807 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.389393  3751 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.402841  3807 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:56.402992  3758 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:56.403801  1708 raft_consensus.cc:2393] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:56.403790  3809 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:56.405869  3890 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.480s	user 0.000s	sys 0.003s
I20260709 12:59:56.406729  3622 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:56.342876  3854 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.345897  3714 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:56.387204  3891 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:56.396265  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:56.415578  1675 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:56.229105  3867 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.371981  3819 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:56.353736  3860 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.400835  3858 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4.
I20260709 12:59:56.385113  3877 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:56.361228  3820 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:59:56.352628  3746 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:56.417090  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:56.419782  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:56.420763  3619 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:59:56.451794  3811 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:56.452879  3811 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:56.423797  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:56.350039  3723 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.360857  3882 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 12:59:56.386857  3900 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:59:56.347802  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 90620us
I20260709 12:59:56.366739  3805 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:56.365671  3837 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:56.443485  1675 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:56.457762  1560 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 3: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:56.456768  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 12:59:56.463547  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46521.7us
W20260709 12:59:56.428097  3763 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
I20260709 12:59:56.469041  1526 leader_election.cc:400] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7.
I20260709 12:59:56.439488  3892 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:56.473701  1526 leader_election.cc:403] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:59:56.430146  3622 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.475648  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:56.477054  3913 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:56.459419  3911 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:56.481932  1557 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:56.481932  1629 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:56.483017  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:56.486426  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:56.459237  3846 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:59:56.427453  3758 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:59:56.471975  3858 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 12:59:56.499786  1675 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.853s (SENT)
I20260709 12:59:56.503350  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 12:59:56.511117  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:56.472805  3877 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:56.493973  3619 raft_consensus.cc:2764] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:59:56.493392  3714 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7.
I20260709 12:59:56.533175  3714 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:56.533421  3922 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:59:56.533851  3714 raft_consensus.cc:697] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:56.491827  3746 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:56.500813  3913 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:56.538025  3882 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:56.539361  3882 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:56.539958  3799 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:56.535054  3714 consensus_queue.cc:237] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:56.541736  3867 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:56.543167  3919 consensus_queue.cc:1059] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:59:56.530898  2288 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:56.520151  3877 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:56.494817  3622 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:56.560284  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.561224  1702 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:56.561079  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:56.563027  2288 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:56.564742  1632 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:56.565069  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:56.565881  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:56.566051  1702 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:56.565061  3805 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:56.551724  3820 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:56.569607  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:56.569005  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:56.575090  1706 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:56.568522  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:56.577428  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:56.575796  1705 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
W20260709 12:59:56.567112  3840 consensus_meta.cc:287] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.001s
I20260709 12:59:56.562997  3877 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:56.581634  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:56.584045  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:56.584867  3917 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:59:56.585109  3840 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:56.591269  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:56.575268  3619 raft_consensus.cc:3055] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:56.563084  3763 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:59:56.596721  1709 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:56.600086  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:56.605309  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:56.609787  1705 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:56.614925  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:56.615916  1560 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 12:59:56.560796  3704 raft_consensus.cc:2955] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:56.598958  3619 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:56.625886  3619 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:56.627940  3619 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:56.587021  3912 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:56.646575  3809 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3.
I20260709 12:59:56.650053  3879 raft_consensus.cc:3055] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:56.654745  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.598042  3854 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:56.657948  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:56.659557  1702 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:56.651865  3912 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:56.666131  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:56.656687  3891 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:56.655472  3879 raft_consensus.cc:740] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 12:59:56.672058  3921 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:59:56.666738  3912 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:56.674818  3819 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:56.685070  3920 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:59:56.686604  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 741) took 1269 ms. Trace:
I20260709 12:59:56.687086  2329 rpcz_store.cc:276] 0709 12:59:55.416933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.417133 (+   200us) service_pool.cc:224] Handling call
0709 12:59:55.458799 (+ 41666us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b5800003c98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 12:59:55.521516 (+ 62717us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5800003c98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960e9c 00007f0ed6960a5b 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 12:59:55.521691 (+   175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:55.522224 (+   533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:55.522252 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:55.579098 (+ 56846us) log.cc:844] Serialized 26 byte log entry
0709 12:59:56.385631 (+806533us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b1800245f80. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 12:59:56.423737 (+ 38106us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:56.423781 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:56.424865 (+  1084us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:56.686307 (+261442us) raft_consensus.cc:1685] finished
0709 12:59:56.686336 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:56.686529 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":985,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":59751,"spinlock_wait_cycles":51283200,"thread_start_us":37906,"threads_started":1,"wal-append.queue_time_us":899920}
I20260709 12:59:56.659364  3711 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:56.693676  3622 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:56.695317  3711 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:56.700984  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.702682  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:56.703372  2329 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 12:59:56.707294  1707 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:59:56.710729  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.713020  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:56.713901  2328 raft_consensus.cc:2410] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:56.714468  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:56.717806  2286 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:56.718994  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:56.720196  1558 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:56.721943  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:56.722725  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:56.723417  2324 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:56.722759  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:56.725870  1634 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:56.727381  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:56.730997  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 346) took 1511 ms. Trace:
I20260709 12:59:56.733172  2286 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:56.664636  3723 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:56.732205  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:56.737352  1627 raft_consensus.cc:2393] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:56.737710  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:56.733369  1553 rpcz_store.cc:276] 0709 12:59:55.219929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.258406 (+ 38477us) service_pool.cc:224] Handling call
0709 12:59:55.259039 (+   633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:55.626787 (+367748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:55.626820 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:55.660380 (+ 33560us) log.cc:844] Serialized 26 byte log entry
0709 12:59:55.664866 (+  4486us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:55.664921 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:56.708772 (+1043851us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400050ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:56.708843 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:56.708905 (+    62us) raft_consensus.cc:1685] finished
0709 12:59:56.708927 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:56.730931 (+ 22004us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":185468,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":56970,"spinlock_wait_cycles":514907008,"thread_start_us":147220,"threads_started":2,"wal-append.queue_time_us":6998}
I20260709 12:59:56.738744  2328 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:56.739970  2286 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:56.740687  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:56.741114  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:56.741590  1558 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:59:56.741994  1558 pending_rounds.cc:85] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 5
I20260709 12:59:56.742213  1558 pending_rounds.cc:107] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 12:59:56.734710  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 223690us
I20260709 12:59:56.731031  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:56.743213  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:56.742478  1558 raft_consensus.cc:2889] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:56.748284  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:56.750011  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:56.750761  1627 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:56.752835  1560 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:56.755577  2286 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:56.759301  3879 consensus_queue.cc:260] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:56.760854  3879 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:56.761507  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1786) took 1205 ms. Trace:
I20260709 12:59:56.761888  1630 rpcz_store.cc:276] 0709 12:59:55.556333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.558043 (+  1710us) service_pool.cc:224] Handling call
0709 12:59:56.761303 (+1203260us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b5400125054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:56.761441 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011834624}
I20260709 12:59:56.764194  3916 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:56.730960  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:56.775862  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:56.767524  1672 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:56.757997  2286 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:56.764796  3916 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:56.736709  3763 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:56.778177  1672 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:56.746289  3837 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:56.756826  3854 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:56.797185  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44253.7us
I20260709 12:59:56.790138  3839 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:56.944597  3839 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.799731  3854 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.945291  3839 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:56.945348  3854 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:56.786512  3892 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:56.905676  3807 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:59:56.969300  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 12:59:56.921514  3913 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:56.759320  3793 raft_consensus.cc:3055] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:56.774187  3821 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:56.781997  3763 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.948974  3877 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:57.010227  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 77240.6us
I20260709 12:59:56.973681  3892 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:57.012542  1675 leader_election.cc:336] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 3.219s (SENT)
I20260709 12:59:57.015555  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:56.782331  3916 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:56.789086  3891 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:57.017729  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 223961us
I20260709 12:59:57.007354  3793 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:57.014971  3704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60036 (request call id 80) took 3595 ms. Trace:
I20260709 12:59:57.032747  3881 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:57.005426  3805 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:57.037461  1560 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:56.987592  3622 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:59:57.016883  3892 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:57.014487  3763 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.068063  1601 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:57.006667  3913 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.056434  3820 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:57.047472  3934 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:57.038625  3704 rpcz_store.cc:276] 0709 12:59:53.426654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.546434 (+119780us) service_pool.cc:224] Handling call
0709 12:59:54.029934 (+483500us) log.cc:844] Serialized 501 byte log entry
0709 12:59:55.237161 (+1207227us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b54002885a0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed99fadbe 00007f0ed9a05930 00007f0ed9a058d8 00007f0ed9a05858 00007f0ed9a05813 00007f0ed9a04a9c 00007f0edf8f0626 00007f0edf8eadd8 00007f0ed9a417cb 00007f0ed9a442c0
0709 12:59:57.011447 (+1774286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15273,"raft.queue_time_us":246265,"raft.run_cpu_time_us":2330,"raft.run_wall_time_us":198877,"spinlock_wait_cycles":69094784,"thread_start_us":232031,"threads_started":1,"wal-append.queue_time_us":320280,"wal-append.run_cpu_time_us":6560,"wal-append.run_wall_time_us":1898450}
W20260709 12:59:57.049443  3899 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.977s	user 0.003s	sys 0.000s
I20260709 12:59:57.050912  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 348) took 1830 ms. Trace:
I20260709 12:59:57.052933  3941 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:57.057024  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:57.059314  3751 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:57.061365  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.062279  3860 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.062435  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:57.011301  3821 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.079636  1601 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:57.097862  1601 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:57.098122  1675 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.020980  3891 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.082527  1556 rpcz_store.cc:276] 0709 12:59:55.260708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.260869 (+   161us) service_pool.cc:224] Handling call
0709 12:59:56.104422 (+843553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:56.202117 (+ 97695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.050682 (+848565us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54001aa4d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:57.050846 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1922580352}
I20260709 12:59:57.091236  2327 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:57.078994  3846 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:57.101687  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:59:57.112965  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 142111us
W20260709 12:59:57.108831  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.117600  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.118391  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:57.119939  2288 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:57.084291  3941 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.112321  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:57.123769  1702 raft_consensus.cc:1240] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:57.103915  2322 raft_consensus.cc:2410] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:57.126860  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:57.102738  3891 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.104045  3881 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.084333  3711 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:59:57.101218  3821 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:57.112017  3819 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:57.152866  3819 raft_consensus.cc:697] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:57.153882  3819 consensus_queue.cc:237] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:59:57.132485  3846 raft_consensus.cc:697] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:57.138057  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:57.142524  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 55337.2us
I20260709 12:59:57.156348  3846 consensus_queue.cc:237] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:57.157428  2320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 573) took 1792 ms. Trace:
I20260709 12:59:57.130151  1551 raft_consensus.cc:2410] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:57.158818  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 1979) took 1140 ms. Trace:
I20260709 12:59:57.159188  1551 rpcz_store.cc:276] 0709 12:59:56.018906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.021412 (+  2506us) service_pool.cc:224] Handling call
0709 12:59:57.056850 (+1035438us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960e9c 00007f0ed6960a5b 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 12:59:57.158755 (+101905us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30968448}
I20260709 12:59:57.129005  3751 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:57.128180  3714 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:57.133275  3793 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.161980  3793 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.135731  3656 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.119669  3799 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:57.164992  3799 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:57.164394  3656 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:57.166088  3799 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:57.167112  3656 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:57.164198  3821 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.157917  2320 rpcz_store.cc:276] 0709 12:59:55.364725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.370011 (+  5286us) service_pool.cc:224] Handling call
0709 12:59:55.484412 (+114401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:55.828788 (+344376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:55.832923 (+  4135us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:55.908909 (+ 75986us) log.cc:844] Serialized 26 byte log entry
0709 12:59:56.055229 (+146320us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:56.062847 (+  7618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.139958 (+1077111us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54004f3b54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:57.140046 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:57.140121 (+    75us) raft_consensus.cc:1685] finished
0709 12:59:57.140138 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.157369 (+ 17231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4543,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":24793,"spinlock_wait_cycles":612345216,"thread_start_us":73159,"threads_started":1,"wal-append.queue_time_us":112587,"wal-append.run_cpu_time_us":1650,"wal-append.run_wall_time_us":1003345}
I20260709 12:59:57.157907  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.103322  3860 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.173957  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:57.174655  1631 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:57.175081  3860 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:57.175542  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:57.176218  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.177687  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.178664  1627 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:57.180160  3876 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:57.180975  3876 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:57.179250  3821 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:57.125913  3941 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.151646  3927 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.166559  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1797) took 1549 ms. Trace:
I20260709 12:59:57.184252  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:57.175550  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:57.188019  1633 rpcz_store.cc:276] 0709 12:59:55.617481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.617763 (+   282us) service_pool.cc:224] Handling call
0709 12:59:57.166384 (+1548621us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400247a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:57.166505 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882815232}
I20260709 12:59:57.188607  1631 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
W20260709 12:59:57.155483  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.179287  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5c1e1be9de68405393292149e41c0724 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:57.191082  3656 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.191624  3656 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.192624  3806 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:57.193961  3656 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:57.194828  1551 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:57.196828  1627 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 3: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:57.200611  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:57.202150  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:57.204653  1560 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:57.208314  1556 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:59:57.208896  3679 consensus_queue.cc:1059] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:57.209755  1556 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:57.209932  3679 raft_consensus.cc:3055] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:57.210381  3679 raft_consensus.cc:740] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:57.145668  3945 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:57.213570  1633 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:57.206419  1599 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:57.216138  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:57.217986  1554 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:57.196010  3622 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:57.225371  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1807) took 1307 ms. Trace:
I20260709 12:59:57.231190  1629 rpcz_store.cc:276] 0709 12:59:55.918370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.918658 (+   288us) service_pool.cc:224] Handling call
0709 12:59:57.225097 (+1306439us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54002c88d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:57.225278 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540504832}
I20260709 12:59:57.232124  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:57.202615  3865 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.235252  1553 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:57.243402  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 145329us
W20260709 12:59:57.248337  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 128475us
I20260709 12:59:57.262873  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.269703  3950 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:57.270226  3950 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.270608  3950 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:57.277191  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2382) took 2329 ms (client timeout 2217 ms). Trace:
W20260709 12:59:57.277679  1708 rpcz_store.cc:269] 0709 12:59:54.947404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.947792 (+   388us) service_pool.cc:224] Handling call
0709 12:59:57.276946 (+2329154us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400396f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:57.277088 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3136950016}
W20260709 12:59:57.279018  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1798) took 1650 ms (client timeout 1853 ms). Trace:
I20260709 12:59:57.228399  3945 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.279438  3950 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.280557  1700 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:57.281772  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 358) took 1076 ms. Trace:
I20260709 12:59:57.281975  3950 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:57.282310  1700 rpcz_store.cc:276] 0709 12:59:56.205144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.206149 (+  1005us) service_pool.cc:224] Handling call
0709 12:59:57.280380 (+1074231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.281015 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.281587 (+   572us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400396f50. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:57.281706 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2443381632}
I20260709 12:59:57.284257  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.286105  3821 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:57.286990  3793 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:57.263044  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 12:59:57.279487  1635 rpcz_store.cc:269] 0709 12:59:55.629058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.629200 (+   142us) service_pool.cc:224] Handling call
0709 12:59:57.278862 (+1649662us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54003282d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:57.278962 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518523136}
I20260709 12:59:57.291904  1635 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 12:59:57.295827  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 51067.9us
I20260709 12:59:57.297513  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.305558  1560 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 12:59:57.198045  3927 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:57.350939  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:57.229954  3622 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:57.233227  3877 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:57.310513  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47218.4us
I20260709 12:59:57.316180  1560 raft_consensus.cc:1240] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:57.351641  3874 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.318s	user 0.000s	sys 0.022s
I20260709 12:59:57.312314  3751 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:57.352346  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:57.308339  3656 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:57.211501  3679 consensus_queue.cc:260] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:57.282691  3945 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:57.388186  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:57.390859  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:57.360718  3622 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.355239  3805 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:57.383993  3874 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.390s	user 0.000s	sys 0.023s
I20260709 12:59:57.279368  3854 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.310066  3865 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:57.355036  3821 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:59:57.392403  3714 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:57.389828  1551 raft_consensus.cc:1275] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:59:57.402029  2320 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:57.414136  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.415005  1557 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 12:59:57.379102  3891 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.417459  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.421722  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:57.422624  2329 raft_consensus.cc:2410] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:57.406473  3758 raft_consensus.cc:2764] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:59:57.415885  1551 pending_rounds.cc:85] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 1
I20260709 12:59:57.419137  3714 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:57.421633  3869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.214s	user 0.021s	sys 0.005s
I20260709 12:59:57.441723  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.399451  3839 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.406212  3806 consensus_queue.cc:1059] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:59:57.429487  1551 pending_rounds.cc:107] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:59:57.453639  1551 raft_consensus.cc:2889] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:57.453752  3876 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:57.451272  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:57.410847  3805 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.422075  3913 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:57.457654  1672 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 12:59:57.427927  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 120123us
I20260709 12:59:57.429692  3656 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:57.442153  3869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.247s	user 0.021s	sys 0.005s
I20260709 12:59:57.455449  1704 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:57.429361  3877 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:57.466137  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:57.466856  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:59:57.465278  3912 consensus_meta.cc:287] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.791s	user 0.011s	sys 0.001s
I20260709 12:59:57.455919  3751 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.480491  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:57.483644  1629 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 12:59:57.486238  3865 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:57.493199  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.475906  3913 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:57.489648  3955 log.cc:927] Time spent T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:59:57.489552  3940 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:59:57.508551  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.477023  3656 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:57.486282  3927 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:57.513374  2288 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:59:57.514323  1675 leader_election.cc:336] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.055s (SENT)
I20260709 12:59:57.514758  1675 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:57.516417  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.516696  3967 consensus_queue.cc:1059] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:57.517892  3927 raft_consensus.cc:3055] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:57.518419  3927 raft_consensus.cc:740] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:57.496414  3793 raft_consensus.cc:697] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:57.502986  3877 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:57.526221  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:57.503413  3913 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.519511  3927 consensus_queue.cc:260] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:57.492268  3912 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.527710  1556 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:57.512154  3956 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.498306  3751 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:57.532824  1599 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:57.532922  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.520301  3806 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:57.532672  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:57.515177  3945 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.529556  3876 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:57.528429  3967 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:59:57.561316  3877 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:57.562575  3854 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:57.562395  3763 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.520550  3906 consensus_queue.cc:1059] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:59:57.541531  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:57.566766  1551 raft_consensus.cc:2410] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:57.559283  1556 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.532056  3913 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.527129  3821 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:57.566877  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.543550  1553 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:57.557281  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 12:59:57.583863  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.579996  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 442) took 1005 ms. Trace:
I20260709 12:59:57.529313  3869 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:57.534646  3881 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:57.601564  1630 rpcz_store.cc:276] 0709 12:59:56.574165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.762719 (+188554us) service_pool.cc:224] Handling call
0709 12:59:56.766342 (+  3623us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:56.785242 (+ 18900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:56.785295 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:56.793030 (+  7735us) log.cc:844] Serialized 26 byte log entry
0709 12:59:57.104453 (+311423us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:57.104493 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.104556 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:57.579699 (+475143us) raft_consensus.cc:1685] finished
0709 12:59:57.579721 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.579906 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":12996,"thread_start_us":172035,"threads_started":1,"wal-append.queue_time_us":301458}
I20260709 12:59:57.609535  1556 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:57.609613  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:57.610523  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:57.611061  1556 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.606575  3952 raft_consensus.cc:3055] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:57.576669  3945 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.611833  3952 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:57.613186  3952 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.610879  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:57.614444  1630 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.614794  2325 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:57.566124  3941 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.559911  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 12:59:57.616346  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 49578.9us
I20260709 12:59:57.531127  3758 consensus_queue.cc:1059] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
W20260709 12:59:57.618554  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 61365.4us
I20260709 12:59:57.558502  3927 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:57.540463  3891 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 12:59:57.626308  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:57.578605  3957 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:59:57.630916  1709 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 12:59:57.523005  3958 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:59:57.539149  3912 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:57.560405  3865 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:57.641009  1556 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:57.539696  3956 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:57.613832  3945 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:57.645092  3954 log.cc:927] Time spent T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 12:59:57.646087  3960 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:59:57.646498  3793 consensus_queue.cc:237] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:57.525055  3961 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 12:59:57.647958  2320 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 12:59:57.603426  3953 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 12:59:57.648723  3916 consensus_meta.cc:287] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.571s	user 0.005s	sys 0.006s
I20260709 12:59:57.714154  3916 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.649338  3839 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:57.602150  3763 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:57.654253  3751 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:57.636922  3854 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:57.719854  3854 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:57.664774  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.671540  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:57.687155  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:57.721544  1700 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:57.636688  3876 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:57.663053  3952 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.644366  3941 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:57.689292  3865 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.685240  3906 consensus_queue.cc:1243] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:59:57.678982  3877 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 12:59:57.723846  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 59111.9us
I20260709 12:59:57.725929  1704 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 12:59:57.705574  3882 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.166s	user 0.008s	sys 0.007s
I20260709 12:59:57.720444  3854 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.704886  3805 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:59:57.733381  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.732537  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:57.738979  3656 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:57.744143  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.756292  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:57.731608  3876 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:57.734066  3865 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.773888  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:57.751287  3758 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:57.763094  3901 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 1.675s	user 0.000s	sys 0.007s
I20260709 12:59:57.775275  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:57.774600  1627 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:57.790228  1552 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:57.769449  3879 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:57.796921  3845 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:57.784992  3758 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:57.781956  3912 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:57.810606  1626 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 12:59:57.844883  3912 raft_consensus.cc:697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:57.845436  1701 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:57.845907  3912 consensus_queue.cc:237] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:57.817440  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:57.862435  1629 raft_consensus.cc:2376] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4. Re-sending same reply.
I20260709 12:59:57.818171  3956 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:57.818413  3622 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.825126  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 439) took 1252 ms. Trace:
I20260709 12:59:57.863505  1634 rpcz_store.cc:276] 0709 12:59:56.573157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.604879 (+ 31722us) service_pool.cc:224] Handling call
0709 12:59:57.824958 (+1220079us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b54000da2d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:57.825070 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116772224}
I20260709 12:59:57.864626  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:57.865166  1634 raft_consensus.cc:2376] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4. Re-sending same reply.
I20260709 12:59:57.832893  3758 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:57.791577  3876 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:57.886948  2286 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 12:59:57.888221  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:57.847128  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 745) took 1113 ms. Trace:
I20260709 12:59:57.847708  3916 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:57.889163  2325 rpcz_store.cc:276] 0709 12:59:56.733649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.735251 (+  1602us) service_pool.cc:224] Handling call
0709 12:59:57.614611 (+879360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.615242 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.846942 (+231700us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b5400107550. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:57.847068 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001006336}
I20260709 12:59:57.850325  1555 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:57.852196  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:57.852435  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:57.891273  1700 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 12:59:57.853243  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:57.853428  1704 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:57.854233  1701 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:57.856881  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:57.893208  1558 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.857605  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:57.858139  3815 raft_consensus.cc:3055] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:57.858366  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:57.860103  1601 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 12:59:57.883139  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 71706.9us
W20260709 12:59:57.883852  3892 consensus_meta.cc:287] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.816s	user 0.012s	sys 0.000s
I20260709 12:59:57.891948  1628 raft_consensus.cc:2376] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3. Re-sending same reply.
I20260709 12:59:57.895416  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:57.901742  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 12:59:57.846731  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:57.902261  2286 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:57.818202  3917 raft_consensus.cc:3055] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:57.914249  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 54208.1us
I20260709 12:59:57.852568  3679 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.926891  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:57.926580  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 12:59:57.942296  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.926580  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:57.954857  1701 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 12:59:57.955629  1707 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 12:59:57.931232  1673 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.865s (SENT)
I20260709 12:59:57.959120  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 12:59:57.926072  1630 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 12:59:57.943428  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:57.913396  3805 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:57.983490  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:58.013676  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:57.983490  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:57.900074  3941 consensus_queue.cc:1059] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:59:58.014917  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:57.990520  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:58.015384  1629 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:58.015540  1630 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.974530  1601 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:59:57.995326  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 64144.5us
I20260709 12:59:58.004199  1558 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 12:59:58.018083  3956 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:58.019246  3956 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:58.019609  3956 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:58.020751  3956 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:58.022445  3956 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:57.918102  3975 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.900251  3876 raft_consensus.cc:697] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:57.900159  3815 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 12:59:57.917128  3906 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:57.916352  3821 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:58.041646  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:58.043043  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:57.947930  3917 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 12:59:57.900777  3847 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.128s
I20260709 12:59:58.023599  3870 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:57.928256  3892 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:57.961261  3820 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.157s
I20260709 12:59:57.977401  3763 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:58.071333  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 12:59:58.260205  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.417012  1701 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:58.066805  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.943622  3916 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:58.412504  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.074407  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:58.027957  3723 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:57.927767  1551 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 12:59:58.148520  1630 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:58.065836  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:58.449826  1704 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:58.451344  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:58.452068  1630 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 12:59:58.431257  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:59:58.134279  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 79072.9us
I20260709 12:59:58.093524  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:58.261866  3952 consensus_meta.cc:287] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
W20260709 12:59:58.433147  3983 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 12:59:58.384181  3913 consensus_meta.cc:287] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.751s	user 0.011s	sys 0.000s
W20260709 12:59:58.407722  3982 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:59:58.041384  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 12:59:58.263093  3854 consensus_meta.cc:287] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
I20260709 12:59:58.406361  3877 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.509974  1709 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:58.326848  3978 log.cc:927] Time spent T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
I20260709 12:59:58.484282  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:58.570226  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:58.433686  2320 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:58.039651  3839 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:58.101488  3963 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.065168  3656 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.607131  3656 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:58.542085  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:58.610626  3992 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.611279  1628 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:58.611428  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1815) took 1512 ms. Trace:
I20260709 12:59:58.611981  1632 rpcz_store.cc:276] 0709 12:59:57.098834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.100933 (+  2099us) service_pool.cc:224] Handling call
0709 12:59:58.611221 (+1510288us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400206054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:58.611364 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568842496}
I20260709 12:59:58.544354  1629 raft_consensus.cc:2410] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:59:58.232024  3882 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:58.613070  3984 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:59:58.610668  3656 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:58.550403  1707 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:58.076074  3705 consensus_queue.cc:1059] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.447s
I20260709 12:59:58.042104  3879 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.466s
I20260709 12:59:58.456403  3723 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.443351  3870 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:58.465869  3622 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:58.581833  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 220263us
I20260709 12:59:58.565724  3987 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 12:59:58.582872  2287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.022s	sys 0.012s
W20260709 12:59:58.640017  2287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.022s	sys 0.012s
I20260709 12:59:58.603837  1601 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 12:59:58.383658  3876 consensus_queue.cc:237] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:58.604714  3839 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:58.605852  3963 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 12:59:58.541410  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:58.055862  3975 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:58.613276  3882 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:58.641224  1601 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 12:59:58.624596  3805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.016s	sys 0.012s
W20260709 12:59:58.628110  3949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.012s	sys 0.066s
I20260709 12:59:58.573112  3956 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:59:58.551797  3913 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:58.565971  3854 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:58.675570  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1106100580000202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2217s for a response
W20260709 12:59:58.649298  3949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.012s	sys 0.067s
I20260709 12:59:58.691398  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2013) took 1012 ms. Trace:
W20260709 12:59:58.679692  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.638175  3723 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:58.662459  3805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.017s	sys 0.012s
I20260709 12:59:58.678772  3763 raft_consensus.cc:697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:58.697705  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:58.616515  3877 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:58.702898  1555 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 12:59:58.649737  3821 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:58.691998  1556 rpcz_store.cc:276] 0709 12:59:57.679023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.683418 (+  4395us) service_pool.cc:224] Handling call
0709 12:59:57.683726 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:57.684053 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:57.684081 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:57.684505 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 12:59:57.771426 (+ 86921us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:57.771624 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.771718 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:58.691099 (+919381us) raft_consensus.cc:1685] finished
0709 12:59:58.691128 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:58.691316 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":440,"raft.queue_time_us":87,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":12380,"thread_start_us":84984,"threads_started":1,"wal-append.queue_time_us":208582}
I20260709 12:59:58.645687  3705 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:58.681360  3873 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:58.611336  3992 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:58.600510  3917 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:58.713871  3806 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.119s	user 0.013s	sys 0.000s
I20260709 12:59:58.716097  3704 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.708118  3705 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.689368  3906 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.650934  3987 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:58.733968  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:58.749716  3906 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:58.700452  3805 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:58.752326  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:58.753150  3987 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:58.753504  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:58.753877  3892 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:58.754132  1555 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:58.753552  3805 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:58.745237  3704 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:58.746081  3705 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:58.746349  3975 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:58.746531  3917 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:58.644368  3870 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:58.787555  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:58.806669  1555 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
W20260709 12:59:58.718958  3912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.007s	sys 0.033s
I20260709 12:59:58.749258  3806 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:58.815820  2328 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:58.819144  2323 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:58.822396  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:58.787190  3987 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.799710  3941 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:58.830420  3941 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:58.831560  3992 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:58.833354  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:58.834498  2322 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:58.823520  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.813788  3912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.008s	sys 0.034s
I20260709 12:59:58.833976  3870 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:58.823541  1555 raft_consensus.cc:2376] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5. Re-sending same reply.
I20260709 12:59:58.832362  3941 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:58.849480  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.822526  3819 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 12:59:58.844018  3956 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.879292  3839 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:58.880782  3882 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 12:59:58.883490  1626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 426) took 2726 ms (client timeout 1711 ms). Trace:
W20260709 12:59:58.889326  3865 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.109s	user 0.007s	sys 0.004s
I20260709 12:59:58.889815  3865 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:58.891430  3927 consensus_meta.cc:287] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.215s	user 0.009s	sys 0.000s
I20260709 12:59:58.891959  3865 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:58.892304  1628 raft_consensus.cc:1275] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:58.858460  3821 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:58.894047  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1828) took 1286 ms. Trace:
I20260709 12:59:58.894517  1628 rpcz_store.cc:276] 0709 12:59:57.607887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.612102 (+1004215us) service_pool.cc:224] Handling call
0709 12:59:58.612538 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.892722 (+280184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.893763 (+  1041us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54002d7654. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:58.893974 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642281344}
I20260709 12:59:58.901530  1635 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:58.902559  1630 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 12:59:58.907673  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.860456  3912 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.869174  3854 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:58.842474  3987 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:58.957118  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 12:59:58.916247  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.929471  3912 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:58.928812  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 366) took 1736 ms. Trace:
W20260709 12:59:58.884028  1626 rpcz_store.cc:269] 0709 12:59:56.157009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.160783 (+  3774us) service_pool.cc:224] Handling call
0709 12:59:58.883247 (+2722464us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54001bb054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 12:59:58.883408 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3119058304}
I20260709 12:59:58.980983  1559 rpcz_store.cc:276] 0709 12:59:57.191998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.204083 (+ 12085us) service_pool.cc:224] Handling call
0709 12:59:58.927579 (+1723496us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 12:59:58.927865 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.928225 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:58.928313 (+    88us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:58.928384 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:58.928443 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.928535 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:58.928740 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44084608}
I20260709 12:59:58.982450  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:58.982781  3912 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:58.983232  1559 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 2: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 12:59:58.983343  3758 consensus_meta.cc:287] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.071s	user 0.012s	sys 0.000s
I20260709 12:59:58.983798  3758 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 12:59:58.932458  3973 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 1.221s	user 0.002s	sys 0.000s
I20260709 12:59:58.822415  3763 consensus_queue.cc:237] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:58.986178  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 368) took 1598 ms. Trace:
I20260709 12:59:58.986613  3723 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:58.987733  3987 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 12:59:58.929229  3906 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:58.986693  1560 rpcz_store.cc:276] 0709 12:59:57.388121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.388934 (+   813us) service_pool.cc:224] Handling call
0709 12:59:57.390906 (+  1972us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:57.391297 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:57.391328 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:57.396220 (+  4892us) log.cc:844] Serialized 26 byte log entry
0709 12:59:57.660761 (+264541us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:57.660820 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.660912 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:58.931540 (+1270628us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 12:59:58.985754 (+ 54214us) raft_consensus.cc:1685] finished
0709 12:59:58.985775 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:58.986119 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2437,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6507,"spinlock_wait_cycles":83582848,"thread_start_us":261333,"threads_started":1,"wal-append.queue_time_us":310153}
I20260709 12:59:58.990693  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:58.992106  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 367) took 1724 ms. Trace:
I20260709 12:59:58.992646  1553 rpcz_store.cc:276] 0709 12:59:57.267686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.310988 (+ 43302us) service_pool.cc:224] Handling call
0709 12:59:57.361765 (+ 50777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.600755 (+238990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.991867 (+1391112us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400160154. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:58.992031 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417413376}
I20260709 12:59:58.993747  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:58.994962  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:58.995725  1553 raft_consensus.cc:2393] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 12:59:58.873692  3819 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:58.999176  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:58.928126  3877 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:59.002043  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:59.002413  3877 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:59.003451  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:58.996433  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:58.992062  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:59.000499  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:59.010102  2325 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:58.934882  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:59.030028  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:59.037063  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:59.026932  1708 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:59.070211  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2030) took 1016 ms. Trace:
I20260709 12:59:59.070686  1708 rpcz_store.cc:276] 0709 12:59:58.054120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.934529 (+880409us) service_pool.cc:224] Handling call
0709 12:59:59.070130 (+135601us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:58.928397  2321 raft_consensus.cc:2955] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 12:59:59.089507  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:59.090260  1558 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 12:59:59.091590  1558 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:59:59.092918  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:59.093912  3705 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:59.103432  1560 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:59:58.945535  3679 consensus_meta.cc:287] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.978s	user 0.012s	sys 0.000s
I20260709 12:59:59.177022  3705 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 12:59:59.178002  3972 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.463s	user 0.000s	sys 0.002s
I20260709 12:59:58.983418  3912 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.180778  3912 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:59.182334  3758 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:59.182734  3912 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:58.914218  3956 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 12:59:59.185632  3956 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:58.928632  3963 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 12:59:59.187089  3723 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:59.195524  2322 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 12:59:59.197255  1558 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:58.984124  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 12:59:58.932849  3913 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 12:59:58.862277  3916 raft_consensus.cc:697] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 12:59:59.221537  3656 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:58.892040  3927 consensus_queue.cc:1059] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.307s
I20260709 12:59:58.910121  3865 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.327s
W20260709 12:59:59.407624  1525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.022s	sys 0.012s
I20260709 12:59:59.385879  1672 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 12:59:59.410158  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:59.447156  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:59.780774  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 394835us
I20260709 12:59:59.767649  1558 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:59.288363  1674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.032s	sys 0.064s
I20260709 12:59:59.787971  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1768) took 1063 ms. Trace:
W20260709 12:59:59.788316  1674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.367s	user 0.061s	sys 0.098s
I20260709 12:59:59.788762  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 744) took 3061 ms. Trace:
I20260709 12:59:59.788491  1558 rpcz_store.cc:276] 0709 12:59:58.724420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.198401 (+473981us) service_pool.cc:224] Handling call
0709 12:59:59.767265 (+568864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.787640 (+ 20375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.787909 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.789332  2327 rpcz_store.cc:276] 0709 12:59:56.726887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.729263 (+  2376us) service_pool.cc:224] Handling call
0709 12:59:56.729771 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.103289 (+373518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.788503 (+2685214us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400078d54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:59.788695 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830680832}
I20260709 12:59:59.790979  2327 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:59.241204  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 12:59:59.792716  2328 raft_consensus.cc:2410] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
W20260709 12:59:59.793033  1632 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.179s	user 0.000s	sys 0.017s
W20260709 12:59:59.793612  1632 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.180s	user 0.000s	sys 0.017s
I20260709 12:59:59.596554  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:59.795002  1556 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 12:59:59.795455  1525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.026s	sys 0.014s
W20260709 12:59:59.323128  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1539969629999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
I20260709 12:59:59.234576  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 12:59:59.797672  1555 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 12:59:59.798600  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1770) took 1073 ms. Trace:
I20260709 12:59:59.782887  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2016) took 3203 ms. Trace:
I20260709 12:59:59.799110  1555 rpcz_store.cc:276] 0709 12:59:58.725360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.030538 (+305178us) service_pool.cc:224] Handling call
0709 12:59:59.798512 (+767974us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.799257  1702 rpcz_store.cc:276] 0709 12:59:56.579099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.667118 (+ 88019us) service_pool.cc:224] Handling call
0709 12:59:56.667391 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.124313 (+456922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.782523 (+2658210us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b5400398d54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 12:59:59.782808 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048895232}
W20260709 12:59:59.248688  1675 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.011s	sys 0.020s
W20260709 12:59:59.800348  1675 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.207s	user 0.011s	sys 0.044s
W20260709 12:59:59.800681  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 1.20793e+06us
W20260709 12:59:59.804946  2324 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.008s	sys 0.004s
W20260709 12:59:59.805526  2324 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.009s	sys 0.004s
I20260709 12:59:59.827075  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1749) took 1140 ms. Trace:
I20260709 12:59:59.827603  1556 rpcz_store.cc:276] 0709 12:59:58.687167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.707208 (+ 20041us) service_pool.cc:224] Handling call
0709 12:59:59.596375 (+889167us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 12:59:59.827003 (+230628us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5564672}
W20260709 12:59:59.724186  1551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.000s	sys 0.011s
I20260709 12:59:59.856122  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 586) took 1027 ms. Trace:
I20260709 12:59:59.857930  2328 rpcz_store.cc:276] 0709 12:59:58.828511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.829373 (+   862us) service_pool.cc:224] Handling call
0709 12:59:59.241046 (+411673us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b5800003c98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 12:59:59.856030 (+614984us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26263296}
I20260709 12:59:59.521919  1559 raft_consensus.cc:1275] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:59.238869  3993 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:59.862190  1701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.223s	user 0.055s	sys 0.084s
I20260709 12:59:59.402549  3992 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.303313  3912 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.867447  2328 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:59.856822  1551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.000s	sys 0.014s
W20260709 12:59:59.870846  1701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.232s	user 0.055s	sys 0.084s
I20260709 12:59:59.802955  3963 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:59.784991  3882 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:59.871726  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:59.873070  1598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.000s	sys 0.014s
I20260709 12:59:59.853240  3622 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 12:59:59.887609  1598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.000s	sys 0.014s
W20260709 12:59:59.888159  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 1.01904e+06us
W20260709 12:59:59.873473  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.178s	user 0.013s	sys 0.025s
W20260709 12:59:59.889310  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.194s	user 0.014s	sys 0.025s
I20260709 12:59:59.889374  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:59.890098  1705 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 12:59:59.874163  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 591) took 1012 ms. Trace:
I20260709 12:59:59.891856  2328 rpcz_store.cc:276] 0709 12:59:58.862106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.860735 (+998629us) service_pool.cc:224] Handling call
0709 12:59:59.861093 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.873921 (+ 12828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.874110 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.766438  3819 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 12:59:59.377365  3892 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:59.853653  4005 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.878186  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:59.803390  3916 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:59.873356  3992 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:59.877635  2325 consensus_meta.cc:287] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.867s	user 0.010s	sys 0.003s
W20260709 12:59:59.880407  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.181s	user 0.024s	sys 0.016s
I20260709 12:59:59.852780  3997 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.398590  3913 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 12:59:59.901081  1704 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:59.910985  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:59.900681  1703 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:59.947530  2325 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 12:59:59.883037  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:59.885059  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 12:59:59.878536  3879 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.224s	user 0.055s	sys 0.110s
I20260709 12:59:59.894105  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:59.802495  3656 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 12:59:59.946085  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.247s	user 0.026s	sys 0.016s
I20260709 12:59:59.952242  1709 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 12:59:59.948601  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:59.899673  2328 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:59.950176  1708 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
W20260709 12:59:59.954355  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 1.25526e+06us
I20260709 12:59:59.947184  1705 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 12:59:59.949817  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:59.887356  4001 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:59.956694  2286 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 12:59:59.958941  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:59.961337  1631 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 12:59:59.957140  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:59.962141  1627 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:59.954727  1704 raft_consensus.cc:1275] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:59:59.952615  1526 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.180s	user 0.033s	sys 0.047s
W20260709 12:59:59.966188  1526 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.194s	user 0.035s	sys 0.047s
W20260709 12:59:59.966495  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 1.19402e+06us
I20260709 12:59:59.959815  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 592) took 1095 ms. Trace:
I20260709 12:59:59.956884  2325 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:59.967204  2328 rpcz_store.cc:276] 0709 12:59:58.867852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.892725 (+1024873us) service_pool.cc:224] Handling call
0709 12:59:59.893047 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.959149 (+ 66102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.959700 (+   551us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.968149  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 12:59:59.891642  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1772) took 1163 ms. Trace:
I20260709 12:59:59.970197  2325 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:59.974730  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 12:59:59.947676  4008 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 12:59:59.975454  2328 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 12:59:59.977340  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:59.977741  1709 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:59.978408  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 12:59:59.951882  3879 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.309s	user 0.056s	sys 0.110s
I20260709 12:59:59.879676  3912 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:59.913604  4004 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 12:59:59.877300  3993 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:59.980067  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:59.979219  1627 raft_consensus.cc:2368] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5.
I20260709 12:59:59.991317  1631 raft_consensus.cc:2410] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:59.990662  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 12:59:59.992426  1704 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:59.982201  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 12:59:59.924300  4000 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:59.954784  3821 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.059s	user 0.004s	sys 0.015s
I20260709 12:59:59.897848  3622 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:59.943213  3819 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.988729  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:59.956131  2322 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 12:59:59.992347  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 12:59:59.981844  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.976617  1559 rpcz_store.cc:276] 0709 12:59:58.726175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.510427 (+784252us) service_pool.cc:224] Handling call
0709 12:59:59.517218 (+  6791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.869841 (+352623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.889926 (+ 20085us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.974071  3839 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:59.980975  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:00.014249  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:00.015551  1628 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:59:59.995981  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 12:59:59.893877  3882 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:59.982756  4018 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:59.997339  3805 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.092s	user 0.005s	sys 0.016s
I20260709 13:00:00.016520  1631 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:00.004859  1627 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 12:59:59.990470  3927 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.045879  3876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.292s	user 0.018s	sys 0.080s
W20260709 13:00:00.046681  3876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.320s	user 0.018s	sys 0.080s
I20260709 13:00:00.046123  3927 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:00.046954  1627 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:59.954700  3913 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.012936  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 12:59:59.990103  4021 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.954914  3997 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 12:59:59.912846  3892 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.000905  4015 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:00.047745  3876 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.048462  1553 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.008s	sys 0.012s
W20260709 12:59:59.999614  3821 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.005s	sys 0.016s
I20260709 12:59:59.965420  4001 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 12:59:59.998600  3879 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 12:59:59.952414  4005 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:00.051594  1628 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:00.049549  1702 raft_consensus.cc:2955] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:00.267433  1709 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:00.083070  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:00.179565  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.272668  1703 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:59.996438  4004 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:00.285142  1553 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.190s	user 0.010s	sys 0.015s
I20260709 13:00:00.002084  4013 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.114270  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1819) took 3014 ms. Trace:
I20260709 13:00:00.319723  1633 rpcz_store.cc:276] 0709 12:59:57.099941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.218014 (+118073us) service_pool.cc:224] Handling call
0709 12:59:57.218422 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:58.418760 (+1200338us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b18003b6140. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a7dbfb 00007f0ed9a8864b
0709 12:59:58.419011 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:58.419038 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:58.419880 (+   842us) log.cc:844] Serialized 26 byte log entry
0709 12:59:58.821234 (+401354us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:58.821268 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.821351 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:00.049383 (+1228032us) raft_consensus.cc:1685] finished
0709 13:00:00.049401 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.114176 (+ 64775us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":158887,"raft.run_cpu_time_us":714,"raft.run_wall_time_us":10205,"spinlock_wait_cycles":5282560,"thread_start_us":435086,"threads_started":2,"wal-append.queue_time_us":1004224}
I20260709 13:00:00.238863  1626 raft_consensus.cc:2368] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4.
I20260709 13:00:00.335451  2327 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:00.086613  3763 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.082s	user 0.011s	sys 0.010s
W20260709 13:00:00.045106  3805 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.143s	user 0.006s	sys 0.016s
I20260709 13:00:00.022032  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 589) took 1164 ms. Trace:
I20260709 13:00:00.355822  1707 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:00.349486  1557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 2004) took 3150 ms (client timeout 1837 ms). Trace:
W20260709 13:00:00.356786  1557 rpcz_store.cc:269] 0709 12:59:57.199415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.200299 (+   884us) service_pool.cc:224] Handling call
0709 13:00:00.349183 (+3148884us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54000b6dd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:00.349344 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490763520}
W20260709 13:00:00.048848  3944 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.164s	user 0.010s	sys 0.010s
I20260709 13:00:00.337990  1628 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:00.352103  1627 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:00:00.372792  1525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.003s	sys 0.024s
I20260709 13:00:00.050160  3839 raft_consensus.cc:697] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:00:00.373456  1525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.003s	sys 0.025s
I20260709 13:00:00.113202  4016 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.375379  1632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.023s	sys 0.077s
W20260709 13:00:00.386229  1632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.023s	sys 0.077s
W20260709 13:00:00.352833  3763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.349s	user 0.015s	sys 0.020s
I20260709 13:00:00.001457  4000 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.350082  3963 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:00.303870  3876 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:00.389088  1633 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:00:00.392938  2288 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.724s (SENT) [suppressed 44 similar messages]
W20260709 13:00:00.397428  1601 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.018s	sys 0.017s
W20260709 13:00:00.420919  1601 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.018s	sys 0.017s
W20260709 13:00:00.421386  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 784544us
W20260709 13:00:00.407928  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.015s	sys 0.020s
I20260709 13:00:00.410565  1703 raft_consensus.cc:2410] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:00:00.375629  3944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.487s	user 0.015s	sys 0.016s
I20260709 13:00:00.013341  3819 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:00.388643  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.024s	sys 0.081s
W20260709 13:00:00.435847  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.024s	sys 0.081s
I20260709 13:00:00.304109  3879 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.438037  1672 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:00.439980  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:00.267505  4021 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.304625  4015 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:00.428092  1556 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:00.428470  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.007s	sys 0.011s
W20260709 13:00:00.446872  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.007s	sys 0.011s
I20260709 13:00:00.081012  4018 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:00.399848  2320 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:00.365396  2322 rpcz_store.cc:276] 0709 12:59:58.853514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.217795 (+364281us) service_pool.cc:224] Handling call
0709 13:00:00.017724 (+799929us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:00.422822  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.015s	sys 0.021s
I20260709 13:00:00.423573  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:00.447649  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:00.449883  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:00.468734  1557 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
W20260709 13:00:00.428570  2321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.007s	sys 0.012s
I20260709 13:00:00.469146  1559 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:00.347981  4013 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:00.468788  1556 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 13:00:00.470376  1629 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:00:00.473058  2321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.007s	sys 0.013s
I20260709 13:00:00.471591  4035 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.435302  3992 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:00.433233  3656 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:00.482784  3912 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:00.486886  3927 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:00.449590  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 474888us
I20260709 13:00:00.399076  4016 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:00.510269  3882 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:00.546653  4001 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:00.561586  4000 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:00.560676  3979 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 1.931s	user 0.015s	sys 0.005s
I20260709 13:00:00.562676  3828 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.574725  3828 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.578011  3828 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:00.562701  4018 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:00.563318  4021 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:00.563536  3876 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:00.564045  4005 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:00.564339  3932 raft_consensus.cc:3055] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:00.581409  3932 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:00.564743  4004 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:00.564963  4016 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:00.568032  4012 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:00.583961  4012 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.587194  4012 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:00.589648  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1830) took 2846 ms (client timeout 3333 ms). Trace:
W20260709 13:00:00.590282  1630 rpcz_store.cc:269] 0709 12:59:57.743664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.569981 (+826317us) service_pool.cc:224] Handling call
0709 13:00:00.589414 (+2019433us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b5400125054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:00.589584 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762187136}
I20260709 13:00:00.521780  4035 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.569444  4013 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:00.595175  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1752) took 1907 ms. Trace:
I20260709 13:00:00.595865  3932 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.595638  1560 rpcz_store.cc:276] 0709 12:59:58.688375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.088704 (+400329us) service_pool.cc:224] Handling call
0709 12:59:59.089170 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:59.104221 (+ 15051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.594886 (+1490665us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5400028354. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:00.595111 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31731456}
I20260709 13:00:00.598083  2320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 605) took 1887 ms. Trace:
I20260709 13:00:00.598573  2320 rpcz_store.cc:276] 0709 12:59:58.711010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.713080 (+  2070us) service_pool.cc:224] Handling call
0709 12:59:58.713630 (+   550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.473685 (+1760055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.597816 (+124131us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54004376d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:00.598016 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3822172416}
W20260709 13:00:00.560541  1704 consensus_meta.cc:287] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.000s
I20260709 13:00:00.600229  1704 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:00.547283  4015 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:00.547425  4014 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
W20260709 13:00:00.548198  4017 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:00:00.539971  3927 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.549858  4030 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:00.522673  3993 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:00.551280  2321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 584) took 1739 ms. Trace:
W20260709 13:00:00.553109  4023 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:00:00.554258  3819 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:00.555840  3970 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.557799  4026 log.cc:927] Time spent T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:00:00.558516  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 590) took 1701 ms. Trace:
W20260709 13:00:00.558681  4025 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:00:00.559607  4024 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:00:00.561877  3892 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:00.582731  1457 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57414 (request call id 189) took 14000 ms (client timeout 15000 ms). Trace:
I20260709 13:00:00.603734  3997 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:00.605058  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 445) took 3134 ms. Trace:
I20260709 13:00:00.605218  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 749) took 3838 ms. Trace:
I20260709 13:00:00.514462  3963 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.504140  3839 consensus_queue.cc:237] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.606295  3763 consensus_queue.cc:1059] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:00.544718  4029 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.662222  2327 rpcz_store.cc:276] 0709 12:59:58.857080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.791944 (+934864us) service_pool.cc:224] Handling call
0709 12:59:59.792228 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.355152 (+562924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.558220 (+203068us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b5400729054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:00.558452 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248684800}
I20260709 13:00:00.607388  3815 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:00.672489  1635 rpcz_store.cc:276] 0709 12:59:57.470373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.472228 (+  1855us) service_pool.cc:224] Handling call
0709 12:59:58.901055 (+1428827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.902048 (+   993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.604854 (+1702806us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54001bb050. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:00.604998 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3255753600}
W20260709 13:00:00.678288  4010 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 1.856s	user 0.009s	sys 0.015s
I20260709 13:00:00.682170  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 582) took 1901 ms. Trace:
I20260709 13:00:00.684005  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:00.688220  1552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 374) took 2831 ms (client timeout 2871 ms). Trace:
I20260709 13:00:00.749529  1707 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
W20260709 13:00:00.749812  1552 rpcz_store.cc:269] 0709 12:59:57.856546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.858179 (+  1633us) service_pool.cc:224] Handling call
0709 13:00:00.687931 (+2829752us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b540017edd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:00.688132 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4936890624}
I20260709 13:00:00.709618  3704 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:00.714172  3998 raft_consensus.cc:3055] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:00.719815  3952 raft_consensus.cc:3055] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:00.721246  3679 raft_consensus.cc:3055] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:00.721617  3980 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 2.206s	user 0.016s	sys 0.005s
I20260709 13:00:00.722749  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 581) took 1956 ms. Trace:
I20260709 13:00:00.764819  2329 rpcz_store.cc:276] 0709 12:59:58.766628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.767528 (+   900us) service_pool.cc:224] Handling call
0709 13:00:00.722510 (+1954982us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b5400566654. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:00.722673 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4307071360}
W20260709 13:00:00.724539  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.672611  2324 rpcz_store.cc:276] 0709 12:59:56.766876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.767101 (+   225us) service_pool.cc:224] Handling call
0709 12:59:56.795518 (+ 28417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:56.907941 (+112423us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:56.987286 (+ 79345us) log.cc:844] Serialized 14 byte log entry
0709 12:59:58.802382 (+1815096us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b1800353b60. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a8f716 00007f0ed9aa0287 00007f0ed9aa0208
0709 12:59:59.852048 (+1049666us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:59.852128 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:59.852199 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.604985 (+752786us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400104354. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:00.605037 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.605159 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9858,"prepare.queue_time_us":78580,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":112425,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":13530,"spinlock_wait_cycles":268124416,"thread_start_us":1003406,"threads_started":1}
W20260709 13:00:00.766153  1599 connection.cc:256] RPC call timeout handler was delayed by -2.588591565999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
I20260709 13:00:00.767827  3679 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:00.768989  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2389) took 2640 ms. Trace:
I20260709 13:00:00.769402  1700 rpcz_store.cc:276] 0709 12:59:58.128974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.197221 (+ 68247us) service_pool.cc:224] Handling call
0709 12:59:58.416847 (+219626us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:58.457977 (+ 41130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:58.458008 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:58.536702 (+ 78694us) log.cc:844] Serialized 26 byte log entry
0709 12:59:58.683231 (+146529us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:58.683283 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.683358 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:00.677408 (+1994050us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:00.762805 (+ 85397us) raft_consensus.cc:1685] finished
0709 13:00:00.762829 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.768924 (+  6095us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5671,"raft.queue_time_us":197798,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":10996,"spinlock_wait_cycles":10630784,"thread_start_us":77936,"threads_started":1,"wal-append.queue_time_us":155936}
I20260709 13:00:00.775167  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:00.773886  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 454) took 2999 ms. Trace:
I20260709 13:00:00.737795  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2391) took 2417 ms. Trace:
I20260709 13:00:00.791002  1701 rpcz_store.cc:276] 0709 12:59:58.320553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.457967 (+137414us) service_pool.cc:224] Handling call
0709 12:59:58.537521 (+ 79554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:58.538101 (+   580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:58.538180 (+    79us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:58.577554 (+ 39374us) log.cc:844] Serialized 26 byte log entry
0709 12:59:59.877469 (+1299915us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:00.383138 (+505669us) log.cc:844] Serialized 14 byte log entry
0709 13:00:00.652823 (+269685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.652905 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:00.737500 (+ 84595us) raft_consensus.cc:1685] finished
0709 13:00:00.737528 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.737712 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":623137,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":166308,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":60,"thread_start_us":1991272,"threads_started":3,"wal-append.queue_time_us":1489270}
I20260709 13:00:00.792766  3962 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.671705  3970 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.793609  3962 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.656278  3927 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.782147  1632 rpcz_store.cc:276] 0709 12:59:57.774037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.613008 (+838971us) service_pool.cc:224] Handling call
0709 12:59:58.613321 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.613536 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:59.802870 (+1189334us) log.cc:844] Serialized 14 byte log entry
0709 13:00:00.773538 (+970668us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:00.773592 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:00.773642 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.773717 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.773828 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1314856,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":175657,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":2150335,"threads_started":3,"wal-append.queue_time_us":744928}
I20260709 13:00:00.796972  3927 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:00.662180  4030 raft_consensus.cc:697] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:00.798427  4030 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.741541  3879 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:00.671752  1457 rpcz_store.cc:269] 0709 12:59:46.582489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.590936 (+  8447us) service_pool.cc:224] Handling call
0709 13:00:00.582631 (+13991695us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:53.648884 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:53.789455 (+140571us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:53.789512 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:59:53.789531 (+    19us) tablet.cc:662] Decoding operations
0709 12:59:54.028515 (+238984us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:54.028618 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:54.028646 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:59:54.029088 (+   442us) tablet.cc:701] Row locks acquired
0709 12:59:54.029134 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:59:54.029287 (+   153us) write_op.cc:270] Start()
0709 12:59:54.029455 (+   168us) write_op.cc:276] Timestamp: P: 1783601994029224 usec, L: 0
0709 12:59:54.029477 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:59:54.030236 (+   759us) log.cc:844] Serialized 1302 byte log entry
0709 12:59:54.697623 (+667387us) spinlock_profiling.cc:243] Waited 95.4 ms on lock 0x7b540029fca0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ef090 00007f0ed99fc6b8 00007f0ed99fc2fa 00007f0ed9a80965 00007f0ed9a80e09 00007f0edd4bb581 00007f0edd4bad58 00007f0edd4bf9f1 00007f0edd4bf9a9 00007f0edd4bf939 00007f0edd4bf901
0709 12:59:55.332421 (+634798us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b18002c1b80. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0edd4bc41d 00007f0edd4be71a 00007f0edd4be6a8 00007f0edd4be628 00007f0edd4be5e3 00007f0edd4bd7fc 00007f0edf8f0626 00007f0edf8eadd8 00007f0ed9a91310
0709 12:59:55.332511 (+    90us) op_driver.cc:464] REPLICATION: finished
0709 12:59:55.472051 (+139540us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540029f754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a8232a 00007f0ed9a07f14 00007f0ed9a07ec3 00007f0ed9a07e38 00007f0ed9a07df3 00007f0ed9a070dc 00007f0ed9a30e16 00007f0ed9a18cbb 00007f0ed9a0339d 00007f0ed9a06d75
0709 12:59:55.669430 (+197379us) write_op.cc:301] APPLY: starting
0709 12:59:55.746024 (+ 76594us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:55.814216 (+ 68192us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:55.837020 (+ 22804us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:55.993268 (+156248us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:55.993611 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:59:55.993655 (+    44us) write_op.cc:312] APPLY: finished
0709 12:59:55.994036 (+   381us) log.cc:844] Serialized 35 byte log entry
0709 12:59:57.193776 (+1199740us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed697b0ac 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b
0709 12:59:57.424216 (+230440us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:57.443137 (+ 18921us) write_op.cc:454] Released schema lock
0709 12:59:57.456346 (+ 13209us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:57.486983 (+ 30637us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:57.487021 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40602,"reported_tablets":6,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":234001,"apply.run_cpu_time_us":28154,"apply.run_wall_time_us":1864083,"num_ops":3,"prepare.queue_time_us":335617,"prepare.run_cpu_time_us":25451,"prepare.run_wall_time_us":1134448,"raft.queue_time_us":262444,"raft.run_cpu_time_us":27612,"raft.run_wall_time_us":948686,"replication_time_us":738089,"spinlock_wait_cycles":763084288,"thread_start_us":1954874,"threads_started":5,"wal-append.queue_time_us":1451303,"wal-append.run_cpu_time_us":46159,"wal-append.run_wall_time_us":2472649}]]}
I20260709 13:00:00.744732  4029 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:00.746596  3913 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:00.656677  2321 rpcz_store.cc:276] 0709 12:59:58.812015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.815116 (+  3101us) service_pool.cc:224] Handling call
0709 12:59:58.865084 (+ 49968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.914123 (+ 49039us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:59.540364 (+626241us) log.cc:844] Serialized 14 byte log entry
0709 13:00:00.515595 (+975231us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:00.519100 (+  3505us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:00.532838 (+ 13738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.540443 (+  7605us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.551203 (+ 10760us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8837,"raft.queue_time_us":3300,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":18285,"thread_start_us":964208,"threads_started":1}
I20260709 13:00:00.803313  4029 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:00.749562  2323 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:00:00.752939  3991 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 1.007s	user 0.006s	sys 0.007s
I20260709 13:00:00.754395  3815 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:00.804683  2323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 607) took 1965 ms (client timeout 1725 ms). Trace:
W20260709 13:00:00.805086  2323 rpcz_store.cc:269] 0709 12:59:58.839114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.839258 (+   144us) service_pool.cc:224] Handling call
0709 13:00:00.683797 (+1844539us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b5800003c98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 13:00:00.804614 (+120817us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14567168}
I20260709 13:00:00.749207  3997 raft_consensus.cc:3055] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:00.808825  3997 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:00.810042  3997 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.730188  3656 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:00.668965  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1757) took 1965 ms. Trace:
I20260709 13:00:00.812234  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:00.758261  3998 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:00.915271  1673 connection.cc:256] RPC call timeout handler was delayed by -1.0854258350000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260709 13:00:01.209088  1628 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:01.210072  1673 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.853s (SENT)
I20260709 13:00:01.210243  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2007) took 3980 ms. Trace:
I20260709 13:00:00.938687  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:01.210654  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:00.915980  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 478005us
I20260709 13:00:00.928040  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:01.210914  1554 rpcz_store.cc:276] 0709 12:59:57.229751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.229911 (+   160us) service_pool.cc:224] Handling call
0709 12:59:57.718271 (+488360us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 12:59:57.718542 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:57.733438 (+ 14896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:57.733484 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:57.749916 (+ 16432us) log.cc:844] Serialized 26 byte log entry
0709 12:59:57.960021 (+210105us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:57.960084 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.960188 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:00.720273 (+2760085us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:01.209962 (+489689us) raft_consensus.cc:1685] finished
0709 13:00:01.209983 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.210186 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6402,"raft.queue_time_us":6014,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":11161,"spinlock_wait_cycles":112995968,"thread_start_us":146271,"threads_started":1,"wal-append.queue_time_us":641467}
I20260709 13:00:01.212776  1633 raft_consensus.cc:2376] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3. Re-sending same reply.
I20260709 13:00:01.213868  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:00.762976  3952 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:00.835842  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:01.001425  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2037) took 1116 ms. Trace:
I20260709 13:00:00.836259  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:00.952450  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:00.768384  3835 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.217640  1627 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
W20260709 13:00:01.143082  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.008s	sys 0.016s
I20260709 13:00:01.217914  3835 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:00.993532  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.218636  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.008s	sys 0.018s
W20260709 13:00:01.219380  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.220324  3835 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:01.221201  1526 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:01.221107  3656 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.782259  3967 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.919203  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 46776.1us
I20260709 13:00:01.223712  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:00.748845  2326 rpcz_store.cc:276] 0709 12:59:58.780934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.786796 (+  5862us) service_pool.cc:224] Handling call
0709 13:00:00.680973 (+1894177us) spinlock_profiling.cc:243] Waited 8.22 ms on lock 0x7b5800003c98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 13:00:00.681265 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.681590 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.681635 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:00.681703 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:00.681786 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.681883 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.682078 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18898816}
I20260709 13:00:01.104691  4016 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.215454  1707 rpcz_store.cc:276] 0709 12:59:59.884531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.884734 (+   203us) service_pool.cc:224] Handling call
0709 13:00:00.984326 (+1099592us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5400397e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:01.001316 (+ 16990us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934140288}
I20260709 13:00:01.208907  1553 rpcz_store.cc:276] 0709 12:59:58.701535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.094036 (+392501us) service_pool.cc:224] Handling call
0709 12:59:59.094301 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.094531 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:00:00.285794 (+1191263us) log.cc:844] Serialized 14 byte log entry
0709 13:00:00.666541 (+380747us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:00.666685 (+   144us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:00.666856 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.667020 (+   164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.667282 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1438298,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":6366,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":67726,"thread_start_us":1491087,"threads_started":2}
I20260709 13:00:00.975880  3932 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:01.106062  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:00.858940  1675 leader_election.cc:336] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.232s (SENT)
I20260709 13:00:00.934044  4035 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:01.133036  2288 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.018s	sys 0.029s
W20260709 13:00:01.313756  2288 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.019s	sys 0.031s
W20260709 13:00:01.314146  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 921085us
W20260709 13:00:01.312294  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 453330us
I20260709 13:00:00.973659  1455 catalog_manager.cc:5697] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
W20260709 13:00:01.261746  1598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.029s	sys 0.076s
W20260709 13:00:01.325831  1598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.029s	sys 0.076s
I20260709 13:00:01.133602  3679 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:01.262674  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 52599.9us
W20260709 13:00:01.327013  1673 connection.cc:256] RPC call timeout handler was delayed by -1.0252969629999598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2391s for a response
I20260709 13:00:01.211464  1632 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:01.264499  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:01.328688  1630 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
W20260709 13:00:01.272284  1558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.047s	sys 0.069s
W20260709 13:00:01.329567  1558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.047s	sys 0.069s
I20260709 13:00:00.769625  3704 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:01.291316  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.000s	sys 0.031s
I20260709 13:00:00.811714  3997 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:00.778908  3793 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.227103  3967 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:00.775375  3828 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:01.306195  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.307050  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 83371.4us
W20260709 13:00:01.330799  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.000s	sys 0.031s
W20260709 13:00:01.349370  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.350033  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.350694  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.349618  1555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.008s	sys 0.027s
W20260709 13:00:01.351269  1555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.008s	sys 0.027s
I20260709 13:00:01.359200  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:01.359840  1630 raft_consensus.cc:2376] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4. Re-sending same reply.
I20260709 13:00:01.267560  4053 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.360957  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:01.266464  4033 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:01.376976  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:01.362241  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:01.379153  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.018s	sys 0.021s
W20260709 13:00:01.379973  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.018s	sys 0.022s
I20260709 13:00:01.325187  1455 catalog_manager.cc:5697] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 3 to 4, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 4 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:01.375113  1557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.007s	sys 0.054s
I20260709 13:00:01.375653  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:01.380859  1557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.008s	sys 0.054s
I20260709 13:00:01.382860  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:01.383255  2324 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:01.384850  1557 raft_consensus.cc:3055] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:01.385382  1557 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:01.394431  1552 raft_consensus.cc:1275] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:00:01.382273  2286 leader_election.cc:336] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.580s (SENT)
I20260709 13:00:01.399562  1455 catalog_manager.cc:5697] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:01.215859  3952 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:01.393805  1633 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
W20260709 13:00:01.309814  1551 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.022s	sys 0.040s
I20260709 13:00:01.393659  1557 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:01.337347  3879 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:01.405052  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:01.411012  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.377911  3679 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:01.472999  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.051s	user 0.028s	sys 0.074s
I20260709 13:00:01.410207  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:01.359863  4035 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.350924  3970 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:01.415629  2288 leader_election.cc:336] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.719s (SENT)
I20260709 13:00:01.369570  3835 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.413142  1455 catalog_manager.cc:5697] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:01.302259  4016 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:01.464289  1552 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:01.463574  1560 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:01.464555  1557 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:01.464865  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:01.470183  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:01.467415  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 106554us
I20260709 13:00:01.505566  1556 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:01.359319  4041 raft_consensus.cc:2764] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
W20260709 13:00:01.474938  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.029s	sys 0.075s
I20260709 13:00:01.370303  3828 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:01.384487  3985 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:01.478390  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 68273.9us
I20260709 13:00:01.477286  3952 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:01.486722  2288 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:01.543303  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 127721us
I20260709 13:00:01.501536  1558 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:00:01.358739  3704 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:01.507457  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:01.553678  1553 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:01.420921  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:01.508656  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:01.473237  3815 consensus_meta.cc:287] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.001s
W20260709 13:00:01.421118  1551 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.022s	sys 0.041s
W20260709 13:00:01.510347  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.889786  3815 consensus_queue.cc:1059] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:01.890246  1631 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:00:01.890697  1631 pending_rounds.cc:85] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 1
I20260709 13:00:01.891157  1631 pending_rounds.cc:107] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:00:01.891516  1631 raft_consensus.cc:2889] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:01.361673  3962 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:01.505893  1526 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:01.517205  1560 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:01.893630  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:01.894229  1560 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 13:00:01.894616  1708 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:01.895008  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:01.895694  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:01.896276  1708 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
W20260709 13:00:01.517491  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.001s	user 0.030s	sys 0.065s
W20260709 13:00:01.896817  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.381s	user 0.030s	sys 0.065s
W20260709 13:00:01.897142  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 1.42737e+06us
I20260709 13:00:01.359457  3793 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:01.462623  4056 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:01.899559  4056 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:01.901007  3793 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:01.901830  3793 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:01.902426  4056 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:01.358951  4049 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.904372  4049 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:01.895706  1560 raft_consensus.cc:2393] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 3: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:01.906142  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:01.907109  4049 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:01.541327  1598 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:01.503746  1455 catalog_manager.cc:5697] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:01.908310  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 366996us
I20260709 13:00:01.908864  1455 catalog_manager.cc:5697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 2, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:01.502343  3945 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.033s	sys 0.051s
W20260709 13:00:01.912220  3945 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.035s	sys 0.053s
I20260709 13:00:01.557901  1630 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:01.866227  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:01.511793  3879 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:01.645689  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:01.913527  1704 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 13:00:01.914466  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:01.915668  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:01.856668  1707 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:01.432720  4033 consensus_queue.cc:1059] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.116s
I20260709 13:00:01.917054  4049 raft_consensus.cc:3055] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:01.917426  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:01.768798  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.816388  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:01.596959  2288 leader_election.cc:336] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.580s (SENT)
I20260709 13:00:01.918984  2288 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:01.919777  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:01.558624  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:01.962184  1552 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:01.962283  1704 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
W20260709 13:00:01.752727  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.857046  4064 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:01.771600  4038 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.567s	user 0.000s	sys 0.002s
W20260709 13:00:01.750756  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.876605  3997 consensus_meta.cc:287] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.000s
I20260709 13:00:01.879329  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:01.881242  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:01.881947  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:01.967898  1558 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 13:00:01.968321  1703 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:01.885052  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:01.691762  1556 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:01.508729  3970 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:00:01.596119  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:01.979419  1559 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:01.385349  4053 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:01.888989  1557 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:01.378217  3998 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:01.645955  4046 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:00:01.919871  3962 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:01.920068  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 322943us
I20260709 13:00:01.553313  3820 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:01.917448  4049 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:01.729483  4047 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:01.946830  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:02.036545  1708 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:02.037555  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:01.541270  3821 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.008s	sys 0.024s
W20260709 13:00:01.964888  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.770648  4052 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.453s	user 0.001s	sys 0.001s
I20260709 13:00:01.968806  1701 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:01.977567  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:01.882894  3839 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.105s	user 0.011s	sys 0.039s
I20260709 13:00:01.559279  4057 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:01.982267  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.015s	sys 0.029s
I20260709 13:00:01.983479  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:01.984781  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 85760.2us
W20260709 13:00:02.045220  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.015s	sys 0.029s
W20260709 13:00:02.045565  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 722992us
I20260709 13:00:02.045466  1704 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:02.046856  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:01.984194  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 478303us
I20260709 13:00:01.985203  1628 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:01.913232  1630 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:01.988919  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:01.797382  3622 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:01.719100  4050 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.273s
I20260709 13:00:01.502113  4035 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:01.992314  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:01.992460  4060 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:01.516731  3835 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:02.001060  3656 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:02.005112  1707 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:02.012877  3967 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:01.958472  3846 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.081377  3846 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:02.082020  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:02.044363  4047 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:02.083248  2326 raft_consensus.cc:2393] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:01.553188  3985 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:02.084903  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:02.086102  2324 raft_consensus.cc:2393] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:02.087788  3985 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:02.065971  1630 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:02.089004  1630 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:02.062055  4057 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:01.596767  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 382515us
I20260709 13:00:02.038177  1708 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
W20260709 13:00:02.092792  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.981839  1552 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:02.094787  4033 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:02.007934  4053 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:02.051898  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.054188  4016 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:02.096361  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.054512  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:02.097249  1704 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 13:00:02.060966  1701 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:02.098363  4049 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:02.099653  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:02.099828  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:02.066779  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:02.100461  1552 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 13:00:02.101295  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:02.101985  1552 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:02.041862  3821 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.371s	user 0.017s	sys 0.033s
W20260709 13:00:02.042074  3839 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.279s	user 0.011s	sys 0.039s
W20260709 13:00:01.990012  4051 log.cc:927] Time spent T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.502s	user 0.003s	sys 0.000s
I20260709 13:00:02.063802  1700 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:02.100776  1709 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:02.067945  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:02.100456  1703 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:02.097318  4033 consensus_queue.cc:1059] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:02.063158  4056 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:02.113157  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:02.114192  2324 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:02.115548  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:02.115586  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:02.121682  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 53703.8us
I20260709 13:00:02.113091  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:02.122670  1526 leader_election.cc:400] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5.
I20260709 13:00:02.125152  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:02.120693  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:02.129801  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:02.112833  4066 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.141824  4066 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:02.144292  4066 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:02.113655  4050 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:02.146802  4035 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:02.151085  3932 consensus_meta.cc:287] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.828s	user 0.012s	sys 0.000s
I20260709 13:00:02.153077  4047 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:02.130972  3704 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:02.129707  4033 consensus_queue.cc:1243] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:02.125885  4049 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:02.130662  4056 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:02.154968  4060 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:02.118371  3967 consensus_queue.cc:1059] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:00:02.158614  4055 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:02.171411  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:02.189754  1553 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:02.189755  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2038) took 2304 ms. Trace:
I20260709 13:00:02.169531  4050 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.198163  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:02.193404  1706 rpcz_store.cc:276] 0709 12:59:59.885460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.885608 (+   148us) service_pool.cc:224] Handling call
0709 12:59:59.895962 (+ 10354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:00.375894 (+479932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.375937 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:00.376561 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 13:00:00.659360 (+282799us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:00.672072 (+ 12712us) log.cc:844] Serialized 14 byte log entry
0709 13:00:00.729799 (+ 57727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.730469 (+   670us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.188983 (+1458514us) raft_consensus.cc:1685] finished
0709 13:00:02.189010 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.189343 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5839,"prepare.queue_time_us":12166,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":706767,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":9683,"thread_start_us":711424,"threads_started":2,"wal-append.queue_time_us":747573}
I20260709 13:00:02.181381  4035 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:02.181957  4066 raft_consensus.cc:3055] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:02.188711  4074 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:02.209573  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.202029  4050 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:02.175158  3963 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.009s	sys 0.070s
I20260709 13:00:02.175477  4043 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:00:02.192803  4055 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:02.205036  3704 raft_consensus.cc:3055] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:02.205665  4041 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:02.236207  1554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.013s	sys 0.014s
W20260709 13:00:02.239382  1554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.013s	sys 0.014s
I20260709 13:00:02.209079  4066 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:02.238407  1526 leader_election.cc:400] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4.
I20260709 13:00:02.246858  3998 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:02.251334  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 456) took 1477 ms. Trace:
I20260709 13:00:02.257575  1634 rpcz_store.cc:276] 0709 13:00:00.773804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.789664 (+ 15860us) service_pool.cc:224] Handling call
0709 13:00:00.790143 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.597382 (+807239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.597424 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:01.597481 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:01.597528 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.250636 (+653108us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b5400247054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:02.250690 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.251058 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1855718784}
I20260709 13:00:02.217871  4057 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:02.214685  3963 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.010s	sys 0.070s
I20260709 13:00:02.185835  4056 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:02.228893  3704 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:02.248594  3835 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:02.324026  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:02.325534  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:02.335497  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:02.291283  3679 consensus_meta.cc:287] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.806s	user 0.006s	sys 0.007s
I20260709 13:00:02.356786  1632 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
W20260709 13:00:02.358317  1673 leader_election.cc:336] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.953s (SENT)
I20260709 13:00:02.358925  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:02.364904  2288 leader_election.cc:336] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.833s (SENT)
I20260709 13:00:02.365587  2288 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:02.366849  2288 leader_election.cc:336] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.973s (SENT)
I20260709 13:00:02.385078  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2389) took 2423 ms. Trace:
I20260709 13:00:02.386042  3828 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:02.385869  1631 rpcz_store.cc:276] 0709 12:59:59.961690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.050347 (+ 88657us) service_pool.cc:224] Handling call
0709 13:00:00.050700 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.892044 (+1841344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.384662 (+492618us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54000f41d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:02.384977 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4228852608}
I20260709 13:00:02.389992  3846 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:02.397123  3952 consensus_meta.cc:287] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.838s	user 0.013s	sys 0.000s
I20260709 13:00:02.369745  3839 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:02.290877  4055 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:02.419041  1555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.008s	sys 0.006s
W20260709 13:00:02.419960  1555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.008s	sys 0.006s
I20260709 13:00:02.342762  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:02.435312  2288 leader_election.cc:336] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.106s (SENT)
W20260709 13:00:02.440469  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.011s	sys 0.004s
W20260709 13:00:02.441267  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.011s	sys 0.004s
W20260709 13:00:02.441650  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 628661us
I20260709 13:00:02.413817  4041 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.361901  3704 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:02.354154  4066 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:02.447468  3962 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.444382  4055 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:02.458609  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 396099us
W20260709 13:00:02.471635  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 113339us
I20260709 13:00:02.448027  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:02.474118  1673 leader_election.cc:336] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.232s (SENT)
I20260709 13:00:02.450979  4060 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:02.486847  2286 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:02.486927  1673 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:02.456296  3815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.009s	sys 0.030s
I20260709 13:00:02.494616  2288 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:02.500998  2288 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:02.504357  2288 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:02.472234  4067 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:02.456233  3962 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:02.472075  3963 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:02.497133  3815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.009s	sys 0.031s
I20260709 13:00:02.453016  4041 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:02.491478  4066 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:02.494959  3854 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.486357  3828 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:00:02.512240  3622 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:02.508088  3952 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:02.506888  3985 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:02.517330  4003 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:02.524523  4072 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:00:02.503656  3821 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:00:02.489925  4050 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:02.535969  3952 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:00:02.535645  3945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.038s	sys 0.030s
I20260709 13:00:02.541375  4073 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:02.534029  3854 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:02.542335  4003 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.591759  3952 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:02.698691  4078 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:02.713605  3962 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:02.639307  4003 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:02.767910  4050 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:02.786983  4049 consensus_meta.cc:287] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.602s	user 0.014s	sys 0.000s
W20260709 13:00:02.902418  1455 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.006s	sys 0.009s
W20260709 13:00:02.903573  1455 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.006s	sys 0.009s
W20260709 13:00:02.968525  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 494171us
I20260709 13:00:02.972798  1702 raft_consensus.cc:1275] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:00:03.009739  1673 leader_election.cc:336] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.279s (SENT)
I20260709 13:00:03.010673  1673 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:03.005554  2321 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:02.973448  1704 raft_consensus.cc:3055] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:02.912904  1558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.007s	sys 0.007s
I20260709 13:00:03.013083  1704 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:00:03.013422  1558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.010s	sys 0.013s
W20260709 13:00:02.905581  1556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.004s	sys 0.008s
W20260709 13:00:03.015853  1556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.010s	sys 0.013s
W20260709 13:00:02.968811  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 625721us
W20260709 13:00:02.972636  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.020553  4055 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.551s	user 0.015s	sys 0.000s
W20260709 13:00:02.910718  1551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.018s	sys 0.026s
W20260709 13:00:02.928673  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.021858  3998 consensus_meta.cc:287] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.757s	user 0.008s	sys 0.006s
W20260709 13:00:02.581857  3945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.039s	sys 0.031s
W20260709 13:00:02.944482  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.025s	sys 0.029s
I20260709 13:00:02.979758  4101 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:02.979563  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 633215us
W20260709 13:00:03.072489  1708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.006s	sys 0.018s
W20260709 13:00:03.073927  1708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.007s	sys 0.018s
W20260709 13:00:02.925271  1598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.016s	user 0.007s	sys 0.013s
I20260709 13:00:03.012727  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2048) took 1120 ms. Trace:
W20260709 13:00:02.956745  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.002s	sys 0.052s
W20260709 13:00:03.089465  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.194s	user 0.034s	sys 0.031s
W20260709 13:00:03.021919  1551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.024s	sys 0.032s
W20260709 13:00:03.098699  1598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.189s	user 0.008s	sys 0.023s
W20260709 13:00:03.099699  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 1.19008e+06us
I20260709 13:00:02.536648  3622 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.103065  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:03.103878  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.009s	sys 0.056s
W20260709 13:00:03.014536  2321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 613) took 1655 ms (client timeout 2013 ms). Trace:
W20260709 13:00:03.114583  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 95876.7us
I20260709 13:00:03.076819  1702 rpcz_store.cc:276] 0709 13:00:01.892313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.979485 (+ 87172us) service_pool.cc:224] Handling call
0709 13:00:01.979821 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.009677 (+1029856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.012200 (+  2523us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b54002553d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:03.012556 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2276836736}
W20260709 13:00:03.123814  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 1.02978e+06us
W20260709 13:00:03.131201  1701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.006s	sys 0.026s
W20260709 13:00:03.131743  1701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.006s	sys 0.027s
I20260709 13:00:03.131247  3622 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.133634  3854 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:03.139739  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:03.141573  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:03.142416  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:03.142625  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 761) took 1004 ms. Trace:
I20260709 13:00:03.143392  2326 rpcz_store.cc:276] 0709 13:00:02.116239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.121518 (+  5279us) service_pool.cc:224] Handling call
0709 13:00:02.125043 (+  3525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:02.125316 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.128271 (+  2955us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:02.141657 (+ 13386us) log.cc:844] Serialized 26 byte log entry
0709 13:00:02.995871 (+854214us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:02.996211 (+   340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.996432 (+   221us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.070560 (+ 74128us) raft_consensus.cc:1685] finished
0709 13:00:03.070585 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.120310 (+ 49725us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":382431,"threads_started":1,"wal-append.queue_time_us":895477}
I20260709 13:00:03.145263  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:03.146763  1552 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:03.147364  1598 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:03.148296  4079 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.149380  1559 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:03.167407  4049 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:03.169207  4041 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:03.179486  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 169984us
I20260709 13:00:03.186679  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:03.181044  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 54166.5us
I20260709 13:00:03.169572  1704 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.169464  4087 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.032450  4101 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:03.210493  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:03.211548  1557 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:03.212822  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 401) took 1254 ms. Trace:
I20260709 13:00:03.213286  1708 rpcz_store.cc:276] 0709 13:00:01.958237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.094165 (+135928us) service_pool.cc:224] Handling call
0709 13:00:02.094463 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.094642 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:02.506643 (+412001us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.173347 (+666704us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:03.190364 (+ 17017us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:03.205690 (+ 15326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.212483 (+  6793us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.212725 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79200,"prepare.queue_time_us":532185,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":91394,"thread_start_us":979379,"threads_started":2,"wal-append.queue_time_us":566258}
W20260709 13:00:03.201464  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 629469us
I20260709 13:00:03.214982  4087 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.216667  1599 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:03.218770  4087 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:03.219681  4087 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.221482  3828 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:03.221585  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2016) took 1868 ms. Trace:
W20260709 13:00:03.121589  2321 rpcz_store.cc:269] 0709 13:00:01.358965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.369385 (+ 10420us) service_pool.cc:224] Handling call
0709 13:00:02.439721 (+1070336us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b5800003c98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 13:00:03.013875 (+574154us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54005668d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:03.014341 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214564480}
I20260709 13:00:03.149791  4079 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.223923  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 407) took 1167 ms. Trace:
I20260709 13:00:03.222227  3828 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.223035  4101 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:03.246703  4101 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.248142  4101 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.251241  4101 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:03.252077  1601 connection.cc:256] RPC call timeout handler was delayed by -1.7018806490000316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 13:00:03.254452  1601 connection.cc:256] RPC call timeout handler was delayed by -1.6091806489999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 13:00:03.254891  1601 connection.cc:256] RPC call timeout handler was delayed by -1.559680649000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260709 13:00:03.255441  1601 connection.cc:256] RPC call timeout handler was delayed by -1.0873449540000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
I20260709 13:00:03.257177  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.258288  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.259598  1632 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 13:00:03.260859  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.261878  2324 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:03.244226  4087 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:03.263052  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:03.264359  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.222247  1555 rpcz_store.cc:276] 0709 13:00:01.352826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.374280 (+ 21454us) service_pool.cc:224] Handling call
0709 13:00:01.509702 (+135422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.580780 (+ 71078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.580832 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.692315 (+111483us) log.cc:844] Serialized 26 byte log entry
0709 13:00:02.420663 (+728348us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:02.469899 (+ 49236us) log.cc:844] Serialized 14 byte log entry
0709 13:00:02.470368 (+   469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.470445 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.220990 (+750545us) raft_consensus.cc:1685] finished
0709 13:00:03.221049 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.221359 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1568,"prepare.queue_time_us":31712,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":44691,"raft.run_cpu_time_us":615,"raft.run_wall_time_us":84602,"thread_start_us":545311,"threads_started":1,"wal-append.queue_time_us":694648}
I20260709 13:00:03.265858  2327 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:03.267405  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.268818  1628 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:03.269121  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.269567  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.270509  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.267563  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.272341  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.272672  4066 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:03.272825  2320 raft_consensus.cc:2410] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:03.273245  1634 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
W20260709 13:00:03.276067  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 129069us
W20260709 13:00:03.274302  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 57942.2us
I20260709 13:00:03.244029  3828 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:03.290748  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:03.273259  4066 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.297595  2323 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:03.297749  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 391) took 1199 ms. Trace:
I20260709 13:00:03.235451  1701 rpcz_store.cc:276] 0709 13:00:02.056886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.099718 (+ 42832us) service_pool.cc:224] Handling call
0709 13:00:02.099941 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.100124 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:02.518692 (+418568us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.196697 (+678005us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:03.223347 (+ 26650us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:03.223432 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.223548 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.223777 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34170,"prepare.queue_time_us":527456,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":51972,"raft.run_cpu_time_us":473,"raft.run_wall_time_us":21442,"thread_start_us":1026369,"threads_started":2,"wal-append.queue_time_us":547681}
I20260709 13:00:03.295836  1631 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
W20260709 13:00:03.300401  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.282377  4060 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.006s
I20260709 13:00:03.222635  4047 consensus_queue.cc:1059] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
W20260709 13:00:03.296470  1673 leader_election.cc:336] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.391s (SENT)
I20260709 13:00:03.311250  1704 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:03.311257  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.300804  4066 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.313241  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.349208  1628 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 13:00:03.349584  2327 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:03.350505  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.351148  1628 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:03.351585  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.352098  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.317682  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.354133  2320 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:03.318681  2286 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:03.356801  3854 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:03.357218  3854 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.358095  3854 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.361508  2286 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:03.324150  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.362865  1627 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:03.363240  1599 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:03.325321  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.325600  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.326442  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.326472  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.327004  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.331717  3985 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:03.333334  1559 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:03.336220  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.337598  4079 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:03.339648  4059 raft_consensus.cc:3055] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:03.341446  4060 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:03.272475  4105 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:00:03.345548  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.346385  1672 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:03.352877  2324 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 13:00:03.294533  3846 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:03.322789  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.368296  1630 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 13:00:03.365078  1673 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:03.364434  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.299481  1556 rpcz_store.cc:276] 0709 13:00:02.098773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.102764 (+  3991us) service_pool.cc:224] Handling call
0709 13:00:02.103028 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:02.110049 (+  7021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.110079 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:02.110509 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:00:03.016964 (+906455us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:03.174482 (+157518us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.293365 (+118883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.297341 (+  3976us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.297422 (+    81us) raft_consensus.cc:1685] finished
0709 13:00:03.297435 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.297684 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97826,"prepare.queue_time_us":234569,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":121584,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":7491,"thread_start_us":993078,"threads_started":3,"wal-append.queue_time_us":917589}
I20260709 13:00:03.368221  1635 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:03.368235  1631 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
W20260709 13:00:03.375543  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 71043.6us
I20260709 13:00:03.368301  4059 raft_consensus.cc:740] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:03.380642  4073 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.311199  4100 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.383143  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.383087  4073 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:03.394356  4100 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:03.395473  1523 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:03.384913  1633 raft_consensus.cc:2410] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:03.385382  1627 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:03.396806  4047 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:03.397378  4047 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.397835  4047 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.385613  1626 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 3: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:03.406613  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.407533  1626 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:03.381186  1634 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 13:00:03.408520  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.409574  2326 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
W20260709 13:00:03.409821  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.410712  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 165034us
I20260709 13:00:03.387099  1628 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 13:00:03.386850  3945 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:03.386845  2286 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:03.411931  3945 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.412393  3945 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:03.414021  3962 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:03.414472  3962 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.414856  3962 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.415685  2322 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:03.410845  4089 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:03.417064  3998 consensus_queue.cc:1059] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:03.419121  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:03.421275  1673 connection.cc:256] RPC call timeout handler was delayed by -2.5411772269999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.269s for a response
W20260709 13:00:03.421981  1673 connection.cc:256] RPC call timeout handler was delayed by -2.3734099989999891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2331s for a response
W20260709 13:00:03.422387  1673 connection.cc:256] RPC call timeout handler was delayed by -1.9818152729999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32830000000000004s for a response
W20260709 13:00:03.422925  1673 connection.cc:256] RPC call timeout handler was delayed by -1.4428837009999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 13:00:03.423336  1673 connection.cc:256] RPC call timeout handler was delayed by -1.392402350999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33330000000000004s for a response
W20260709 13:00:03.423615  1673 connection.cc:256] RPC call timeout handler was delayed by -1.2439837009999906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 13:00:03.423966  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1998837009999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260709 13:00:03.393250  4087 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:03.424954  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 60375.3us
W20260709 13:00:03.424530  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1836837010000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
W20260709 13:00:03.428133  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 268360us
I20260709 13:00:03.368274  3985 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:03.396293  4073 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:03.438238  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 91844.8us
I20260709 13:00:03.457195  3793 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:00:03.430115  3962 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.482239  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 389) took 1384 ms. Trace:
I20260709 13:00:03.491096  3932 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:03.493429  3967 raft_consensus.cc:3055] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:03.494270  3967 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:03.494618  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:03.481738  4089 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:03.495857  4089 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:03.496477  4089 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.496568  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:03.499195  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.500815  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.501103  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.495741  3967 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.502557  3967 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.503528  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:03.506260  4003 consensus_meta.cc:287] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.721s	user 0.014s	sys 0.001s
I20260709 13:00:03.506893  4003 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.507637  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.474465  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.507301  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 402) took 1525 ms. Trace:
I20260709 13:00:03.509910  1626 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 13:00:03.488543  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.510185  1704 rpcz_store.cc:276] 0709 13:00:01.981916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.097910 (+115994us) service_pool.cc:224] Handling call
0709 13:00:02.098256 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.972915 (+874659us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b54003b31a0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed99fcdc0 00007f0ed9a871c0 00007f0ed9a88231 00007f0ed9a84d8f 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c
0709 13:00:03.471988 (+499073us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:03.472016 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:03.472058 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:03.472098 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.474240 (+  2142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.507237 (+ 32997us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17612,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":9771,"spinlock_wait_cycles":189645056}
I20260709 13:00:03.511809  2324 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:03.482125  4100 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:03.510637  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:03.488358  4053 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:00:03.514864  1628 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:03.519726  2327 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:03.482874  1558 rpcz_store.cc:276] 0709 13:00:02.098249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.100834 (+  2585us) service_pool.cc:224] Handling call
0709 13:00:02.117360 (+ 16526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.117555 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:02.130299 (+ 12744us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.439247 (+1308948us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:03.462129 (+ 22882us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:03.471688 (+  9559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.477734 (+  6046us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.482176 (+  4442us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12570,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":183910,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":81198,"thread_start_us":1247128,"threads_started":2,"wal-append.queue_time_us":918573}
I20260709 13:00:03.523873  1672 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:03.522595  4087 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.529985  4118 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:03.530007  4087 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:03.531543  4110 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:03.528088  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.489652  3622 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.499318  4112 raft_consensus.cc:3055] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:03.517515  2326 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:03.519845  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 376) took 4854 ms. Trace:
I20260709 13:00:03.533087  3793 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:03.554549  1598 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:03.541996  4110 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:03.570996  4003 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:03.572870  4087 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:03.573701  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 79194.4us
I20260709 13:00:03.565521  1599 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:03.550441  4112 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:00:03.582644  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 50035.7us
I20260709 13:00:03.510439  3985 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.596895  4111 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:03.597473  4111 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.597760  3985 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.597932  4111 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.597543  4112 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:03.598786  4112 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:03.602057  4103 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.563s	user 0.004s	sys 0.000s
W20260709 13:00:03.602933  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.580860  4110 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.604604  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 757) took 1552 ms. Trace:
I20260709 13:00:03.605078  2329 rpcz_store.cc:276] 0709 13:00:02.051642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.051791 (+   149us) service_pool.cc:224] Handling call
0709 13:00:02.052161 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:02.513797 (+461636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.513840 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:02.520335 (+  6495us) log.cc:844] Serialized 52 byte log entry
0709 13:00:03.121783 (+601448us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:03.165896 (+ 44113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.177643 (+ 11747us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.601544 (+423901us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b24002e0f28. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed681e9c4 00007f0ed681cacb 00007f0ed69d7dc9 00007f0ed69d7a55 00007f0ed69d709d 00007f0ed960910e 00007f0ed962088c 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221
0709 13:00:03.604003 (+  2459us) raft_consensus.cc:1685] finished
0709 13:00:03.604029 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.604389 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9258,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":35792,"spinlock_wait_cycles":27320576,"thread_start_us":509265,"threads_started":2,"wal-append.queue_time_us":501396}
I20260709 13:00:03.609184  4047 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.610777  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:03.611852  4104 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:03.612258  4047 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:03.612900  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.614698  3932 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:03.549597  1551 rpcz_store.cc:276] 0709 12:59:58.660986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.671046 (+ 10060us) service_pool.cc:224] Handling call
0709 12:59:58.727266 (+ 56220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:59.890121 (+1162855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:59.892411 (+  2290us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:59.948196 (+ 55785us) log.cc:844] Serialized 26 byte log entry
0709 13:00:00.446286 (+498090us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:01.889736 (+1443450us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.355776 (+1466040us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b4800290358. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ede9aeaa1 00007f0ede9a5b37 00007f0ede9a59ca 00007f0edea9d26f 00007f0edea9cf37 00007f0edeab155c 00007f0edeab1508 00007f0edeab1488 00007f0edeab1443 00007f0edeab06ec 00007f0edd9daa96
0709 13:00:03.379530 (+ 23754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.439524 (+ 59994us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.454517 (+ 14993us) raft_consensus.cc:1685] finished
0709 13:00:03.476021 (+ 21504us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.515180 (+ 39159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":80330,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":354553,"raft.run_cpu_time_us":3786,"raft.run_wall_time_us":94272,"spinlock_wait_cycles":17331968,"thread_start_us":4244210,"threads_started":5,"wal-append.queue_time_us":1330151,"wal-append.run_cpu_time_us":1752,"wal-append.run_wall_time_us":1015897}
I20260709 13:00:03.615075  3932 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.612478  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:03.616468  4047 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:03.617605  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:03.625346  3962 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:03.624895  3793 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.644968  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:03.626626  1599 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:03.584142  4056 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:00:03.647353  3793 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:03.648275  3854 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.649281  4100 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:03.649446  3952 consensus_meta.cc:287] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.941s	user 0.015s	sys 0.008s
I20260709 13:00:03.649760  2323 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:03.649998  3952 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.651127  2321 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:03.655140  2286 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:03.657091  3997 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:03.657639  3997 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.658013  3997 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:03.661069  4066 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.661602  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:03.627625  1598 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:03.620716  4087 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:03.628405  3828 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:03.629820  4116 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.157s	user 0.004s	sys 0.000s
I20260709 13:00:03.638296  3970 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:03.639876  1523 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:03.640208  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:03.641489  3622 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:03.644327  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:03.645051  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.644956  3656 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:03.645210  4043 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:03.657254  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.541888  4059 consensus_queue.cc:260] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.663353  1635 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:03.652385  3952 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:03.750701  2327 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:00:03.752012  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 112216us
I20260709 13:00:03.687342  1629 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:03.668298  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:03.711529  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.754559  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 127022us
I20260709 13:00:03.755302  1598 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:03.651952  4089 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.633531  4047 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:03.679996  4050 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:03.799489  1598 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:03.673753  2326 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:03.750857  3970 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:03.663398  4087 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:03.803325  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 180174us
W20260709 13:00:03.804266  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 45879us
I20260709 13:00:03.683892  3704 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:03.750651  3854 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:03.757772  4105 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:03.756518  3828 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:03.807447  4080 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:03.763448  4059 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.763634  3846 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:03.762854  3835 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:03.649924  4100 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:03.827284  4108 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:03.827725  3846 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.758509  3945 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.811992  4087 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.809137  3970 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:03.834640  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.809837  4056 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:03.836916  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 175584us
I20260709 13:00:03.838054  1599 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:03.839900  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:03.821135  4080 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:03.835892  4108 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.855157  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:03.833652  3835 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.842028  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:03.857848  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.817334  4050 raft_consensus.cc:697] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:03.839254  3846 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:03.865783  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.830583  4110 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:03.829631  4118 consensus_queue.cc:1059] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:00:03.870699  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:03.872646  4056 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.873543  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:03.877121  2320 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 7. Ops: []
I20260709 13:00:03.821599  4043 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:03.856609  4080 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:03.859702  3835 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.857220  4108 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.871376  3828 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:03.894459  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:03.897369  1559 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.897941  1634 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:03.853021  4053 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:00:03.901126  3828 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.917130  3828 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.919302  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:03.919854  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:03.903290  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:03.922854  1557 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.920382  1700 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.909188  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:03.924326  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:03.925027  2327 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.924929  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:03.870836  4105 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.927357  1708 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:03.921969  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:03.928396  1701 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 2.
I20260709 13:00:03.925570  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:03.934793  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.936232  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 291869us
I20260709 13:00:03.911901  4060 raft_consensus.cc:3055] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:03.980763  1554 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.910024  3945 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:03.901669  4066 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:03.931313  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:03.992377  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 59815.2us
I20260709 13:00:03.995913  1702 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.908743  1551 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
W20260709 13:00:03.989593  4109 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:00:04.006721  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:04.009166  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:04.010552  4110 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:04.019969  1555 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:03.913868  4129 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 13:00:04.013121  4111 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.014071  4100 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:04.015100  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:03.988991  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:04.021507  1599 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:04.027511  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:04.022259  1705 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
W20260709 13:00:04.033308  1675 leader_election.cc:336] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.725s (SENT)
I20260709 13:00:04.034477  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:04.033036  3679 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:04.036983  4053 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:04.040799  1709 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:04.046445  2288 leader_election.cc:336] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.636s (SENT)
W20260709 13:00:04.047245  2288 leader_election.cc:336] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.636s (SENT)
I20260709 13:00:04.047578  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:04.049876  4056 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:04.052515  4043 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:04.053850  4050 consensus_queue.cc:237] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:04.058393  3656 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:03.986274  4060 raft_consensus.cc:740] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:04.065456  4060 consensus_queue.cc:260] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.067384  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:04.054868  4053 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:04.068392  1703 raft_consensus.cc:2376] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4. Re-sending same reply.
I20260709 13:00:04.022892  1704 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:04.102865  1708 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:04.108781  3846 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:04.111198  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 114403us
I20260709 13:00:04.112198  3846 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:04.113035  3846 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:04.113844  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:04.114698  1555 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:00:04.020354  4105 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:04.118952  3932 consensus_meta.cc:287] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.005s
I20260709 13:00:04.119657  4105 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:04.119517  3932 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.123116  4087 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:04.149473  3952 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:04.059484  3656 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.155295  1700 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:04.149642  4079 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:04.068392  4053 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:04.177743  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 142506us
W20260709 13:00:04.178598  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 131405us
I20260709 13:00:04.181622  1554 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:04.024977  4089 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:04.185187  3952 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.189972  1709 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 13:00:04.191062  1702 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:04.149863  3997 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.198109  3952 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:04.198661  3997 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:04.199045  1601 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:04.203028  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:04.204187  2320 raft_consensus.cc:2368] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6.
I20260709 13:00:04.195618  1555 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:04.195116  1559 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:04.206987  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:04.207983  2322 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 13:00:04.210412  1627 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:04.214589  1632 raft_consensus.cc:2410] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:00:04.217005  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 104105us
I20260709 13:00:04.221853  1708 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:04.235117  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:04.209643  4111 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:04.236310  1709 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:04.236270  2288 leader_election.cc:336] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.684s (SENT)
I20260709 13:00:04.244972  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.245455  4087 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:04.245086  3835 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.245837  1634 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
W20260709 13:00:04.247589  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48654.4us
I20260709 13:00:04.241849  4043 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:04.247936  3835 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:04.251745  1672 leader_election.cc:400] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6.
I20260709 13:00:04.252107  1672 leader_election.cc:403] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:04.224467  3846 raft_consensus.cc:697] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:04.253777  2288 leader_election.cc:336] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.684s (SENT)
I20260709 13:00:04.254424  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:04.248878  4043 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.264361  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:04.265100  1556 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.267871  1552 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:04.271171  1672 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:00:04.271862  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.272030  2327 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:04.269901  2286 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:04.274247  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:04.282333  1557 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
W20260709 13:00:04.282994  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 265894us
I20260709 13:00:04.264843  4043 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.241652  3970 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.288120  1601 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:04.279628  3987 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:04.272994  4060 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:04.292485  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.293118  2286 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:04.274170  4073 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:04.261314  3967 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:00:04.305609  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:04.321148  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1832) took 1059 ms. Trace:
I20260709 13:00:04.320120  1706 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:04.323539  2286 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:04.321660  1632 rpcz_store.cc:276] 0709 13:00:03.261371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.262358 (+   987us) service_pool.cc:224] Handling call
0709 13:00:04.318005 (+1055647us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b54000d8ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:04.321050 (+  3045us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184700288}
I20260709 13:00:04.326678  3793 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:04.327260  3793 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.327646  3793 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:04.297187  3952 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:04.329295  1626 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:00:04.329716  1626 pending_rounds.cc:85] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 6
I20260709 13:00:04.329947  1626 pending_rounds.cc:107] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:04.330307  1626 raft_consensus.cc:2889] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:04.259267  4087 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
W20260709 13:00:04.333659  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.375025  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:04.276731  4080 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:04.376935  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.312933  4073 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:04.382269  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:04.382803  2328 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:04.384016  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:04.381502  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 75975.7us
I20260709 13:00:04.378068  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:04.381021  3967 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:04.389621  3967 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:04.390048  4053 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:04.390867  3967 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.277033  1708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39852
I20260709 13:00:04.393348  1708 raft_consensus.cc:606] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Received request to transfer leadership
I20260709 13:00:04.393766  1708 raft_consensus.cc:614] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:04.332803  3932 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:04.406781  1709 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
W20260709 13:00:04.408927  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 85494.8us
I20260709 13:00:04.409118  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:04.410075  2327 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:00:04.408190  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.373489  4003 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:04.400835  4138 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.383440  4073 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:04.420827  4033 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6.
I20260709 13:00:04.417761  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:04.410936  3997 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:04.444175  2327 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
W20260709 13:00:04.449585  1675 leader_election.cc:336] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.096s (SENT)
I20260709 13:00:04.451611  3945 consensus_queue.cc:1059] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:04.450819  2286 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:04.417773  3839 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.452883  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:04.453373  4138 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:04.454053  4108 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.004s
I20260709 13:00:04.454288  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:04.454443  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:04.467747  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:04.468757  4104 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.469408  4104 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.471544  2328 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:04.454298  4003 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:04.475360  3945 raft_consensus.cc:3055] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:04.475824  3945 raft_consensus.cc:740] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:04.476857  3945 consensus_queue.cc:260] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.478058  3945 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:04.478331  4104 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:04.479362  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:04.479789  1705 raft_consensus.cc:1275] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:04.480014  1709 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:04.481106  4080 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:04.481662  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:04.455366  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 194781us
I20260709 13:00:04.445698  1598 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:04.423869  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:04.473712  3932 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:04.473649  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:04.473106  1454 catalog_manager.cc:5697] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 1 to 4, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.482760  1708 raft_consensus.cc:2368] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5.
I20260709 13:00:04.466751  4108 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.442924  3962 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:04.490501  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 44908.1us
I20260709 13:00:04.494920  1598 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:04.495446  4145 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:04.441097  3656 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:04.404028  3846 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:04.416936  3828 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 13:00:04.473793  4138 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:04.496368  4087 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:04.502516  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.503763  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:04.504184  3970 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:04.505198  1454 catalog_manager.cc:5697] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 1 to 2, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:04.494246  2326 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:04.496796  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 110969us
I20260709 13:00:04.511776  1553 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 4: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:04.463626  3997 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:04.496071  3932 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.460317  3854 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:00:04.523149  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:04.525054  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:04.511379  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:04.526208  4108 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:04.528829  4059 consensus_meta.cc:287] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.702s	user 0.019s	sys 0.001s
I20260709 13:00:04.534041  1702 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:04.496097  3835 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:04.558737  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:04.525048  2288 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:04.541095  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:04.545982  1454 catalog_manager.cc:5697] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 2 to 3, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.521417  3952 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:04.550151  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.561434  1556 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
W20260709 13:00:04.547343  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 46128us
I20260709 13:00:04.561357  1627 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:04.569060  3997 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.569993  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:04.570823  2320 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:04.571120  1708 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 13:00:04.571280  3828 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:04.497383  3839 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.475420  4003 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:04.577906  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 52954.2us
I20260709 13:00:04.581152  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.581655  1709 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:00:04.572273  4146 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:00:04.551028  4087 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:04.616781  1634 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:04.617563  4087 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:04.619097  4143 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:00:04.588195  4033 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.589838  1554 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:04.590585  3932 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:04.585222  3970 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:00:04.593286  3793 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:04.579917  3835 raft_consensus.cc:697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:04.602382  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 105180us
I20260709 13:00:04.607726  4043 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:04.614665  3839 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:04.626494  1629 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:04.626107  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:04.633235  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:04.634475  1455 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41166 (request call id 324) took 12597 ms (client timeout 15000 ms). Trace:
W20260709 13:00:04.642238  1506 auto_rebalancer.cc:893] Removing replace marker failed: Replica 4f6fa2fd61114dc190d8f9b310696e1a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 13:00:04.641935  3835 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:04.642920  1506 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:00:04.643333  1506 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:00:04.646081  4043 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:04.647053  1632 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:04.650964  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:04.651957  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 63993.6us
I20260709 13:00:04.652169  3945 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:04.652550  1601 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:04.652873  3945 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:04.653388  4059 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:04.654018  3828 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:04.653887  3945 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.654692  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:04.656229  4080 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:04.657049  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 92427.2us
I20260709 13:00:04.626873  1454 catalog_manager.cc:5697] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 2 to 3, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.658036  2286 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:04.623900  4145 raft_consensus.cc:697] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:04.668129  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:04.670851  2288 leader_election.cc:336] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.977s (SENT)
I20260709 13:00:04.656278  3828 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:00:04.689450  2322 raft_consensus.cc:2955] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:04.670710  4138 raft_consensus.cc:2955] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:04.676054  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.677642  1702 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:04.663300  3970 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.692714  4147 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:04.693064  3970 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:04.696748  2288 leader_election.cc:336] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.991s (SENT)
I20260709 13:00:04.697394  2288 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:04.687274  1708 pending_rounds.cc:85] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 6
I20260709 13:00:04.701319  1708 pending_rounds.cc:107] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:04.701696  1708 raft_consensus.cc:2889] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:04.704819  3952 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.706102  4147 raft_consensus.cc:697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:04.673585  3854 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:04.707669  3854 raft_consensus.cc:697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:04.707882  4148 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:04.708647  3854 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.703949  4073 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.663177  4080 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:04.731133  4080 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.736019  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:04.736814  1706 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:04.737011  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:04.737607  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:04.738366  1707 raft_consensus.cc:2393] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 7: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:04.738507  1554 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:04.739199  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:04.740127  1702 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 1.
I20260709 13:00:04.740496  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.673106  3793 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:04.627991  4033 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.741313  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.742025  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.742028  1626 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:04.742853  1634 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:04.740540  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.685029  3962 raft_consensus.cc:697] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:04.744503  4053 consensus_queue.cc:1059] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:04.744400  1632 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 13:00:04.713297  1454 catalog_manager.cc:5697] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.744107  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:04.772213  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 92082.4us
I20260709 13:00:04.794632  2286 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:04.796851  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:04.797894  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:04.802275  1553 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:00:04.802357  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.743722  4033 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:04.750620  3970 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:04.803438  1705 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:04.803889  2323 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:04.779888  4053 raft_consensus.cc:3055] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:04.811908  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:00:04.635038  1455 rpcz_store.cc:269] 0709 12:59:51.985037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.985668 (+   631us) service_pool.cc:224] Handling call
0709 12:59:52.253142 (+267474us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400230690. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed69610b2 00007f0edf8daa89 00007f0edf872da6 00007f0edf844088 00007f0edf94237e 00007f0edde032a4 00007f0edde03232 00007f0edde03161 00007f0edde030dc
0709 13:00:04.578050 (+12324908us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:03.032660 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:03.205386 (+172726us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:03.224315 (+ 18929us) write_op.cc:435] Acquired schema lock
0709 13:00:03.234648 (+ 10333us) tablet.cc:662] Decoding operations
0709 13:00:03.248752 (+ 14104us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:03.248895 (+   143us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:03.248932 (+    37us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:00:03.249654 (+   722us) tablet.cc:701] Row locks acquired
0709 13:00:03.249720 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:00:03.249983 (+   263us) write_op.cc:270] Start()
0709 13:00:03.250465 (+   482us) write_op.cc:276] Timestamp: P: 1783602003249909 usec, L: 0
0709 13:00:03.250494 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:00:03.254212 (+  3718us) log.cc:844] Serialized 2536 byte log entry
0709 13:00:03.573108 (+318896us) op_driver.cc:464] REPLICATION: finished
0709 13:00:03.807988 (+234880us) write_op.cc:301] APPLY: starting
0709 13:00:03.808114 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:03.808322 (+   208us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:03.828216 (+ 19894us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:03.908803 (+ 80587us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:03.909208 (+   405us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:00:03.909254 (+    46us) write_op.cc:312] APPLY: finished
0709 13:00:03.909607 (+   353us) log.cc:844] Serialized 53 byte log entry
0709 13:00:03.909803 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:03.909927 (+   124us) write_op.cc:454] Released schema lock
0709 13:00:03.910039 (+   112us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:03.910633 (+   594us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:03.910663 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":244582,"reported_tablets":15,"spinlock_wait_cycles":233947008,"child_traces":[["op",{"apply.queue_time_us":233088,"apply.run_cpu_time_us":5048,"apply.run_wall_time_us":102612,"num_ops":6,"prepare.queue_time_us":1114928,"prepare.run_cpu_time_us":58994,"prepare.run_wall_time_us":420536,"raft.queue_time_us":41983,"raft.run_cpu_time_us":18691,"raft.run_wall_time_us":39106,"replication_time_us":322423,"thread_start_us":1197105,"threads_started":4,"wal-append.queue_time_us":203743}]]}
I20260709 13:00:04.809826  1454 catalog_manager.cc:5697] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.745735  3962 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.828372  1601 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:04.829985  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:04.707660  4147 consensus_queue.cc:237] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.810314  4085 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:04.837642  1554 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:04.838622  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:04.839928  1454 catalog_manager.cc:5697] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.813854  4053 raft_consensus.cc:740] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:04.843838  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.821166  4089 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:04.844520  1632 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:04.845546  1553 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 2.
I20260709 13:00:04.846762  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:04.744154  4145 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.838218  4087 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:04.848248  1454 catalog_manager.cc:5697] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 3 to 4, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.839409  4050 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.839525  4085 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.860832  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.871572  1632 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:04.864709  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.872633  1626 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:04.848181  4089 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.892613  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:04.893280  2323 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:04.893451  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:04.883201  4033 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:04.888928  4073 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:04.889564  2288 leader_election.cc:336] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.149s (SENT)
I20260709 13:00:04.901398  1632 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:04.894747  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:04.881677  1454 catalog_manager.cc:5697] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 1 to 2, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.908087  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:04.876952  4085 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:04.914028  2288 leader_election.cc:336] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.183s (SENT)
I20260709 13:00:04.917642  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:04.924414  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.924731  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.925889  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:04.926115  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:04.926999  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.927332  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.927824  1627 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:04.928979  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.930073  1628 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:04.929833  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.931021  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.931651  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:04.931802  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.931864  1627 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:04.932238  1628 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:04.932379  1631 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:04.932840  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.933327  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.933440  1627 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:04.934092  1631 raft_consensus.cc:2393] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:04.934597  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:04.931110  1635 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:04.939875  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:04.897370  4089 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:04.951431  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.950944  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:04.952205  1558 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
W20260709 13:00:04.941943  4146 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:00:04.974103  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:04.975930  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:04.976848  4060 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.977694  4060 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:04.965201  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 88361.5us
I20260709 13:00:04.981133  1553 raft_consensus.cc:2410] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:04.967512  2326 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:04.982082  1555 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 13:00:04.984004  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:04.880378  4050 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:04.987509  1629 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
W20260709 13:00:04.987550  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 73564.6us
W20260709 13:00:05.294370  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.129678  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:05.362785  2323 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 13:00:05.362895  1630 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:04.990422  1633 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:05.122490  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:05.364234  1708 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:05.024952  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:05.123994  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:05.365671  1702 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 13:00:05.118108  4060 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:04.965981  1628 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:05.205955  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:04.987725  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:05.124431  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:05.394502  1700 raft_consensus.cc:2410] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:05.123461  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:04.951220  3793 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:05.066560  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:05.395277  1709 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 2.
I20260709 13:00:05.395692  1551 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:05.125142  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:05.396466  1672 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:04.962863  4033 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:04.980811  4053 consensus_queue.cc:260] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:05.378257  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:05.380187  2288 leader_election.cc:336] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.547s (SENT)
I20260709 13:00:05.026790  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:05.361281  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 373411us
I20260709 13:00:05.407591  1558 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 13:00:05.407742  4073 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:05.112246  4085 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:05.424706  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:05.115080  4154 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.330s	user 0.000s	sys 0.006s
W20260709 13:00:05.047367  1675 leader_election.cc:336] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.831s (SENT)
W20260709 13:00:05.428452  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 380900us
W20260709 13:00:05.217408  4138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39852 (request call id 84) took 23061 ms (client timeout 29999 ms). Trace:
I20260709 13:00:05.071382  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:05.364099  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:05.430783  1707 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 13:00:05.072134  1598 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:05.401472  1673 leader_election.cc:336] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.726s (SENT)
I20260709 13:00:05.433698  1673 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:05.401571  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:05.351614  4158 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
W20260709 13:00:05.119585  4152 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 13:00:05.386570  4156 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.538s	user 0.000s	sys 0.011s
I20260709 13:00:05.425645  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:05.432358  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 360239us
I20260709 13:00:05.443773  1706 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
W20260709 13:00:05.429893  4138 rpcz_store.cc:269] 0709 12:59:42.156455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.156606 (+   151us) service_pool.cc:224] Handling call
0709 12:59:42.185997 (+ 29391us) log.cc:844] Serialized 501 byte log entry
0709 12:59:42.289939 (+103942us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b1800305ec0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6912c0a 00007f0ee0052219 00007f0ed699aa40 00007f0ed69954e4 00007f0ed6995455 00007f0ed99deb0b 00007f0ed9a63b63 00007f0ed9a8b752 00007f0ed9a839fa
0709 13:00:05.217208 (+22927269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46544,"raft.queue_time_us":64212,"raft.run_cpu_time_us":1451,"raft.run_wall_time_us":9579,"spinlock_wait_cycles":18844032,"thread_start_us":42517,"threads_started":1,"wal-append.queue_time_us":107730,"wal-append.run_cpu_time_us":1856,"wal-append.run_wall_time_us":1001874}
I20260709 13:00:05.458822  4085 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:05.462189  4080 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:05.480150  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.462317  1601 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:05.462672  1632 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:05.481142  1558 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:05.464128  1551 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
W20260709 13:00:05.468691  1675 leader_election.cc:336] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.880s (SENT)
I20260709 13:00:05.485443  1560 raft_consensus.cc:2410] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:05.400753  3793 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.493007  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:05.494411  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 114273us
I20260709 13:00:05.468267  4105 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.497419  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:05.493832  1675 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.991s (SENT) [suppressed 60 similar messages]
I20260709 13:00:05.501055  1632 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:00:05.501590  1675 leader_election.cc:336] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.898s (SENT)
I20260709 13:00:05.483263  4053 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:05.512400  2288 leader_election.cc:336] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.724s (SENT)
I20260709 13:00:05.516216  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:05.520880  1553 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:05.522665  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:05.501775  3793 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:05.522341  2326 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEARNER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:00:05.550114  4085 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:05.551509  4060 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.552603  4060 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:05.557847  4033 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:05.558892  4033 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:05.561013  4050 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:05.561879  4050 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:05.562366  4050 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.562772  4050 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:05.544353  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:05.567332  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.569845  1551 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:05.576181  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:05.578368  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.579614  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:05.580166  1559 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:05.581460  4169 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:00:05.584570  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.585922  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.587025  4033 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:05.587340  1558 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:05.587695  4033 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:05.590553  4033 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:05.585927  4087 consensus_meta.cc:287] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.714s	user 0.011s	sys 0.001s
I20260709 13:00:05.593945  4087 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:05.510315  4105 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:05.598913  4105 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:05.570504  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:05.586247  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:05.609758  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:05.614570  1558 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.615486  1553 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:05.623525  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:05.608863  1557 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 4: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:05.641072  1553 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.627167  4060 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:05.685416  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.686658  1555 raft_consensus.cc:2368] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 13:00:05.721356  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:05.744748  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 232350us
I20260709 13:00:05.747516  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:05.748370  1560 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:05.752286  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:05.762475  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.763440  1557 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:05.766588  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:05.767472  1555 raft_consensus.cc:2376] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5. Re-sending same reply.
I20260709 13:00:05.768468  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.769214  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.770785  1555 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:05.771579  1556 raft_consensus.cc:2368] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6.
I20260709 13:00:05.773437  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.776916  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.600724  3793 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:05.772035  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:05.777693  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.782204  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:05.785091  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:05.786324  3793 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:05.787837  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:05.788708  1555 raft_consensus.cc:2368] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 13:00:05.789515  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.790295  1555 raft_consensus.cc:2393] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:05.791033  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.791762  1555 raft_consensus.cc:2393] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:05.792572  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.793085  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:05.793227  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.794129   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:05.795166  1555 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
W20260709 13:00:05.796304  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 75062.3us
I20260709 13:00:05.765555  4087 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:05.803290  1553 raft_consensus.cc:2410] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:05.809623  1559 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:05.811180  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.801445  1556 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 2: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:00:05.802500  1554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.030s	sys 0.047s
W20260709 13:00:05.813078  1554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.030s	sys 0.047s
I20260709 13:00:05.816303  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:05.816613  1599 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:05.818531  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.819545  1553 raft_consensus.cc:2368] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 13:00:05.818742  1599 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:05.822372  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.858342  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:05.859429  1559 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:00:05.865257  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:05.869824  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 51150us
I20260709 13:00:05.871098  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:05.878268  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:05.881273  1557 raft_consensus.cc:2376] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4. Re-sending same reply.
I20260709 13:00:05.821338  2326 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:05.891898  1555 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:00:05.888168  1675 leader_election.cc:336] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.535s (SENT)
W20260709 13:00:05.899649  1675 leader_election.cc:336] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.709s (SENT)
I20260709 13:00:05.900130  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:05.902110  1631 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.000s	sys 0.043s
W20260709 13:00:05.902865  1631 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.000s	sys 0.043s
I20260709 13:00:05.861012  3793 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:05.903622  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 543608us
I20260709 13:00:05.859764  4073 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:05.906081  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:05.909828  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.911883  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:05.918519  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 456215us
I20260709 13:00:05.919880  1554 raft_consensus.cc:2376] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5. Re-sending same reply.
I20260709 13:00:05.884555  4060 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.952255  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 494) took 1019 ms. Trace:
I20260709 13:00:05.952637  1559 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:05.899413  3962 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.952713  1631 rpcz_store.cc:276] 0709 13:00:04.932442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.934654 (+  2212us) service_pool.cc:224] Handling call
0709 13:00:04.934982 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.935236 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.935274 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.935752 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:00:05.004476 (+ 68724us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:05.907446 (+902970us) log.cc:844] Serialized 14 byte log entry
0709 13:00:05.951927 (+ 44481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.952010 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.952049 (+    39us) raft_consensus.cc:1685] finished
0709 13:00:05.952073 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.952197 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14488,"thread_start_us":904276,"threads_started":2,"wal-append.queue_time_us":432886}
I20260709 13:00:05.931833  1554 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:05.912803  3793 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:05.961856  1557 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:05.951856  4186 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:05.963889  4188 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:05.958675  4060 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:05.964946  4178 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:05.903100  4148 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:05.878463  4080 raft_consensus.cc:697] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:05.970124  4176 log.cc:927] Time spent T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Append to log took a long time: real 0.175s	user 0.001s	sys 0.001s
I20260709 13:00:05.972663  1555 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:05.973026  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:05.973330  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f4ee010e653949d581d35eb9b09d59dd with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:00:05.958840  1673 leader_election.cc:336] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.096s (SENT)
I20260709 13:00:06.004680  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.021201  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:05.987355  4163 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:00:06.023015  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 229991us
I20260709 13:00:06.005084  3793 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:06.017165  1558 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:06.021843  1554 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:06.006106  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 135055us
I20260709 13:00:06.004360  4179 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:06.026497  1445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 53325.7us
I20260709 13:00:06.006577  4186 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.039812  1555 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:06.018939  4089 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.036s	user 0.011s	sys 0.002s
I20260709 13:00:06.048291  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:06.049687  1557 raft_consensus.cc:2368] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6.
I20260709 13:00:06.013057  4148 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:06.006409  4079 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:00:06.058766  1555 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:05.992439  3962 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:06.025110  1551 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
W20260709 13:00:06.054469  4177 log.cc:927] Time spent T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:00:06.073912  4053 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:06.074833  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.080365  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:06.080698  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:06.053797  4148 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.083217  2286 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:06.062476  1599 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:06.039222  4186 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:06.097018  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:06.097409  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 138560us
I20260709 13:00:06.108778  3828 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:06.120239  4050 consensus_meta.cc:287] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.000s
I20260709 13:00:06.043532  4179 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:06.093554  4183 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:00:06.093241  4073 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:06.123988  1675 leader_election.cc:336] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.410s (SENT)
I20260709 13:00:06.124923  1707 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 1.
W20260709 13:00:06.145100  1675 leader_election.cc:336] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.603s (SENT)
I20260709 13:00:06.147714  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.052677  4089 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:06.148722  1555 raft_consensus.cc:2368] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6.
I20260709 13:00:06.149796  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.150578  4089 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:06.151208  4053 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.151533  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:06.151796  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:06.152098  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 110924us
I20260709 13:00:06.151732  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:06.153249  2329 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:06.126447  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.129253  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.129608  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.156175  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:06.151727  4053 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:06.147775  4183 consensus_queue.cc:1059] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:00:06.130559  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:06.134238  1673 leader_election.cc:336] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.535s (SENT)
I20260709 13:00:06.156175  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.158595  1554 raft_consensus.cc:2368] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 13:00:06.158481  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:06.134976  3997 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:06.099920  3987 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:06.135797  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.137262  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2050) took 1186 ms. Trace:
I20260709 13:00:06.160454  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:06.141368  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 45484.3us
I20260709 13:00:06.150251  4080 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:06.154395  1599 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:06.127929  4187 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 13:00:06.158830  1559 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:06.134887  4192 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:06.190075  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:06.190589  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.140245  1560 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:06.190075  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.170506  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:06.199488  1707 raft_consensus.cc:2410] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:06.199914  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.200618  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:06.201344  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.202054  1627 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:06.202170  4089 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:06.202966  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.203827  1626 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:06.206028  1551 raft_consensus.cc:2368] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
W20260709 13:00:06.206521  2321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 631) took 1698 ms (client timeout 1878 ms). Trace:
W20260709 13:00:06.206987  2321 rpcz_store.cc:269] 0709 13:00:04.508098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.510964 (+  2866us) service_pool.cc:224] Handling call
0709 13:00:06.206294 (+1695330us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54005668d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:06.206450 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3700765056}
I20260709 13:00:06.155648  4050 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:06.210762  4050 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:06.209204  3793 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:06.211596  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.212960  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.213195  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:06.176164  2326 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:06.213762  1631 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:06.221238  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.209112  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:06.222026  1700 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:06.161302  1552 rpcz_store.cc:276] 0709 13:00:04.950748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.964325 (+ 13577us) service_pool.cc:224] Handling call
0709 13:00:05.006681 (+ 42356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:05.023887 (+ 17206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:05.023916 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:05.024459 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:00:05.601740 (+577281us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:05.601781 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.601870 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:06.137062 (+535192us) raft_consensus.cc:1685] finished
0709 13:00:06.137081 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.137204 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2391,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":17236,"thread_start_us":211978,"threads_started":1,"wal-append.queue_time_us":758228}
I20260709 13:00:06.173403  4060 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:06.229226  1706 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:06.173976  3987 raft_consensus.cc:697] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:06.175601  4186 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:06.237864  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:06.238334  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.239253  1558 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:06.221031  4087 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:06.239830  4186 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:06.176154  1673 leader_election.cc:336] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.610s (SENT)
I20260709 13:00:06.240468  4087 raft_consensus.cc:697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:06.241181  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 65074.2us
I20260709 13:00:06.177016  3839 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:06.177595  3828 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.179057  4175 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:06.179576  4179 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:06.180135  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.181154  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:06.181360  4053 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:06.181838  3962 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:06.181675  4173 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:06.182245  1553 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 13:00:06.188963  1599 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:06.200944  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:06.268923  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 80031.8us
W20260709 13:00:06.191524  1675 leader_election.cc:336] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.875s (SENT)
I20260709 13:00:06.173657  3952 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.230453  2329 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:00:06.237495  3987 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:06.183950  4193 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:06.272037  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.275202  4193 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:06.276247  4193 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:06.277463  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.278282  1626 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:00:06.261584  1673 leader_election.cc:336] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.831s (SENT)
I20260709 13:00:06.231802  4050 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:00:06.212903  3793 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:06.281612  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.265810  1557 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:06.269860  1675 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:06.279222  3952 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:06.283473  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 91967.6us
I20260709 13:00:06.269017  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.268963  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.270699  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:06.269860  1599 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:06.282241  1629 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 13:00:06.286558  1706 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.273660  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.268179  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:06.277647  4193 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:06.263767  1560 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:06.279016  1673 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:06.290256  1599 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:06.294327  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.279709  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:06.280498  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 99394.5us
I20260709 13:00:06.295466  1599 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:06.285779  1635 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 13:00:06.288430  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:06.296767  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:06.289414  4053 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:06.301390  1673 leader_election.cc:336] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.880s (SENT)
I20260709 13:00:06.301743  4053 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:06.301903  1673 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:06.290225  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.290885  3793 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:06.303040  1673 leader_election.cc:336] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.898s (SENT)
I20260709 13:00:06.303429  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:06.291052  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.296519  1626 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:06.241602  4087 consensus_queue.cc:237] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:06.298575  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:06.298728  4186 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:06.299645  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:06.300211  4179 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:06.318549  1553 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:06.304286  1633 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:06.279326  4188 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:06.307446  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.322118  1629 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:06.322278  1526 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:06.305783  4073 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:06.329731  1700 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.311391  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:06.296151  3997 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.312139  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.315037  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.316982  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:06.321089  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:06.333573  1553 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.333640  1635 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:06.302877  3793 raft_consensus.cc:697] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:06.334478  1556 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.333895  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:06.305320  4050 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:06.335916  1673 leader_election.cc:336] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.119s (SENT)
I20260709 13:00:06.348650  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:06.349822  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:06.357131  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.358484  1632 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:06.368263  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:06.364413  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.370716  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:06.319216  4175 raft_consensus.cc:2764] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:00:06.373442  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:06.377406  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.379247  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:06.381440  2288 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.871s (SENT)
I20260709 13:00:06.382264  1560 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:06.330081  3932 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.331696  4186 raft_consensus.cc:697] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:06.329782  4188 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.333081  4089 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:06.332417  4204 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:06.393807  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46056.7us
I20260709 13:00:06.382215  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:06.396463  1553 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:06.397280  1700 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:06.403012  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:06.403172  4186 consensus_queue.cc:237] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:06.404011  1557 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:06.405455  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.406946  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:06.408488  1629 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:06.408896  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 73027.6us
W20260709 13:00:06.408746  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47928.9us
I20260709 13:00:06.410539  1632 pending_rounds.cc:85] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 4
I20260709 13:00:06.411223  1632 pending_rounds.cc:107] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:00:06.411835  1632 raft_consensus.cc:2889] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:06.413379  1526 leader_election.cc:400] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5.
I20260709 13:00:06.413725  1526 leader_election.cc:403] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:06.414228  1673 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.599s (SENT)
I20260709 13:00:06.414404  1626 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:06.414682  1673 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:06.415822  1628 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:06.381106  4053 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.422475  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:06.423009  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:06.423686  1700 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.394366  4138 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:06.428472  1700 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:06.408434  4183 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.431922  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:06.395231  4188 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.407187  3932 raft_consensus.cc:2764] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:06.430279  1601 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:06.454897  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.393596  4050 raft_consensus.cc:697] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:06.417806  3952 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:06.346931  4179 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:06.439576  4138 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:06.445501  1633 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.449199  1629 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:00:06.451555  1675 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:06.392882  4182 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:06.456188  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 44909.1us
I20260709 13:00:06.407716  4148 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:06.422397  3962 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.462692  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:06.486896  1700 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:06.488528  4148 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:06.470605  1631 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
W20260709 13:00:06.471091  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 60380.3us
I20260709 13:00:06.457914  1556 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:06.451835  2321 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:00:06.490396  1673 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.618s (SENT)
I20260709 13:00:06.490924  1673 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:06.461879  4181 consensus_queue.cc:1059] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:00:06.485296  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:06.492237  1628 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.492873  1557 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:06.453639  4089 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:06.515266  1628 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:06.495114  1700 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
W20260709 13:00:06.494832  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 113406us
W20260709 13:00:06.497663  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 67462us
I20260709 13:00:06.499176  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:06.519222  2288 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:06.441270  4208 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:00:06.529884  1675 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:06.529299  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 98415.4us
I20260709 13:00:06.459494  4033 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:00:06.536414  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:06.501173  4053 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:06.538201  1557 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:06.531476  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:06.542744  2288 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:06.549520  1601 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:06.554874  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:06.457063  4183 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:06.595806  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46365.8us
W20260709 13:00:06.601974  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 50271.6us
I20260709 13:00:06.516079  3932 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
W20260709 13:00:06.580833  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 89011us
I20260709 13:00:06.552546  3839 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.545625  4148 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:06.586694  1633 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:06.547744  4203 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:06.467579  3793 consensus_queue.cc:237] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 13:00:06.591254  4182 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:06.604805  4169 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:00:06.610044  3962 raft_consensus.cc:670] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } [suppressed 4 similar messages]
I20260709 13:00:06.677385  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:06.691628  1628 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 13:00:06.678362  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:06.692916  1631 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:06.685691  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.608975  4073 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:06.607031  4194 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:06.688616  4170 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:00:06.642884  4079 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:00:06.592653  3945 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:00:06.670176  4105 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5.
I20260709 13:00:06.552875  4215 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.131s
I20260709 13:00:06.655795  4203 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.581990  4204 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.108s
I20260709 13:00:06.643108  4148 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:00:06.688985  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 86050us
W20260709 13:00:06.696442  4177 log.cc:927] Time spent T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:00:06.725749  1631 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:06.719353  2288 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:06.871858  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 152592us
I20260709 13:00:06.681649  4182 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:06.844811  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 354383us
W20260709 13:00:06.863919  1706 consensus_meta.cc:287] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.000s
W20260709 13:00:06.849020  2328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.009s	sys 0.028s
I20260709 13:00:06.910141  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:06.910501  1673 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.640s (SENT)
I20260709 13:00:06.917858  1707 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:06.910851  2328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.010s	sys 0.028s
I20260709 13:00:06.917881  1673 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:06.911096  1706 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
W20260709 13:00:06.923727  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 82132.8us
I20260709 13:00:06.920533  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:06.929791  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:06.655150  4050 consensus_queue.cc:237] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:06.870481  4148 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:06.936837  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.932054  1706 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.849730  4203 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.917050  4170 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:06.925561  4186 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:06.849905  4208 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.090s
W20260709 13:00:06.928354  4169 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:00:06.946487  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:06.917193  4182 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:06.870864  4210 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:06.680522  4138 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:06.973944  4209 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 13:00:06.934520  4145 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:06.994799  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 478643us
W20260709 13:00:07.041916  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 117322us
I20260709 13:00:07.042795  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:06.953625  4151 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:06.953310  4170 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.953751  4195 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:07.077347  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:07.079171  1702 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:07.097716  1560 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.000s	sys 0.010s
I20260709 13:00:06.961032  4225 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:07.104627  1632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.006s	sys 0.005s
W20260709 13:00:07.111080  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 68364.8us
I20260709 13:00:06.956387  3932 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.132s
W20260709 13:00:07.136780  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.003s	sys 0.007s
W20260709 13:00:07.137231  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.003s	sys 0.007s
I20260709 13:00:07.088392  4170 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:07.171854  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:07.087037  4189 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:07.173657  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.016s	sys 0.019s
W20260709 13:00:07.175218  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.016s	sys 0.020s
W20260709 13:00:07.175490  4181 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.007s	sys 0.009s
W20260709 13:00:07.176167  4181 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.007s	sys 0.009s
W20260709 13:00:07.177927  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 267376us
W20260709 13:00:07.105680  1632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.006s	sys 0.005s
I20260709 13:00:07.093238  4145 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:00:07.099382  1560 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.000s	sys 0.011s
I20260709 13:00:07.103588  4060 raft_consensus.cc:2764] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:07.088085  4195 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:07.103639  4225 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.105692  4151 raft_consensus.cc:697] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:07.207528  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:07.184719  4198 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:00:07.237526  1702 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:07.241091  1706 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:07.241298  1701 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:00:07.240289  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 68505us
I20260709 13:00:07.245218  1675 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:07.255009  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 142792us
I20260709 13:00:07.193704  4183 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:07.284780  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:07.207998  4195 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:07.297559  1633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.016s	sys 0.027s
W20260709 13:00:07.298099  1633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.016s	sys 0.027s
I20260709 13:00:07.299934  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:07.205440  4087 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.006s	sys 0.012s
I20260709 13:00:07.232242  4181 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.308122  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:07.306778  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.228868  4226 raft_consensus.cc:2764] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:07.310127  1706 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:07.234030  4225 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.334522  1560 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:07.335335  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:07.250334  4179 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:07.336426  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:07.339423  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 133091us
W20260709 13:00:07.317620  4087 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.007s	sys 0.012s
W20260709 13:00:07.350008  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.380813  1673 leader_election.cc:336] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.331s (SENT)
I20260709 13:00:07.381529  1673 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:07.383628  1701 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:07.307828  4215 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:07.317332  4204 raft_consensus.cc:2764] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:07.385769  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:07.405723  1706 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.394402  4235 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.395742  1634 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:07.397738  4151 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:07.398643  4244 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:07.334322  4181 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:07.410200  1707 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
W20260709 13:00:07.412089  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 71807.1us
I20260709 13:00:07.342598  4060 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:07.439940  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:07.375519  4189 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:07.449798  1706 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
W20260709 13:00:07.457003  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 211837us
I20260709 13:00:07.458101  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:07.459628  1707 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:07.438840  4235 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:07.425379  4244 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:07.451745  4179 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:07.438225  4175 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.438191  4060 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:07.434548  4215 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:07.406497  4145 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:07.469961  4232 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:07.469971  4191 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.470244  4242 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:07.509303  4148 consensus_meta.cc:287] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.000s
W20260709 13:00:07.511471  4203 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.000s
I20260709 13:00:07.512431  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 619) took 1226 ms. Trace:
W20260709 13:00:07.517792  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 176487us
I20260709 13:00:07.519611  1601 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:07.520188  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2072) took 1006 ms. Trace:
I20260709 13:00:07.520692  4244 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:07.503048  1701 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:07.506634  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 66816.1us
I20260709 13:00:07.612187  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:07.846230  1675 connection.cc:256] RPC call timeout handler was delayed by -1.2329114580000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
W20260709 13:00:07.476439  4193 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.183s	user 0.010s	sys 0.002s
I20260709 13:00:07.688323  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:07.697715  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:07.863197  1704 raft_consensus.cc:2410] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:07.469691  4219 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:07.856550  2328 rpcz_store.cc:276] 0709 13:00:06.285883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.286002 (+   119us) service_pool.cc:224] Handling call
0709 13:00:06.303584 (+ 17582us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.314399 (+ 10815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.314461 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.318369 (+  3908us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.918787 (+600418us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:06.918827 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.918903 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.512198 (+593295us) raft_consensus.cc:1685] finished
0709 13:00:07.512219 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.512373 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10783,"raft.queue_time_us":14518,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":9957,"spinlock_wait_cycles":70400,"thread_start_us":586947,"threads_started":1,"wal-append.queue_time_us":1179058}
I20260709 13:00:07.789594  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2076) took 1073 ms. Trace:
I20260709 13:00:07.855811  1709 rpcz_store.cc:276] 0709 13:00:06.513397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.513531 (+   134us) service_pool.cc:224] Handling call
0709 13:00:06.518070 (+  4539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.591927 (+ 73857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.591994 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.645279 (+ 53285us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.180507 (+535228us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:07.180619 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.180994 (+   375us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.519974 (+338980us) raft_consensus.cc:1685] finished
0709 13:00:07.519995 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.520129 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79684,"raft.queue_time_us":387630,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":6081,"thread_start_us":471981,"threads_started":1,"wal-append.queue_time_us":838283}
W20260709 13:00:07.858373  1673 leader_election.cc:336] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.410s (SENT)
I20260709 13:00:07.525544  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:07.856760  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 337199us
I20260709 13:00:07.738741  1703 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:00:07.489912  4231 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:00:07.686823  4188 consensus_meta.cc:287] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.222s	user 0.006s	sys 0.006s
I20260709 13:00:07.697285  3932 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.505895  4204 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:07.476439  4182 consensus_meta.cc:287] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.000s
I20260709 13:00:07.870249  1627 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 13:00:07.901340  1702 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:00:07.488430  4250 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:00:07.469735  4212 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:07.507165  4248 log.cc:927] Time spent T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
W20260709 13:00:07.698135  3839 consensus_meta.cc:287] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.055s	user 0.005s	sys 0.005s
I20260709 13:00:07.475329  4073 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:07.897228  1707 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:00:07.855984  4138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.007s	sys 0.017s
W20260709 13:00:07.493382  4224 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:00:07.479980  4220 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.768s	user 0.001s	sys 0.018s
I20260709 13:00:08.028442  2321 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:08.029295  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:07.907828  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.864730  1559 rpcz_store.cc:276] 0709 13:00:06.716056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.716231 (+   175us) service_pool.cc:224] Handling call
0709 13:00:06.910866 (+194635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.054729 (+143863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:07.054778 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:07.077605 (+ 22827us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.254228 (+176623us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:07.254648 (+   420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.256743 (+  2095us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.789323 (+532580us) raft_consensus.cc:1685] finished
0709 13:00:07.789343 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.789514 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105914,"raft.queue_time_us":165987,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":15798,"thread_start_us":162198,"threads_started":2,"wal-append.queue_time_us":636341}
I20260709 13:00:07.867619  1673 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:07.771150  3945 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:08.031736  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2077) took 1078 ms. Trace:
I20260709 13:00:08.031867  3945 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:07.462571  4243 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:07.475173  4178 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:07.785965  4230 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:07.921110  1703 raft_consensus.cc:3055] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:07.485400  3987 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:08.044262  1703 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:07.682092  3962 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:07.927327  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 503) took 1261 ms. Trace:
I20260709 13:00:07.686832  4226 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:07.612201  4060 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:07.902966  4033 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.018849  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:07.925035  4227 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.869s	user 0.002s	sys 0.000s
I20260709 13:00:08.065935  4222 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:00:08.119729  1707 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:08.119566  4033 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.112179  4228 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:07.860487  4232 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:08.025069  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:08.121937  1555 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
W20260709 13:00:08.031409  4202 log.cc:927] Time spent T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:00:07.919450  1706 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:08.033018  4189 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.032150  1708 rpcz_store.cc:276] 0709 13:00:06.953464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.953633 (+   169us) service_pool.cc:224] Handling call
0709 13:00:06.953972 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.038732 (+ 84760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:07.038772 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:07.039341 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.203517 (+164176us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:07.296615 (+ 93098us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.413864 (+117249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.413960 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.486307 (+ 72347us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:08.031451 (+545144us) raft_consensus.cc:1685] finished
0709 13:00:08.031547 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.031669 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139048,"prepare.queue_time_us":47234,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":257688,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":106370,"spinlock_wait_cycles":29996416,"thread_start_us":163559,"threads_started":1,"wal-append.queue_time_us":359678}
I20260709 13:00:08.033947  4255 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.938143  4180 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.034201  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 446) took 1811 ms. Trace:
I20260709 13:00:07.867975  4219 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:07.914434  4053 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:07.661609  4175 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:07.902978  4221 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:08.004048  4105 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:08.023881  4138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.011s	sys 0.017s
I20260709 13:00:07.921479  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:07.496476  4195 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:07.861456  4148 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.070288  1559 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:07.902856  4237 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.172s
W20260709 13:00:08.085224  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.024348  3839 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:08.048368  1633 rpcz_store.cc:276] 0709 13:00:06.665688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.665902 (+   214us) service_pool.cc:224] Handling call
0709 13:00:06.666413 (+   511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.298539 (+632126us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:07.298673 (+   134us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:07.299180 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.613350 (+314170us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:07.613382 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.613450 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.927016 (+313566us) raft_consensus.cc:1685] finished
0709 13:00:07.927041 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.927229 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13,"raft.queue_time_us":373037,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":23833,"thread_start_us":870439,"threads_started":2,"wal-append.queue_time_us":588710}
I20260709 13:00:08.100654  2327 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:07.916270  4188 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.004855  4204 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:08.182775  4204 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:07.864128  4203 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.185598  4204 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:08.186829  4203 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:08.152340  4180 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.188823  4216 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:08.189386  4216 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.191053  4180 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:08.150664  4255 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.193107  4179 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:07.867456  4191 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.193815  4179 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.011348  4182 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:08.197266  4260 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:00:08.047756  4230 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.200222  2322 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:00:08.201978  4263 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:00:08.202996  2326 raft_consensus.cc:1813] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Handling vote request from an unknown peer e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:08.203621  2326 raft_consensus.cc:2393] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 3: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:08.044837  4178 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.942341  3932 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.206350  3932 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:08.207357  4178 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.018151  4212 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:08.093664  4170 consensus_meta.cc:287] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.892s	user 0.006s	sys 0.005s
I20260709 13:00:08.209653  4170 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.211931  4170 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:08.213578  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1815) took 2086 ms. Trace:
W20260709 13:00:08.125178  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 236652us
I20260709 13:00:08.126782  1702 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:07.896342  4242 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:08.153414  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 231964us
I20260709 13:00:08.214012  1554 rpcz_store.cc:276] 0709 13:00:06.127012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.161287 (+ 34275us) service_pool.cc:224] Handling call
0709 13:00:06.161591 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.181888 (+ 20297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.181921 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.182443 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.339140 (+156697us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b1800254380. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1
0709 13:00:06.339298 (+   158us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:06.339332 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.339397 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.829232 (+1489835us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b1800254380. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:00:08.213373 (+384141us) raft_consensus.cc:1685] finished
0709 13:00:08.213392 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.213515 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22115,"raft.queue_time_us":68558,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":22228,"spinlock_wait_cycles":37723648,"thread_start_us":74907,"threads_started":1,"wal-append.queue_time_us":72418}
I20260709 13:00:08.223191  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:08.101296  4235 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:08.065814  3987 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.123745  4232 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:08.177560  4033 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:08.094255  3962 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.181846  3945 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:08.192180  4216 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:08.239400  4214 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:00:08.250416  4244 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.123965  4226 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.140995  4189 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.230680  2321 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:08.231629  4240 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.835s	user 0.002s	sys 0.002s
I20260709 13:00:08.196229  4191 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:08.202543  4230 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:08.150651  4219 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.176311  4237 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:08.154560  4105 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.252490  3932 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:08.258481  4148 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:08.140938  1551 rpcz_store.cc:276] 0709 13:00:06.222923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.229229 (+  6306us) service_pool.cc:224] Handling call
0709 13:00:06.237213 (+  7984us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.241020 (+  3807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.241068 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.241645 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.610719 (+369074us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:06.647192 (+ 36473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.665475 (+ 18283us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.479220 (+813745us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:08.033846 (+554626us) raft_consensus.cc:1685] finished
0709 13:00:08.033873 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.034133 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38914,"raft.queue_time_us":15976,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4193,"spinlock_wait_cycles":4622080,"thread_start_us":365453,"threads_started":1,"wal-append.queue_time_us":469472}
I20260709 13:00:08.270780  4195 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:08.272166  4261 log.cc:927] Time spent T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:00:08.277385  3987 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:08.218961  1701 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:08.154255  4053 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.426963  4053 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:08.361203  4264 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 13:00:08.239877  4245 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.843s	user 0.001s	sys 0.002s
W20260709 13:00:08.373306  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 143623us
W20260709 13:00:08.401081  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 542639us
I20260709 13:00:08.362483  4182 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:08.415271  4244 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:08.398142  4225 consensus_meta.cc:287] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.984s	user 0.005s	sys 0.007s
I20260709 13:00:08.406140  4216 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.455829  1700 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:00:08.438210  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 215059us
I20260709 13:00:08.439164  1708 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:00:08.456179  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 385786us
I20260709 13:00:08.447036  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 507) took 1725 ms. Trace:
I20260709 13:00:08.414433  3962 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:08.457801  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:08.458567  1707 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:08.460956  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:08.461510  1707 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:08.461613  1708 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 13:00:08.457206  1629 rpcz_store.cc:276] 0709 13:00:06.721415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.721813 (+   398us) service_pool.cc:224] Handling call
0709 13:00:06.722324 (+   511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.926707 (+204383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.926750 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.939960 (+ 13210us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.306205 (+366245us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:07.306261 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.306377 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:08.230902 (+924525us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:08.430221 (+199319us) raft_consensus.cc:1685] finished
0709 13:00:08.430241 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.446937 (+ 16696us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106055,"raft.queue_time_us":252549,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":20268,"spinlock_wait_cycles":64868224,"thread_start_us":352849,"threads_started":1,"wal-append.queue_time_us":443443}
I20260709 13:00:08.463546  1708 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.462631  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:08.409813  4179 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.468788  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:08.470319  1700 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:08.434170  4181 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:08.472388  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:08.477595  1709 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:08.478652  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:08.480556  1704 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:08.485045  1554 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.484952  1558 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
W20260709 13:00:08.481571  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 565745us
I20260709 13:00:08.488796  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:08.489555  1700 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 13:00:08.493392  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:08.493685  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:08.494379  1559 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:08.495704  1629 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:08.498090  1629 raft_consensus.cc:1240] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:08.499459  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:08.500186  1555 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:08.501883  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:08.497056  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:08.503821  1559 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:08.507115  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:08.509145  1626 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:08.513412  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:08.513815  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:08.474759  4195 raft_consensus.cc:2764] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:08.529987  1633 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:08.462046  4216 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.460343  4225 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.593586  1555 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:08.603550  1601 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:08.613206  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1864) took 2344 ms (client timeout 2177 ms). Trace:
W20260709 13:00:08.558224  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.533437  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:08.629235  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 495) took 2189 ms. Trace:
I20260709 13:00:08.613683  1631 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:08.631415  1554 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:08.603041  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:08.632936  1626 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 2.
I20260709 13:00:08.627146  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:08.547508  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50279.9us
W20260709 13:00:08.630064  1627 rpcz_store.cc:269] 0709 13:00:06.268445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.268713 (+   268us) service_pool.cc:224] Handling call
0709 13:00:08.612953 (+2344240us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54000d93d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:08.613090 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3641497984}
I20260709 13:00:08.499513  4175 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:08.611325  1703 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.653092  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:08.631592  1632 rpcz_store.cc:276] 0709 13:00:06.401628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.409863 (+  8235us) service_pool.cc:224] Handling call
0709 13:00:06.410284 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.433411 (+ 23127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.433456 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.441530 (+  8074us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.182457 (+740927us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:07.351337 (+168880us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.405257 (+ 53920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.405328 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:08.239107 (+833779us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:08.534665 (+295558us) raft_consensus.cc:1685] finished
0709 13:00:08.590536 (+ 55871us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.590777 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53614,"prepare.queue_time_us":503315,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":118876,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"spinlock_wait_cycles":19073408,"thread_start_us":849526,"threads_started":2,"wal-append.queue_time_us":928422}
I20260709 13:00:08.644968  2286 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:08.659089  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:08.665596  1703 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.667598  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:08.626232  4053 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.540690  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:08.673532  1702 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:08.626065  4073 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:08.716081  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 48746.5us
I20260709 13:00:08.541942  4189 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:08.713637  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 208388us
I20260709 13:00:08.650040  4243 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.541647  4105 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:08.533778  4252 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.177s
I20260709 13:00:08.658057  4182 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.732604  1709 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:08.658623  4080 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:08.538932  4226 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:08.537343  4242 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:08.709549  3945 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:08.539845  4178 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.708066  4228 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:08.673707  4181 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:08.807912  4181 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:08.809832  4277 log.cc:927] Time spent T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 13:00:08.810967  4270 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:08.738848  2286 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:08.747898  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:08.811575  4270 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:08.812558  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 66426.7us
I20260709 13:00:08.813946  4270 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:08.815219  4278 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:00:08.816255  4179 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:08.816758  4226 raft_consensus.cc:2764] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:08.816972  4179 consensus_queue.cc:1059] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:08.733942  4073 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.797124  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:08.817860  4105 raft_consensus.cc:3055] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:08.798499  3945 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.818606  4105 raft_consensus.cc:740] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:08.818961  3945 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.819929  4073 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:08.601349  4272 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.197s
I20260709 13:00:08.747496  4243 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.795414  4182 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.823632  4243 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:08.806936  4228 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:08.825615  4182 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:08.826678  4228 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:00:08.827976  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:08.819532  4105 consensus_queue.cc:260] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.829247  4105 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:08.829562  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:08.512408  4244 consensus_queue.cc:1059] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.231s
I20260709 13:00:08.830453  3945 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.831099  4244 raft_consensus.cc:3055] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:08.831509  4244 raft_consensus.cc:740] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:08.831780  4212 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:08.832360  4244 consensus_queue.cc:260] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.832916  4181 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:08.827483  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:08.836958  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 98173.7us
I20260709 13:00:08.837216  4281 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:08.837795  4281 raft_consensus.cc:697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:08.837846  2286 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:08.838944  4281 consensus_queue.cc:237] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.841118  4269 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:08.833599  4244 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:08.859336  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.746531  4175 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:08.849340  1526 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:08.816576  1673 leader_election.cc:400] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 13:00:08.873569  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:08.770334  4232 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.534s	user 0.013s	sys 0.000s
I20260709 13:00:08.876696  1555 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.721642  4053 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.841837  4269 raft_consensus.cc:697] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:08.981570  4269 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:08.832998  3945 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:08.885912  4175 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:08.989696  4175 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:08.885826  4060 consensus_meta.cc:287] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.769s	user 0.006s	sys 0.007s
I20260709 13:00:08.992969  4060 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.979338  4232 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:08.996730  4232 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:08.925631  1675 leader_election.cc:336] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.991s (SENT)
W20260709 13:00:08.829559  4280 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:00:08.762398  4188 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:08.749665  4080 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:00:09.003275  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 331250us
W20260709 13:00:09.003756  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 78188.4us
I20260709 13:00:09.007290  4080 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:09.029738  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2079) took 1916 ms. Trace:
W20260709 13:00:09.040769  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.054127  1555 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:09.030532  1705 rpcz_store.cc:276] 0709 13:00:07.113849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.114240 (+   391us) service_pool.cc:224] Handling call
0709 13:00:07.114693 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.188361 (+ 73668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:07.188404 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:07.207201 (+ 18797us) log.cc:844] Serialized 26 byte log entry
0709 13:00:08.196017 (+988816us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b18004335a0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:00:08.507967 (+311950us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:08.508019 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.508392 (+   373us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:09.023732 (+515340us) raft_consensus.cc:1685] finished
0709 13:00:09.023759 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.029628 (+  5869us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":213841,"raft.queue_time_us":73915,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":12916,"spinlock_wait_cycles":8491392,"thread_start_us":311554,"threads_started":1,"wal-append.queue_time_us":1314245}
W20260709 13:00:09.260004  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:09.268993  2323 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.012s	sys 0.021s
W20260709 13:00:09.270188  2323 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.012s	sys 0.021s
W20260709 13:00:09.258116  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 441741us
I20260709 13:00:09.271762  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:09.255069  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:09.274848  1601 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:09.219295  1703 consensus_meta.cc:287] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.553s	user 0.005s	sys 0.005s
I20260709 13:00:09.257866  2286 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:09.277287  1703 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:09.278551  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2094) took 1759 ms. Trace:
W20260709 13:00:09.263100  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 413932us
I20260709 13:00:09.287079  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:09.269728  1704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.013s	sys 0.016s
W20260709 13:00:09.344789  1704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.013s	sys 0.017s
W20260709 13:00:09.344861  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 68456.3us
I20260709 13:00:09.279098  1703 rpcz_store.cc:276] 0709 13:00:07.519037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.917417 (+398380us) service_pool.cc:224] Handling call
0709 13:00:07.920976 (+  3559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:08.610822 (+689846us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b4c00091b00. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed7d51a20 00007f0ed7d62a29 00007f0ed7d28644 00007f0ed7d4ff2d 00007f0ed7d4fb93 00007f0ed9a8018b 00007f0ed9a80cb5 00007f0ed9a7bf30 00007f0ed9a7d7de 00007f0ed9a87b49 00007f0ed9a88416
0709 13:00:09.277879 (+667057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.278465 (+   586us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56396032}
W20260709 13:00:09.347009  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 75373.4us
I20260709 13:00:09.348227  1673 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:09.070494  4226 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:09.258549  4219 consensus_meta.cc:287] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.001s
W20260709 13:00:09.129878  4050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.039s	sys 0.056s
I20260709 13:00:09.353403  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:09.360519  4105 consensus_meta.cc:287] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.004s
I20260709 13:00:09.240199  4179 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:09.350375  4212 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:09.347086  4275 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:09.193322  4274 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:09.348191  4089 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:00:09.239959  4178 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:09.373807  4178 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:09.272716  4216 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:09.375167  4053 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:09.375252  4216 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:09.376530  4060 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:09.377233  4216 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:09.378312  4216 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:09.379205  4216 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:09.349247  4188 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:09.373276  4274 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:09.386902  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 457) took 1349 ms. Trace:
I20260709 13:00:09.351847  4270 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:09.355508  4232 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.388357  1552 rpcz_store.cc:276] 0709 13:00:08.038026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.038175 (+   149us) service_pool.cc:224] Handling call
0709 13:00:09.386188 (+1348013us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960e9c 00007f0ed6960a5b 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 13:00:09.386374 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:09.386560 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:09.386585 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:09.386627 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:09.386668 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.386723 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.386843 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4035584}
I20260709 13:00:09.390914  1558 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:09.360519  4050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.041s	sys 0.058s
I20260709 13:00:09.404122  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:09.411144  1558 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:09.412905  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:09.361274  4219 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:09.420020  1599 connection.cc:256] RPC call timeout handler was delayed by -1.6914517719999367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
W20260709 13:00:09.426462  1599 connection.cc:256] RPC call timeout handler was delayed by -1.4916517719999547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
W20260709 13:00:09.426954  1599 connection.cc:256] RPC call timeout handler was delayed by -1.3062517719999391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
I20260709 13:00:09.357122  4252 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:00:09.425856  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:09.436017  1558 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:09.432775  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:09.399363  4060 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:09.395499  2326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.022s	sys 0.015s
W20260709 13:00:09.434363  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.426735  4193 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.400291  4275 raft_consensus.cc:697] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:09.362298  4226 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:09.443496  4219 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:09.394709  4212 raft_consensus.cc:697] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:09.392997  4233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.007s	sys 0.030s
I20260709 13:00:09.439899  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:09.473919  1552 raft_consensus.cc:2368] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6.
I20260709 13:00:09.425462  4105 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:09.478438  4274 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:09.476114  4244 consensus_meta.cc:287] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.000s
I20260709 13:00:09.475745  4080 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:09.419695  4232 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:09.476926  4226 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:09.462178  2326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.023s	sys 0.015s
W20260709 13:00:09.479946  4233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.007s	sys 0.031s
I20260709 13:00:09.456084  4050 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:09.485340  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 137201us
I20260709 13:00:09.482309  1558 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:09.521155  1559 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:00:09.527352  1559 pending_rounds.cc:85] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 2
I20260709 13:00:09.462201  4060 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:09.529706  1559 pending_rounds.cc:107] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:00:09.489542  4290 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:09.592154  1559 raft_consensus.cc:2917] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:00:09.478812  4212 consensus_queue.cc:237] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:09.531526  1673 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:09.473392  4193 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:09.529325  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 175973us
I20260709 13:00:09.638478  1559 raft_consensus.cc:2889] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:09.533509  4281 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.021s	sys 0.017s
W20260709 13:00:09.645200  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 113758us
I20260709 13:00:09.653395  1673 leader_election.cc:400] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6.
I20260709 13:00:09.654500  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:09.641582  1601 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:09.642212  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 624) took 1615 ms. Trace:
I20260709 13:00:09.660094  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:09.666106  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:09.666761  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 379770us
I20260709 13:00:09.641732  4226 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:09.642900  4281 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.021s	sys 0.017s
I20260709 13:00:09.518765  4050 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:09.666589  4175 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.676s	user 0.014s	sys 0.000s
I20260709 13:00:09.683127  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:09.642772  4301 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:09.685973  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:09.672891  4053 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:09.667258  4194 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:09.686947  4244 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:09.658727  4309 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:09.637375  4290 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:09.646986  4252 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:00:09.670182  4188 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:00:09.691136  4274 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:09.681262  1673 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:09.683302  4178 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:09.667595  4270 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:00:09.641358  4275 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:09.689445  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:09.668023  2322 rpcz_store.cc:276] 0709 13:00:08.027149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.033341 (+  6192us) service_pool.cc:224] Handling call
0709 13:00:08.033624 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:08.200676 (+167052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.532809 (+1332133us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54004551d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:09.638336 (+105527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380635520}
I20260709 13:00:09.713125  4193 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:09.682250  4226 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:09.714775  3835 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:09.718127  4225 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:09.721838  1673 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:09.712396  4232 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:09.688978  4175 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:09.739300  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 49983.5us
I20260709 13:00:09.747148  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:09.749500  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:09.691978  4301 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:09.731956  4053 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:09.772727  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:09.740494  4193 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.745718  4244 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:09.747043  4178 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.734625  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 627) took 1117 ms. Trace:
W20260709 13:00:09.780834  1599 connection.cc:256] RPC call timeout handler was delayed by -1.0632517719999441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
I20260709 13:00:09.786994  1599 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:09.789198  1599 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:09.760048  4225 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:09.757071  4232 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:09.760768  4234 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.802660  4232 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.779210  4274 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:09.794561  4194 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:09.794332  4060 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:09.758431  4080 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:09.806829  1599 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:09.784196  1673 leader_election.cc:336] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.013s (SENT)
I20260709 13:00:09.831486  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:09.817360  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 140427us
I20260709 13:00:09.829264  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:09.834009  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:09.834414  1632 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:09.812322  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:09.835032  1631 raft_consensus.cc:1813] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Handling vote request from an unknown peer e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:09.835615  1631 raft_consensus.cc:2410] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:00:09.836714  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:09.837378  1626 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
W20260709 13:00:09.838943  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.839656  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:09.785420  4193 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:09.806067  4188 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:09.792224  4178 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:09.813971  4301 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:09.814172  4305 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:00:09.845961  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 447) took 1347 ms. Trace:
W20260709 13:00:09.847687  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 63541.6us
W20260709 13:00:09.865000  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.865048  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:09.841848  4232 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:09.850865  4050 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:09.857102  4290 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:09.857317  4175 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:09.821321  4234 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:09.858443  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:09.859202  4302 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:00:09.859947  4311 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:09.847460  4316 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:00:09.813613  4306 raft_consensus.cc:2764] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:00:09.878132  4053 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.849860  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:09.864151  1704 rpcz_store.cc:276] 0709 13:00:08.498703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.500570 (+  1867us) service_pool.cc:224] Handling call
0709 13:00:08.529901 (+ 29331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:08.530102 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:08.736012 (+205910us) log.cc:844] Serialized 14 byte log entry
0709 13:00:09.844132 (+1108120us) log.cc:844] Serialized 14 byte log entry
0709 13:00:09.844451 (+   319us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:09.844519 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:09.845623 (+  1104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.845719 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.845883 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19191,"prepare.queue_time_us":455848,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":28389,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":15019,"spinlock_wait_cycles":104752000,"thread_start_us":1180038,"threads_started":4,"wal-append.queue_time_us":749726}
I20260709 13:00:09.869789  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:09.873178  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:09.875286  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:09.843775  4308 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:09.895807  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 53517.5us
W20260709 13:00:09.865649  1673 connection.cc:256] RPC call timeout handler was delayed by -2.1421032360000254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
W20260709 13:00:09.908674  1673 connection.cc:256] RPC call timeout handler was delayed by -1.8215465119999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
W20260709 13:00:09.909065  1673 connection.cc:256] RPC call timeout handler was delayed by -1.7565865710000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
I20260709 13:00:09.909616  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:09.913185  4315 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:00:09.914474  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:09.916538  1632 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
W20260709 13:00:09.909675  1673 connection.cc:256] RPC call timeout handler was delayed by -1.7441465119999862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
W20260709 13:00:09.917804  1673 connection.cc:256] RPC call timeout handler was delayed by -1.6948936910000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.37200000000000005s for a response
W20260709 13:00:09.918174  1673 connection.cc:256] RPC call timeout handler was delayed by -1.2385032360000423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2877s for a response
W20260709 13:00:09.919351  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1733865709999804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24s for a response
W20260709 13:00:09.920177  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1359032360000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29910000000000003s for a response
I20260709 13:00:09.921130  4194 raft_consensus.cc:697] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:09.921689  1673 leader_election.cc:336] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.752s (SENT)
I20260709 13:00:09.925084  1673 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:09.927196  1526 connection.cc:256] RPC call timeout handler was delayed by -2.0778545039999585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260709 13:00:09.927783  1526 connection.cc:256] RPC call timeout handler was delayed by -2.07245450399995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 13:00:09.928174  1526 connection.cc:256] RPC call timeout handler was delayed by -1.8303545039999563s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
I20260709 13:00:09.930178  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:09.932714  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:09.938235  4301 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:09.939040  4301 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:09.918463  4306 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:09.918689  4193 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:09.916630  4053 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 13:00:09.946460  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 468) took 1103 ms. Trace:
I20260709 13:00:09.952723  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:09.953655  1555 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 13:00:09.955054  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:09.956025  1555 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:09.960912  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:09.918310  4308 raft_consensus.cc:697] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:09.964331  4286 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.978s	user 0.001s	sys 0.014s
I20260709 13:00:09.964197  4308 consensus_queue.cc:237] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:09.966712  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 623) took 1949 ms. Trace:
I20260709 13:00:09.967129  2329 rpcz_store.cc:276] 0709 13:00:08.017780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.018502 (+   722us) service_pool.cc:224] Handling call
0709 13:00:08.035364 (+ 16862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.229839 (+194475us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:08.467623 (+237784us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.716711 (+249088us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.737972 (+ 21261us) log.cc:844] Serialized 26 byte log entry
0709 13:00:08.738120 (+   148us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:08.738155 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.738238 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:09.963779 (+1225541us) spinlock_profiling.cc:243] Waited 78.9 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:09.966375 (+  2596us) raft_consensus.cc:1685] finished
0709 13:00:09.966466 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.966638 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38416,"prepare.queue_time_us":460638,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":115566,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":11597,"spinlock_wait_cycles":181519104,"thread_start_us":590433,"threads_started":3,"wal-append.queue_time_us":488557}
I20260709 13:00:09.973249  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:09.973965  4170 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.974148  1558 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:09.974509  4170 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:09.975217  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:09.975943  1558 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 3: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:09.976706  4170 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:09.940599  4234 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:09.980553  4310 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:09.980921  4313 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:00:09.981591  4270 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:09.982301  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 469) took 1139 ms. Trace:
I20260709 13:00:09.982391  4270 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:09.982852  1551 rpcz_store.cc:276] 0709 13:00:08.842929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.873416 (+ 30487us) service_pool.cc:224] Handling call
0709 13:00:09.362075 (+488659us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:09.420007 (+ 57932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:09.431566 (+ 11559us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:09.445227 (+ 13661us) log.cc:844] Serialized 26 byte log entry
0709 13:00:09.693293 (+248066us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:09.699368 (+  6075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.704381 (+  5013us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:09.982050 (+277669us) raft_consensus.cc:1685] finished
0709 13:00:09.982072 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.982220 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77647,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":68,"thread_start_us":239041,"threads_started":1,"wal-append.queue_time_us":334498}
I20260709 13:00:09.987903  4225 consensus_queue.cc:1059] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:09.988281  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:09.786468  2326 rpcz_store.cc:276] 0709 13:00:08.617605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.654555 (+ 36950us) service_pool.cc:224] Handling call
0709 13:00:08.746457 (+ 91902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.835790 (+ 89333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.835827 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.836978 (+  1151us) log.cc:844] Serialized 26 byte log entry
0709 13:00:09.501231 (+664253us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:09.528676 (+ 27445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.564885 (+ 36209us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:09.729207 (+164322us) raft_consensus.cc:1685] finished
0709 13:00:09.729240 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.734546 (+  5306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19710,"raft.queue_time_us":20719,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":206,"spinlock_wait_cycles":68992,"thread_start_us":651658,"threads_started":1,"wal-append.queue_time_us":807644}
I20260709 13:00:09.990456  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:09.990810  4301 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:09.992174  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:09.992753  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 449) took 2058 ms. Trace:
I20260709 13:00:09.994323  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:09.952095  4226 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:09.993305  1556 rpcz_store.cc:276] 0709 13:00:07.934647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.940070 (+  5423us) service_pool.cc:224] Handling call
0709 13:00:07.940648 (+   578us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.213235 (+272587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.213269 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.213782 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:00:08.496262 (+282480us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:08.496377 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.992254 (+1495877us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400050fd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:09.992325 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:09.992385 (+    60us) raft_consensus.cc:1685] finished
0709 13:00:09.992405 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.992676 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9100,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":7494,"spinlock_wait_cycles":625840512,"thread_start_us":132778,"threads_started":1,"wal-append.queue_time_us":503524,"wal-append.run_cpu_time_us":2666,"wal-append.run_wall_time_us":1260453}
I20260709 13:00:09.941617  4306 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:09.995937  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:09.997467  4306 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:09.998140  2322 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:00:09.998449  4297 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.625s	user 0.003s	sys 0.005s
W20260709 13:00:10.001125  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 160908us
I20260709 13:00:10.002856  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:09.974838  4053 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:09.974169  1559 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:10.007236  1555 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:09.922775  4194 consensus_queue.cc:237] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:09.947666  1553 rpcz_store.cc:276] 0709 13:00:08.842586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.842740 (+   154us) service_pool.cc:224] Handling call
0709 13:00:09.270190 (+427450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:09.270398 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:09.647587 (+377189us) log.cc:844] Serialized 14 byte log entry
0709 13:00:09.945883 (+298296us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:09.945965 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:09.946040 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.946137 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.946299 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37577,"prepare.queue_time_us":175550,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"thread_start_us":563108,"threads_started":2,"wal-append.queue_time_us":244632}
I20260709 13:00:10.009989  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:10.011503  1559 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:10.012355  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:10.013294  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 88270.5us
I20260709 13:00:10.014446  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:10.014714  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:10.016306  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 470) took 1173 ms. Trace:
I20260709 13:00:10.016826  1554 rpcz_store.cc:276] 0709 13:00:08.843219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.843347 (+   128us) service_pool.cc:224] Handling call
0709 13:00:08.843706 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.843951 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.843982 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.873723 (+ 29741us) log.cc:844] Serialized 26 byte log entry
0709 13:00:09.217744 (+344021us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:09.217786 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.217867 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:09.997707 (+779840us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:10.000776 (+  3069us) raft_consensus.cc:1685] finished
0709 13:00:10.000804 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.016233 (+ 15429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154996864,"thread_start_us":343571,"threads_started":1,"wal-append.queue_time_us":499515}
I20260709 13:00:10.008141  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:09.945578  4288 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.570s	user 0.006s	sys 0.000s
I20260709 13:00:10.018234  1556 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:10.018355  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:10.019243  1554 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
W20260709 13:00:10.019850  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 61674.2us
I20260709 13:00:10.012538  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:10.024374  1559 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:10.022509  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.010178  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:09.942865  4178 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:10.020607  1556 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: [2.5-5.6]
I20260709 13:00:09.959839  4219 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.049551  1599 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:10.018270  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:10.000517  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.063282  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:10.020725  4173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.025s	user 0.013s	sys 0.058s
I20260709 13:00:09.992841  4215 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:10.100132  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.100417  1599 leader_election.cc:400] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6.
I20260709 13:00:10.104261  1599 leader_election.cc:403] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:10.021128  4306 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:10.104653  4173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.013s	sys 0.059s
I20260709 13:00:10.020538  4053 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:10.104545  4216 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:10.105223  1599 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:10.047999  4234 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
W20260709 13:00:10.110361  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 92194.5us
I20260709 13:00:10.073007  4060 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:10.156342  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 51200.8us
I20260709 13:00:10.059880  4226 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:10.050736  4291 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.978s	user 0.011s	sys 0.016s
I20260709 13:00:10.117590  4317 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:10.165480  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:10.022284  4269 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:00:10.109124  4252 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:10.169572  4270 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:10.180673  4270 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:10.180294  4252 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:10.172000  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.181612  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:10.182637  1633 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 13:00:10.183753  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:10.073553  4233 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:00:10.176431  4226 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:10.104954  4327 consensus_queue.cc:1059] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 13:00:10.190498  4226 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:10.191118  4327 raft_consensus.cc:3055] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:10.191701  4327 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:10.170140  4080 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:10.193430  4080 raft_consensus.cc:697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:10.194648  4080 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:10.206696  1633 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:10.021284  4180 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.130s
I20260709 13:00:10.105406  4219 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:10.173879  4050 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:00:10.178028  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:10.119237  4178 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:10.122166  4216 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.114931  4306 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:10.050392  4170 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 13:00:10.219151  1556 raft_consensus.cc:1240] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:10.242096  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:10.059345  3997 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:00:10.223827  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.114267  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.224397  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.100554  4232 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:10.073652  4148 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:00:10.227810  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:10.268806  1559 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 4: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:10.235332  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:10.251871  4175 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:10.274937  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:10.280342  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:10.171316  4275 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:00:10.277411  4212 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:10.283404  4193 consensus_queue.cc:1059] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:00:10.289036  4212 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:10.290000  4193 raft_consensus.cc:3055] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:10.290397  4193 raft_consensus.cc:740] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:10.291465  4212 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:10.251878  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.291255  4193 consensus_queue.cc:260] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:10.124396  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:10.265908  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:10.291662  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:10.299523  1553 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:10.299692  1633 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:10.252352  4216 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:10.296175  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:10.253441  4306 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:10.230129  4266 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.250118  1558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "327c042262d94ababf63c12c177e29ed"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:41170
I20260709 13:00:10.325799  1558 raft_consensus.cc:606] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:10.331327  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:10.333559  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 297792us
I20260709 13:00:10.339721  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:10.340435  1634 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:10.287048  4178 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 13:00:10.347038  1675 leader_election.cc:336] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.177s (SENT)
I20260709 13:00:10.359869  1633 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
W20260709 13:00:10.340381  4293 log.cc:927] Time spent T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.793s	user 0.001s	sys 0.000s
I20260709 13:00:10.333739  4193 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:10.366933  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 188320us
I20260709 13:00:10.368116  1673 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:10.370473  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 315372us
I20260709 13:00:10.364668  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:10.373694  1526 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:10.300223  4175 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:10.374025  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:10.371119  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:10.377952  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1878) took 4014 ms (client timeout 2991 ms). Trace:
I20260709 13:00:10.354455  4252 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:10.378542  1635 rpcz_store.cc:269] 0709 13:00:06.363441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.363741 (+   300us) service_pool.cc:224] Handling call
0709 13:00:10.377670 (+4013929us) spinlock_profiling.cc:243] Waited 3.06 s on lock 0x7b5400327dd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:10.377855 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7048407296}
I20260709 13:00:10.384266  1633 pending_rounds.cc:85] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 4
I20260709 13:00:10.384760  1633 pending_rounds.cc:107] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:00:10.385040  1633 raft_consensus.cc:2889] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:10.385337  1633 pending_rounds.cc:107] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:00:10.385516  1635 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:00:10.376564  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 326975us
I20260709 13:00:10.385612  1633 raft_consensus.cc:2889] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:10.397291  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:10.366358  4053 consensus_queue.cc:1059] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:00:10.430821  2288 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:10.436678  4281 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:10.438875  4281 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:10.428920  4179 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.428789  4226 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:10.434794  4255 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:10.410166  4225 consensus_queue.cc:1059] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:00:10.434576  4151 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:00:10.490067  4053 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:10.453926  4178 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:10.453213  4219 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:10.456064  4232 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:10.322203  4266 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:10.525192  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 127984us
W20260709 13:00:10.515102  4328 log.cc:927] Time spent T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:00:10.453408  4330 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:00:10.531783  1635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
W20260709 13:00:10.532122  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 164083us
I20260709 13:00:10.516749  2320 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:10.539333  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:10.515179  4178 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.522604  4335 raft_consensus.cc:3055] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:10.524647  4219 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.521114  4225 raft_consensus.cc:3055] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:10.549055  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:10.537849  1635 raft_consensus.cc:606] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:10.240772  4327 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:10.511632  4053 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:10.537042  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 172446us
I20260709 13:00:10.492672  4226 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:10.553049  1635 raft_consensus.cc:614] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:10.535749  4232 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:10.546407  4178 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:10.557158  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 117752us
W20260709 13:00:10.564559  1675 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.658s (SENT) [suppressed 16 similar messages]
I20260709 13:00:10.546329  4335 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:10.570814  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 454) took 2559 ms. Trace:
I20260709 13:00:10.551913  4225 raft_consensus.cc:740] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:10.559623  4053 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.557814  4330 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:10.571300  1557 rpcz_store.cc:276] 0709 13:00:08.007161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.007344 (+   183us) service_pool.cc:224] Handling call
0709 13:00:08.023440 (+ 16096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:08.432043 (+408603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.432085 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:08.432141 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:08.432324 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.565423 (+2133099us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54000b72d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:10.565466 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.565592 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938906496}
I20260709 13:00:10.561405  4232 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:10.578275  4226 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:10.579860  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.561687  4327 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:10.557756  4342 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:10.593540  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.593230  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:10.598428  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:10.556483  4219 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:10.570649  4344 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.608654  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.606518  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:10.594288  4232 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:10.600518  4329 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:00:10.593861  4342 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:00:10.630282  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.631924  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:10.632755  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.637152  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.637557  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.640857  4352 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:10.641500  4339 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:00:10.641861  1598 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:10.647835  4316 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:10.648983  2326 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEARNER]: Advancing to term 4
W20260709 13:00:10.653203  4337 log.cc:927] Time spent T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:00:10.653872  1635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:44138
I20260709 13:00:10.654484  1635 raft_consensus.cc:606] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:10.654821  1635 raft_consensus.cc:614] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:10.657245  4266 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:10.639333  4324 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.658463  4324 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:10.634518  4325 log.cc:927] Time spent T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:00:10.661250  4341 log.cc:927] Time spent T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:00:10.662194  4219 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:10.604323  4330 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:00:10.635622  4050 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.666661  1551 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:10.667280  4175 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:10.669090  4342 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:10.670542  4342 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:10.671237  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:10.672518  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:10.673146  1635 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:10.614588  4335 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:10.677179  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.641876  4352 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:10.686046  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.678467  2324 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:10.694142  1523 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:10.673034   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:10.701754  1556 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:10.706890  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.663851  4050 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:10.685667  4352 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:10.698700  4225 consensus_queue.cc:260] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:10.705235  4219 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:10.724282  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:10.914011  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:10.723587  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:11.206308  1708 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:11.206730  1703 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:00:11.207299  1635 consensus_meta.cc:287] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 13:00:11.207638  1635 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:11.207933  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:10.727638  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:10.725070  1556 raft_consensus.cc:1275] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:11.209739  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:10.747131  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:11.210532  1705 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:10.761480  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:11.198877  1707 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:11.211920  1701 raft_consensus.cc:2376] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4. Re-sending same reply.
I20260709 13:00:10.697506  4290 consensus_queue.cc:1059] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 13:00:11.201108  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.000s	sys 0.009s
W20260709 13:00:11.202359  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 603878us
I20260709 13:00:10.698112  4145 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:11.217394  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.000s	sys 0.009s
W20260709 13:00:11.217825  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 611352us
W20260709 13:00:11.211302  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.004s	sys 0.051s
I20260709 13:00:11.206946  1634 raft_consensus.cc:2410] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:00:11.045195  4328 log.cc:927] Time spent T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:00:11.174844  2326 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.525s	user 0.018s	sys 0.002s
W20260709 13:00:11.181809  4317 consensus_meta.cc:287] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.981s	user 0.013s	sys 0.000s
I20260709 13:00:10.950912  4346 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:11.231204  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:11.234714  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.004s	sys 0.051s
I20260709 13:00:11.218883  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:11.216805  1708 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:10.950445  3835 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:10.762326  4338 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:00:11.235911  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:11.236356  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:10.781780  4330 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.761099  4179 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:11.269263  4330 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:10.744038  4340 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:00:11.237880  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:11.275208  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2096) took 1003 ms. Trace:
I20260709 13:00:11.275732  1559 rpcz_store.cc:276] 0709 13:00:10.271748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.301531 (+ 29783us) service_pool.cc:224] Handling call
0709 13:00:10.301939 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:10.302227 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.302264 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:10.319803 (+ 17539us) log.cc:844] Serialized 26 byte log entry
0709 13:00:10.501805 (+182002us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:10.501862 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.501972 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:10.743522 (+241550us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:11.274836 (+531314us) raft_consensus.cc:1685] finished
0709 13:00:11.274864 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.275139 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102846848,"thread_start_us":164753,"threads_started":1,"wal-append.queue_time_us":270423}
I20260709 13:00:10.814880  4344 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:11.204393  4351 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.498s	user 0.001s	sys 0.004s
I20260709 13:00:11.280340  4360 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.218611  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:10.775580  4178 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:11.281921  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 63410.1us
I20260709 13:00:10.770818  4050 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:11.283398  1704 raft_consensus.cc:2393] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:10.765054  4316 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.487s
I20260709 13:00:10.728752  4306 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:11.299625  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:11.213037  4219 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.302093  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2426) took 1483 ms. Trace:
I20260709 13:00:11.257035  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:11.303575  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:11.304411  1559 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.230602  4145 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.305110  4145 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:11.305444  4309 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:11.305986  4309 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.306380  4309 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:11.308065  1630 rpcz_store.cc:276] 0709 13:00:09.819096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.819458 (+   362us) service_pool.cc:224] Handling call
0709 13:00:09.845040 (+ 25582us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:09.914370 (+ 69330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:09.914402 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:09.914877 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:00:10.253155 (+338278us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:10.253221 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.284087 (+1030866us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b54000e6d54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:11.284164 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:11.284219 (+    55us) raft_consensus.cc:1685] finished
0709 13:00:11.284234 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.302005 (+ 17771us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14190,"raft.queue_time_us":14966,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5870,"spinlock_wait_cycles":125775104,"thread_start_us":311796,"threads_started":1,"wal-append.queue_time_us":434986}
I20260709 13:00:11.328388  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.336426  1632 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:11.261320  2288 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:11.262050  2326 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:11.255860  3835 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:10.727099  4232 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:11.343814  4232 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:11.343961  3835 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:11.263792  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:11.344763  1702 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:11.345813  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:11.346175  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:11.347569  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:11.264247  4148 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:11.349159  2326 raft_consensus.cc:2410] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:00:11.265733  4299 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 2.004s	user 0.018s	sys 0.017s
I20260709 13:00:11.189107  4335 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.281177  4360 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:11.351555  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 472) took 2504 ms. Trace:
I20260709 13:00:11.248975  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:11.352006  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.352895  1701 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:11.351917  1560 rpcz_store.cc:276] 0709 13:00:08.847547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.847759 (+   212us) service_pool.cc:224] Handling call
0709 13:00:08.848105 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.848330 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.848370 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.885003 (+ 36633us) log.cc:844] Serialized 26 byte log entry
0709 13:00:09.227766 (+342763us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:09.227806 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.227914 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:11.264953 (+2037039us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:11.351270 (+ 86317us) raft_consensus.cc:1685] finished
0709 13:00:11.351289 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.351500 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15470336,"thread_start_us":204272,"threads_started":1,"wal-append.queue_time_us":252855}
I20260709 13:00:11.353758  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.354497  1632 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:11.251498  1705 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:10.762439  4053 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:11.258828  4346 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:11.293392  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.294956  4080 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:00:11.254781  4225 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:10.754626  4216 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:11.296723  1556 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:11.296916  4178 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:11.297220  4342 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.005s
I20260709 13:00:11.254257  4317 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6.
I20260709 13:00:11.300508  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:11.302861  4219 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:10.713001  4252 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.522s
I20260709 13:00:11.382797  4252 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:11.383201  4252 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:11.311825  4353 log.cc:927] Time spent T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.541s	user 0.000s	sys 0.007s
I20260709 13:00:11.316955  4306 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:11.386029  4216 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:11.386807  1635 raft_consensus.cc:2393] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:11.386963  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2100) took 1068 ms. Trace:
I20260709 13:00:11.387465  1558 rpcz_store.cc:276] 0709 13:00:10.318950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.387769 (+ 68819us) service_pool.cc:224] Handling call
0709 13:00:10.388314 (+   545us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:10.540456 (+152142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.540491 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:10.541094 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 13:00:10.611947 (+ 70853us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:10.612009 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.612135 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:11.310759 (+698624us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:11.386449 (+ 75690us) raft_consensus.cc:1685] finished
0709 13:00:11.386497 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.386887 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40438,"raft.queue_time_us":141122,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":6813,"spinlock_wait_cycles":41941248,"thread_start_us":158298,"threads_started":2,"wal-append.queue_time_us":174939}
I20260709 13:00:11.389333  4324 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:11.390038  4252 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:11.318053  2321 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:11.391335  4252 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.204859  4352 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:11.395329  4349 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.742s	user 0.000s	sys 0.010s
I20260709 13:00:11.320109  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:11.402215  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:11.322343  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:11.322525  4330 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:11.326294  1598 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:11.326857  4350 log.cc:927] Time spent T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.641s	user 0.009s	sys 0.000s
I20260709 13:00:11.329151  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1840) took 1321 ms. Trace:
I20260709 13:00:11.329809  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:11.330710  4343 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.667s	user 0.000s	sys 0.008s
I20260709 13:00:11.251878  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:11.355190  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.359714  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.375650  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:11.419461  1630 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:11.417152  1707 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 3: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:11.379474  1559 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:11.404443  2327 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:11.406813  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 80796.5us
I20260709 13:00:11.422609  1598 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:11.408843  1553 rpcz_store.cc:276] 0709 13:00:10.008140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.009967 (+  1827us) service_pool.cc:224] Handling call
0709 13:00:11.328939 (+1318972us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b540017f2d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:11.329067 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615350144}
I20260709 13:00:11.424703  1598 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:11.425783  3835 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:11.427299  1598 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:11.430912  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 513) took 1271 ms. Trace:
I20260709 13:00:11.434749  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:11.433763  1633 rpcz_store.cc:276] 0709 13:00:10.160099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.383859 (+223760us) service_pool.cc:224] Handling call
0709 13:00:10.384105 (+   246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:10.406676 (+ 22571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.406727 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:10.407325 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 13:00:10.560004 (+152679us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:10.572916 (+ 12912us) log.cc:844] Serialized 14 byte log entry
0709 13:00:10.575731 (+  2815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.575837 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:11.394643 (+818806us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:11.430601 (+ 35958us) raft_consensus.cc:1685] finished
0709 13:00:11.430691 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.430840 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1782,"prepare.queue_time_us":10743,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":8088,"raft.queue_time_us":1961,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":71,"spinlock_wait_cycles":81387904,"thread_start_us":65911,"threads_started":1,"wal-append.queue_time_us":176948}
W20260709 13:00:11.435881  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.436406  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.437902  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.438848  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:11.439234  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.439337  1598 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:11.440505  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.442829  4179 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:11.443445  4179 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:11.445480  4360 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:11.445691  4179 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:11.446688  3828 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:11.449256  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.451671  1632 raft_consensus.cc:2410] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:11.449610  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.439565  1633 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:11.455472  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.456530  1631 raft_consensus.cc:2410] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:11.412379  4324 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:11.460508  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:11.386960  4178 consensus_queue.cc:1059] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:00:11.469959  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:11.464401  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.447271  4053 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:11.432548  4216 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:11.464064  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:11.428982  4364 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:11.549191  4352 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:11.549504  4364 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:11.550796  1703 raft_consensus.cc:2410] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:11.553210  1706 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:11.529795  1707 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:11.542347  1601 leader_election.cc:336] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.515s (SENT)
I20260709 13:00:11.553730  4346 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:11.554141  1601 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:11.552534  4352 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:00:11.556219  4216 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:11.557260  4145 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:11.558408  4352 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:11.559131  4352 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:11.560047  4145 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:11.543946  1632 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:11.456887  4304 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.561230  4352 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:11.560931  4304 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:11.563570  4304 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:11.448369  4317 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:11.565413  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:11.570041  2324 raft_consensus.cc:2393] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 4: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:11.455482  4306 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:11.446719  4179 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:11.552246  4364 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:11.588706  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:11.591722  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:11.584349  4332 raft_consensus.cc:3055] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:11.594599  2320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 644) took 3552 ms. Trace:
I20260709 13:00:11.600239  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2097) took 1323 ms. Trace:
I20260709 13:00:11.641769  1554 rpcz_store.cc:276] 0709 13:00:10.276879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.316019 (+ 39140us) service_pool.cc:224] Handling call
0709 13:00:10.316415 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:10.322683 (+  6268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.322730 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:10.333208 (+ 10478us) log.cc:844] Serialized 26 byte log entry
0709 13:00:10.532288 (+199080us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:10.533572 (+  1284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.534137 (+   565us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:11.329904 (+795767us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:11.574969 (+245065us) raft_consensus.cc:1685] finished
0709 13:00:11.575006 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.600132 (+ 25126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5770,"raft.queue_time_us":6415,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":10906,"spinlock_wait_cycles":58155776,"thread_start_us":158850,"threads_started":1,"wal-append.queue_time_us":311867}
W20260709 13:00:11.648569  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 396774us
W20260709 13:00:11.652947  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 439856us
I20260709 13:00:11.640327  1703 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:11.662427  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:11.664088  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.575884  4346 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.576999  4232 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:11.638752  4332 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:00:11.678264  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.600827  4342 consensus_queue.cc:1059] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:00:11.717197  1675 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:11.666574  4335 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.639329  4179 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:11.712134  4188 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:11.641703  2320 rpcz_store.cc:276] 0709 13:00:08.042603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.043566 (+   963us) service_pool.cc:224] Handling call
0709 13:00:08.138939 (+ 95373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.545340 (+2406401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.594332 (+1048992us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b54006711d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:11.594513 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5413332864}
I20260709 13:00:11.736558  1707 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:11.642433  4306 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:11.742137  1630 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 13:00:11.742939  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1903) took 1058 ms. Trace:
I20260709 13:00:11.743336  1630 rpcz_store.cc:276] 0709 13:00:10.684007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.365045 (+681038us) service_pool.cc:224] Handling call
0709 13:00:11.742850 (+377805us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.735133  4232 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:11.746755  4232 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:11.747313  4306 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:11.731631  4238 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.749769  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:11.750856  1707 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:11.792805  4332 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:11.741150  4342 consensus_queue.cc:1243] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:11.714663  4346 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:11.799554  4346 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:11.796145  4309 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:11.801743  4179 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:12.101794  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:11.802752  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:12.107349  1703 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:12.107730  1707 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:11.806841   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:11.804240  1454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41156 (request call id 259) took 13739 ms (client timeout 15000 ms). Trace:
I20260709 13:00:12.108882  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:12.110237  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:12.110591  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 393412us
I20260709 13:00:12.112509  1706 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:11.813313  4327 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.113590  4327 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:11.980126  1704 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.012s	sys 0.008s
I20260709 13:00:11.979918  4366 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:12.036684  2288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.006s	sys 0.030s
I20260709 13:00:12.116328  4366 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:11.982782  2285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.013s	sys 0.019s
W20260709 13:00:12.118108  2285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.016s	sys 0.027s
I20260709 13:00:12.118904  4366 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:11.816704  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.007s	sys 0.034s
W20260709 13:00:12.081712  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.009s	sys 0.033s
W20260709 13:00:12.017580  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.008s	sys 0.026s
W20260709 13:00:12.121269  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.010s	sys 0.033s
W20260709 13:00:12.121536  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.009s	sys 0.027s
W20260709 13:00:11.978032  2321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.014s	sys 0.006s
I20260709 13:00:11.731693  4324 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:12.115787  1704 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.017s	sys 0.009s
I20260709 13:00:11.734035  4335 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:11.734277  4219 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:11.813745  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.384925  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:12.385700  1626 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:12.385058  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:11.732501  4053 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.387215  1628 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:12.282516  1707 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 13:00:12.132170  1703 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:12.343708  1552 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:12.313416  1559 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:12.392841  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:12.116386  2288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.008s	sys 0.031s
W20260709 13:00:12.394088  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 1.13282e+06us
I20260709 13:00:12.385738  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:12.132983  1705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.011s	sys 0.024s
I20260709 13:00:12.395565  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:11.982576  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.013s	sys 0.020s
W20260709 13:00:12.122696  2321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.016s	sys 0.010s
W20260709 13:00:12.396332  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.013s	sys 0.031s
W20260709 13:00:12.396675  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.024s	sys 0.053s
W20260709 13:00:12.396862  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 936281us
W20260709 13:00:12.397011  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 1.11399e+06us
I20260709 13:00:12.126020  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:12.399533  1554 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:00:12.133180  1701 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.012s	sys 0.023s
W20260709 13:00:12.400558  1701 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.012s	sys 0.032s
W20260709 13:00:12.342394  1601 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.007s	sys 0.010s
W20260709 13:00:12.402544  1601 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.009s	sys 0.010s
I20260709 13:00:12.112432  1675 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:12.101593  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 720961us
W20260709 13:00:12.395797  1705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.015s	sys 0.029s
I20260709 13:00:12.397707  1526 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:12.067567  4255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.291s	user 0.015s	sys 0.041s
I20260709 13:00:11.749189  4148 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:12.408998  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 296598us
I20260709 13:00:12.423321  1675 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:12.403013  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 650811us
I20260709 13:00:12.413631  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:12.030486  4290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.000s	sys 0.036s
W20260709 13:00:12.037046  2326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.004s	sys 0.019s
I20260709 13:00:12.415709  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:12.359017  4225 consensus_meta.cc:287] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.990s	user 0.007s	sys 0.003s
I20260709 13:00:12.414561  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:12.397707  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:12.418627  1708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.004s	sys 0.016s
W20260709 13:00:12.440193  1708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.005s	sys 0.017s
W20260709 13:00:12.407600  1700 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.001s	sys 0.025s
W20260709 13:00:12.441356  1700 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.001s	sys 0.025s
I20260709 13:00:11.789896  4238 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:12.415019  4255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.649s	user 0.020s	sys 0.060s
I20260709 13:00:12.197117  4179 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:12.428614  1630 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:11.790491  4360 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:12.200289  3835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.005s	sys 0.024s
I20260709 13:00:12.115062  4309 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:12.428613  4371 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:12.430994  1558 raft_consensus.cc:2393] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:12.431684  1556 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:12.434007  4335 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:12.434947  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:12.436067  4219 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:12.382599  4175 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.693s	user 0.009s	sys 0.042s
I20260709 13:00:12.436553  1557 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:12.436421  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:12.443058  4379 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:12.443722  1552 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:12.421878  1554 raft_consensus.cc:1240] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:12.445887  2328 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:12.167503  4060 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:12.447145  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 49516.3us
I20260709 13:00:12.506844  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:12.424575  1703 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:12.508222  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2428) took 1127 ms. Trace:
I20260709 13:00:12.508805  1703 rpcz_store.cc:276] 0709 13:00:11.380867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.413324 (+1032457us) service_pool.cc:224] Handling call
0709 13:00:12.508141 (+ 94817us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.740753  4188 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:12.109229  1454 rpcz_store.cc:269] 0709 12:59:58.064487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.064681 (+   194us) service_pool.cc:224] Handling call
0709 13:00:11.804151 (+13739470us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:05.366836 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:05.367913 (+  1077us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:05.367957 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:00:05.367982 (+    25us) tablet.cc:662] Decoding operations
0709 13:00:05.369492 (+  1510us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:05.369577 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:05.369608 (+    31us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:00:05.370552 (+   944us) tablet.cc:701] Row locks acquired
0709 13:00:05.370567 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:00:05.370730 (+   163us) write_op.cc:270] Start()
0709 13:00:05.370864 (+   134us) write_op.cc:276] Timestamp: P: 1783602005370674 usec, L: 0
0709 13:00:05.370882 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:00:05.385651 (+ 14769us) log.cc:844] Serialized 3621 byte log entry
0709 13:00:06.258339 (+872688us) op_driver.cc:464] REPLICATION: finished
0709 13:00:06.459657 (+201318us) write_op.cc:301] APPLY: starting
0709 13:00:06.463885 (+  4228us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:06.528982 (+ 65097us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:06.613027 (+ 84045us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:07.339595 (+726568us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:07.431078 (+ 91483us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:00:07.445350 (+ 14272us) write_op.cc:312] APPLY: finished
0709 13:00:07.476887 (+ 31537us) log.cc:844] Serialized 71 byte log entry
0709 13:00:07.902200 (+425313us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:07.914640 (+ 12440us) write_op.cc:454] Released schema lock
0709 13:00:07.919974 (+  5334us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:08.065762 (+145788us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:08.093722 (+ 27960us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2552632,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":172856,"apply.run_cpu_time_us":28397,"apply.run_wall_time_us":1583063,"num_ops":9,"prepare.queue_time_us":294756,"prepare.run_cpu_time_us":18690,"prepare.run_wall_time_us":142670,"raft.queue_time_us":163875,"raft.run_cpu_time_us":2669,"raft.run_wall_time_us":16331,"replication_time_us":887290,"spinlock_wait_cycles":16640,"thread_start_us":962323,"threads_started":5,"wal-append.queue_time_us":964689,"wal-append.run_cpu_time_us":23977,"wal-append.run_wall_time_us":2855425}]]}
W20260709 13:00:12.436981  2326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.014s	sys 0.026s
W20260709 13:00:12.486218  4175 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.818s	user 0.010s	sys 0.042s
I20260709 13:00:12.429728  4281 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:12.429836  2321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 645) took 1109 ms. Trace:
W20260709 13:00:12.457031  3835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.010s	sys 0.029s
I20260709 13:00:12.440975  4352 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:12.404000  4332 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:12.457798  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:12.497535  4384 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:12.446617  4385 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:12.486585  1555 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:12.493794  1560 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:00:12.551748  1560 pending_rounds.cc:85] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 2
W20260709 13:00:12.551970  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 128744us
I20260709 13:00:12.552018  1560 pending_rounds.cc:107] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:00:12.417495  4324 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:12.428337  4290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.009s	sys 0.054s
W20260709 13:00:12.511385  2288 connection.cc:256] RPC call timeout handler was delayed by -1.1701240130000201s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33130000000000004s for a response
W20260709 13:00:12.555511  2288 connection.cc:256] RPC call timeout handler was delayed by -1.021344503000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
I20260709 13:00:12.519428  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:12.421393  4367 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:12.449530  4386 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:12.465164  4360 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:12.504359  4379 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.509210  4225 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.415246  4366 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:00:12.531584  2321 rpcz_store.cc:276] 0709 13:00:11.320641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.391811 (+ 71170us) service_pool.cc:224] Handling call
0709 13:00:11.392135 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.392370 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:11.439490 (+ 47120us) log.cc:844] Serialized 14 byte log entry
0709 13:00:12.429446 (+989956us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:12.429501 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:12.429552 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.429646 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.429775 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70728,"prepare.queue_time_us":61969,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":38796,"raft.queue_time_us":33634,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9572,"thread_start_us":956847,"threads_started":1}
I20260709 13:00:12.542738  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2108) took 1628 ms. Trace:
I20260709 13:00:12.522082  4335 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:12.458323  4179 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:12.552863  1560 raft_consensus.cc:2889] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:12.546277  4348 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.879s	user 0.011s	sys 0.006s
I20260709 13:00:12.556324  1707 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:12.498270  4357 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:00:12.552865  1675 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:12.576450  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:12.646171  1703 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:12.521262  4060 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:12.499228  4371 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:12.601579  1701 rpcz_store.cc:276] 0709 13:00:10.914684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.353673 (+438989us) service_pool.cc:224] Handling call
0709 13:00:11.353976 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.354209 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:12.401239 (+1047030us) log.cc:844] Serialized 14 byte log entry
0709 13:00:12.542260 (+141021us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:12.542313 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:12.542368 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.542494 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.542680 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":987733,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":12867,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":26848,"thread_start_us":1187227,"threads_started":2}
W20260709 13:00:12.621447  2288 leader_election.cc:336] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.604s (SENT)
W20260709 13:00:12.671759  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 50254.9us
W20260709 13:00:12.579543  4252 consensus_meta.cc:287] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.188s	user 0.011s	sys 0.002s
I20260709 13:00:12.564677  4219 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:12.645941  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 248279us
I20260709 13:00:12.546515  4309 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:12.686658  1630 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:12.688263  1629 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:12.647575  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:12.648550  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2436) took 1096 ms. Trace:
I20260709 13:00:12.651325  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:12.654744  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:12.649276  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 142539us
I20260709 13:00:12.691570  1626 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:12.693801  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:12.604018  3828 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.005s	sys 0.009s
I20260709 13:00:12.690625  1707 rpcz_store.cc:276] 0709 13:00:11.552096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.469929 (+917833us) service_pool.cc:224] Handling call
0709 13:00:12.648344 (+178415us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:12.666667  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 113868us
I20260709 13:00:12.578743  4327 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:12.546955  4352 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:12.619724  4225 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:12.595279  4379 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:12.590929  4290 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:12.625000  4348 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.958s	user 0.011s	sys 0.006s
W20260709 13:00:12.677791  2288 leader_election.cc:336] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 2.160s (SENT)
I20260709 13:00:12.779033  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:12.679352  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:12.690732  1560 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:12.693819  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:12.696753  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:12.600468  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 213576us
I20260709 13:00:12.558192  4384 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:12.557777  4194 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 13:00:12.566401  4385 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:12.742158  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:12.691610  1703 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:12.677914  4310 raft_consensus.cc:3055] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:12.802032  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:12.749774  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:12.673414  4367 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:12.587918  4344 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:12.713320  3828 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.005s	sys 0.012s
W20260709 13:00:12.782454  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 333695us
W20260709 13:00:12.820030  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 140769us
W20260709 13:00:12.790192  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 112417us
I20260709 13:00:12.821691  1673 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:12.799234  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:12.713898  4219 raft_consensus.cc:697] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:00:12.828485  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.804414  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 270594us
I20260709 13:00:12.812417  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:12.829823  1703 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 13:00:12.830518  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2440) took 1165 ms. Trace:
I20260709 13:00:12.831007  1703 rpcz_store.cc:276] 0709 13:00:11.665323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.812125 (+1146802us) service_pool.cc:224] Handling call
0709 13:00:12.830435 (+ 18310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.803088  1552 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:12.817981  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:12.832193  1707 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
W20260709 13:00:12.820022  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 100077us
I20260709 13:00:12.833206  1601 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:12.834015  4335 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:12.834986  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:12.835075  4335 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:12.837761  4335 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:12.838495  4335 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:12.839560  4335 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:12.840818  4335 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:12.838940  1673 connection.cc:256] RPC call timeout handler was delayed by -1.3661904329999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
I20260709 13:00:12.847791  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2439) took 1198 ms. Trace:
I20260709 13:00:12.848272  1701 rpcz_store.cc:276] 0709 13:00:11.649340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.693539 (+1044199us) service_pool.cc:224] Handling call
0709 13:00:12.847728 (+154189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:12.851570  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 157836us
I20260709 13:00:12.802513  4310 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:12.854538  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:12.857450  1555 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:12.806428  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 644) took 1485 ms. Trace:
I20260709 13:00:12.755450  4252 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:00:12.801802  4290 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:12.880184  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:12.913383  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 153648us
I20260709 13:00:12.876906  4367 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:12.997761  4389 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
I20260709 13:00:12.997987  4406 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:12.998606  4406 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:12.998832  4374 log.cc:927] Time spent T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:00:12.999046  4406 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:12.999354  4405 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:13.000324  4405 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.939436  4310 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:13.000560  4367 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:13.001418  4310 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:13.001025  4405 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:13.002120  4397 consensus_queue.cc:1059] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:13.002954  4400 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:13.003749  4400 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:13.004750  4400 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:13.004930  1701 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:12.851116  4344 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:12.890579  4194 consensus_queue.cc:1059] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 13:00:12.881106  4366 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:00:13.093078  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2100) took 2141 ms. Trace:
I20260709 13:00:13.102223  1709 rpcz_store.cc:276] 0709 13:00:10.911617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.911794 (+   177us) service_pool.cc:224] Handling call
0709 13:00:11.200121 (+288327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:11.680993 (+480872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.681050 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:12.418354 (+737304us) log.cc:844] Serialized 52 byte log entry
0709 13:00:12.577987 (+159633us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:12.578032 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.578113 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.972745 (+394632us) raft_consensus.cc:1685] finished
0709 13:00:12.972779 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.053158 (+ 80379us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104540,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":586158,"threads_started":2,"wal-append.queue_time_us":472993}
I20260709 13:00:13.004465  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 1907) took 2319 ms. Trace:
W20260709 13:00:13.233700  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 374336us
W20260709 13:00:13.051906  4369 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 13:00:13.079885  4383 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.449s	user 0.000s	sys 0.001s
I20260709 13:00:12.875906  4219 consensus_queue.cc:237] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:12.974001  4188 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:13.050997  4060 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:13.007872  4225 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:13.227919  1633 rpcz_store.cc:276] 0709 13:00:10.685012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.479995 (+794983us) service_pool.cc:224] Handling call
0709 13:00:11.480449 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.527194 (+ 46745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.527237 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.553192 (+ 25955us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.996033 (+442841us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:11.996094 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.996197 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.003831 (+1007634us) raft_consensus.cc:1685] finished
0709 13:00:13.003851 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.004407 (+   556us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8787,"raft.queue_time_us":3162,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":2656,"thread_start_us":442325,"threads_started":1,"wal-append.queue_time_us":889591}
I20260709 13:00:13.311599  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:13.052112  4403 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:13.231794  4324 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:13.267470  4394 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:00:13.373646  1701 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:13.014079  4348 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.295s
I20260709 13:00:13.309549  4412 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:13.313390  4360 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:13.365942  4060 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:13.399492  4419 raft_consensus.cc:3055] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:13.406777  4419 raft_consensus.cc:740] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:13.415130  4401 log.cc:927] Time spent T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.501s	user 0.001s	sys 0.000s
I20260709 13:00:13.416781  4384 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:13.417320  1706 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2431) took 1999 ms (client timeout 1699 ms). Trace:
I20260709 13:00:13.352923  4252 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:00:13.371771   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:13.379201  4381 log.cc:927] Time spent T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.647s	user 0.000s	sys 0.001s
I20260709 13:00:13.052129  4372 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.544s
W20260709 13:00:13.417900  1706 rpcz_store.cc:269] 0709 13:00:11.417964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.662059 (+244095us) service_pool.cc:224] Handling call
0709 13:00:13.416982 (+1754923us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b5400266454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:13.417184 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032827264}
I20260709 13:00:13.352854  4410 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 13:00:13.431764  4332 consensus_meta.cc:287] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.885s	user 0.008s	sys 0.000s
I20260709 13:00:13.399595  4405 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:13.432374  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:13.433467  4290 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:13.433694  1706 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:00:13.405230  4417 log.cc:927] Time spent T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:00:13.434769  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2121) took 1035 ms. Trace:
I20260709 13:00:13.380338  4371 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:13.435067  2288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.024s	sys 0.029s
I20260709 13:00:13.435174  1706 rpcz_store.cc:276] 0709 13:00:12.399829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.431982 (+1032153us) service_pool.cc:224] Handling call
0709 13:00:13.434713 (+  2731us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.418061  4385 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:13.374611  4188 consensus_queue.cc:1059] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:00:13.550742  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2103) took 2638 ms. Trace:
W20260709 13:00:13.435777  2288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.024s	sys 0.029s
W20260709 13:00:13.553565  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 687828us
I20260709 13:00:13.553200  1700 rpcz_store.cc:276] 0709 13:00:10.912796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.912939 (+   143us) service_pool.cc:224] Handling call
0709 13:00:11.165701 (+252762us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:11.166100 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.166128 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:11.205317 (+ 39189us) log.cc:844] Serialized 52 byte log entry
0709 13:00:11.672976 (+467659us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:12.442160 (+769184us) log.cc:844] Serialized 14 byte log entry
0709 13:00:12.598528 (+156368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.598638 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.550442 (+951804us) raft_consensus.cc:1685] finished
0709 13:00:13.550470 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.550659 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":755907,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":230707,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":15641,"thread_start_us":1282955,"threads_started":3,"wal-append.queue_time_us":1481414}
W20260709 13:00:13.431334  4053 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.032s	user 0.005s	sys 0.005s
I20260709 13:00:12.880210  2326 rpcz_store.cc:276] 0709 13:00:11.320330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.350637 (+ 30307us) service_pool.cc:224] Handling call
0709 13:00:11.350982 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.351198 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:11.399457 (+ 48259us) log.cc:844] Serialized 14 byte log entry
0709 13:00:12.697217 (+1297760us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:12.714271 (+ 17054us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:12.721756 (+  7485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.766375 (+ 44619us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.797935 (+ 31560us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39126,"prepare.queue_time_us":57093,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":51,"raft.queue_time_us":64128,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":12986,"spinlock_wait_cycles":74499328,"thread_start_us":1262723,"threads_started":2,"wal-append.queue_time_us":1601290}
I20260709 13:00:13.634464  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:13.656433  1706 raft_consensus.cc:2410] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:00:13.400811  4412 raft_consensus.cc:697] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:13.365038  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.018s	sys 0.027s
W20260709 13:00:13.658454  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.018s	sys 0.027s
W20260709 13:00:13.659051  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 825776us
W20260709 13:00:13.517340  4400 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.005s
I20260709 13:00:13.650842  4281 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:13.651119  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:13.545919  4345 raft_consensus.cc:993] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
W20260709 13:00:13.531498  4310 consensus_meta.cc:287] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.001s
I20260709 13:00:13.658028  4233 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.411371  4367 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:13.505777  4382 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.703s	user 0.001s	sys 0.001s
I20260709 13:00:13.664983  4233 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:13.665745  4399 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:13.666211  4399 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:13.541579  4406 consensus_meta.cc:287] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.000s
I20260709 13:00:13.666963  4406 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:13.667183  4399 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:13.669032  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2116) took 2436 ms. Trace:
I20260709 13:00:13.669754  4406 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:13.670593  4406 raft_consensus.cc:1081] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 13:00:13.668212  4233 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:13.673244  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.669615  1705 rpcz_store.cc:276] 0709 13:00:11.233097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.355779 (+122682us) service_pool.cc:224] Handling call
0709 13:00:11.356116 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:11.356543 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.356598 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:11.357847 (+  1249us) log.cc:844] Serialized 52 byte log entry
0709 13:00:12.405987 (+1048140us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:12.406035 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.406126 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.668672 (+1262546us) raft_consensus.cc:1685] finished
0709 13:00:13.668699 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.668870 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37123,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"thread_start_us":1035807,"threads_started":1,"wal-append.queue_time_us":1233594}
I20260709 13:00:13.659953  4053 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:13.684912  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:13.685791  1705 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:13.686349  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2124) took 1260 ms. Trace:
I20260709 13:00:13.687021  4419 consensus_queue.cc:260] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:13.688566  4419 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:13.538130  4377 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.537s	user 0.000s	sys 0.002s
I20260709 13:00:13.660847  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2443) took 1548 ms. Trace:
W20260709 13:00:13.542414  4395 log.cc:927] Time spent T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:00:13.663849  4400 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:13.686725  1705 rpcz_store.cc:276] 0709 13:00:12.425826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.684511 (+1258685us) service_pool.cc:224] Handling call
0709 13:00:13.686280 (+  1769us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.702350  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:13.358273  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 437813us
W20260709 13:00:13.505458  4396 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.623s	user 0.001s	sys 0.001s
I20260709 13:00:13.689635  1706 rpcz_store.cc:276] 0709 13:00:12.112936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.634175 (+1521239us) service_pool.cc:224] Handling call
0709 13:00:13.660759 (+ 26584us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:13.850251  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.006s	sys 0.013s
W20260709 13:00:13.850958  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.006s	sys 0.013s
W20260709 13:00:13.704900  1553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.157s	user 0.023s	sys 0.017s
W20260709 13:00:13.853165  1553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.305s	user 0.023s	sys 0.017s
I20260709 13:00:13.852512  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:13.854645  1706 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
W20260709 13:00:13.834697  1556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.008s	sys 0.006s
I20260709 13:00:13.706964  1599 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:13.858309  2286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.036s	sys 0.045s
W20260709 13:00:13.859141  2286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.037s	sys 0.045s
W20260709 13:00:13.859743  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 624665us
W20260709 13:00:13.726799  4418 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.711s	user 0.001s	sys 0.016s
W20260709 13:00:13.861284  3835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.175s	user 0.004s	sys 0.015s
W20260709 13:00:13.861842  3835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.188s	user 0.004s	sys 0.015s
I20260709 13:00:13.705554  1705 raft_consensus.cc:2393] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:13.863574  3835 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:13.864096  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 526) took 1215 ms. Trace:
W20260709 13:00:13.737489  4373 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.652s	user 0.008s	sys 0.011s
I20260709 13:00:13.864970  4225 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.689618  4385 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.866148  4225 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:13.867775  4385 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:13.864312  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2120) took 1464 ms. Trace:
I20260709 13:00:13.752331  4179 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:13.869203  1705 rpcz_store.cc:276] 0709 13:00:12.399534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.702013 (+1302479us) service_pool.cc:224] Handling call
0709 13:00:13.864088 (+162075us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.730162  1709 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
W20260709 13:00:13.849123  1628 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.171s	user 0.005s	sys 0.036s
W20260709 13:00:13.872113  1628 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.006s	sys 0.036s
I20260709 13:00:13.872848  4310 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:13.874130  4310 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:13.755052  4232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.033s	sys 0.058s
W20260709 13:00:13.877313  4232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.033s	sys 0.058s
I20260709 13:00:13.743772  4252 raft_consensus.cc:3055] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:13.878742  4332 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:13.878933  4252 raft_consensus.cc:740] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:13.855957  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2438) took 2285 ms. Trace:
I20260709 13:00:13.786147  4400 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:13.905229  4433 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:13.907518  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.906780  4433 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:13.908195  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.750888  4309 consensus_meta.cc:287] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.037s	user 0.008s	sys 0.003s
I20260709 13:00:13.908406  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:13.909524  4309 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:13.909732  2323 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:13.752055  4379 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.963s	user 0.009s	sys 0.002s
I20260709 13:00:13.911576  4379 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:13.755267  4412 consensus_queue.cc:237] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:13.701532  4399 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:13.914006  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:13.713246  4255 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:00:13.661375  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:13.871146  4233 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:13.792914  4424 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:00:13.873042  4053 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:13.858105  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 151062us
I20260709 13:00:13.864861  1627 rpcz_store.cc:276] 0709 13:00:12.648362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.649472 (+  1110us) service_pool.cc:224] Handling call
0709 13:00:12.649797 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.650129 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.650154 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:12.665854 (+ 15700us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.773393 (+107539us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:12.773451 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.773550 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.707880 (+934330us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:13.863283 (+155403us) raft_consensus.cc:1685] finished
0709 13:00:13.863340 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.863753 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15078,"raft.queue_time_us":147476,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":13601,"spinlock_wait_cycles":81954176,"thread_start_us":20619,"threads_started":1,"wal-append.queue_time_us":303344}
I20260709 13:00:13.856187  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2110) took 1506 ms. Trace:
I20260709 13:00:13.864172  3835 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.871176  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:13.880332  1706 rpcz_store.cc:276] 0709 13:00:11.570792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.851326 (+2280534us) service_pool.cc:224] Handling call
0709 13:00:13.855769 (+  4443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.866400  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:13.917368  1556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.009s	sys 0.007s
I20260709 13:00:13.879667  4332 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:13.878638  4225 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:13.927942  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 52009us
I20260709 13:00:13.912451  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:13.948629  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:13.979246  3835 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:13.973032  4385 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:13.967801  1553 rpcz_store.cc:276] 0709 13:00:12.349929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.350162 (+   233us) service_pool.cc:224] Handling call
0709 13:00:12.350715 (+   553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.351008 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:12.547348 (+196340us) log.cc:844] Serialized 14 byte log entry
0709 13:00:13.854986 (+1307638us) log.cc:844] Serialized 14 byte log entry
0709 13:00:13.855309 (+   323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:13.855376 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:13.855526 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.855664 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.855950 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":338015,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":120,"raft.queue_time_us":31334,"raft.run_cpu_time_us":464,"raft.run_wall_time_us":464,"spinlock_wait_cycles":2304,"thread_start_us":1500411,"threads_started":2}
I20260709 13:00:14.012974  2326 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:14.018035  1554 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.103s	user 0.010s	sys 0.003s
I20260709 13:00:14.024986  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.029295  1705 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:14.036341  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 465) took 1156 ms. Trace:
I20260709 13:00:14.036878  1705 rpcz_store.cc:276] 0709 13:00:12.884051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.870615 (+986564us) service_pool.cc:224] Handling call
0709 13:00:14.036228 (+165613us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:14.041837  1554 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.010s	sys 0.005s
I20260709 13:00:14.050467  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:14.025840  4379 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:13.993645  4233 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:14.024309  4310 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:14.048398  1557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.160s	user 0.010s	sys 0.021s
W20260709 13:00:14.068290  1559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.233s	user 0.013s	sys 0.015s
W20260709 13:00:14.070206  1557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.011s	sys 0.021s
W20260709 13:00:14.070559  2325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.535s	user 0.008s	sys 0.011s
I20260709 13:00:14.060187  4233 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:14.077315  1559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.334s	user 0.014s	sys 0.016s
I20260709 13:00:14.079629  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 457) took 1231 ms. Trace:
W20260709 13:00:14.073532  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.018s	sys 0.067s
I20260709 13:00:14.080173  1706 rpcz_store.cc:276] 0709 13:00:12.848453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.997079 (+1148626us) service_pool.cc:224] Handling call
0709 13:00:14.079438 (+ 82359us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:14.078727  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.011s	sys 0.003s
W20260709 13:00:14.082177  2325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.638s	user 0.008s	sys 0.011s
W20260709 13:00:14.083230  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.028s	sys 0.114s
W20260709 13:00:14.083742  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.019s	sys 0.068s
W20260709 13:00:14.085451  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.011s	sys 0.004s
W20260709 13:00:14.086151  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.231s	user 0.028s	sys 0.114s
W20260709 13:00:14.072244  4357 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.007s	sys 0.013s
W20260709 13:00:14.075003  4335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.012s	sys 0.009s
I20260709 13:00:14.094576  4419 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:14.094717  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:14.095254  4419 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:14.095786  4419 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:14.100838  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:14.089723  4441 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.113852  4441 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:14.114375  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 1.25976e+06us
W20260709 13:00:14.107791  4335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.012s	sys 0.011s
W20260709 13:00:14.131515  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 82543.7us
W20260709 13:00:14.111595  4357 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.008s	sys 0.014s
I20260709 13:00:14.117563  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2128) took 1356 ms. Trace:
I20260709 13:00:14.137326  4441 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:14.073594  4053 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:14.140949  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:14.154289  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 61239us
I20260709 13:00:14.168941  4193 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:14.169651  4193 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.170110  4193 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:14.184211  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.184046  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.185127  2321 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:14.185974  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.188035  4053 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:14.194208  1632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.993s	user 0.023s	sys 0.035s
W20260709 13:00:14.202303  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.202456  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2122) took 1679 ms. Trace:
I20260709 13:00:14.202912  1554 rpcz_store.cc:276] 0709 13:00:12.523211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.523472 (+   261us) service_pool.cc:224] Handling call
0709 13:00:12.523926 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.524335 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:12.704317 (+179982us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.186175 (+1481858us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.201681 (+ 15506us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.201742 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:14.201937 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.202167 (+   230us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.202396 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15112,"prepare.queue_time_us":281105,"prepare.run_cpu_time_us":154,"prepare.run_wall_time_us":5144,"raft.queue_time_us":532091,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":1497743,"threads_started":3,"wal-append.queue_time_us":298930}
I20260709 13:00:14.078222  4252 consensus_queue.cc:260] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:14.215721  1632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.024s	sys 0.035s
W20260709 13:00:14.210537  1673 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.003s	sys 0.039s
I20260709 13:00:14.135843  1556 rpcz_store.cc:276] 0709 13:00:12.761401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.761819 (+   418us) service_pool.cc:224] Handling call
0709 13:00:12.762203 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.762467 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:12.816216 (+ 53749us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.027108 (+1210892us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.050577 (+ 23469us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:14.077971 (+ 27394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.084716 (+  6745us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.117483 (+ 32767us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22115,"prepare.queue_time_us":154774,"prepare.run_cpu_time_us":6916,"prepare.run_wall_time_us":82608,"raft.queue_time_us":577566,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":4352,"thread_start_us":1152068,"threads_started":2,"wal-append.queue_time_us":847351}
I20260709 13:00:14.223464  2323 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:14.221251  1705 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:14.225991  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2444) took 2112 ms. Trace:
I20260709 13:00:14.226432  1705 rpcz_store.cc:276] 0709 13:00:12.113498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.074600 (+1961102us) service_pool.cc:224] Handling call
0709 13:00:14.225942 (+151342us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.228344  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2124) took 1633 ms. Trace:
W20260709 13:00:14.224829  1673 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.003s	sys 0.039s
I20260709 13:00:14.233826  4411 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:14.239228  4411 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
W20260709 13:00:14.241385  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 514) took 4080 ms (client timeout 3313 ms). Trace:
W20260709 13:00:14.241961  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2448) took 2126 ms (client timeout 1898 ms). Trace:
W20260709 13:00:14.241916  1634 rpcz_store.cc:269] 0709 13:00:10.160361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.362976 (+202615us) service_pool.cc:224] Handling call
0709 13:00:14.240853 (+3877877us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54000da2d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:14.241119 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497553664}
W20260709 13:00:14.242798  1701 rpcz_store.cc:269] 0709 13:00:12.115296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.860622 (+745326us) service_pool.cc:224] Handling call
0709 13:00:14.241615 (+1380993us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54002530d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:14.241778 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272726400}
I20260709 13:00:14.246932  4252 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:14.247861  4388 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:14.250362  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:14.250741  1707 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:14.251677  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2422) took 2968 ms. Trace:
W20260709 13:00:14.252281  4435 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:00:14.253381  1703 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:14.253494  4348 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:14.254272  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2117) took 3018 ms. Trace:
I20260709 13:00:14.254703  1703 rpcz_store.cc:276] 0709 13:00:11.235941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.173208 (+2937267us) service_pool.cc:224] Handling call
0709 13:00:14.253033 (+ 79825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.253962 (+   929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.254192 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.255656  4348 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:14.258337  1703 raft_consensus.cc:2955] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:14.252235  1707 rpcz_store.cc:276] 0709 13:00:11.283764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.249705 (+2965941us) service_pool.cc:224] Handling call
0709 13:00:14.250244 (+   539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.251217 (+   973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.251573 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.236006  1599 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:14.261188  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 599661us
I20260709 13:00:14.271348  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 655) took 2956 ms. Trace:
I20260709 13:00:14.256484  4348 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:14.275668  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.271832  2328 rpcz_store.cc:276] 0709 13:00:11.314979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.315772 (+   793us) service_pool.cc:224] Handling call
0709 13:00:11.316076 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.505834 (+1189758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.270837 (+1765003us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540052c454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:14.271125 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2591073664}
I20260709 13:00:14.267350  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 527) took 1613 ms. Trace:
I20260709 13:00:14.285609  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 650) took 1881 ms. Trace:
W20260709 13:00:14.325994  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 775657us
W20260709 13:00:14.328203  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 172203us
I20260709 13:00:14.296231  4332 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:14.231859  1557 rpcz_store.cc:276] 0709 13:00:12.594973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.595449 (+   476us) service_pool.cc:224] Handling call
0709 13:00:12.595867 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.596160 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:12.800203 (+204043us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.111027 (+1310824us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.143240 (+ 32213us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:14.158156 (+ 14916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.197606 (+ 39450us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.228286 (+ 30680us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":256649,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":541650,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":5683,"thread_start_us":1433231,"threads_started":3,"wal-append.queue_time_us":127178,"wal-append.run_cpu_time_us":1802,"wal-append.run_wall_time_us":1024775}
I20260709 13:00:14.332831  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:14.334450  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 69475.7us
I20260709 13:00:14.298544  4053 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:14.342959  1701 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:14.346946  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2118) took 3107 ms. Trace:
I20260709 13:00:14.299480  1628 rpcz_store.cc:276] 0709 13:00:12.651163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.652429 (+  1266us) service_pool.cc:224] Handling call
0709 13:00:12.652801 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.652989 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:13.873189 (+1220200us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.106396 (+233207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.133831 (+ 27435us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:14.211244 (+ 77413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.228210 (+ 16966us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.264788 (+ 36578us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4353,"prepare.queue_time_us":41878,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":15449,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":46004,"thread_start_us":1395870,"threads_started":2,"wal-append.queue_time_us":400404}
I20260709 13:00:14.347417  1701 rpcz_store.cc:276] 0709 13:00:11.239312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.243965 (+3004653us) service_pool.cc:224] Handling call
0709 13:00:14.261964 (+ 17999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.343670 (+ 81706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.346861 (+  3191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.312065  2325 rpcz_store.cc:276] 0709 13:00:12.394097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.394251 (+   154us) service_pool.cc:224] Handling call
0709 13:00:12.420789 (+ 26538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.421028 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:12.443557 (+ 22529us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.154251 (+1710694us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.200741 (+ 46490us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:14.213732 (+ 12991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.227324 (+ 13592us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.274097 (+ 46773us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4999,"prepare.queue_time_us":170694,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":21302,"raft.run_cpu_time_us":603,"raft.run_wall_time_us":70391,"spinlock_wait_cycles":19200768,"thread_start_us":1641642,"threads_started":1,"wal-append.queue_time_us":1643957}
I20260709 13:00:14.364838  4368 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:14.365754  4368 raft_consensus.cc:697] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:14.371876  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.372852  4178 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.373807  4050 raft_consensus.cc:3055] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:00:14.389060  4392 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 1.707s	user 0.011s	sys 0.026s
I20260709 13:00:14.386706  4411 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:14.387879  4348 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:14.413221  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:14.413671  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.382911  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:14.397660  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 2111) took 2007 ms. Trace:
W20260709 13:00:14.410765  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49473.2us
I20260709 13:00:14.402868  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.417819  4178 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:14.425755  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 456) took 1578 ms. Trace:
I20260709 13:00:14.428931  1706 rpcz_store.cc:276] 0709 13:00:12.847916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.382458 (+1534542us) service_pool.cc:224] Handling call
0709 13:00:14.425666 (+ 43208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.410539  4050 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:14.432919  4050 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:14.434499  4050 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:14.434614  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2106) took 3520 ms. Trace:
I20260709 13:00:14.435570  4344 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:14.435534  1708 rpcz_store.cc:276] 0709 13:00:10.914023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.252927 (+338904us) service_pool.cc:224] Handling call
0709 13:00:11.253412 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.669748 (+416336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.669795 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.712165 (+ 42370us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.440764 (+728599us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:12.440821 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.441078 (+   257us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.387420 (+1946342us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:14.434116 (+ 46696us) raft_consensus.cc:1685] finished
0709 13:00:14.434136 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.434431 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6565,"raft.queue_time_us":51514,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":10257280,"thread_start_us":1086436,"threads_started":2,"wal-append.queue_time_us":821138}
I20260709 13:00:14.438541  4178 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:14.443845  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.439486  1708 raft_consensus.cc:1275] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:14.446548  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2123) took 2021 ms. Trace:
I20260709 13:00:14.415012  1558 rpcz_store.cc:276] 0709 13:00:12.391504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.392568 (+  1064us) service_pool.cc:224] Handling call
0709 13:00:14.396845 (+2004277us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b540023f0d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:14.397421 (+   576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85784960}
I20260709 13:00:14.447275  1708 rpcz_store.cc:276] 0709 13:00:12.425054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.438388 (+2013334us) service_pool.cc:224] Handling call
0709 13:00:14.438889 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.445949 (+  7060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.446260 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.442646  1705 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:00:14.452342  1701 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:14.454507  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2122) took 2054 ms. Trace:
I20260709 13:00:14.454991  1701 rpcz_store.cc:276] 0709 13:00:12.400185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.352689 (+1952504us) service_pool.cc:224] Handling call
0709 13:00:14.424866 (+ 72177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.453873 (+ 29007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.454439 (+   566us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.392189  3835 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:14.460567  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2126) took 1767 ms. Trace:
W20260709 13:00:14.467422  4327 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.604s	user 0.040s	sys 0.049s
W20260709 13:00:14.467964  4327 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.670s	user 0.040s	sys 0.049s
W20260709 13:00:14.468647  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1892) took 3797 ms (client timeout 1621 ms). Trace:
W20260709 13:00:14.468871  4448 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:00:14.469199  1635 rpcz_store.cc:269] 0709 13:00:10.670597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.209499 (+538902us) service_pool.cc:224] Handling call
0709 13:00:14.468125 (+3258626us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54001bb554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:14.468385 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404118912}
W20260709 13:00:14.468837  1700 consensus_meta.cc:287] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.747s	user 0.006s	sys 0.014s
I20260709 13:00:14.474587  1700 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
W20260709 13:00:14.475297  1700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 455) took 1629 ms (client timeout 1604 ms). Trace:
W20260709 13:00:14.475636  1700 rpcz_store.cc:269] 0709 13:00:12.846446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.635016 (+788570us) service_pool.cc:224] Handling call
0709 13:00:14.475182 (+840166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.439141  4193 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:14.490127  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:14.499537  1706 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:14.464291  1559 rpcz_store.cc:276] 0709 13:00:12.693607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.696660 (+  3053us) service_pool.cc:224] Handling call
0709 13:00:12.742314 (+ 45654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.115111 (+1372797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.115170 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.116014 (+   844us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.211603 (+ 95589us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:14.211664 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.231092 (+ 19428us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.449143 (+218051us) raft_consensus.cc:1685] finished
0709 13:00:14.449175 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.460484 (+ 11309us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":599052,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":20638,"thread_start_us":1434411,"threads_started":2,"wal-append.queue_time_us":228942}
I20260709 13:00:14.367439  4368 consensus_queue.cc:237] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:14.513924  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.514672  2323 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:14.477914  4344 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:14.430955  4053 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:14.520722  4399 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.593s	user 0.014s	sys 0.003s
W20260709 13:00:14.524147  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.526122  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:14.527576  3835 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:14.529573  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 529) took 1863 ms. Trace:
I20260709 13:00:14.530817  4193 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:14.531463  1631 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:14.531215  2324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 639) took 3293 ms (client timeout 1730 ms). Trace:
I20260709 13:00:14.532788  2322 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:14.526172  4458 consensus_queue.cc:1059] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:00:14.524017  4238 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:14.539391  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:14.542507  1601 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:14.553037  2324 rpcz_store.cc:269] 0709 13:00:11.237393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.237579 (+   186us) service_pool.cc:224] Handling call
0709 13:00:14.530744 (+3293165us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54008291d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:14.531015 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678658816}
I20260709 13:00:14.543488  4301 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.581857  4301 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:14.586567  1675 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.747s (SENT)
I20260709 13:00:14.587371  1675 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:14.589561  4335 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:14.592695  4397 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.326s	user 0.005s	sys 0.009s
W20260709 13:00:14.593209  4397 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.590s	user 0.005s	sys 0.009s
I20260709 13:00:14.594686  1558 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:14.596616  2323 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:14.552078  1632 rpcz_store.cc:276] 0709 13:00:12.666211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.666332 (+   121us) service_pool.cc:224] Handling call
0709 13:00:12.666673 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.973627 (+306954us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:13.079941 (+106314us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.337150 (+1257209us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.350286 (+ 13136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.357212 (+  6926us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:14.403564 (+ 46352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.529156 (+125592us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54001bbf54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:14.529225 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.529456 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":142758,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":108,"raft.queue_time_us":5724,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":13267,"spinlock_wait_cycles":608560000,"thread_start_us":1136001,"threads_started":1,"wal-append.queue_time_us":1107549}
I20260709 13:00:14.599753  4335 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:14.600733  4335 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:14.602394  1526 connection.cc:256] RPC call timeout handler was delayed by -2.7654695280000396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:00:14.602890  1526 connection.cc:256] RPC call timeout handler was delayed by -2.7179549440000415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 13:00:14.603190  1526 connection.cc:256] RPC call timeout handler was delayed by -2.7017549440000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:00:14.603495  1526 connection.cc:256] RPC call timeout handler was delayed by -2.6630549440000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 13:00:14.603777  1526 connection.cc:256] RPC call timeout handler was delayed by -2.6270549440000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
I20260709 13:00:14.578130  1557 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:00:14.612843  4458 raft_consensus.cc:3055] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:14.613451  4458 raft_consensus.cc:740] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:14.614724  4458 consensus_queue.cc:260] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
W20260709 13:00:14.618677  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 76387.5us
I20260709 13:00:14.618820  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 656) took 3303 ms. Trace:
I20260709 13:00:14.619385  2322 rpcz_store.cc:276] 0709 13:00:11.315296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.320683 (+  5387us) service_pool.cc:224] Handling call
0709 13:00:14.532257 (+3211574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.600986 (+ 68729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.618511 (+ 17525us) spinlock_profiling.cc:243] Waited 3.21 s on lock 0x7b54008291d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:14.618744 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7383917824}
I20260709 13:00:14.620949  4308 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:14.624346  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:14.643968  1706 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:14.629030  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 530) took 1955 ms. Trace:
W20260709 13:00:14.656045  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 306314us
I20260709 13:00:14.645183  1631 rpcz_store.cc:276] 0709 13:00:12.673360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.673478 (+   118us) service_pool.cc:224] Handling call
0709 13:00:14.244108 (+1570630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.581740 (+337632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.628008 (+ 46268us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54000da2d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:14.628683 (+   675us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54000da2d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:14.628936 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4270083712}
I20260709 13:00:14.655289  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2425) took 3315 ms. Trace:
I20260709 13:00:14.664028  1705 rpcz_store.cc:276] 0709 13:00:11.329125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.270128 (+2941003us) service_pool.cc:224] Handling call
0709 13:00:14.409851 (+139723us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.461938 (+ 52087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.644096 (+182158us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b5400253ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:14.644311 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41358720}
W20260709 13:00:14.663487  4419 consensus_meta.cc:287] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.003s
W20260709 13:00:14.678330  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.680758  4404 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:14.692850  4419 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:14.693493  4404 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:14.695645  4419 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:14.681484  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2114) took 3478 ms. Trace:
I20260709 13:00:14.685436  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:14.687278  1632 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:14.671638  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:14.687521  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:14.688328  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:14.689320  4352 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:14.689522  4316 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.689711  4053 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:14.690037  4399 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:14.715899  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:14.721892  1706 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:14.721606  4399 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:14.720706  1675 leader_election.cc:336] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.860s (SENT)
W20260709 13:00:14.725666  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.690469  4442 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:00:14.726969  1598 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:14.727321  1526 connection.cc:256] RPC call timeout handler was delayed by -2.4785549440000523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260709 13:00:14.727743  1526 connection.cc:256] RPC call timeout handler was delayed by -2.4659549440000319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
I20260709 13:00:14.689743  1557 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:14.728176  1526 connection.cc:256] RPC call timeout handler was delayed by -2.3903549440000234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
I20260709 13:00:14.691669  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:14.664304  4301 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:14.724813  4080 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:14.681545  4433 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:14.728435  4412 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:14.728909  1633 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:14.729146  3835 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.729893  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:14.730087  4457 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:14.730191  1709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2427) took 3294 ms (client timeout 2828 ms). Trace:
I20260709 13:00:14.730577  4458 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:14.731377  4399 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:14.729178  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:14.724855  4308 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:14.690754  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:14.729908  4316 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:14.734737  4327 consensus_queue.cc:1059] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:00:14.737639  1526 connection.cc:256] RPC call timeout handler was delayed by -2.3597549440000307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260709 13:00:14.750236  1629 raft_consensus.cc:2368] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6.
I20260709 13:00:14.750402  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:14.728184  4238 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:14.748513  1709 rpcz_store.cc:269] 0709 13:00:11.374324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.229949 (+1855625us) service_pool.cc:224] Handling call
0709 13:00:14.656085 (+1426136us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54003ec6d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:14.668085 (+ 12000us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774518656}
I20260709 13:00:14.753733  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:14.758996  1634 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:14.759102  1626 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:14.662808  4344 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:14.767117  4308 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:14.768308  1631 raft_consensus.cc:2393] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:14.771878  4175 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.772522  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.813304  1705 raft_consensus.cc:2393] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:14.813750  2326 raft_consensus.cc:2410] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:14.775236  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.776122  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.776976  4335 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:14.777031  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.777927  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.779713  4366 raft_consensus.cc:3055] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:14.779516  4080 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:14.785211  4412 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:14.789127  1526 connection.cc:256] RPC call timeout handler was delayed by -2.338869528000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
I20260709 13:00:14.771912  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.791854  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:14.839253  1526 connection.cc:256] RPC call timeout handler was delayed by -2.192588910999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 13:00:14.839613  1526 connection.cc:256] RPC call timeout handler was delayed by -1.8197549440000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2828s for a response
I20260709 13:00:14.839655  1632 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:14.839970  1526 connection.cc:256] RPC call timeout handler was delayed by -1.5931889109999702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2277s for a response
W20260709 13:00:14.840301  1526 connection.cc:256] RPC call timeout handler was delayed by -1.5749549440000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31000000000000005s for a response
I20260709 13:00:14.697378  1704 rpcz_store.cc:276] 0709 13:00:11.203397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.358247 (+154850us) service_pool.cc:224] Handling call
0709 13:00:11.370572 (+ 12325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.370858 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:14.239854 (+2868996us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b180032dbe0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0edd47d3c7 00007f0ed9a8f9a7 00007f0ed9a9f0bf
0709 13:00:14.240085 (+   231us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.657977 (+417892us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.667368 (+  9391us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:14.680427 (+ 13059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.681171 (+   744us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.681317 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6285,"prepare.queue_time_us":1017851,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":1550,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":51602,"spinlock_wait_cycles":9555328,"thread_start_us":1386110,"threads_started":2}
W20260709 13:00:14.840711  1526 connection.cc:256] RPC call timeout handler was delayed by -1.395854944000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3299s for a response
I20260709 13:00:14.801127  1706 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:14.811079  1701 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:14.830150  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.833243  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:14.833158  2325 raft_consensus.cc:2393] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 4: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:14.864610  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:14.840189  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:14.867790  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:14.791311  4399 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:00:14.889626  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:14.891805  1705 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 13:00:14.829957  4366 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:14.824373  4404 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:14.890456  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:14.892848  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:14.902953  1634 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:14.904618  1526 connection.cc:256] RPC call timeout handler was delayed by -1.2128148630000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 13:00:14.898118  1633 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:14.905021  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1093148630000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 13:00:14.905350  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0859148630000277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 13:00:14.905642  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0625148630000467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
I20260709 13:00:14.879096  4335 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.910571  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.831404  4175 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:14.901701  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:14.915274  1635 raft_consensus.cc:1813] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Handling vote request from an unknown peer e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:14.919436  1635 raft_consensus.cc:2410] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:00:14.912173  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:14.921773  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 462741us
I20260709 13:00:14.917995  1709 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:14.931679  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:14.932605  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:14.933553  1627 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:14.935267  4234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.113s	user 0.027s	sys 0.022s
W20260709 13:00:14.935755  4234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.187s	user 0.027s	sys 0.022s
I20260709 13:00:14.936820  2326 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
W20260709 13:00:14.937747  1585 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:44807 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:44807 timed out after 15.000s (SENT)
I20260709 13:00:14.927570  4335 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:14.893783  4238 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:14.939883  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:14.940538  2327 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
W20260709 13:00:14.937065  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 56335.8us
I20260709 13:00:14.942970  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 531) took 2263 ms. Trace:
I20260709 13:00:14.943840  1631 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:14.944172  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:14.945161  1706 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:14.942010  4238 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:14.946978  1672 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:14.946300  1455 catalog_manager.cc:5697] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 5 to 7, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.947862  4404 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:14.948444  4404 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.948953  4404 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:14.951552  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:14.957970  4412 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:14.959757  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2119) took 2560 ms. Trace:
I20260709 13:00:14.878343  3835 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:14.964697  1455 catalog_manager.cc:5697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 4 to 6, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.963435  2324 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:14.976372  4308 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:14.976987  1455 catalog_manager.cc:5697] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 5, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.979254  1455 catalog_manager.cc:5697] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 3, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.983304  4344 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:14.985319  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.984750  4366 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:14.986761  4366 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:14.991325  1627 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:00:14.960191  1707 rpcz_store.cc:276] 0709 13:00:12.399160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.263689 (+1864529us) service_pool.cc:224] Handling call
0709 13:00:14.331029 (+ 67340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.356414 (+ 25385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.356457 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.403804 (+ 47347us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.740448 (+336644us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:14.740504 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.740604 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.959434 (+218830us) raft_consensus.cc:1685] finished
0709 13:00:14.959460 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.959660 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6153,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":34793,"thread_start_us":280078,"threads_started":1,"wal-append.queue_time_us":469017}
I20260709 13:00:15.010076  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:15.011689  1706 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:15.059873  1629 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:15.067932  1632 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:15.065794  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:15.011198  4252 consensus_meta.cc:287] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.763s	user 0.003s	sys 0.012s
I20260709 13:00:14.984822  1599 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:15.068668  1701 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 13:00:14.943359  1630 rpcz_store.cc:276] 0709 13:00:12.679179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.687854 (+  8675us) service_pool.cc:224] Handling call
0709 13:00:12.723920 (+ 36066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.743454 (+ 19534us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:12.798190 (+ 54736us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.525367 (+1727177us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b1800434f20. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed962523a 00007f0ed9a8fa2a
0709 13:00:14.895134 (+369767us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.908169 (+ 13035us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:14.927974 (+ 19805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.942656 (+ 14682us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.942787 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20885,"prepare.queue_time_us":54090,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":27353,"raft.queue_time_us":24808,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":11750,"spinlock_wait_cycles":72348032,"thread_start_us":301660,"threads_started":1}
I20260709 13:00:15.073385  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 462) took 2198 ms. Trace:
I20260709 13:00:15.200176  1633 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:15.204408  1706 rpcz_store.cc:276] 0709 13:00:12.850908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.011029 (+2160121us) service_pool.cc:224] Handling call
0709 13:00:15.011406 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.048480 (+ 37074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.048794 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:15.059448  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 89367.6us
W20260709 13:00:15.110841  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.141842  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:14.992478  1455 catalog_manager.cc:5697] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 5, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.009804  4080 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:15.161976  1708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.020s	sys 0.012s
W20260709 13:00:15.206120  1559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.009s	sys 0.022s
W20260709 13:00:15.224102  1559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.010s	sys 0.022s
W20260709 13:00:15.141381  4454 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:00:15.131598  4352 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.137496  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:15.228858  1707 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:15.230185  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:15.231298  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 466) took 2311 ms. Trace:
I20260709 13:00:15.181682  3835 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:15.236898  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.178165  4175 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:15.239051  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:15.205883  4457 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:15.222854  4344 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.136962  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:14.967482  4178 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.254s
W20260709 13:00:15.223565  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 238826us
I20260709 13:00:15.248339  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 463) took 2395 ms. Trace:
W20260709 13:00:15.263999  1553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.011s	sys 0.027s
W20260709 13:00:15.265053  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.264544  1707 rpcz_store.cc:276] 0709 13:00:12.851167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.066707 (+2215540us) service_pool.cc:224] Handling call
0709 13:00:15.154961 (+ 88254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:15.246495 (+ 91534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.246778 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:15.058354  4316 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:15.249989  1560 raft_consensus.cc:2410] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:15.247316  1706 rpcz_store.cc:276] 0709 13:00:12.919987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.230345 (+2310358us) service_pool.cc:224] Handling call
0709 13:00:15.230692 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.230935 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.230966 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:15.231029 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:15.231063 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.231122 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.231223 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:15.245774  1455 catalog_manager.cc:5697] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 3, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:15.222157  1708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.020s	sys 0.016s
I20260709 13:00:15.253357  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:15.248006  4080 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:15.247092  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:15.256433  1635 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:15.254434  1552 raft_consensus.cc:2393] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:00:15.264825  1553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.011s	sys 0.027s
I20260709 13:00:15.274863  1556 raft_consensus.cc:2393] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:15.102857  4053 consensus_queue.cc:1059] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.169s
W20260709 13:00:15.282234  1598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.011s	sys 0.027s
W20260709 13:00:15.282783  1598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.012s	sys 0.027s
W20260709 13:00:15.281072  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.008s	sys 0.030s
W20260709 13:00:15.311295  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.008s	sys 0.031s
W20260709 13:00:15.311669  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 577311us
I20260709 13:00:15.315006  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:15.273398  4080 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.264014  4344 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:15.275882  4193 raft_consensus.cc:3055] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:15.356005  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:15.318264  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:15.336596  1702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.019s	sys 0.012s
I20260709 13:00:15.317556  1701 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 13:00:15.333634  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:15.360015  1702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.022s	sys 0.012s
I20260709 13:00:15.323909  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:15.318069  1455 catalog_manager.cc:5697] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 5, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:00:15.359558  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 632523us
I20260709 13:00:15.336433  1707 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:15.379822  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 140987us
I20260709 13:00:15.332321  1551 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:00:15.394300  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 467) took 2396 ms. Trace:
I20260709 13:00:15.394903  1707 rpcz_store.cc:276] 0709 13:00:13.020031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.277100 (+2257069us) service_pool.cc:224] Handling call
0709 13:00:15.336166 (+ 59066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.385206 (+ 49040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.394216 (+  9010us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:15.397194  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:15.355351  4080 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:15.398402  1552 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:15.358865  4193 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:15.417094  1556 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:15.417769  4468 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:00:15.418391  4193 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:15.381969  1455 catalog_manager.cc:5697] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 3, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.322316  4316 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 13:00:15.421046  1455 catalog_manager.cc:5697] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.423067  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:15.422824  1455 catalog_manager.cc:5697] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 3, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:00:15.424301  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:15.426303  4178 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:15.314103  4352 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:15.428851  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:15.429636  1557 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:15.430119  1551 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:15.434293  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:15.435122  1560 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.392763  4404 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:15.440960  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:15.441850  4397 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:15.442548  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:15.443393  2328 raft_consensus.cc:1813] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Handling vote request from an unknown peer e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:15.446637  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:15.422816  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 471) took 2039 ms. Trace:
I20260709 13:00:15.463462  1706 rpcz_store.cc:276] 0709 13:00:13.383615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.399109 (+2015494us) service_pool.cc:224] Handling call
0709 13:00:15.422099 (+ 22990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.422347 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.422368 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:15.422405 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:15.422441 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.422657 (+   216us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.422767 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:15.444166  2328 raft_consensus.cc:2393] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 4: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:15.461704  1455 catalog_manager.cc:5697] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 4, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:00:15.474700  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 75776.3us
W20260709 13:00:15.480346  2329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.003s	sys 0.007s
I20260709 13:00:15.462584  2325 raft_consensus.cc:2376] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6. Re-sending same reply.
W20260709 13:00:15.490332  2329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.003s	sys 0.007s
I20260709 13:00:15.420050  4193 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:15.449088  4467 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:00:15.489589  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:15.481575  4458 consensus_meta.cc:287] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.720s	user 0.009s	sys 0.004s
W20260709 13:00:15.500897  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 103826us
I20260709 13:00:15.443786  4404 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:15.502998  1632 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:15.452872  4060 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.552505  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:15.549364  1455 catalog_manager.cc:5697] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.503688  4175 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:15.566475  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 62333.7us
I20260709 13:00:15.572558  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:15.583621  1557 raft_consensus.cc:2410] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:00:15.585937  1558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.006s	sys 0.015s
I20260709 13:00:15.586493  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:15.591566  1558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.007s	sys 0.016s
I20260709 13:00:15.559316  4348 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:15.601994  1706 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:15.613178  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:15.612103  1556 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:15.615161  1557 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:15.615298  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:15.616240  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:15.616976  1557 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 13:00:15.617524  4399 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.617894  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 459) took 2768 ms. Trace:
I20260709 13:00:15.618214  4399 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:15.619777  4472 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:00:15.618470  1700 rpcz_store.cc:276] 0709 13:00:12.849585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.476312 (+1626727us) service_pool.cc:224] Handling call
0709 13:00:14.516638 (+ 40326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.533152 (+ 16514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.533189 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.533712 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.835977 (+302265us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:14.836023 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.836093 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.617664 (+781571us) raft_consensus.cc:1685] finished
0709 13:00:15.617683 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.617807 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":138,"thread_start_us":293467,"threads_started":1,"wal-append.queue_time_us":672788}
I20260709 13:00:15.621297  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:15.639547  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:15.621699  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:15.628965  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:15.629642  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:15.630359  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:15.623077  1673 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.588s (SENT) [suppressed 39 similar messages]
I20260709 13:00:15.626714  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:15.625468  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:15.620824  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 115734us
I20260709 13:00:15.667147  1634 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:15.628265  1599 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:15.616405  1707 raft_consensus.cc:2410] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:15.658514  1700 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 3: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:15.620553  4399 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:15.605015  1455 catalog_manager.cc:5697] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 4 to 5, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New cstate: current_term: 2 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:15.629271  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:15.671907  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 48857us
I20260709 13:00:15.676373  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:15.587713  4060 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:15.679934  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:15.706046  1700 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 7: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:00:15.681299  1555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.001s	sys 0.011s
W20260709 13:00:15.706635  1555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.001s	sys 0.011s
I20260709 13:00:15.683034  4344 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:15.678296  4479 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:15.688941  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:15.691572  4366 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.704s	user 0.008s	sys 0.008s
I20260709 13:00:15.667382  4352 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:15.603924  4411 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:15.659552  4473 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:00:15.694743  1557 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
W20260709 13:00:15.665333  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.699987  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:15.702543  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:15.692875  4308 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:15.712836  1630 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:15.697368  4175 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:15.725350  1552 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
W20260709 13:00:15.725507  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:15.726943  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.729646  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:15.731096  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.733884  1554 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:15.733836  1599 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:15.719111  4474 log.cc:927] Time spent T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:15.740747  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:15.741911  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:15.744319  1556 raft_consensus.cc:2410] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:15.743800  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:15.753506  1700 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:15.755111  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:15.756994  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:15.760012  1704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.010s	sys 0.030s
W20260709 13:00:15.760468  1704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.010s	sys 0.030s
W20260709 13:00:15.761557  1709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.005s	sys 0.033s
W20260709 13:00:15.761965  1709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.005s	sys 0.033s
I20260709 13:00:15.770208  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:15.771673  1557 raft_consensus.cc:2393] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:15.772853  1628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.033s	sys 0.041s
W20260709 13:00:15.773207  1628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.033s	sys 0.041s
I20260709 13:00:15.727664  4308 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.777252  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:15.777706  1627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.005s	sys 0.027s
I20260709 13:00:15.732870  4175 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:15.775622  1455 catalog_manager.cc:5697] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 4, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:15.783143  1627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.005s	sys 0.027s
I20260709 13:00:15.782840  1552 raft_consensus.cc:2410] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:15.742278  4352 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:15.786981  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:15.788964  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 43841.5us
I20260709 13:00:15.793776  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:15.783346  1707 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
W20260709 13:00:15.796015  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.016s	sys 0.023s
W20260709 13:00:15.796360  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.016s	sys 0.023s
W20260709 13:00:15.796730  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 551320us
I20260709 13:00:15.798280  1556 raft_consensus.cc:2410] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:15.808965  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:15.809187  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:15.809867  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:15.810539  1632 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:15.780405  4366 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.785429  4308 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:15.828728  1455 catalog_manager.cc:5697] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:15.830761  1455 catalog_manager.cc:5697] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.779700  4411 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:15.833452  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:15.834699  4411 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:15.834920  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:15.784902  4399 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:15.820528  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:15.788175  4175 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.821257  4060 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:15.823861  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2134) took 1238 ms. Trace:
I20260709 13:00:15.789710  4352 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:15.824622  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:15.825148  4080 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:15.825719  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:15.812492  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:15.820518  1672 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:15.905608  1632 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: [7.9-9.10]
I20260709 13:00:15.860302  1629 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:15.832336  1455 catalog_manager.cc:5697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:15.897316  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:15.847095  1560 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:15.911298  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:15.999434  1552 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:00:15.942066  1700 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:16.009989  1706 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:15.994571  1559 rpcz_store.cc:276] 0709 13:00:14.585072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.609887 (+ 24815us) service_pool.cc:224] Handling call
0709 13:00:14.629652 (+ 19765us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.630239 (+   587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.630274 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.630805 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:00:15.224681 (+593876us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:15.224725 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.225037 (+   312us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.823499 (+598462us) raft_consensus.cc:1685] finished
0709 13:00:15.823528 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.823791 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3146,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":9088,"thread_start_us":593358,"threads_started":1,"wal-append.queue_time_us":873824}
W20260709 13:00:16.013499  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 193041us
I20260709 13:00:15.998442  1630 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:15.834692  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:15.843770  4366 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:16.020886  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:16.028852  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:15.931998  4470 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.382s	user 0.001s	sys 0.003s
I20260709 13:00:16.029659  2325 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:16.039490  1557 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:16.041280  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:16.042768  1631 raft_consensus.cc:2393] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:16.024660  4193 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 13:00:16.046556  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:16.040248  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.051120  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:16.026502  4053 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.015s	sys 0.022s
I20260709 13:00:16.045334  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:15.870602  4335 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:16.039687  1455 catalog_manager.cc:5697] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 2, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:16.045436  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:15.870961  4399 raft_consensus.cc:697] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:15.936529  4348 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:00:16.072995  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 247371us
W20260709 13:00:16.063715  1708 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.029s	sys 0.070s
I20260709 13:00:15.965963  4178 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.056509  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:16.084144  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:16.065109  1634 raft_consensus.cc:2410] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:16.071767  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:16.088973  1700 raft_consensus.cc:1813] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Handling vote request from an unknown peer 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:16.089478  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.073809  1598 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:16.075791  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.075949  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:16.080703  4348 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:16.084556  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.028966  3835 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:16.065407  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.089890  1700 raft_consensus.cc:2410] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:00:16.073998  1708 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.029s	sys 0.071s
I20260709 13:00:16.093578  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 458) took 3244 ms. Trace:
I20260709 13:00:16.095521  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:16.096717  1599 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:16.097471  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.086977  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 461) took 3236 ms. Trace:
I20260709 13:00:16.101913  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:16.096320  1630 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
W20260709 13:00:16.064430  4053 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.016s	sys 0.023s
I20260709 13:00:16.102548  1554 raft_consensus.cc:2376] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5. Re-sending same reply.
W20260709 13:00:16.096261  1626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.009s	sys 0.024s
I20260709 13:00:16.066807  1551 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 13:00:16.108949  1626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.009s	sys 0.024s
I20260709 13:00:16.115319  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:16.115952  1701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.012s	sys 0.022s
I20260709 13:00:16.116036  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:16.116570  1701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.012s	sys 0.023s
I20260709 13:00:16.107302  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.112649  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:16.117935  1700 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:16.120160  1560 raft_consensus.cc:2393] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:16.125634  1556 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:16.100989  1709 rpcz_store.cc:276] 0709 13:00:12.850538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.960733 (+2110195us) service_pool.cc:224] Handling call
0709 13:00:15.122761 (+162028us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:15.137328 (+ 14567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.137358 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:15.137956 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 13:00:15.777675 (+639719us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:15.777727 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.777800 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.086655 (+308855us) raft_consensus.cc:1685] finished
0709 13:00:16.086683 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.086897 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3880,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"thread_start_us":623960,"threads_started":1,"wal-append.queue_time_us":946728}
I20260709 13:00:16.131111  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:16.133051  1630 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:16.095611  1708 rpcz_store.cc:276] 0709 13:00:12.849149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.477283 (+1628134us) service_pool.cc:224] Handling call
0709 13:00:14.505431 (+ 28148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.528251 (+ 22820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.528283 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.528880 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 13:00:15.268358 (+739478us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:16.092926 (+824568us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.093207 (+   281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.093300 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.093349 (+    49us) raft_consensus.cc:1685] finished
0709 13:00:16.093365 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.093513 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4342,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":170,"thread_start_us":1560090,"threads_started":2,"wal-append.queue_time_us":852200}
I20260709 13:00:16.149660  1552 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
W20260709 13:00:16.150664  1702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.014s	sys 0.018s
I20260709 13:00:16.132797  1559 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:16.149986  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:16.133764  2288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.000s	sys 0.027s
I20260709 13:00:16.158269  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:16.158857  2288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.000s	sys 0.027s
W20260709 13:00:16.159307  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 606773us
W20260709 13:00:16.153373  1702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.014s	sys 0.019s
W20260709 13:00:16.160737  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 87014.3us
I20260709 13:00:16.157778  1631 raft_consensus.cc:2376] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5. Re-sending same reply.
W20260709 13:00:16.162825  2286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.005s	sys 0.030s
W20260709 13:00:16.163412  2286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.005s	sys 0.030s
I20260709 13:00:16.108539  4193 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:16.203079  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.205835  1700 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:16.206714  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 477) took 1657 ms. Trace:
I20260709 13:00:16.207121  1700 rpcz_store.cc:276] 0709 13:00:14.549201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.159646 (+1610445us) service_pool.cc:224] Handling call
0709 13:00:16.205455 (+ 45809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.206372 (+   917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.206639 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.125550  4458 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:16.133431  4335 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:16.134028  4470 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:00:16.164124  1635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.009s	sys 0.017s
I20260709 13:00:16.200768  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:16.218485  1635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.009s	sys 0.021s
I20260709 13:00:16.218662  1556 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:16.191608  1523 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:16.163910  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.220125  1554 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
W20260709 13:00:16.163820  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 722280us
W20260709 13:00:16.199796  4466 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:00:16.197548  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:16.228603  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:16.210557  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:16.213878  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.230438  1552 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:16.231729  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 472) took 2812 ms. Trace:
I20260709 13:00:16.232265  1707 rpcz_store.cc:276] 0709 13:00:13.419067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.108059 (+2688992us) service_pool.cc:224] Handling call
0709 13:00:16.213000 (+104941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.213227 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.213264 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.231355 (+ 18091us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:16.231428 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.231513 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.231650 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.216763  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 473) took 2753 ms. Trace:
I20260709 13:00:16.233765  1706 rpcz_store.cc:276] 0709 13:00:13.463261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.117356 (+2654095us) service_pool.cc:224] Handling call
0709 13:00:16.204907 (+ 87551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.216259 (+ 11352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.216306 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.216368 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:16.216421 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.216499 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.216689 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.217306  1559 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:16.177510  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.157541  4490 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:16.240819  1560 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:16.216042  4335 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:16.198309  3835 raft_consensus.cc:2764] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:16.198998  4477 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:16.211841  4458 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.273499  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.274667  1559 raft_consensus.cc:2410] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:16.259366  1707 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:16.277446  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 480) took 1131 ms. Trace:
W20260709 13:00:16.277668  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.277927  1707 rpcz_store.cc:276] 0709 13:00:15.145728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.233463 (+1087735us) service_pool.cc:224] Handling call
0709 13:00:16.258937 (+ 25474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.277070 (+ 18133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.277369 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.260082  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:16.261322  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 152894us
I20260709 13:00:16.250211  4335 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:16.262804  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.250406  1700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "327c042262d94ababf63c12c177e29ed"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39878
I20260709 13:00:16.288429  1700 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:16.288650  1557 raft_consensus.cc:2410] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:16.288885  1700 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:16.264912  4352 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:16.257539  4489 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.177s	user 0.000s	sys 0.002s
I20260709 13:00:16.269450  4411 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:16.270839  1553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.002s	sys 0.044s
W20260709 13:00:16.303967  1553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.003s	sys 0.044s
I20260709 13:00:16.242995  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.290292  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:16.280820  4327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.025s	sys 0.023s
W20260709 13:00:16.288277  4487 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:00:16.246330  4310 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:16.198026  4178 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:16.251619  4490 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:16.336823  1555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.014s	sys 0.050s
W20260709 13:00:16.311264  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:16.338510  1673 leader_election.cc:336] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.618s (SENT)
I20260709 13:00:16.293568  2325 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
W20260709 13:00:16.339145  1673 leader_election.cc:336] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.642s (SENT)
I20260709 13:00:16.310441  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:16.339669  1673 leader_election.cc:336] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.652s (SENT)
I20260709 13:00:16.339803  1552 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:00:16.341236  1555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.015s	sys 0.050s
I20260709 13:00:16.340056  1673 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:16.343281  1554 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:16.345227  1707 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:16.341159  1672 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:16.281354  4458 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:16.313763  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.346262  1523 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:16.342085  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 490) took 1449 ms. Trace:
I20260709 13:00:16.327872  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2107) took 5389 ms. Trace:
I20260709 13:00:16.421177  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2424) took 5092 ms. Trace:
W20260709 13:00:16.393993  1558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.017s	sys 0.031s
I20260709 13:00:16.425064  1703 rpcz_store.cc:276] 0709 13:00:11.328780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.255626 (+2926846us) service_pool.cc:224] Handling call
0709 13:00:14.256065 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.257881 (+  1816us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:14.545377 (+287496us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.963758 (+418381us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.976206 (+ 12448us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.976378 (+   172us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:14.976414 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.976489 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.930747 (+954258us) spinlock_profiling.cc:243] Waited 8.56 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:16.385112 (+454365us) raft_consensus.cc:1685] finished
0709 13:00:16.420867 (+ 35755us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.421094 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82037,"raft.queue_time_us":6382,"raft.run_cpu_time_us":599,"raft.run_wall_time_us":81527,"spinlock_wait_cycles":19689216,"thread_start_us":370673,"threads_started":1,"wal-append.queue_time_us":793764}
I20260709 13:00:16.376266  1631 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:16.348042  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.359630  1556 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:00:16.425284  1558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.018s	sys 0.032s
I20260709 13:00:16.383546  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 496) took 1152 ms. Trace:
I20260709 13:00:16.378991  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 500) took 1146 ms. Trace:
I20260709 13:00:16.432996  1553 rpcz_store.cc:276] 0709 13:00:15.230905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.482793 (+251888us) service_pool.cc:224] Handling call
0709 13:00:15.499553 (+ 16760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.569769 (+ 70216us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:15.606111 (+ 36342us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.383067 (+776956us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.383142 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:16.383214 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.383304 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.383460 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20063,"prepare.queue_time_us":49389,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"thread_start_us":680363,"threads_started":1}
I20260709 13:00:16.432353  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 489) took 1571 ms. Trace:
I20260709 13:00:16.446269  1709 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:00:16.312304  4411 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:16.254603  4399 consensus_queue.cc:237] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:16.453106  1559 raft_consensus.cc:2410] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:00:16.380787  4481 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:00:16.465265  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 498) took 1222 ms. Trace:
I20260709 13:00:16.465698  1556 rpcz_store.cc:276] 0709 13:00:15.231514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.289646 (+1058132us) service_pool.cc:224] Handling call
0709 13:00:16.344065 (+ 54419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.431062 (+ 86997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.454096 (+ 23034us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b54000b7cd0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:16.454239 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64060672}
W20260709 13:00:16.426980  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.022s	sys 0.031s
W20260709 13:00:16.467341  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.023s	sys 0.031s
I20260709 13:00:16.433197  1560 rpcz_store.cc:276] 0709 13:00:15.232342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.377857 (+1145515us) service_pool.cc:224] Handling call
0709 13:00:16.378431 (+   574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.378653 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.378684 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.378729 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:16.378769 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.378827 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.378934 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:16.468397  1704 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.019s	sys 0.020s
W20260709 13:00:16.373193  4308 consensus_meta.cc:287] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.544s	user 0.006s	sys 0.005s
W20260709 13:00:16.457746  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 131820us
I20260709 13:00:16.302101  4366 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:16.414784  4397 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.022s	sys 0.015s
W20260709 13:00:16.346859  4327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.025s	sys 0.030s
W20260709 13:00:16.425274  4457 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.012s	sys 0.025s
W20260709 13:00:16.467657  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 960588us
I20260709 13:00:16.372673  4178 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:16.436967  1558 rpcz_store.cc:276] 0709 13:00:14.860757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.867877 (+  7120us) service_pool.cc:224] Handling call
0709 13:00:14.900055 (+ 32178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.956074 (+ 56019us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:14.956391 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.431878 (+1475487us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.431923 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:16.431957 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.432042 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.432290 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":375,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":429177,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2470,"thread_start_us":1449053,"threads_started":2,"wal-append.queue_time_us":865401}
I20260709 13:00:16.343422  4490 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:16.518088  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 279388us
I20260709 13:00:16.376758  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 497) took 1145 ms. Trace:
I20260709 13:00:16.524001  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.435985  4080 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:16.425590  1702 rpcz_store.cc:276] 0709 13:00:10.914386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.347259 (+432873us) service_pool.cc:224] Handling call
0709 13:00:11.347576 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.348107 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:11.821582 (+473475us) log.cc:844] Serialized 14 byte log entry
0709 13:00:12.426183 (+604601us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:12.426944 (+   761us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.427133 (+   189us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:14.601519 (+2174386us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b1800433900. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6912c0a 00007f0ee0052219 00007f0ed699aa40 00007f0ed69954e4 00007f0ed6995455 00007f0edd47d3c7 00007f0ed9a8f9a7 00007f0ed9a9f0bf 00007f0ed9a9f038
0709 13:00:14.601944 (+   425us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.221048 (+1619104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.242278 (+ 21230us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.255873 (+ 13595us) raft_consensus.cc:1685] finished
0709 13:00:16.283653 (+ 27780us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.303237 (+ 19584us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34032,"prepare.queue_time_us":3168775,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":95,"raft.queue_time_us":407878,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":18007,"spinlock_wait_cycles":3473152,"thread_start_us":2395339,"threads_started":4,"wal-append.queue_time_us":1837098,"wal-append.run_cpu_time_us":3907,"wal-append.run_wall_time_us":1508874}
W20260709 13:00:16.518206  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 48611.8us
I20260709 13:00:16.450255  4352 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:16.561698  1707 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:00:16.581699  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2136) took 1089 ms. Trace:
I20260709 13:00:16.424718  1555 rpcz_store.cc:276] 0709 13:00:14.893075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.928062 (+ 34987us) service_pool.cc:224] Handling call
0709 13:00:15.004665 (+ 76603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.005039 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:15.005466 (+   427us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.341763 (+1336297us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.341820 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:16.341859 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.341917 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.342034 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12393,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":3977,"raft.queue_time_us":349276,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":16543,"thread_start_us":1329553,"threads_started":2,"wal-append.queue_time_us":803793}
I20260709 13:00:16.577950  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 503) took 1193 ms. Trace:
I20260709 13:00:16.582118  1707 rpcz_store.cc:276] 0709 13:00:15.492145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.465142 (+972997us) service_pool.cc:224] Handling call
0709 13:00:16.561254 (+ 96112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.581442 (+ 20188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.581639 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.582693  1559 rpcz_store.cc:276] 0709 13:00:15.389691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.474195 (+1084504us) service_pool.cc:224] Handling call
0709 13:00:16.577218 (+103023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.577466 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.577504 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.577558 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:16.577610 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.577705 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.577862 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.526841  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 501) took 1271 ms. Trace:
I20260709 13:00:16.560313  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:16.562095  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2137) took 1207 ms. Trace:
I20260709 13:00:16.584985  1560 rpcz_store.cc:276] 0709 13:00:15.354480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.469216 (+1114736us) service_pool.cc:224] Handling call
0709 13:00:16.561445 (+ 92229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.561655 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.561714 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.561768 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:16.561816 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.561882 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.562021 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.584650  1557 rpcz_store.cc:276] 0709 13:00:15.255024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.426854 (+1171830us) service_pool.cc:224] Handling call
0709 13:00:16.461370 (+ 34516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.526378 (+ 65008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.526418 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.526480 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:16.526527 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.526610 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.526772 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.588935  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 502) took 1305 ms. Trace:
I20260709 13:00:16.589504  1556 rpcz_store.cc:276] 0709 13:00:15.283537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.519468 (+1235931us) service_pool.cc:224] Handling call
0709 13:00:16.588278 (+ 68810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.588486 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.588523 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.588578 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:16.588634 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.588717 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.588862 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.592711  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 464) took 3719 ms. Trace:
I20260709 13:00:16.594341  1558 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:16.595206  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 499) took 1363 ms. Trace:
I20260709 13:00:16.595602  1554 rpcz_store.cc:276] 0709 13:00:15.231826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.407932 (+1176106us) service_pool.cc:224] Handling call
0709 13:00:16.424951 (+ 17019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.576145 (+151194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.576176 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.576230 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:16.594880 (+ 18650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.594953 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.595133 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.595036  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 504) took 1157 ms. Trace:
I20260709 13:00:16.375074  4173 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 13:00:16.594625  1705 rpcz_store.cc:276] 0709 13:00:12.874531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.141294 (+2266763us) service_pool.cc:224] Handling call
0709 13:00:15.141727 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:15.168008 (+ 26281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.168052 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:15.214779 (+ 46727us) log.cc:844] Serialized 26 byte log entry
0709 13:00:15.705536 (+490757us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:15.705571 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.705637 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.592371 (+886734us) raft_consensus.cc:1685] finished
0709 13:00:16.592399 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.592632 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":474457,"threads_started":1,"wal-append.queue_time_us":837238}
I20260709 13:00:16.598719  1558 rpcz_store.cc:276] 0709 13:00:15.437958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.519930 (+1081972us) service_pool.cc:224] Handling call
0709 13:00:16.587919 (+ 67989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.594776 (+  6857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.594979 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.601529  1709 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:16.602123  4497 raft_consensus.cc:2764] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:16.602273  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2137) took 1103 ms. Trace:
I20260709 13:00:16.517835  4308 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:16.602993  2288 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:16.602938  4497 consensus_queue.cc:1059] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:16.603914  1633 raft_consensus.cc:2368] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9.
I20260709 13:00:16.605686  4404 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:16.605839  4308 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:16.605844  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.606734  4308 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.606420  4404 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:16.607265  1560 raft_consensus.cc:2410] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:16.608101  4404 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:16.607242  4308 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:16.609334  4404 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:16.610832  4308 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:16.607079  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 541) took 1797 ms. Trace:
I20260709 13:00:16.612239  1559 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:16.611446  1627 rpcz_store.cc:276] 0709 13:00:14.817832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.071426 (+253594us) service_pool.cc:224] Handling call
0709 13:00:15.142326 (+ 70900us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:15.161725 (+ 19399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.161758 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:15.173981 (+ 12223us) log.cc:844] Serialized 52 byte log entry
0709 13:00:15.783572 (+609591us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:15.884910 (+101338us) log.cc:844] Serialized 14 byte log entry
0709 13:00:15.925789 (+ 40879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.925865 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.436409 (+510544us) raft_consensus.cc:1685] finished
0709 13:00:16.436430 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.606887 (+170457us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b54001bb050. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:16.607021 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98453,"prepare.queue_time_us":125300,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":46051,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":52360,"spinlock_wait_cycles":161904000,"thread_start_us":609166,"threads_started":1,"wal-append.queue_time_us":908705}
I20260709 13:00:16.613096  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2140) took 1158 ms. Trace:
I20260709 13:00:16.613525  1559 rpcz_store.cc:276] 0709 13:00:15.454528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.611436 (+1156908us) service_pool.cc:224] Handling call
0709 13:00:16.611835 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.612782 (+   947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.613023 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.602739  1709 rpcz_store.cc:276] 0709 13:00:15.499110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.463070 (+963960us) service_pool.cc:224] Handling call
0709 13:00:16.576168 (+113098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.602003 (+ 25835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.602209 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:16.519284  4457 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.012s	sys 0.025s
W20260709 13:00:16.518800  4397 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.023s	sys 0.015s
I20260709 13:00:16.382658  4477 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:16.525279  4492 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:16.592638  4498 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:16.637619  1559 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: [2.5-5.6]
W20260709 13:00:16.524646  1704 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.019s	sys 0.020s
I20260709 13:00:16.627046  4327 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:16.636514  1553 raft_consensus.cc:2410] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:16.604233  4497 consensus_queue.cc:1059] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:00:16.689296  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:16.524168  4310 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:16.707409  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1851) took 1207 ms. Trace:
I20260709 13:00:16.469419  4411 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:16.724802  1553 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
W20260709 13:00:16.650132  4252 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.020s	user 0.017s	sys 0.024s
I20260709 13:00:16.729828  1559 rpcz_store.cc:276] 0709 13:00:15.499863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.614521 (+1114658us) service_pool.cc:224] Handling call
0709 13:00:16.615261 (+   740us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:16.657239 (+ 41978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.707297 (+ 50058us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.726071  1552 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
W20260709 13:00:16.744982  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.015s	sys 0.012s
W20260709 13:00:16.745440  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.015s	sys 0.012s
I20260709 13:00:16.720772  4327 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:16.728147  4193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.005s	sys 0.020s
I20260709 13:00:16.755565  1675 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:16.730118  4178 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:16.741374  4252 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.018s	sys 0.024s
W20260709 13:00:16.768038  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 477173us
W20260709 13:00:16.769855  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 546880us
I20260709 13:00:16.727681  4477 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:16.724756  4498 raft_consensus.cc:697] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:16.780325  1601 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:16.763140  4193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.006s	sys 0.021s
W20260709 13:00:16.797410  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:16.798758  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:16.801868  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.760285  4327 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:16.823014  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:16.816057  2285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.013s	sys 0.017s
I20260709 13:00:16.817763  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:16.824899  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 483735us
W20260709 13:00:16.825042  2285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.014s	sys 0.018s
I20260709 13:00:16.825479  1556 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:16.825066  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:16.826519  1557 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:16.831733  3835 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:16.834236  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 536) took 2107 ms. Trace:
W20260709 13:00:16.820343  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 49025.7us
I20260709 13:00:16.824043  1599 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:16.824023  1554 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:16.860725  4080 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:16.861382  4080 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:16.861869  4080 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:16.525292  1551 rpcz_store.cc:276] 0709 13:00:15.231223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.494629 (+263406us) service_pool.cc:224] Handling call
0709 13:00:16.013311 (+518682us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.125273 (+111962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.376509 (+251236us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54001d7ed0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:16.376687 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022030080}
I20260709 13:00:16.676252  4492 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:16.834815  1628 rpcz_store.cc:276] 0709 13:00:14.726523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.741516 (+ 14993us) service_pool.cc:224] Handling call
0709 13:00:14.755304 (+ 13788us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:14.810655 (+ 55351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.810689 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:14.877633 (+ 66944us) log.cc:844] Serialized 52 byte log entry
0709 13:00:15.773808 (+896175us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:15.845418 (+ 71610us) log.cc:844] Serialized 14 byte log entry
0709 13:00:15.845689 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.967153 (+121464us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b5400125a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:15.967232 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.815020 (+847788us) raft_consensus.cc:1685] finished
0709 13:00:16.833893 (+ 18873us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.834148 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61809,"prepare.queue_time_us":59092,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":39667,"raft.run_cpu_time_us":477,"raft.run_wall_time_us":59561,"spinlock_wait_cycles":49277312,"thread_start_us":835296,"threads_started":1,"wal-append.queue_time_us":1179349}
I20260709 13:00:16.879055  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:16.868924  4316 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.006s	sys 0.027s
I20260709 13:00:16.813596  4193 raft_consensus.cc:697] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:16.872416  4368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.013s	sys 0.011s
W20260709 13:00:16.898002  1626 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.010s	sys 0.032s
I20260709 13:00:16.820465  4178 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:00:16.908610  1626 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.010s	sys 0.032s
I20260709 13:00:16.922358  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2460) took 2156 ms. Trace:
W20260709 13:00:16.906985  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 126903us
I20260709 13:00:16.931118  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:16.936448  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 596675us
W20260709 13:00:16.937477  1673 leader_election.cc:336] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.904s (SENT)
I20260709 13:00:16.938156  1673 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:16.901458  1599 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:16.949529  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 48168.4us
I20260709 13:00:16.956346  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:16.908202  4368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.014s	sys 0.011s
I20260709 13:00:16.922891  1626 rpcz_store.cc:276] 0709 13:00:14.765729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.933164 (+167435us) service_pool.cc:224] Handling call
0709 13:00:14.933563 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.933885 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:15.388871 (+454986us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.921871 (+1533000us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.921951 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:16.922022 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.922122 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.922285 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96020,"prepare.queue_time_us":798679,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":343101,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":52393,"thread_start_us":1864322,"threads_started":3,"wal-append.queue_time_us":1202200}
W20260709 13:00:16.908531  4316 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.007s	sys 0.027s
I20260709 13:00:16.986366  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:16.994529  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 248552us
W20260709 13:00:17.011861  1700 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.671s	user 0.010s	sys 0.005s
I20260709 13:00:17.012425  1700 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:17.027580  1675 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:16.883213  4495 raft_consensus.cc:3055] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:00:17.032784  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 76548.4us
W20260709 13:00:17.034041  1630 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.848s	user 0.010s	sys 0.001s
I20260709 13:00:17.034854  1630 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:17.035593  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1938) took 1131 ms. Trace:
I20260709 13:00:17.036051  1630 rpcz_store.cc:276] 0709 13:00:16.008890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.113218 (+104328us) service_pool.cc:224] Handling call
0709 13:00:17.035514 (+922296us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:16.994059  4458 consensus_meta.cc:287] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.004s
I20260709 13:00:16.943913  4344 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:16.961227  4477 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:16.935774  4494 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:16.993718  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:17.075568  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2139) took 1506 ms. Trace:
I20260709 13:00:17.076193  1707 rpcz_store.cc:276] 0709 13:00:15.569017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.583418 (+1014401us) service_pool.cc:224] Handling call
0709 13:00:16.604141 (+ 20723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.604467 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:16.604898 (+   431us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.074895 (+469997us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.075092 (+   197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.075171 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:17.075243 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.075338 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.075493 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87351,"prepare.queue_time_us":127140,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"thread_start_us":357451,"threads_started":1}
W20260709 13:00:17.083510  2287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.019s	sys 0.024s
W20260709 13:00:17.084030  2287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.020s	sys 0.025s
I20260709 13:00:17.039758  4308 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:17.085255  4499 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:17.086194  4499 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:17.086596  4499 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:17.086931  4499 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:17.088783  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:17.093170  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:17.094162  1551 raft_consensus.cc:2393] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:17.100637  4482 log.cc:927] Time spent T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.501s	user 0.001s	sys 0.000s
I20260709 13:00:17.102948  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 460) took 4252 ms. Trace:
W20260709 13:00:17.104472  4503 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.353s	user 0.000s	sys 0.001s
I20260709 13:00:17.104872   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:17.106413  1558 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:17.107124  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2153) took 1293 ms. Trace:
I20260709 13:00:17.107443  1558 rpcz_store.cc:276] 0709 13:00:15.813668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.105377 (+1291709us) service_pool.cc:224] Handling call
0709 13:00:17.105935 (+   558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.106866 (+   931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.107065 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:17.112870  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 175426us
I20260709 13:00:17.103463  1704 rpcz_store.cc:276] 0709 13:00:12.850240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.918419 (+2068179us) service_pool.cc:224] Handling call
0709 13:00:14.953891 (+ 35472us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:14.954549 (+   658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.954655 (+   106us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:14.955653 (+   998us) log.cc:844] Serialized 52 byte log entry
0709 13:00:15.761262 (+805609us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:16.675844 (+914582us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.722475 (+ 46631us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.723124 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.723330 (+   206us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:17.102726 (+379396us) raft_consensus.cc:1685] finished
0709 13:00:17.102746 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.102889 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46029,"prepare.queue_time_us":1028575,"prepare.run_cpu_time_us":218,"prepare.run_wall_time_us":218,"raft.queue_time_us":298225,"raft.run_cpu_time_us":486,"raft.run_wall_time_us":66901,"thread_start_us":1702868,"threads_started":2,"wal-append.queue_time_us":1248116}
I20260709 13:00:17.095094  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:17.115199  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 85661us
I20260709 13:00:17.126086  1557 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:17.038395  4495 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:17.137979  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2154) took 1280 ms. Trace:
I20260709 13:00:17.145237  1558 rpcz_store.cc:276] 0709 13:00:15.836011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.112753 (+1276742us) service_pool.cc:224] Handling call
0709 13:00:17.113093 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.113270 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.115719 (+  2449us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.115772 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:17.115816 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.115877 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.115989 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:17.152467  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 222507us
I20260709 13:00:17.153549  1601 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:17.173108  1675 connection.cc:256] RPC call timeout handler was delayed by -1.2063839269999903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:00:17.173786  1675 connection.cc:256] RPC call timeout handler was delayed by -1.1366113079999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 13:00:17.174023  2288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.019s	sys 0.071s
I20260709 13:00:17.070487  4368 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:17.185931  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2155) took 1032 ms. Trace:
I20260709 13:00:17.195690  1557 rpcz_store.cc:276] 0709 13:00:16.110054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.135714 (+1025660us) service_pool.cc:224] Handling call
0709 13:00:17.136041 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.141971 (+  5930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.142004 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.142072 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:17.142121 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.142189 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.142327 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.136691  4060 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:17.065441  4510 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:17.191547  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 345984us
W20260709 13:00:17.185984  2288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.023s	sys 0.079s
I20260709 13:00:17.151533  1551 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:16.915972  4498 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:17.065119  4458 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:17.210153  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:17.207921  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 592592us
I20260709 13:00:17.216956  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:17.199013  4500 log.cc:927] Time spent T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.452s	user 0.000s	sys 0.002s
W20260709 13:00:17.247105  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.195499  4368 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:17.271785  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:17.138595  4080 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:17.272359  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:17.271894  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 118370us
W20260709 13:00:17.217028  4493 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.483s	user 0.000s	sys 0.002s
I20260709 13:00:17.209352  4060 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:17.282346  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:17.283209  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:17.207489  4308 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:17.207666  4510 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:17.217478  4344 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.289196  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:17.290182  1706 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.009s	sys 0.022s
I20260709 13:00:17.291698  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:17.218044  4477 raft_consensus.cc:697] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:17.288070  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:17.297751  1675 leader_election.cc:336] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.618s (SENT)
I20260709 13:00:17.305922  4080 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:17.308081  4348 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.197s	user 0.006s	sys 0.006s
I20260709 13:00:17.309335  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:17.310079  4518 raft_consensus.cc:3055] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:17.310006  4512 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.314079  4535 consensus_queue.cc:1059] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:17.318886  1675 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:17.193120  4522 consensus_queue.cc:1059] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.158s
I20260709 13:00:17.208244  4193 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:17.219058  4178 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:17.319169  1706 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.009s	sys 0.022s
I20260709 13:00:17.388010  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:17.283059  4368 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:17.387637  2325 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:00:17.494652  1633 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1918) took 1856 ms (client timeout 2186 ms). Trace:
I20260709 13:00:17.506145  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:17.509784  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 269053us
W20260709 13:00:17.356895  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 242169us
W20260709 13:00:17.516000  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.516721  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.513779  1633 rpcz_store.cc:269] 0709 13:00:15.628306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.676116 (+ 47810us) service_pool.cc:224] Handling call
0709 13:00:17.484198 (+1808082us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b5400204254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:17.484500 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2066327936}
I20260709 13:00:17.296062  4060 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:17.500779  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 352388us
W20260709 13:00:17.532696  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 256869us
W20260709 13:00:17.497984  4335 consensus_meta.cc:287] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.185s	user 0.008s	sys 0.004s
I20260709 13:00:17.368640  4397 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:17.302417  4510 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:17.512861  4175 consensus_meta.cc:287] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.484s	user 0.014s	sys 0.000s
I20260709 13:00:17.543982  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:17.540042  4080 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.386803  4513 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.543848  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:17.539083  4518 raft_consensus.cc:740] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:00:17.596179  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 57297.8us
I20260709 13:00:17.598091  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:17.601370  4492 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:17.320359  4344 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:17.605381  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.607875  1599 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:17.605708  1601 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:17.563557  4399 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:17.614954  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:17.498332  4477 consensus_queue.cc:237] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:17.522881  4348 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:17.547606  4335 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:17.654412  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 97076.7us
W20260709 13:00:17.655184  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 95374.8us
W20260709 13:00:17.617142  4490 consensus_meta.cc:287] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.024s	user 0.007s	sys 0.006s
I20260709 13:00:17.554895  4175 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:17.670958  1598 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:17.672881  1598 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:17.665827  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 60228.1us
I20260709 13:00:17.558673  4080 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:17.625604  4352 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.029s	user 0.012s	sys 0.001s
I20260709 13:00:17.682579  1598 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:17.319564  4495 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:17.686945  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.684791  2328 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:17.709416  2323 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:17.712081  1705 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:17.715852  1601 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:17.708316  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 156960us
I20260709 13:00:17.614274  4535 consensus_queue.cc:1059] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:00:17.714092  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2152) took 1992 ms. Trace:
I20260709 13:00:17.716112  1598 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:17.720199  1556 rpcz_store.cc:276] 0709 13:00:15.722062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.940564 (+1218502us) service_pool.cc:224] Handling call
0709 13:00:17.012426 (+ 71862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.012829 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:17.502264 (+489435us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.713430 (+211166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.713515 (+    85us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:17.713584 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.713759 (+   175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.713967 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":661101,"prepare.run_cpu_time_us":5187,"prepare.run_wall_time_us":15606,"thread_start_us":573444,"threads_started":3}
I20260709 13:00:17.561174  4513 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:17.566012  4512 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:17.692689  4457 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:17.681941  4519 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:17.721899  1601 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:17.679159  4458 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:17.745447  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:17.712630  4399 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:17.684888  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 671) took 1657 ms. Trace:
I20260709 13:00:17.719281  4520 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:17.724005  4252 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:17.679733  4490 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:17.759382  1556 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:17.759306  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:17.761059  4514 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
W20260709 13:00:17.762552  4541 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:00:17.762432  4561 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:17.719174  4537 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.175s
I20260709 13:00:17.764010  4496 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:17.765998  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:17.761119  4516 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.153s
I20260709 13:00:17.769232  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:17.771183  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2146) took 2149 ms. Trace:
W20260709 13:00:17.752935  4517 log.cc:927] Time spent T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:00:17.760999  4515 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:17.818303  1702 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:17.821993  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:17.823980  4511 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:17.828500  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 468) took 4732 ms. Trace:
W20260709 13:00:17.763442  4534 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:00:17.838487  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2151) took 2157 ms. Trace:
W20260709 13:00:17.841179  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 123116us
W20260709 13:00:17.833845  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 111214us
I20260709 13:00:17.781929  2322 rpcz_store.cc:276] 0709 13:00:16.021959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.042587 (+ 20628us) service_pool.cc:224] Handling call
0709 13:00:16.079352 (+ 36765us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.575777 (+496425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.596632 (+ 20855us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:16.602469 (+  5837us) log.cc:844] Serialized 26 byte log entry
0709 13:00:17.083626 (+481157us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:17.083673 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.083814 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:17.650604 (+566790us) raft_consensus.cc:1685] finished
0709 13:00:17.650621 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.679511 (+ 28890us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":294942,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":905897,"threads_started":2,"wal-append.queue_time_us":895688}
I20260709 13:00:17.782030  4520 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:17.841039  1553 rpcz_store.cc:276] 0709 13:00:15.621582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.735620 (+1114038us) service_pool.cc:224] Handling call
0709 13:00:16.735988 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.748441 (+ 12453us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:00:17.242107 (+493666us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.770457 (+528350us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b18001c7980. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed962523a
0709 13:00:17.770670 (+   213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.770727 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:17.770790 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.770953 (+   163us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.771109 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":795121,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"spinlock_wait_cycles":9682304,"thread_start_us":755646,"threads_started":2}
I20260709 13:00:17.845568  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2158) took 1044 ms. Trace:
I20260709 13:00:17.857921  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:17.843864  4404 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.234s	user 0.004s	sys 0.011s
I20260709 13:00:17.861987  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:17.862366  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 134845us
I20260709 13:00:17.864876  1558 rpcz_store.cc:276] 0709 13:00:16.801672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.615276 (+813604us) service_pool.cc:224] Handling call
0709 13:00:17.615609 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.615838 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:17.650622 (+ 34784us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.845043 (+194421us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.845094 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:17.845143 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.845207 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.845468 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":80585,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":53,"thread_start_us":194072,"threads_started":1}
W20260709 13:00:17.866691  2288 connection.cc:256] RPC call timeout handler was delayed by -2.46216049100002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
I20260709 13:00:17.852303  1701 rpcz_store.cc:276] 0709 13:00:13.096814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.361176 (+2264362us) service_pool.cc:224] Handling call
0709 13:00:15.437037 (+ 75861us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.117080 (+680043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.117128 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:16.162315 (+ 45187us) log.cc:844] Serialized 26 byte log entry
0709 13:00:16.734428 (+572113us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:16.763323 (+ 28895us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.763719 (+1000396us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b1800276820. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a8f716 00007f0ed9aa0287
0709 13:00:17.763864 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.763954 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:17.828174 (+ 64220us) raft_consensus.cc:1685] finished
0709 13:00:17.828281 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.828434 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39914,"prepare.queue_time_us":216615,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":40,"raft.queue_time_us":526728,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":31777,"spinlock_wait_cycles":13063936,"thread_start_us":1566857,"threads_started":3,"wal-append.queue_time_us":976287}
I20260709 13:00:17.865111  1633 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 13:00:17.842630  4457 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:17.874208  2288 connection.cc:256] RPC call timeout handler was delayed by -2.2389604910000571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 13:00:17.878129  2288 connection.cc:256] RPC call timeout handler was delayed by -1.395816286000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3098s for a response
W20260709 13:00:17.878842  2288 connection.cc:256] RPC call timeout handler was delayed by -1.2376701040000171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33130000000000004s for a response
I20260709 13:00:17.879341  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2151) took 1814 ms. Trace:
I20260709 13:00:17.879765  1701 rpcz_store.cc:276] 0709 13:00:16.064811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.878486 (+1813675us) service_pool.cc:224] Handling call
0709 13:00:17.878800 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.878990 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.879017 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.879067 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:17.879108 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.879165 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.879283 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.855692  4490 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:17.884476  4506 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:17.872805  4308 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.001s
I20260709 13:00:17.883410  1599 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:17.843945  4497 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:00:17.884676  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2148) took 2262 ms. Trace:
W20260709 13:00:17.890628  4553 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:00:17.891870  4527 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:00:17.877213  4458 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:17.997059  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 120184us
I20260709 13:00:17.890694  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:17.890671  4555 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260709 13:00:17.958959  4530 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:00:17.959147  4348 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:17.960536  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:17.962240  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:17.962641  1558 raft_consensus.cc:3055] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:18.045629  1558 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:17.965497  1559 rpcz_store.cc:276] 0709 13:00:15.622256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.742795 (+1120539us) service_pool.cc:224] Handling call
0709 13:00:16.770484 (+ 27689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.875498 (+105014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.875538 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:16.888543 (+ 13005us) log.cc:844] Serialized 26 byte log entry
0709 13:00:17.253073 (+364530us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:17.253133 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.253224 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:17.884423 (+631199us) raft_consensus.cc:1685] finished
0709 13:00:17.884448 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.884614 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55471,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":19768,"thread_start_us":292114,"threads_started":1,"wal-append.queue_time_us":586933}
I20260709 13:00:17.757725  4518 consensus_queue.cc:260] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:17.975276  1556 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:17.870496  4520 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:17.873181  4511 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:17.883003  4252 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.878042  4335 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:18.043711  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 321894us
W20260709 13:00:18.046265  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 324560us
I20260709 13:00:18.005349  4344 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:17.996606  1551 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.711s	user 0.014s	sys 0.001s
I20260709 13:00:17.845800  4496 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.055908  1555 raft_consensus.cc:2410] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:17.995482  4308 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:17.884779  3835 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.031s	user 0.013s	sys 0.002s
I20260709 13:00:18.061388  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:18.062970  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:17.995844  4457 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:18.070822  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 110355us
I20260709 13:00:18.002110  4519 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:18.085081  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.007567  4458 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
W20260709 13:00:18.263080  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.115645  1558 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:18.377709  1558 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:18.379215  4060 consensus_meta.cc:287] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.831s	user 0.012s	sys 0.000s
W20260709 13:00:18.379546  4327 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.507s	user 0.011s	sys 0.011s
I20260709 13:00:18.381661  4457 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:18.382642  4411 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.629s	user 0.014s	sys 0.000s
I20260709 13:00:18.383361  4411 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.051606  4399 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:18.116180  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 50181.8us
W20260709 13:00:18.387825  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 323245us
W20260709 13:00:18.388953  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 506659us
I20260709 13:00:18.390079  1556 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
W20260709 13:00:18.409538  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.050136  4513 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:18.053754  4506 raft_consensus.cc:2764] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
W20260709 13:00:18.385098  4555 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:00:18.279862  4550 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.417s	user 0.000s	sys 0.000s
I20260709 13:00:18.384479  4457 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:18.052693  4080 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:18.280267  4501 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.251s	user 0.001s	sys 0.006s
W20260709 13:00:18.279268  4532 log.cc:927] Time spent T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:00:18.286677  4556 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.243s	user 0.000s	sys 0.000s
W20260709 13:00:18.116391  4527 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:00:18.452251  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:18.115214  4348 consensus_queue.cc:1059] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.360s
I20260709 13:00:18.282266  4569 raft_consensus.cc:2764] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:18.063470  4175 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:18.430119  1560 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:18.285543  4542 log.cc:927] Time spent T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:00:18.074755  1551 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:18.131834  4252 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.435304  4308 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:18.437575  4513 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:18.301011  4565 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 13:00:18.388756  1559 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:18.457095  2288 leader_election.cc:400] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6.
I20260709 13:00:18.380113  4060 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.380081  4327 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.161842  4316 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.285s
I20260709 13:00:18.271111  4560 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:18.405344  3835 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:18.488602  1551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1883) took 1458 ms (client timeout 1592 ms). Trace:
I20260709 13:00:18.496264  1558 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:00:18.496284  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 87124.5us
I20260709 13:00:18.498741  1555 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:18.505749  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2159) took 1703 ms. Trace:
I20260709 13:00:18.506095  1558 rpcz_store.cc:276] 0709 13:00:16.802331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.874212 (+1071881us) service_pool.cc:224] Handling call
0709 13:00:17.875615 (+  1403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.505484 (+629869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.505695 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:18.486130  4368 consensus_meta.cc:287] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.942s	user 0.008s	sys 0.005s
I20260709 13:00:18.486877  4516 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.510892  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:18.514108  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:18.514199  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:18.515494  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:18.503933  4510 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.945s	user 0.005s	sys 0.007s
I20260709 13:00:18.516542  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:18.518049  1630 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:18.520257  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 92665.5us
I20260709 13:00:18.313534  4511 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:18.439668  4519 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.503494  4397 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.524786  1559 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
W20260709 13:00:18.529536  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 107639us
I20260709 13:00:18.530611  4502 raft_consensus.cc:2764] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:00:18.530824  4558 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:18.531437  4558 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:18.531899  4558 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.532994  1700 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:18.533421  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2147) took 2635 ms. Trace:
I20260709 13:00:18.533547  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39878 (request call id 2456) took 3909 ms. Trace:
I20260709 13:00:18.514312  4566 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.509773  4348 consensus_queue.cc:1243] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer 8106dfc0bda54df0ae10ba13c28ccc18 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:18.533869  1709 rpcz_store.cc:276] 0709 13:00:15.898522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.616684 (+718162us) service_pool.cc:224] Handling call
0709 13:00:16.651737 (+ 35053us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.734455 (+ 82718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.734562 (+   107us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:16.745544 (+ 10982us) log.cc:844] Serialized 26 byte log entry
0709 13:00:17.005180 (+259636us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:17.079669 (+ 74489us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.082469 (+  2800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.082577 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:18.533211 (+1450634us) raft_consensus.cc:1685] finished
0709 13:00:18.533230 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.533365 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49804,"prepare.queue_time_us":79778,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":336069,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":33789,"spinlock_wait_cycles":10927872,"thread_start_us":220862,"threads_started":1,"wal-append.queue_time_us":1117191}
I20260709 13:00:18.533959  1700 rpcz_store.cc:276] 0709 13:00:14.623942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.208077 (+1584135us) service_pool.cc:224] Handling call
0709 13:00:18.532869 (+2324792us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b4c00091b00. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed7d51a20 00007f0ed7d62a29 00007f0ed7d6313f 00007f0ed7d272ab 00007f0ed7d54f3c 00007f0ed7d553fe 00007f0ed7fe288b 00007f0ed99e1495 00007f0ed9a3230f 00007f0ed9a7ca55 00007f0edea4ccd0
0709 13:00:18.533414 (+   545us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316013312}
I20260709 13:00:18.542522  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:18.534861  4476 raft_consensus.cc:1064] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
W20260709 13:00:18.505210  1551 rpcz_store.cc:269] 0709 13:00:17.029778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.094790 (+ 65012us) service_pool.cc:224] Handling call
0709 13:00:18.488501 (+1393711us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:18.547259  4570 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:00:18.547724  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 545) took 3157 ms. Trace:
I20260709 13:00:18.523171  4516 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:18.578848  1635 rpcz_store.cc:276] 0709 13:00:15.390237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.390507 (+   270us) service_pool.cc:224] Handling call
0709 13:00:15.426492 (+ 35985us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:15.494018 (+ 67526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.494053 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:15.575502 (+ 81449us) log.cc:844] Serialized 52 byte log entry
0709 13:00:16.218947 (+643445us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:16.255936 (+ 36989us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.741216 (+485280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.741300 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:17.971306 (+1230006us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:18.547312 (+576006us) raft_consensus.cc:1685] finished
0709 13:00:18.547519 (+   207us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.547658 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115054,"prepare.queue_time_us":32170,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":402493,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":54011,"spinlock_wait_cycles":10100480,"thread_start_us":1086908,"threads_started":2,"wal-append.queue_time_us":946631}
I20260709 13:00:18.580489  4516 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:18.551101  4564 log.cc:927] Time spent T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.127s	user 0.003s	sys 0.000s
I20260709 13:00:18.555729  4496 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:18.555938  4519 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:18.537652  4397 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:18.557948  4060 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:18.558959  4411 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:18.559300  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2141) took 2883 ms. Trace:
I20260709 13:00:18.542140  4566 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.586148  1703 rpcz_store.cc:276] 0709 13:00:15.696259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.596567 (+900308us) service_pool.cc:224] Handling call
0709 13:00:16.596913 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.612867 (+ 15954us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:16.961827 (+348960us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.354700 (+392873us) log.cc:844] Serialized 14 byte log entry
0709 13:00:18.320850 (+966150us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b1800390a60. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:00:18.558666 (+237816us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b1800390a60. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6912c0a 00007f0ee0052219 00007f0ed699aa40 00007f0ed69954e4 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a8f716 00007f0ed9aa0287 00007f0ed9aa0208
0709 13:00:18.558860 (+   194us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:18.558917 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:18.558993 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.559083 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.559218 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1096466,"prepare.queue_time_us":171466,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":113,"raft.queue_time_us":1244905,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":75900,"spinlock_wait_cycles":84651520,"thread_start_us":607735,"threads_started":2,"wal-append.queue_time_us":842881}
I20260709 13:00:18.560631  4565 consensus_queue.cc:1059] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:18.589347  4566 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:18.561865  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 1.26391e+06us
I20260709 13:00:18.561982  4252 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:18.562361  4557 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:18.563657  4310 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:18.564302  4524 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:18.619287  4053 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.619890  4053 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.621568  4569 raft_consensus.cc:3055] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:18.622038  4569 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:18.622148  4053 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:18.565173  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2150) took 2506 ms. Trace:
I20260709 13:00:18.622957  4569 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.622807  1707 rpcz_store.cc:276] 0709 13:00:16.058433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.140569 (+1082136us) service_pool.cc:224] Handling call
0709 13:00:17.194853 (+ 54284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.195111 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:17.246084 (+ 50973us) log.cc:844] Serialized 14 byte log entry
0709 13:00:18.564812 (+1318728us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:18.564870 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:18.564916 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.564983 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.565117 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1015531,"prepare.queue_time_us":87194,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":1019369,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":302396,"threads_started":1,"wal-append.queue_time_us":462700}
W20260709 13:00:18.566113  1673 connection.cc:256] RPC call timeout handler was delayed by -1.4197536399999535s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
W20260709 13:00:18.625029  1673 connection.cc:256] RPC call timeout handler was delayed by -1.3350850539999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
I20260709 13:00:18.566777  4536 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.567947  4492 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.568131  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2148) took 2519 ms. Trace:
I20260709 13:00:18.560604  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:18.570451  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2150) took 2899 ms. Trace:
I20260709 13:00:18.544881  1599 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:18.634507  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 89739.6us
I20260709 13:00:18.635337  1599 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:18.574081  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:18.510865  4368 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.561156  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 661) took 1342 ms. Trace:
I20260709 13:00:18.639341  2328 rpcz_store.cc:276] 0709 13:00:17.218494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.218639 (+   145us) service_pool.cc:224] Handling call
0709 13:00:18.560924 (+1342285us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b5400426154. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:18.561066 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930955520}
W20260709 13:00:18.593888  1675 leader_election.cc:336] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.642s (SENT)
I20260709 13:00:18.640756  1675 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:18.595317  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2129) took 3105 ms. Trace:
I20260709 13:00:18.606022  4523 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:18.606813  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:18.606932  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:18.645488  1634 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:18.641386  1706 rpcz_store.cc:276] 0709 13:00:15.489859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.234994 (+745135us) service_pool.cc:224] Handling call
0709 13:00:16.235430 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.282725 (+ 47295us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:17.508244 (+1225519us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.859963 (+351719us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:17.879307 (+ 19344us) log.cc:844] Serialized 26 byte log entry
0709 13:00:17.879522 (+   215us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:17.879750 (+   228us) log.cc:844] Serialized 14 byte log entry
0709 13:00:18.594744 (+714994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.594843 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:18.594897 (+    54us) raft_consensus.cc:1685] finished
0709 13:00:18.594917 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.595235 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":747489,"prepare.queue_time_us":338054,"prepare.run_cpu_time_us":509,"prepare.run_wall_time_us":24050,"raft.queue_time_us":1043159,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":30424,"thread_start_us":1465658,"threads_started":2,"wal-append.queue_time_us":524686}
I20260709 13:00:18.607786  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:18.592137  4499 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.491s	user 0.015s	sys 0.000s
I20260709 13:00:18.613982  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:18.614665  1709 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:18.615381  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:18.615734  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2139) took 3161 ms. Trace:
I20260709 13:00:18.616044  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:18.592140  4327 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:18.617605  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:18.654425  1703 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:18.617733  4397 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:18.655141  1626 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:18.606072  4476 consensus_queue.cc:237] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.565725  4458 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:00:18.523914  4510 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.633312  1704 rpcz_store.cc:276] 0709 13:00:16.049096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.114164 (+1065068us) service_pool.cc:224] Handling call
0709 13:00:17.114498 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:17.114884 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.114909 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:17.206987 (+ 92078us) log.cc:844] Serialized 26 byte log entry
0709 13:00:17.558445 (+351458us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:17.593852 (+ 35407us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.820129 (+226277us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b1800433240. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6998522 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:00:18.567627 (+747498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.567732 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:18.567780 (+    48us) raft_consensus.cc:1685] finished
0709 13:00:18.567896 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.568056 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":976618,"prepare.queue_time_us":40121,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":19580,"raft.queue_time_us":1072317,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":54860,"spinlock_wait_cycles":25865984,"thread_start_us":248680,"threads_started":1,"wal-append.queue_time_us":376626}
I20260709 13:00:18.633694  1552 rpcz_store.cc:276] 0709 13:00:15.673561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.744352 (+1070791us) service_pool.cc:224] Handling call
0709 13:00:16.749785 (+  5433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.750027 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:17.199316 (+449289us) log.cc:844] Serialized 14 byte log entry
0709 13:00:18.569831 (+1370515us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b18001cb5e0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a8f716 00007f0ed9aa0287
0709 13:00:18.569942 (+   111us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:18.569997 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:18.570068 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.570159 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.570375 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22151,"prepare.queue_time_us":820706,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":136634,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":8516,"spinlock_wait_cycles":71331456,"thread_start_us":762612,"threads_started":3,"wal-append.queue_time_us":630227}
I20260709 13:00:18.644198  4316 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:18.569162  4576 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:00:18.651052  1700 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:18.651047  1560 rpcz_store.cc:276] 0709 13:00:15.454029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.607993 (+1153964us) service_pool.cc:224] Handling call
0709 13:00:16.608301 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.458849 (+1850548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.615507 (+156658us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b540017e8d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:18.615673 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4188681472}
W20260709 13:00:18.653204  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 59355.3us
W20260709 13:00:18.664088  1675 leader_election.cc:336] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.877s (SENT)
I20260709 13:00:18.664530  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:18.648458  1599 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:18.656550  1701 raft_consensus.cc:2410] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:18.668025  4510 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:18.668843  2326 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:18.669718  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 95687us
I20260709 13:00:18.670382  1599 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:18.619302  4521 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:18.643692  4515 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:18.676205  4496 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:18.676707  4511 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:18.649448  1632 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:18.676600  4327 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:18.677208  4511 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.677875  4511 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:18.679126  4397 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:18.679559  4397 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.679870  4397 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:18.649569  4557 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:18.658217  4310 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:18.656841  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:18.688436  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.681423  4193 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 13:00:18.706552  4540 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.878s	user 0.002s	sys 0.014s
I20260709 13:00:18.684491  1703 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
W20260709 13:00:18.681599  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 121368us
I20260709 13:00:18.644644  4569 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:18.693001  4557 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:18.693526  4522 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:18.694854  4368 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:18.643316  4536 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:18.658340  4523 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.649290  4492 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:18.701717  1675 leader_election.cc:336] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.919s (SENT)
I20260709 13:00:18.703408  4512 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:18.680935  4565 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:18.735172  4492 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:18.662981  4316 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.735953  4316 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:18.738546  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:18.676781  4515 raft_consensus.cc:697] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:18.713294  4520 consensus_meta.cc:287] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.639s	user 0.012s	sys 0.000s
I20260709 13:00:18.651043  4499 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:18.730094  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:18.718279  4557 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.744131  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:18.730759  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 105167us
W20260709 13:00:18.749337  1673 leader_election.cc:336] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.644s (SENT)
I20260709 13:00:18.749691  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:18.754350  1700 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:18.740823  4565 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:18.735280  4523 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:18.761912  1673 leader_election.cc:336] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.736s (SENT)
I20260709 13:00:18.759061  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:18.744560  4573 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:18.762991  1627 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:18.766021  1673 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:18.676174  4521 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:18.767848  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 66155.6us
W20260709 13:00:18.769598  1675 leader_election.cc:336] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.982s (SENT)
W20260709 13:00:18.770578  1675 leader_election.cc:336] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.186s (SENT)
I20260709 13:00:18.761130  4492 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:18.773329  4310 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:18.756938  4494 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:18.778268  1673 leader_election.cc:336] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.982s (SENT)
I20260709 13:00:18.778703  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:18.778601  1629 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:00:18.783810  4536 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:18.791333  4521 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:18.791790  4515 consensus_queue.cc:237] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:18.764977  4573 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:18.747787  4520 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:18.801296  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1324699759999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30390000000000006s for a response
I20260709 13:00:18.804039  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:18.797365  4523 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.807598  4523 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:18.810572  4523 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:18.812284  4494 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:18.813184  4494 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.813266  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:18.795542  4492 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:18.796568  4573 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:18.815045  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:18.816027  1706 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:18.797534  4536 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:18.818552  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.821347  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:18.823674  1703 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:18.827415  1627 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:18.827117  4524 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:00:18.835388  1706 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:18.839395  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:18.840334  1701 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 4: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:18.822479  4411 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:18.844210  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:18.847774  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:18.845746  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:18.850772  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 667) took 1547 ms. Trace:
I20260709 13:00:18.846549  4316 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:18.864846  4316 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:18.853792  1706 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:18.851147  2323 rpcz_store.cc:276] 0709 13:00:17.303669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.303814 (+   145us) service_pool.cc:224] Handling call
0709 13:00:17.314062 (+ 10248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.712884 (+398822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.850593 (+1137709us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b540064fd54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:18.850726 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908156160}
W20260709 13:00:18.854348  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 50427.7us
I20260709 13:00:18.847447  4411 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:18.828084  4536 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.836822  4523 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.840360  4565 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.862444  4520 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:18.862852  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:18.876381  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:18.877648  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:18.878190  1628 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:18.862994  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:18.872268  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:18.871618  1673 leader_election.cc:336] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.579s (SENT)
I20260709 13:00:18.813737  4494 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.871085  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:18.903733  1627 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:00:18.904750  1673 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:18.824731  4492 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:18.878552  4411 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:18.909660  1673 leader_election.cc:336] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.592s (SENT)
I20260709 13:00:18.907569  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:18.921308  4494 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:18.921849  4397 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:18.922794  4499 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:18.911414  4310 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:18.903584  4511 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:18.937856  4310 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.939112  4511 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:18.941936  4557 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:18.945254  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:18.938580  4310 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:18.945768  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:18.947135  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:18.947645  4310 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:18.948647  4558 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.956414  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:18.913829  1628 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:18.982188  1629 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:18.944324  4557 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:18.986579  1673 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:18.993917  1553 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:19.001255  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:19.006184  2323 raft_consensus.cc:1240] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:19.017068  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:19.000733  4547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.277s	user 0.036s	sys 0.053s
W20260709 13:00:19.017994  4547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.299s	user 0.037s	sys 0.053s
W20260709 13:00:19.024349  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.061065  4547 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:19.061971  4547 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.992834  4560 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:19.053341  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:19.065385  2328 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:19.065289  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:18.908427  4523 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:18.980952  4506 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:19.006196  4551 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:18.908164  4590 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.148s
I20260709 13:00:19.049690  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:19.091181  4536 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:19.094074  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:19.053015  4535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.267s	user 0.019s	sys 0.028s
I20260709 13:00:19.036160  4573 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:19.574220  1552 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:19.342037  2328 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
W20260709 13:00:19.336329  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 426604us
W20260709 13:00:19.596872  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 649958us
I20260709 13:00:19.493885  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2140) took 3889 ms. Trace:
I20260709 13:00:19.202276  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 551) took 1293 ms. Trace:
I20260709 13:00:19.157783  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:19.165617  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:19.186117  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:19.605675  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.150342  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.416366  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.565254  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2145) took 3729 ms. Trace:
W20260709 13:00:19.607616  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.607930  1705 rpcz_store.cc:276] 0709 13:00:15.836212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.599687 (+763475us) service_pool.cc:224] Handling call
0709 13:00:16.641673 (+ 41986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.715016 (+1073343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.564879 (+1849863us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400397e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:19.565182 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2419443584}
I20260709 13:00:19.603986  1702 rpcz_store.cc:276] 0709 13:00:15.632030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.595497 (+963467us) service_pool.cc:224] Handling call
0709 13:00:16.601415 (+  5918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.854242 (+1252827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.493508 (+1639266us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003d9ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:19.493779 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2797812608}
I20260709 13:00:19.604085  1626 rpcz_store.cc:276] 0709 13:00:17.871586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.871723 (+   137us) service_pool.cc:224] Handling call
0709 13:00:17.881317 (+  9594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.655548 (+774231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.164175 (+508627us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54000f50d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:19.164487 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1779028736}
I20260709 13:00:19.606292  2321 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:19.607628  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.578127  1675 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:19.611471  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:19.047811  4397 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:19.612057  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 740905us
I20260709 13:00:19.609560  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 822) took 2254 ms. Trace:
I20260709 13:00:19.618511  2327 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:19.618400  2324 rpcz_store.cc:276] 0709 13:00:17.355456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.355926 (+   470us) service_pool.cc:224] Handling call
0709 13:00:19.165391 (+1809465us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b5800003c98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 13:00:19.609488 (+444097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13204352}
W20260709 13:00:19.434655  4544 log.cc:927] Time spent T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.711s	user 0.008s	sys 0.016s
I20260709 13:00:19.620185  4558 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:19.621565  4523 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:19.161777  4554 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 1.434s	user 0.003s	sys 0.012s
W20260709 13:00:19.626693  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 48672.9us
I20260709 13:00:19.170432  4537 raft_consensus.cc:3055] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:19.269665  4533 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:19.602978  4535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.851s	user 0.029s	sys 0.038s
I20260709 13:00:19.628223  4523 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:19.616989  1551 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.631637  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:19.158330  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:19.638087  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:19.641429  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:19.633194  4572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.020s	sys 0.028s
I20260709 13:00:19.646286  4573 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:19.670311  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:19.635447  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:19.153648  4492 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:19.096876  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:19.556704  4551 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:17.858314  1554 rpcz_store.cc:276] 0709 13:00:15.681029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.910379 (+1229350us) service_pool.cc:224] Handling call
0709 13:00:16.910824 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.911260 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:17.293817 (+382557us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.838166 (+544349us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.838217 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:17.838266 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.838325 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.838436 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":687286,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":144323,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":22763,"spinlock_wait_cycles":16624512,"thread_start_us":866405,"threads_started":3,"wal-append.queue_time_us":361509}
I20260709 13:00:19.664376  1675 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:19.666792  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:19.665455  2324 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:19.649241  4547 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:19.659816  4411 consensus_meta.cc:287] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.000s
I20260709 13:00:19.630524  4537 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:00:19.677103  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 45556.2us
I20260709 13:00:19.681061  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:19.669061  1552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:41170
W20260709 13:00:19.670596  4572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.020s	sys 0.029s
I20260709 13:00:19.659497  4523 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.660632  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:19.698752  2323 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:19.692916  1675 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:19.701478  1523 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:19.689471  1672 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:19.677282  4559 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:19.668246  4506 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:19.705971  1552 raft_consensus.cc:606] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:19.688237  4515 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.719983  4492 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:19.725853  1552 raft_consensus.cc:614] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:19.719115  1672 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:19.698827  4551 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:19.690533  4573 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:19.728756  1675 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:19.698732  4397 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:19.711529  4533 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:19.719125  4523 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:19.737349  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:19.709062  4547 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:19.716684  4577 raft_consensus.cc:670] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } [suppressed 3 similar messages]
I20260709 13:00:19.707427  4411 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:19.729020  4506 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:19.732312  4536 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:19.708480  4558 consensus_queue.cc:1059] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:00:19.730898  4477 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:19.738507  4524 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:19.741987  4533 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.744403  4521 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:19.770810  1556 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:19.744827  4559 raft_consensus.cc:697] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:19.750223  4506 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:19.759157  4536 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.744007  4368 consensus_queue.cc:1059] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:00:19.732230  4515 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:19.794503  4502 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:19.796159  4411 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:19.796355  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:19.797132  4525 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 1.833s	user 0.010s	sys 0.000s
I20260709 13:00:19.746259  4397 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:19.777938  4521 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.778748  4533 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:19.755884  4547 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:19.801504  4536 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:19.779336  4477 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:19.811633  4411 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:19.819093  2329 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:19.809237  4521 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:19.806800  4502 raft_consensus.cc:697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:19.817922  4411 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:19.813495  4559 consensus_queue.cc:237] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:19.831442  4411 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:19.843659  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2135) took 4351 ms. Trace:
I20260709 13:00:19.847322  1708 rpcz_store.cc:276] 0709 13:00:15.491898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.298943 (+807045us) service_pool.cc:224] Handling call
0709 13:00:16.344436 (+ 45493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.345548 (+  1112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.345588 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:16.423712 (+ 78124us) log.cc:844] Serialized 26 byte log entry
0709 13:00:16.995334 (+571622us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:16.995384 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.995476 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:19.716927 (+2721451us) spinlock_profiling.cc:243] Waited 8.43 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:19.836823 (+119896us) raft_consensus.cc:1685] finished
0709 13:00:19.836844 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:19.843577 (+  6733us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19390336,"thread_start_us":416432,"threads_started":1,"wal-append.queue_time_us":1384464}
I20260709 13:00:19.850937  1707 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:19.851783  1704 raft_consensus.cc:1275] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:19.851836  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2156) took 1225 ms. Trace:
I20260709 13:00:19.853025  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:19.853209  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:19.853478  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:19.853816  1705 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:19.854131  1703 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:19.853830  1701 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:19.845899  4547 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:19.852419  1707 rpcz_store.cc:276] 0709 13:00:18.626492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.849926 (+1223434us) service_pool.cc:224] Handling call
0709 13:00:19.850416 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:19.851552 (+  1136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.851778 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:19.876000  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 272203us
W20260709 13:00:19.877115  1673 leader_election.cc:336] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.800s (SENT)
I20260709 13:00:19.877657  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:19.898656  1673 leader_election.cc:336] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.991s (SENT)
W20260709 13:00:19.899710  1673 leader_election.cc:336] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.186s (SENT)
I20260709 13:00:19.900177  1673 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:19.901664  1673 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.200s (SENT)
I20260709 13:00:19.903043  4492 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:19.903990  4492 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:19.902264  1673 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:19.906188  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:19.907711  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:19.909732  1555 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:19.855641  4565 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:19.913836  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:19.914335  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 237653us
I20260709 13:00:19.916302  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:19.918121  1708 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:19.961709  4539 raft_consensus.cc:3055] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:19.962435  4539 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:19.971383  2321 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
W20260709 13:00:19.976956  4600 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:00:19.979673  4477 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:19.980971  4477 raft_consensus.cc:3055] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:19.983656  4515 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:19.917016  4565 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:19.992524  4565 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:19.993374  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:19.993722  4565 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:19.997167  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 95551.9us
W20260709 13:00:19.997943  1673 leader_election.cc:336] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.435s (SENT)
I20260709 13:00:19.998330  1673 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:19.999096  4397 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:20.005267  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:20.006194  1702 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:20.007447  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:20.013285  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.016278  1673 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.588s (SENT)
I20260709 13:00:20.016968  1673 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:20.008204  1702 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:20.034307  1635 raft_consensus.cc:1240] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:20.036713  4506 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:20.043571  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.044114  4524 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:19.963773  4539 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.045353  4539 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.053117  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:20.054090  1631 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:19.957204  4502 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.061749  4523 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:19.967995  4499 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:20.065320  1551 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:20.066586  1558 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:00:20.068022  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 2175) took 1119 ms. Trace:
I20260709 13:00:20.068831  1551 rpcz_store.cc:276] 0709 13:00:18.948257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.980419 (+ 32162us) service_pool.cc:224] Handling call
0709 13:00:20.067917 (+1087498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:20.069916  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:20.071900  1705 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:20.017820  4477 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:20.077891  4477 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.079294  4477 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:20.039047  4506 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:20.088932  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 387507us
W20260709 13:00:20.098330  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 82105.6us
W20260709 13:00:20.100239  1673 leader_election.cc:336] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.933s (SENT)
I20260709 13:00:20.100720  1673 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:20.107529  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.131596  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:20.132737  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:20.106887  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 437441us
W20260709 13:00:20.142161  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.154191  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.157984  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1586616630000321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
I20260709 13:00:20.042912  4551 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.168326  2321 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:20.089977  4523 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:20.185722  1708 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:20.191596  1553 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:20.214699  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.167881  4558 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.226569  1631 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:20.169931  4492 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.235324  2286 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:20.240996  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:20.241684  1708 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:20.242005  1700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.033s	sys 0.062s
W20260709 13:00:20.242395  1700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.033s	sys 0.062s
I20260709 13:00:20.235895  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:20.170913  4411 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:20.220480  4308 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:20.225306  4573 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:00:20.245524  4567 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:20.293089  1708 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:20.302021  1560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:41170
I20260709 13:00:20.303117  1560 raft_consensus.cc:606] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:20.303606  1560 raft_consensus.cc:614] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:20.245056  4492 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:20.309289  4411 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:20.276147  4577 consensus_queue.cc:1059] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:00:20.338395  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:20.338228  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:20.341933  1708 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:20.280911  4497 consensus_queue.cc:1059] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:00:20.344864  2329 raft_consensus.cc:2410] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:20.312855  4612 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.347148  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:20.281543  4308 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.333060  4559 raft_consensus.cc:3055] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:20.356253  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.255826  4558 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:20.349774  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:20.351892  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:20.353231  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:20.360355  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 102802us
W20260709 13:00:20.363763  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.366120  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:20.367580  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:20.377214  4551 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:20.315620  4536 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.342981  4524 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:20.390178  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:20.388098  1702 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:20.397547  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:20.381989  4521 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.001s
I20260709 13:00:20.400897  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:20.404506  1704 raft_consensus.cc:2393] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 11: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:20.409802  1708 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:20.405903  4536 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:20.356652  4559 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:20.410465  1702 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:20.407657  4533 consensus_meta.cc:287] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.593s	user 0.007s	sys 0.002s
I20260709 13:00:20.413259  2329 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:20.381582  4518 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.412966  1551 raft_consensus.cc:2955] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:20.417883  2324 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:20.408859  4310 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:20.425436  4610 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:00:20.425457  4499 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:20.426743  4308 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:20.426829  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 507) took 1482 ms. Trace:
I20260709 13:00:20.427019  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:20.428974  2322 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:00:20.431329  4623 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.432062  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:20.444418  1707 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:20.356791  4612 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.399215  4524 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.434562  4492 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:20.417285  4521 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:20.435479  1703 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:20.432410  4622 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 13:00:20.463088  4598 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.707s	user 0.000s	sys 0.003s
I20260709 13:00:20.463534  4622 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.464398  4495 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.464910  1701 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 7: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:20.437871  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:20.427366  1559 rpcz_store.cc:276] 0709 13:00:18.944868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.952120 (+  7252us) service_pool.cc:224] Handling call
0709 13:00:19.559320 (+607200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.612729 (+ 53409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.612764 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.657244 (+ 44480us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.135140 (+477896us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:20.135196 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.135287 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.426617 (+291330us) raft_consensus.cc:1685] finished
0709 13:00:20.426635 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.426775 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13396,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":10224,"thread_start_us":421102,"threads_started":1,"wal-append.queue_time_us":598158}
I20260709 13:00:20.470651  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 558) took 1627 ms. Trace:
I20260709 13:00:20.471107  1627 rpcz_store.cc:276] 0709 13:00:18.842995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.908160 (+ 65165us) service_pool.cc:224] Handling call
0709 13:00:18.952861 (+ 44701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.953108 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:18.953418 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.407716 (+1454298us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b1800423ca0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed962523a 00007f0ed9a8fa2a
0709 13:00:20.470312 (+ 62596us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:20.470364 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:20.470415 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.470477 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.470589 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":106,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":4843,"spinlock_wait_cycles":72774400,"thread_start_us":62374,"threads_started":1}
I20260709 13:00:20.474476  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:20.476065  2324 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:20.476799  4612 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:20.477312  2324 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:20.449442  4623 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.478471  4308 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:20.478883  4308 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:20.479360  4623 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:20.479746  4308 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:20.482656  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.052s	sys 0.097s
W20260709 13:00:20.483008  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.052s	sys 0.097s
I20260709 13:00:20.485286  4308 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:20.485847  4572 raft_consensus.cc:3055] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:20.486310  4572 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:20.487190  4572 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.488631  4572 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.490185  4524 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:20.494397  4509 raft_consensus.cc:3055] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:20.495070  4509 raft_consensus.cc:740] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:20.495731  4060 raft_consensus.cc:3055] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:20.496464  4565 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.003s
I20260709 13:00:20.496351  4060 raft_consensus.cc:740] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:20.499867  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:20.500664  4060 consensus_queue.cc:260] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.502055  4060 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:20.502501  4558 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:20.440150  2322 pending_rounds.cc:85] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 4
W20260709 13:00:20.459208  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 102055us
I20260709 13:00:20.503219  2322 pending_rounds.cc:107] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:00:20.503597  2322 raft_consensus.cc:2889] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:20.504679  1601 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:20.506690  1672 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:20.506775  4567 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:20.508961  4492 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:20.509110  4567 raft_consensus.cc:3055] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:20.509524  4492 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.509621  4567 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:20.510102  4492 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:20.510789  4567 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.422055  4533 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:20.514006  1706 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:00:20.461570  4614 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:00:20.462571  4521 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:20.501268  2321 raft_consensus.cc:2410] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:00:20.464089  4622 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:20.515623  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 75980.3us
I20260709 13:00:20.514266  2288 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:20.508491  1672 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:20.518563  1672 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:20.483520  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 753174us
I20260709 13:00:20.518082  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:20.521891  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:20.512419  4567 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.454485  1702 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
W20260709 13:00:20.525410  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.529019  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:20.529603  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:20.529861  1633 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:20.530438  2325 raft_consensus.cc:2410] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:00:20.530154  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.531392  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:20.535866  1633 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:00:20.520915  4551 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:20.539487  1633 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:20.523756  4457 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:20.521225  4536 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:20.595498  4477 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.516s	user 0.013s	sys 0.000s
I20260709 13:00:20.547142  4622 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:20.547590  4521 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:20.496289  4509 consensus_queue.cc:260] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.527343  4624 consensus_queue.cc:1059] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:00:20.605917  4624 raft_consensus.cc:3055] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:20.606091  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:20.525380  4573 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:20.607321  4573 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:20.608245  4573 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.552968  1627 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:20.520419  4612 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:00:20.558089  4623 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:20.558588  4511 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.559813  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:20.612950  4511 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.614547  2321 raft_consensus.cc:2410] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:00:20.616026  4511 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:20.516001  4515 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:00:20.520902  4524 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 13:00:20.580475  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 64976.9us
I20260709 13:00:20.581987  4533 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:20.583446  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:20.530812  4411 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:20.521929  4558 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:00:20.636967  4060 raft_consensus.cc:2764] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:20.593819  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 823) took 3238 ms. Trace:
I20260709 13:00:20.523671  4523 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:20.596571  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:20.599561  4457 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.602766  2328 raft_consensus.cc:2410] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:20.603317  1559 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:20.606356  4624 raft_consensus.cc:740] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:20.548995  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:20.568655  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.637728  2326 rpcz_store.cc:276] 0709 13:00:17.357941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.441022 (+ 83081us) service_pool.cc:224] Handling call
0709 13:00:18.567086 (+1126064us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b5800003c98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 13:00:18.567626 (+   540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.673382 (+105756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.593530 (+1920148us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400104354. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:20.593744 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245771904}
I20260709 13:00:20.611984  4623 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.626259  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:20.629938  1601 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:20.633929  4535 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:20.636798  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 53468.6us
I20260709 13:00:20.526279  4308 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:00:20.640875  4591 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.650676  4612 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:00:20.655022  4591 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:20.646402  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.655880  4502 consensus_queue.cc:1059] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:20.649510  1601 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:20.657117  4502 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:20.657466  4502 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:20.658380  4502 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.659562  4502 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.666699  4623 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:20.668371  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:20.669381  4492 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.638157  4499 raft_consensus.cc:3055] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:20.673584  4499 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:20.674561  4499 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.676165  4499 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:20.681959  1601 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:20.687944  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 155519us
I20260709 13:00:20.691777  1526 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:20.653203  4515 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:20.692898  4515 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.693277  4515 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:20.693981  1599 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.017s (SENT) [suppressed 30 similar messages]
I20260709 13:00:20.693989  1631 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:20.697228  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:20.678814  4535 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.698324  4567 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:20.698736  4567 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.699139  4567 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.698805  4624 consensus_queue.cc:260] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.700224  4624 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:20.653651  4457 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.702427  4613 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.702610  4457 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:20.641847  4411 raft_consensus.cc:697] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:20.703083  4613 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:20.704468  4411 consensus_queue.cc:237] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:20.707654  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 392331us
I20260709 13:00:20.709347  4613 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:20.710421  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 487) took 1883 ms. Trace:
I20260709 13:00:20.710927  1700 rpcz_store.cc:276] 0709 13:00:18.827288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.827439 (+   151us) service_pool.cc:224] Handling call
0709 13:00:18.841268 (+ 13829us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.291494 (+450226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.291535 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.334426 (+ 42891us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.242868 (+908442us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:20.242917 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.710037 (+467120us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b5400265554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:20.710090 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.710145 (+    55us) raft_consensus.cc:1685] finished
0709 13:00:20.710157 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.710365 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":383,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":37887,"spinlock_wait_cycles":1033780992,"thread_start_us":865240,"threads_started":1,"wal-append.queue_time_us":962511}
I20260709 13:00:20.633352  4511 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:00:20.712412  4567 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:20.713227  2321 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:20.717237  1631 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:20.719316  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:20.719573  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 199304us
W20260709 13:00:20.723127  1673 leader_election.cc:336] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.559s (SENT)
I20260709 13:00:20.723675  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:20.726939  1626 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:20.729295  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:20.730073  1633 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:20.720232  4594 consensus_queue.cc:1059] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:00:20.733896  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:20.736696  1630 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:20.725896  4628 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:20.737967  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:20.738600  2322 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:20.734162  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:20.741333  2325 raft_consensus.cc:2376] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4. Re-sending same reply.
I20260709 13:00:20.735276  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:20.742743  1627 raft_consensus.cc:2376] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7. Re-sending same reply.
I20260709 13:00:20.734642  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:20.747071  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.750850  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:20.752019  1626 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.735080  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:20.714517  4623 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:20.734871  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:20.771018  1630 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:20.789788  1628 raft_consensus.cc:2410] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:00:20.762776  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 71069us
I20260709 13:00:20.791793  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:20.792409  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:20.793465  1630 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:20.768236  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:20.769971  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:20.734210  4565 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:00:20.770970  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:20.778770  4567 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:20.780320  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.735666  4617 raft_consensus.cc:3055] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:20.802206  1557 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
W20260709 13:00:20.802924  1557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 2178) took 1853 ms (client timeout 1847 ms). Trace:
W20260709 13:00:20.803248  1557 rpcz_store.cc:269] 0709 13:00:18.953023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.770713 (+1817690us) service_pool.cc:224] Handling call
0709 13:00:20.802858 (+ 32145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:20.795044  1633 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:20.781044  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:20.781203  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:20.781651  1709 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:20.781810  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:20.782495  4628 raft_consensus.cc:697] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:20.724709  4573 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:00:20.783329  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:20.763933  4524 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.811946  1703 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:20.795893  1631 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.780449  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:20.738880  4533 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.822701  1630 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:20.826344  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:20.806329  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 83224.1us
I20260709 13:00:20.806658  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:20.806851  1627 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:20.827687  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.808493  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:20.808801  1551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:41170
I20260709 13:00:20.831276  1557 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:20.765008  4613 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:20.826551  1675 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:20.841364  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:20.833952  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 102827us
I20260709 13:00:20.845239  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:20.852718  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:20.853992  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:20.810771  4310 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:20.810335  4617 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:20.861814  1557 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:20.823489  4558 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:20.905099  1631 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:00:20.822487  4492 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:20.834285  4623 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:20.883774  1703 raft_consensus.cc:2393] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:20.891194  1627 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:20.906494  4492 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:20.906984  4623 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:20.884111  1709 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:20.910737  1709 raft_consensus.cc:1275] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:20.839452  4613 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:20.914988  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1953) took 2076 ms (client timeout 1723 ms). Trace:
W20260709 13:00:20.911525  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 45646.1us
I20260709 13:00:20.917649  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:20.915585  1629 rpcz_store.cc:269] 0709 13:00:18.838356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.848702 (+ 10346us) service_pool.cc:224] Handling call
0709 13:00:20.914781 (+2066079us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b5400206054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:20.914922 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110321536}
I20260709 13:00:20.864337  4502 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:20.944828  1551 raft_consensus.cc:606] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:20.842573  4536 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:00:20.834081  4524 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:20.945945  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:20.952262  1632 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.907476  4492 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 13:00:20.929123  4613 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:20.994010  1627 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:20.843756  4533 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:20.986843  4610 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:20.944985  4502 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:20.949055  4060 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:20.981006  4310 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:21.022552  1702 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:21.023754  1626 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:20.990052  1560 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:21.039245  1560 raft_consensus.cc:1275] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:21.011970  4502 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:21.127988  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.218434  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 364493us
I20260709 13:00:21.011744  4060 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:21.220189  1632 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:21.019696  4551 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:21.258669  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.278354  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:21.279326  1554 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:21.284449  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.293371  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:20.947603  4628 consensus_queue.cc:237] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:21.040472  4558 raft_consensus.cc:697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:21.322669  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:21.337023  1553 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:21.338116  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 118834us
I20260709 13:00:20.997848  4617 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.228900  4060 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:21.360854  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:21.353776  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.003s	sys 0.008s
W20260709 13:00:21.363862  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.368049  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.004s	sys 0.008s
I20260709 13:00:21.366842  1560 raft_consensus.cc:1240] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:21.368659  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 562017us
W20260709 13:00:21.362712  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.001s	sys 0.011s
W20260709 13:00:21.374717  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.001s	sys 0.012s
W20260709 13:00:21.375067  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 548526us
I20260709 13:00:21.375672  1675 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:21.382638  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:21.383776  1627 raft_consensus.cc:2393] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:21.388839  1673 leader_election.cc:336] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.664s (SENT)
I20260709 13:00:21.394497  1673 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:21.397385  4640 log.cc:927] Time spent T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
W20260709 13:00:21.399020  4636 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 13:00:21.400213  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 496) took 1220 ms. Trace:
I20260709 13:00:21.400619  1707 rpcz_store.cc:276] 0709 13:00:20.180273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.446309 (+266036us) service_pool.cc:224] Handling call
0709 13:00:20.460346 (+ 14037us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.473209 (+ 12863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.473241 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:20.512997 (+ 39756us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.802011 (+289014us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:20.802126 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.802192 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.399977 (+597785us) raft_consensus.cc:1685] finished
0709 13:00:21.399996 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.400153 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5735,"thread_start_us":288464,"threads_started":1,"wal-append.queue_time_us":402301}
I20260709 13:00:21.401906  4536 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:21.402232  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:21.403040  1707 raft_consensus.cc:2368] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6.
I20260709 13:00:21.404018  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:21.404388  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:21.405092  2320 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:21.407148  4524 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:21.407764  4524 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:21.402385  4536 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.408957  4536 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:21.411420  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:21.414410  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:21.415221  1702 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:21.412328  1707 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:21.417353  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:21.418810  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:21.419847  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:21.420315  1707 raft_consensus.cc:1813] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Handling vote request from an unknown peer e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:21.424953  4639 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.526s	user 0.000s	sys 0.001s
I20260709 13:00:21.427564  1632 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11. Ops: [7.9-10.10]
I20260709 13:00:21.416217  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:21.432865  1707 raft_consensus.cc:2368] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5.
I20260709 13:00:21.389756  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:21.439815  1560 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:21.291352  4551 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.424381  4536 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:21.473631  4536 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:21.476423  1560 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:21.482395  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:21.484110  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:21.492866  4624 consensus_meta.cc:287] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.778s	user 0.008s	sys 0.005s
I20260709 13:00:21.500491  4492 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:21.502343  4533 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:21.503891  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:21.387399  4648 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:21.518369  4499 consensus_meta.cc:287] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.834s	user 0.007s	sys 0.004s
I20260709 13:00:21.519151  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 686) took 1859 ms. Trace:
I20260709 13:00:21.573992  2328 rpcz_store.cc:276] 0709 13:00:19.660233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.660359 (+   126us) service_pool.cc:224] Handling call
0709 13:00:21.518841 (+1858482us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b5400529254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:21.519051 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036778880}
I20260709 13:00:21.520398  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2166) took 1664 ms. Trace:
I20260709 13:00:21.575366  1704 rpcz_store.cc:276] 0709 13:00:19.856457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.856572 (+   115us) service_pool.cc:224] Handling call
0709 13:00:21.520116 (+1663544us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54003d9fd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:21.520318 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143389568}
I20260709 13:00:21.530532  4551 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:21.532047  4642 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:00:21.536975  1702 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:21.457170  4643 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:21.536954  4558 consensus_queue.cc:237] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:21.538530  1557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.027s	sys 0.070s
W20260709 13:00:21.594611  1557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.027s	sys 0.070s
I20260709 13:00:21.466339  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:21.595633  1626 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:21.528225  4612 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:21.557121  4535 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:21.561909  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 560) took 1547 ms. Trace:
W20260709 13:00:21.563807  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.564872  1555 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
W20260709 13:00:21.568974  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2165) took 1713 ms (client timeout 2017 ms). Trace:
W20260709 13:00:21.613698  1705 rpcz_store.cc:269] 0709 13:00:19.855509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.894303 (+ 38794us) service_pool.cc:224] Handling call
0709 13:00:21.568740 (+1674437us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54003f0554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:21.568904 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353388800}
W20260709 13:00:21.460872  4515 consensus_meta.cc:287] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.767s	user 0.008s	sys 0.004s
I20260709 13:00:21.592012  1553 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
W20260709 13:00:21.553154  4523 consensus_meta.cc:287] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.909s	user 0.006s	sys 0.006s
I20260709 13:00:21.614650  1629 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:21.618309  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:21.621053  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:21.624080  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2168) took 1716 ms (client timeout 1659 ms). Trace:
I20260709 13:00:21.626776  1632 raft_consensus.cc:2393] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:21.626188  1700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.047s	sys 0.080s
W20260709 13:00:21.626883  1701 rpcz_store.cc:269] 0709 13:00:19.907346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.907474 (+   128us) service_pool.cc:224] Handling call
0709 13:00:21.623763 (+1716289us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54003ec6d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:21.623962 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1279084928}
W20260709 13:00:21.630394  1700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.047s	sys 0.080s
I20260709 13:00:21.627979  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:21.627198  1553 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:21.611969  1634 rpcz_store.cc:276] 0709 13:00:20.014590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.014725 (+   135us) service_pool.cc:224] Handling call
0709 13:00:20.015032 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.015228 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:20.275620 (+260392us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.560910 (+1285290us) spinlock_profiling.cc:243] Waited 938 us on lock 0x7b180048a360. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a8f716 00007f0ed9aa0287
0709 13:00:21.561034 (+   124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:21.561086 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:21.561137 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.561590 (+   453us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.561835 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":326325,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":90238,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3445,"spinlock_wait_cycles":2157312,"thread_start_us":432339,"threads_started":3,"wal-append.queue_time_us":148189,"wal-append.run_cpu_time_us":1330,"wal-append.run_wall_time_us":1021301}
W20260709 13:00:21.628268  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.634019  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:21.633531  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:21.647773  1704 raft_consensus.cc:2368] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6.
I20260709 13:00:21.582554  4648 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:21.648687  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:21.648366  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:21.650763  1552 raft_consensus.cc:2376] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6. Re-sending same reply.
I20260709 13:00:21.651098  1701 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:21.614367  4551 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.611413  4612 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:21.658124  1705 raft_consensus.cc:2368] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5.
W20260709 13:00:21.658775  1706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.039s	sys 0.030s
I20260709 13:00:21.638266  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:21.624737  4624 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.665273  1555 raft_consensus.cc:2376] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8. Re-sending same reply.
I20260709 13:00:21.672634  4624 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.672950  4612 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.673779  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:21.674350  4612 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:21.675100  4624 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:21.675691  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:21.665851  1706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.039s	sys 0.031s
I20260709 13:00:21.636941  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:21.692548  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:21.693176  1553 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:21.693979  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:21.695082  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:21.696173  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:21.669157  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:21.621331  4633 consensus_queue.cc:1059] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:00:21.631918  4523 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:21.697966  1703 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:21.698539  1707 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:21.699195  1703 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:21.698770  4559 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.625944  4647 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.655401  4648 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:21.697985  4633 raft_consensus.cc:3055] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:21.700824  4633 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:21.701596  4633 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:21.703048  4595 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 1.949s	user 0.008s	sys 0.007s
I20260709 13:00:21.703786  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:21.705384  4513 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.677165  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:21.680738  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 526) took 1085 ms. Trace:
I20260709 13:00:21.708568  1559 rpcz_store.cc:276] 0709 13:00:20.595449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.595616 (+   167us) service_pool.cc:224] Handling call
0709 13:00:20.595934 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.638945 (+ 43011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.680386 (+1041441us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b540017edd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:21.680664 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16125824}
I20260709 13:00:21.630441  4515 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:21.664826  4551 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.682009  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:21.684921  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:21.722970  1552 raft_consensus.cc:2376] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5. Re-sending same reply.
I20260709 13:00:21.686275  4518 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:21.667440  4411 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.688397  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:21.728070  1634 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:21.688910  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:21.662665  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:21.689563  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:21.690251  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:21.731810  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 517) took 2108 ms. Trace:
I20260709 13:00:21.732671  1556 rpcz_store.cc:276] 0709 13:00:19.615525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.615673 (+   148us) service_pool.cc:224] Handling call
0709 13:00:19.616032 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:19.784765 (+168733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.723371 (+1938606us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400050ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:21.723550 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355202304}
I20260709 13:00:21.735541  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:21.662515  4310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.015s	sys 0.033s
I20260709 13:00:21.711105  1553 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:21.632089  4643 raft_consensus.cc:697] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:21.725289  1705 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:21.705432  4594 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:21.740180  1556 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:21.742580  4561 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:21.736828  4495 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:00:21.726229  4497 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:21.743373  4607 consensus_queue.cc:1059] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:21.741501  4411 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.746753  1628 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:21.705983  4513 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.709610  1555 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:21.750335  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:21.723188  4397 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:21.743216  4635 consensus_queue.cc:1059] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:21.759317  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:21.766162  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 377303us
I20260709 13:00:21.763180  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:21.751570  4594 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.700100  4647 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:21.660250  4502 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:21.767297  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:21.779879  1705 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:21.769376  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 514) took 2191 ms. Trace:
I20260709 13:00:21.758661  4633 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:21.780781  1558 rpcz_store.cc:276] 0709 13:00:19.577617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.797486 (+219869us) service_pool.cc:224] Handling call
0709 13:00:20.066252 (+268766us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.067446 (+  1194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.769093 (+1701647us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400027e50. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:21.769289 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617142016}
I20260709 13:00:21.785036  1558 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:21.786779  1558 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:21.782548  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:21.748692  4310 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:21.746551  4537 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.802407  1553 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:21.797103  4624 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:21.776412  4594 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:21.803074  1554 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.004s
I20260709 13:00:21.814374  1554 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:21.777757  4497 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:21.809553  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:21.818419  1701 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:00:21.810079  1560 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:21.821662  1632 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:21.823520  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:21.826094  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:21.826874  1703 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:21.827427  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2185) took 1048 ms. Trace:
I20260709 13:00:21.827715  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:21.828570  1707 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:21.773151  4607 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:00:21.803974  4495 raft_consensus.cc:3055] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:21.804629  4652 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.820653  4635 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:21.864290  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 488607us
I20260709 13:00:21.865533  1675 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:21.867339  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:21.827881  1700 rpcz_store.cc:276] 0709 13:00:20.778667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.839201 (+ 60534us) service_pool.cc:224] Handling call
0709 13:00:20.863088 (+ 23887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.933916 (+ 70828us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:20.987691 (+ 53775us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.640302 (+652611us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:21.640380 (+    78us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:21.640451 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.827197 (+186746us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b540002c6d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:21.827244 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.827371 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23440,"prepare.queue_time_us":56760,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":9010,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6807,"spinlock_wait_cycles":161508608,"thread_start_us":643228,"threads_started":1,"wal-append.queue_time_us":756053}
I20260709 13:00:21.849984  4513 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:21.851884  4497 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.771078  4397 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.822810  4643 consensus_queue.cc:237] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:21.845896  4310 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.803333  4624 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:21.832753  4537 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:21.886858  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 289911us
I20260709 13:00:21.873569  1675 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:21.894872  4638 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:21.870646  4612 raft_consensus.cc:3055] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:21.901881  4638 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:21.902172  4612 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:21.902848  4638 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.903358  4612 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.896238  4515 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:00:21.905663  4612 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:21.895833  1675 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:21.862499  4495 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:21.908483  4523 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:21.908787  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.909108  4523 raft_consensus.cc:697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:21.907971  4515 consensus_queue.cc:1059] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:21.910104  4523 consensus_queue.cc:237] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:21.911820  4646 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.912504  4646 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.916528  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:21.917588  2327 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:21.831645  4060 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.925601  1523 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:21.942332  1705 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
W20260709 13:00:21.960628  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.979928  1629 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
W20260709 13:00:21.922106  4613 consensus_meta.cc:287] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.911s	user 0.011s	sys 0.002s
I20260709 13:00:21.872534  4661 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:21.985018  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 305412us
W20260709 13:00:21.986253  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.986912  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.884259  4660 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:21.999918  1554 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:21.929579  2320 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.524s	user 0.015s	sys 0.000s
I20260709 13:00:21.924703  4646 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:21.941267  4633 raft_consensus.cc:3055] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:21.936800  4533 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.037559  4533 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:22.016896  4551 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:21.917832  4513 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:00:21.872836  4652 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.021500  4495 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:22.022334  4657 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:00:22.023689  4397 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:22.023664  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2186) took 1159 ms. Trace:
I20260709 13:00:22.007421  4624 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.030280  4411 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:22.024111  4547 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.872922  4635 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:21.921463  4623 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:00:22.020747  4662 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.080080  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 312944us
W20260709 13:00:22.080813  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 155287us
W20260709 13:00:22.098675  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:22.102219  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 367979us
I20260709 13:00:22.013918  4558 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:22.103549  1552 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:22.100929  4499 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:22.009698  2320 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:22.204646  1598 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:22.012897  4633 raft_consensus.cc:740] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:22.174793  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.004369  4613 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.189497  4611 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:22.099591  4660 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:22.192823  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41170 (request call id 20) took 1365 ms. Trace:
W20260709 13:00:22.104143  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 206355us
W20260709 13:00:22.196904  1673 leader_election.cc:336] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.954s (SENT)
I20260709 13:00:22.234838  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:22.103636  1557 rpcz_store.cc:276] 0709 13:00:20.864453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.902419 (+ 37966us) service_pool.cc:224] Handling call
0709 13:00:20.902852 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.595013 (+692161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.595042 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.618367 (+ 23325us) log.cc:844] Serialized 26 byte log entry
0709 13:00:21.930218 (+311851us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:21.930268 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.930346 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.023000 (+ 92654us) raft_consensus.cc:1685] finished
0709 13:00:22.023019 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.023601 (+   582us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44034,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":10022,"thread_start_us":961640,"threads_started":2,"wal-append.queue_time_us":374800}
W20260709 13:00:22.203348  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.233846  1551 rpcz_store.cc:276] 0709 13:00:20.808560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.808692 (+   132us) service_pool.cc:224] Handling call
0709 13:00:22.173656 (+1364964us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54001d6ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a7f853 00007f0edea4d60a 00007f0ed7fd37d4 00007f0ed7fd3762 00007f0ed7fd3691 00007f0ed7fd360c 00007f0ed7fd28c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:22.173752 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262971776}
W20260709 13:00:22.244263  1673 leader_election.cc:336] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.967s (SENT)
I20260709 13:00:22.222790  4662 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.245169  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:22.245848  4664 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:00:22.246230  4663 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:22.247400  4662 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:22.247390  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.248373  4611 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.248834  4662 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.249505  4662 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.253120  4665 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:22.253723  4665 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.255937  4665 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:22.257485  1708 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:22.258895  1705 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:22.260926  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:22.261667  1704 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 13:00:22.199319  4558 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.264987  1707 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:22.269649  1558 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:22.278548  4663 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:22.217571  4624 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:22.222760  4638 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.285643  1526 connection.cc:256] RPC call timeout handler was delayed by -5.8058901899999569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 13:00:22.237677  4495 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.233309  4310 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.291194  1526 connection.cc:256] RPC call timeout handler was delayed by -5.7959901899999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
I20260709 13:00:22.186461  4547 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.307514  4547 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:22.307261  4633 consensus_queue.cc:260] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:22.309087  4633 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.241513  4523 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:22.311925  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.313273  4559 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.314772  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.315336  4613 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:22.223889  4499 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:22.315555  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.316219  1557 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:22.317757  4635 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:22.318303  4635 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.318890  1553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
mode: GRACEFUL
new_leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
 from {username='slave'} at 127.0.0.1:41170
I20260709 13:00:22.318764  4635 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.319451  1553 raft_consensus.cc:606] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:22.319792  1553 raft_consensus.cc:614] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:22.282802  4649 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:00:22.282536  4558 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:22.321118  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.320545  4660 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.322320  1554 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
W20260709 13:00:22.293751  1526 connection.cc:256] RPC call timeout handler was delayed by -5.7716901899999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 13:00:22.293933  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:22.330600  1526 connection.cc:256] RPC call timeout handler was delayed by -5.5961901899999589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260709 13:00:22.256455  4665 raft_consensus.cc:2764] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:22.286417  4502 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:22.279832  4663 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.299494  4652 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:22.304539  4060 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:22.304770  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2186) took 1525 ms. Trace:
I20260709 13:00:22.304860  4310 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.294489  4533 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:22.331158  1526 connection.cc:256] RPC call timeout handler was delayed by -5.5439901899999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
I20260709 13:00:22.287293  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:22.348142  1526 connection.cc:256] RPC call timeout handler was delayed by -5.4134901899999477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
I20260709 13:00:22.343344  1706 rpcz_store.cc:276] 0709 13:00:20.778897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.836871 (+ 57974us) service_pool.cc:224] Handling call
0709 13:00:20.837401 (+   530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.005716 (+168315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.005762 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.006282 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:00:21.691250 (+684968us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:21.996785 (+305535us) log.cc:844] Serialized 14 byte log entry
0709 13:00:22.058875 (+ 62090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.304301 (+245426us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54003ebcd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:22.304353 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.304407 (+    54us) raft_consensus.cc:1685] finished
0709 13:00:22.304506 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.304706 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86014,"prepare.queue_time_us":330158,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":458359,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":54862,"spinlock_wait_cycles":385833856,"thread_start_us":962738,"threads_started":2,"wal-append.queue_time_us":754673}
W20260709 13:00:22.353413  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:22.360474  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 73271.5us
I20260709 13:00:22.364022  4175 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.349274  1526 connection.cc:256] RPC call timeout handler was delayed by -5.3954901899999754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
W20260709 13:00:22.370100  1526 connection.cc:256] RPC call timeout handler was delayed by -5.3477901899999551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
W20260709 13:00:22.371244  1526 connection.cc:256] RPC call timeout handler was delayed by -5.1992901899999424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
W20260709 13:00:22.372313  1526 connection.cc:256] RPC call timeout handler was delayed by -4.9733901899999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2457s for a response
W20260709 13:00:22.373260  1526 connection.cc:256] RPC call timeout handler was delayed by -3.8321901899999489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.37250000000000005s for a response
W20260709 13:00:22.373945  1526 connection.cc:256] RPC call timeout handler was delayed by -3.5855901899999481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.39990000000000003s for a response
W20260709 13:00:22.375272  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 136321us
W20260709 13:00:22.384488  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 179966us
W20260709 13:00:22.377074  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 144876us
I20260709 13:00:22.327589  4638 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.381337  2327 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:22.366060  4533 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:22.390760  1675 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:22.385993  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:22.395045  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.396284  1706 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:22.395859  4533 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:22.397370  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:22.397573  4533 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:22.398463  4533 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:22.399138  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:22.400061  1673 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.611s (SENT)
I20260709 13:00:22.385742  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:22.400555  1673 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:22.400991  2323 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:22.376241  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:22.393662  1601 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:22.371938  4175 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.402107  1523 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:22.394321  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:22.403149  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:22.399778  1706 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.402801  1701 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:22.407840  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:22.407737  1673 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.685s (SENT)
I20260709 13:00:22.408730  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:22.408921  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:22.409955  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:22.410266  1705 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:22.411209  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:22.411286  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:22.411900  1708 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:22.411995  1701 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:22.408644  2327 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:22.415416  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:22.419960  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:22.421193  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:22.420567  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 186121us
I20260709 13:00:22.405584  4665 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:22.426725  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:22.407788  4623 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:22.439404  4623 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.439855  4623 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.415417  4643 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:22.441522  4662 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:22.442344  4612 consensus_meta.cc:287] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.004s
I20260709 13:00:22.444201  4617 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.448483  1706 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
W20260709 13:00:22.451957  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 75828.3us
I20260709 13:00:22.454162  1601 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:22.430289  1673 leader_election.cc:336] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.899s (SENT)
I20260709 13:00:22.462605  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:22.413664  4502 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:22.432879  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2192) took 1627 ms. Trace:
I20260709 13:00:22.433477  4310 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:22.434360  4648 consensus_meta.cc:287] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.734s	user 0.007s	sys 0.009s
I20260709 13:00:22.424817  4537 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:22.435981  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:22.470142  4502 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.479560  4502 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:22.429663  4683 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:00:22.463550  1709 rpcz_store.cc:276] 0709 13:00:20.805143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.944442 (+139299us) service_pool.cc:224] Handling call
0709 13:00:21.121150 (+176708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.627405 (+506255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.627450 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.653769 (+ 26319us) log.cc:844] Serialized 26 byte log entry
0709 13:00:22.010646 (+356877us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:22.010702 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.010777 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.432655 (+421878us) raft_consensus.cc:1685] finished
0709 13:00:22.432674 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.432821 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":280009,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":51,"thread_start_us":824535,"threads_started":2,"wal-append.queue_time_us":665300}
I20260709 13:00:22.413722  4499 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:22.472470  1673 leader_election.cc:336] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.079s (SENT)
I20260709 13:00:22.491364  1673 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:22.406531  4060 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:00:22.425160  4685 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:22.481832  4515 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:22.507507  2326 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:22.482388  1598 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:22.418025  4523 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:22.416941  4635 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:22.484992  4643 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:22.476307  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48275.8us
I20260709 13:00:22.479902  2321 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:22.417542  4670 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:22.488263  1601 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:22.477736  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:22.487133  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 63928.7us
W20260709 13:00:22.424345  4628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.001s	sys 0.031s
I20260709 13:00:22.501473  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:22.519431  1599 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:22.477317  4594 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.002s
I20260709 13:00:22.515844  1672 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:22.505415  4310 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:22.491279  4665 raft_consensus.cc:697] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:22.478259  4612 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:00:22.504848  4521 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:22.525358  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:22.486116  4648 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:22.519538  4628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.001s	sys 0.032s
I20260709 13:00:22.535501  2288 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:22.571080  2288 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:00:22.572875  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48930.9us
I20260709 13:00:22.492363  4558 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.572386  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:00:22.537276  4669 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.247s	user 0.001s	sys 0.001s
W20260709 13:00:22.575234  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 73835.5us
I20260709 13:00:22.582281  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:22.576570  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.517868  4670 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.579619  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:22.527575  4690 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:22.531616  4662 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:22.589424  1555 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:22.593719  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.544008  4537 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:22.594339  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 112022us
I20260709 13:00:22.596657  4537 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.597175  4537 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.536182  4497 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:00:22.605752  4175 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:22.579229  4565 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:22.609954  4565 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.610404  4565 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.543563  4521 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:22.536106  4624 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:00:22.614852  4521 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:22.590391  4670 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.616148  4611 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:22.616957  4558 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:22.582759  4590 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:22.620839  4590 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.621239  4590 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:22.628718  4509 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:22.633311  4678 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 13:00:22.634493  4665 consensus_queue.cc:237] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:22.635150  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:22.586454  4677 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:22.579736  4613 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:22.576889  4571 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:22.576740  4535 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:22.576308  4515 raft_consensus.cc:697] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:22.636368  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 56839.8us
I20260709 13:00:22.650355  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:22.532505  4594 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.648520   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:22.584329  4685 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:22.641688  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:22.642379  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:22.643814  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 125399us
I20260709 13:00:22.590874  4690 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.662425  4648 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:22.648789  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:22.653412  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:22.663386  1702 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:22.653595  2326 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:22.658552  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:22.610008  4638 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:22.665011  1672 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:22.662536  4690 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.591140  4662 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.666093  4662 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:22.666157  4648 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:22.669518  4537 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.671509  4537 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:22.665544  1526 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:22.672608  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:22.673393  1709 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.673588  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:22.676819  4060 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.676261  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:22.641443  4612 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:22.664149  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:22.585132  4686 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:00:22.643146  4677 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:22.647514  4535 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.641770  4613 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:22.696554  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:22.680692  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:22.690847  4599 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.691813  4658 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.712756  4411 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:22.682565  4558 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:22.676972  4648 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:00:22.645323  4661 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:00:22.714227  1526 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:22.698271  4613 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:22.693490  4677 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.716861  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:22.684790  4611 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:22.682304  4655 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:22.696920  4535 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:22.722724  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:22.718197  4698 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:00:22.709993  4571 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:22.765574  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:22.773752  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 56943.1us
I20260709 13:00:22.774508  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:22.774881  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:22.775544  1560 raft_consensus.cc:2368] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 13:00:22.707484  4513 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:22.727725  4676 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:22.728735  4561 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.732980  4647 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:22.733753  4502 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.743551  1709 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:22.684515  4659 consensus_queue.cc:1059] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:00:22.766155  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:22.766824  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.767204  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.764008  4611 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:22.776412  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:22.833830  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 57356.1us
I20260709 13:00:22.834663  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:22.776291  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.693645  4623 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.719312  4680 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:22.784919  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.784171  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.836500  1551 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:22.790067  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.785630  4670 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.788503  2326 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:22.716090  4558 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:22.676995  4662 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.714579  4685 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:22.761467  4661 consensus_queue.cc:1243] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:22.734848  4655 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.832123  1553 raft_consensus.cc:2368] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 13:00:22.785643  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.859833  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.860407  1552 raft_consensus.cc:2393] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:22.734750  4688 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:22.707506  4689 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:00:22.840922  4513 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:22.841856  1557 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:22.843091  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:22.781420  4571 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:22.851496  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.851553  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.870482  1551 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:22.782215  4612 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:22.852167  1556 raft_consensus.cc:2410] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:22.715049  4599 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.786675  4697 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:22.862264  1599 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:22.882050  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:22.883245  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:22.863200  1553 raft_consensus.cc:2393] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:22.837211  4559 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:22.847236  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 121070us
I20260709 13:00:22.886899  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:22.840873  1554 raft_consensus.cc:2410] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:22.718889  4658 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.853384  4558 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:22.846551  4686 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:22.868175  1560 raft_consensus.cc:2368] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6.
I20260709 13:00:22.892771  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:22.872982  4696 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:00:22.847270  4611 raft_consensus.cc:697] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:22.872928  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.874753  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.877748  4663 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:22.904623  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2199) took 1425 ms. Trace:
I20260709 13:00:22.915884  1555 rpcz_store.cc:276] 0709 13:00:21.479230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.782159 (+302929us) service_pool.cc:224] Handling call
0709 13:00:21.782501 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:22.592302 (+809801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.904168 (+311866us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b54001c89d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:22.904545 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1847474432}
I20260709 13:00:22.917577  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.878094  4623 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:22.904119  4699 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:22.887179  4698 raft_consensus.cc:2764] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:22.904985  1552 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:22.879439  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:22.886902  1599 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:22.922487  2321 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:22.922174  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:22.923429  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.925484  4703 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:22.928210  4698 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:22.887204  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.927516  4703 consensus_queue.cc:1059] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:00:22.930414  4703 raft_consensus.cc:3055] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:22.867326  4607 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.854566  4685 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.893601  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.931128  4703 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:22.931617  1559 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:22.932770  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.933528  1559 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:22.932695  4703 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:22.934345  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:22.895167  4695 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:00:22.935032  4703 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.935278  4565 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.907848  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.938194  1557 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 13:00:22.894012  1551 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:22.941576  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:22.892889  4397 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:00:22.871554  4571 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.943080  4397 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:22.943625  4397 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:22.945006  4397 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:22.889384  4700 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:22.949201  4623 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:22.928627  4599 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:22.934353  4591 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:22.899781  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.951151  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:22.914880  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:22.906051  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:22.952708  1556 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:22.953063  1554 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.888315  2328 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 4: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:22.931331  4685 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:22.956933  4523 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.862731  4655 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:22.957585  4523 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.937245  4310 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:22.959061  4310 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:22.930528  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.952070  1558 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:22.939743  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.930194  4611 consensus_queue.cc:237] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:22.966289  1556 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:22.968736  1554 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:22.782466  4515 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.846202  4561 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.986032  2321 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:22.987407  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:22.999120  2327 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:22.990386  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:22.977234   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:22.943813  4635 raft_consensus.cc:3055] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:22.901153  4686 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.001652  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:23.012483  1560 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:23.010016  2326 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:22.995465  1454 catalog_manager.cc:5697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 6 to 7, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:23.023013  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.911559  4060 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:22.941591  4607 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:23.036852  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:22.894639  4688 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 13:00:23.109685  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:23.122538  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.020773  4617 consensus_meta.cc:287] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
I20260709 13:00:23.160189  1556 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:23.200834  4513 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:22.996865  4647 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:23.020090  4686 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:23.205150  4647 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:23.206593  1560 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:23.180323  4565 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:23.102376  4521 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:23.189085  4658 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:23.189566  4670 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:23.191738  4509 consensus_meta.cc:287] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.001s
I20260709 13:00:23.005373  4635 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:23.224261  2323 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:23.224413  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:23.230062  1556 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:23.211820  4539 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.902626  4559 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:23.234526  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:23.239344  1552 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:23.235675  1673 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.983s (SENT)
I20260709 13:00:23.039626  4533 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:23.239917  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:23.241582  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:23.245818  1556 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:23.237977  4539 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:23.208532  4647 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:23.251559  4559 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:23.006671  4638 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.227s
I20260709 13:00:23.254439  4638 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:23.256312  4662 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:23.257239  4662 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:23.261391  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:23.161443  4699 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:23.226717  4495 consensus_meta.cc:287] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.901s	user 0.008s	sys 0.005s
I20260709 13:00:23.272863  1556 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:23.231992  4684 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:23.301824  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1959) took 2584 ms (client timeout 1866 ms). Trace:
W20260709 13:00:23.295469  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 370967us
I20260709 13:00:23.291867  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:23.308135  1552 raft_consensus.cc:2368] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6.
I20260709 13:00:23.011615  4663 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.228s
W20260709 13:00:23.305095  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 397665us
I20260709 13:00:23.313277  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:23.314101  1555 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:23.312721  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:23.316679  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:23.319243  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:23.320221  1555 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:23.315704  1556 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:23.259142  4533 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:00:23.296674  4690 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.631s	user 0.005s	sys 0.006s
I20260709 13:00:23.336007  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:23.340305  1557 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 3.
I20260709 13:00:23.210381  4521 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:23.341446  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:23.353443  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:23.302539  1635 rpcz_store.cc:269] 0709 13:00:20.717892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.718036 (+   144us) service_pool.cc:224] Handling call
0709 13:00:23.297836 (+2579800us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b5400125054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:23.301724 (+  3888us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4193962240}
W20260709 13:00:23.343758  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 433778us
I20260709 13:00:23.338445  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:23.357507  2286 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:23.359567  2327 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:23.354790  1559 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:23.360854  1601 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:23.362042  1601 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:23.362092  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:23.333987  4663 consensus_queue.cc:1243] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:00:23.343335  4535 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.000s
I20260709 13:00:23.373526  1633 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:23.362915  1559 raft_consensus.cc:2376] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6. Re-sending same reply.
I20260709 13:00:23.219146  4635 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:23.353493  4590 consensus_meta.cc:287] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.732s	user 0.012s	sys 0.000s
I20260709 13:00:23.367841  4670 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:23.368930  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:23.369772  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:23.378000  1632 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:23.370361  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:23.370704  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:23.371337  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:23.371676  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:23.372104  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:23.385941  1626 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:23.386029  1559 raft_consensus.cc:3055] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:23.371816  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:23.375116  1635 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:00:23.375902  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:23.389185  1523 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:23.386941  1559 raft_consensus.cc:740] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:23.297551  4699 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:23.403023  1709 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:23.430039  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:23.449535  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:23.450600  1552 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
W20260709 13:00:23.452836  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.457887  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:23.458849  1629 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:23.309804  4684 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:23.473273  1559 consensus_queue.cc:260] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:23.479169  1559 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:23.474390  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 238707us
W20260709 13:00:23.480978  1673 leader_election.cc:336] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 3.039s (SENT)
I20260709 13:00:23.481451  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:23.491827  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:23.476280  1556 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:23.493427  1631 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:23.376654  4628 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:23.353293  4690 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:23.492698  1700 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 4: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:23.496960  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:23.497720  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 394696us
I20260709 13:00:23.499856  1707 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:23.445974  4647 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:23.506538  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 53147.9us
I20260709 13:00:23.512223  4670 raft_consensus.cc:697] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:23.515714  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 158318us
I20260709 13:00:23.521312  1632 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:23.366160  4700 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:00:23.534843  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:23.498140  4665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.010s	sys 0.019s
I20260709 13:00:23.513865  4670 consensus_queue.cc:237] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:23.376217  4535 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:23.454176  4590 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:23.577999  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:23.539490  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:23.590802  1558 raft_consensus.cc:3055] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:23.593189  1556 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:23.593400  1558 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:23.594844  1707 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:23.476887  4689 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:23.613154  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:23.614250  1627 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:23.538491  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:23.622779  1632 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:23.623934  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:23.593845  4611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.017s	sys 0.052s
I20260709 13:00:23.635484  1558 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:23.590014  4665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.010s	sys 0.020s
I20260709 13:00:23.526485  4658 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:23.577522  4647 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:23.555625  4703 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.656389  1558 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:23.467585  4533 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:23.674659  4535 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:23.674765  4533 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:23.676699  2320 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:23.664813  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:23.670704  4521 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:23.700824  1627 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:00:23.672056  4707 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:00:23.673034  4703 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:23.735250  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 520) took 1095 ms. Trace:
I20260709 13:00:23.577888  4662 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:00:23.695498  1632 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
W20260709 13:00:23.647481  4611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.017s	sys 0.052s
I20260709 13:00:23.735699  1703 rpcz_store.cc:276] 0709 13:00:22.639800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.639910 (+   110us) service_pool.cc:224] Handling call
0709 13:00:22.918480 (+278570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:22.918692 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:23.467032 (+548340us) log.cc:844] Serialized 14 byte log entry
0709 13:00:23.734842 (+267810us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:23.734917 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:23.734970 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.735041 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:23.735172 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":694327,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"thread_start_us":733681,"threads_started":2}
I20260709 13:00:23.656867  4658 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.642275  4689 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:23.648818  4663 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:23.792861  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 311851us
I20260709 13:00:23.734023  4535 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:23.833808  4712 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:00:23.780659  4571 consensus_meta.cc:287] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.837s	user 0.011s	sys 0.002s
I20260709 13:00:23.777021  4658 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:23.987572  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.039958  2287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.002s	sys 0.010s
W20260709 13:00:23.996783  1705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.010s	sys 0.003s
W20260709 13:00:24.051044  1705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.010s	sys 0.007s
W20260709 13:00:23.945130  4707 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 13:00:24.052220  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 258402us
I20260709 13:00:24.201301  1632 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:00:24.197875  1555 consensus_meta.cc:287] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.877s	user 0.019s	sys 0.011s
I20260709 13:00:24.202410  1555 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
W20260709 13:00:24.209841  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.074730  1558 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:00:24.210541  1558 pending_rounds.cc:85] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 4
I20260709 13:00:24.210803  1558 pending_rounds.cc:107] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:00:24.211040  1558 raft_consensus.cc:2889] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:24.050899  2287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.003s	sys 0.010s
I20260709 13:00:24.212854  1553 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:24.215758  1556 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:00:23.945463  4655 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.987s	user 0.013s	sys 0.000s
W20260709 13:00:24.258711  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 60798.5us
W20260709 13:00:24.271152  1673 leader_election.cc:336] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.035s (SENT)
I20260709 13:00:24.271692  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:24.293061  2286 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:24.294317  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:24.295151  1632 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:24.300616  4706 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.669s	user 0.001s	sys 0.000s
I20260709 13:00:24.301649  4708 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.301852  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 519) took 1662 ms. Trace:
I20260709 13:00:24.302217  4708 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:24.303022  4558 consensus_meta.cc:287] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.397s	user 0.007s	sys 0.003s
I20260709 13:00:24.302186  1701 rpcz_store.cc:276] 0709 13:00:22.639501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.640799 (+  1298us) service_pool.cc:224] Handling call
0709 13:00:22.641115 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:22.645129 (+  4014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:22.645158 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:22.900119 (+254961us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b2c000f3418. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2
0709 13:00:22.900709 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.350273 (+449564us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:23.350327 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.350414 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.301575 (+951161us) raft_consensus.cc:1685] finished
0709 13:00:24.301597 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.301793 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3656,"raft.queue_time_us":4372,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":9463,"spinlock_wait_cycles":10027392,"thread_start_us":449130,"threads_started":1,"wal-append.queue_time_us":659522}
I20260709 13:00:24.303579  4558 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:24.306732  4663 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:24.345655  4613 consensus_meta.cc:287] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.581s	user 0.011s	sys 0.001s
I20260709 13:00:24.346079  4613 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:24.347088  4686 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.141s	user 0.002s	sys 0.010s
I20260709 13:00:24.347747  4686 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:23.930783  4535 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:23.970975  4571 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:24.050837  4647 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:24.348459  4613 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:24.727546  1709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.136s	user 0.006s	sys 0.048s
W20260709 13:00:24.817221  1709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.007s	sys 0.048s
W20260709 13:00:24.378538  1675 leader_election.cc:336] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.866s (SENT)
I20260709 13:00:24.817312  1701 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:00:24.817749  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 439181us
I20260709 13:00:24.818213  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2206) took 1378 ms. Trace:
W20260709 13:00:24.728508  1702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.227s	user 0.003s	sys 0.002s
W20260709 13:00:24.818992  1702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.317s	user 0.007s	sys 0.004s
W20260709 13:00:24.741791  2288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.096s	user 0.005s	sys 0.001s
W20260709 13:00:24.367552  4680 consensus_meta.cc:287] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.524s	user 0.007s	sys 0.005s
W20260709 13:00:24.819868  2288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.174s	user 0.007s	sys 0.003s
W20260709 13:00:24.356969  4694 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 1.705s	user 0.005s	sys 0.004s
I20260709 13:00:24.314921  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:24.820636  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 1.18425e+06us
I20260709 13:00:24.255849  4611 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:24.599448  4565 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:24.673596  4533 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.998s	user 0.010s	sys 0.001s
I20260709 13:00:24.310446  4689 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:24.311803  4677 consensus_meta.cc:287] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.584s	user 0.006s	sys 0.005s
I20260709 13:00:24.304538  4708 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:24.312273  4590 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:24.307332  4718 log.cc:927] Time spent T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.511s	user 0.000s	sys 0.000s
I20260709 13:00:24.566668  4662 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.132984  4719 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:24.309305  4720 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:00:24.351459  4685 consensus_meta.cc:287] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.394s	user 0.010s	sys 0.001s
I20260709 13:00:24.812381  4599 raft_consensus.cc:3055] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:24.824119  4700 consensus_queue.cc:1059] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:00:24.316212  4521 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:24.808213  4558 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:24.832206  4743 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:24.836896  4565 raft_consensus.cc:697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:24.842012  4599 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:24.845389  4743 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:24.846030  4565 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:24.824509  4663 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:24.297133  4699 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:24.353046  4690 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:24.800535  4703 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:24.824697  4741 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:24.836567  4677 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:24.839382  4662 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:24.857859  4743 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:24.858404  4677 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:24.856550  4663 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:24.291949  4655 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:24.858701  4662 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:00:24.860291  4686 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:24.860577  4663 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:24.373464  4658 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:24.834481  4611 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:24.861740  4571 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:24.820485  4680 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:24.860755  4655 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:24.869242  4611 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:24.904537  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.311194  1557 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:24.310241  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:24.986223  1556 raft_consensus.cc:2376] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6. Re-sending same reply.
W20260709 13:00:24.800752  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 190351us
I20260709 13:00:24.910758  1554 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:24.989532  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 560) took 1417 ms. Trace:
I20260709 13:00:24.990347  1557 rpcz_store.cc:276] 0709 13:00:23.572274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.572479 (+   205us) service_pool.cc:224] Handling call
0709 13:00:23.572899 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.985448 (+1412549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.988845 (+  3397us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54002283d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:24.989239 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697265920}
W20260709 13:00:24.320010  1559 consensus_meta.cc:287] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.840s	user 0.009s	sys 0.002s
I20260709 13:00:24.804616  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:24.317476  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:24.727069  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.091s	user 0.002s	sys 0.003s
W20260709 13:00:24.996785  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.361s	user 0.007s	sys 0.003s
I20260709 13:00:24.369004  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:24.998536  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:24.999279  1627 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:24.999766  1635 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:25.000101  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 591) took 1019 ms. Trace:
I20260709 13:00:24.921694  1628 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:25.002187  1628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1975) took 1632 ms (client timeout 1935 ms). Trace:
W20260709 13:00:25.002725  1628 rpcz_store.cc:269] 0709 13:00:23.369475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.371402 (+  1927us) service_pool.cc:224] Handling call
0709 13:00:25.001852 (+1630450us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54000e6d54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:25.002096 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3525869824}
W20260709 13:00:24.727510  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.226s	user 0.002s	sys 0.003s
W20260709 13:00:25.005137  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.504s	user 0.003s	sys 0.008s
I20260709 13:00:25.007287  1627 rpcz_store.cc:276] 0709 13:00:23.981064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.254575 (+273511us) service_pool.cc:224] Handling call
0709 13:00:24.999967 (+745392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.008977  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:25.009349  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.011210  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:25.011422  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:24.824824  1673 connection.cc:256] RPC call timeout handler was delayed by -1.0438854770000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.339s for a response
I20260709 13:00:24.821594  1703 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:24.819120  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:24.314572  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:25.015697  1705 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:25.016252  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:25.017400  1703 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:25.018515  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.019696  1703 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:00:25.020217  1703 pending_rounds.cc:85] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 7
I20260709 13:00:24.801419  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:25.034838  1707 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:25.035470  4663 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:25.036531  4663 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:25.038620  4523 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:24.726388  1708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.015s	sys 0.030s
W20260709 13:00:25.040412  1708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.015s	sys 0.032s
I20260709 13:00:25.042904  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2210) took 1575 ms. Trace:
I20260709 13:00:25.043248  4663 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:24.930449  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2204) took 1501 ms. Trace:
I20260709 13:00:24.930483  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2208) took 1488 ms. Trace:
I20260709 13:00:25.054857  1704 rpcz_store.cc:276] 0709 13:00:23.441620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.453387 (+ 11767us) service_pool.cc:224] Handling call
0709 13:00:23.453843 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.454337 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.454378 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.454957 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.663174 (+208217us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:23.663226 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.663317 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.929480 (+1266163us) raft_consensus.cc:1685] finished
0709 13:00:24.929536 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.930155 (+   619us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":12353,"thread_start_us":106803,"threads_started":1,"wal-append.queue_time_us":1321476}
W20260709 13:00:24.728051  2285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.002s	sys 0.003s
W20260709 13:00:25.064056  2285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.386s	user 0.004s	sys 0.008s
I20260709 13:00:25.071081  4397 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.077344  4571 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:25.077952  4635 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.078727  4571 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:24.566692  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 273683us
I20260709 13:00:24.822700  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:24.808645  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:25.081847  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 259399us
I20260709 13:00:25.082343  2329 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:25.083251  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:25.083241  4497 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.085376  4497 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.936086  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 839) took 1971 ms. Trace:
I20260709 13:00:24.836926  4533 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.086807  4533 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:25.086205  2328 rpcz_store.cc:276] 0709 13:00:22.963999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.964212 (+   213us) service_pool.cc:224] Handling call
0709 13:00:22.964769 (+   557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:22.965101 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:22.965137 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.002574 (+ 37437us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.523376 (+520802us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:23.523614 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.523818 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.935482 (+1411664us) raft_consensus.cc:1685] finished
0709 13:00:24.935515 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.935817 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":236001,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":314318,"threads_started":1,"wal-append.queue_time_us":764464}
I20260709 13:00:25.087350  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:25.089628  4533 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:24.846465  4599 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:24.862676  4658 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:24.843480  4685 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.090974  4565 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:24.848196  4719 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.094280  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:25.095592  2328 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:24.863716  4741 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:24.953994  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:25.098805  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.100063  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:25.101070  2325 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
W20260709 13:00:24.957345  1700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.006s	sys 0.017s
W20260709 13:00:25.104964  1700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.007s	sys 0.017s
I20260709 13:00:24.960954  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:24.964712  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:25.106307  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2212) took 1636 ms. Trace:
I20260709 13:00:24.966241  4535 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:24.965636  4521 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:25.109699  4535 consensus_queue.cc:1059] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:25.111361  4521 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:25.111793  4658 raft_consensus.cc:3055] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:24.974400  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.112493  4658 raft_consensus.cc:740] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:00:25.113261  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.976943  4677 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.114849  4680 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:25.114336  4658 consensus_queue.cc:260] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.115346  4677 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:25.115787  4680 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:24.991065  1554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 556) took 1674 ms (client timeout 2139 ms). Trace:
I20260709 13:00:24.309930  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:24.994822  1552 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:25.122390  4741 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:24.811687  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2207) took 1371 ms. Trace:
I20260709 13:00:25.020249  1701 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:25.123622  4677 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:25.123596  1706 rpcz_store.cc:276] 0709 13:00:23.440352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.440503 (+   151us) service_pool.cc:224] Handling call
0709 13:00:23.440946 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.456850 (+ 15904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.456892 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.457369 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.663839 (+206470us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:23.663878 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.663947 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.712007 (+1048060us) raft_consensus.cc:1685] finished
0709 13:00:24.712033 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.811608 (+ 99575us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15441,"raft.queue_time_us":51909,"raft.run_cpu_time_us":439,"raft.run_wall_time_us":40592,"thread_start_us":93711,"threads_started":1,"wal-append.queue_time_us":1170798}
I20260709 13:00:25.126947  4684 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:25.022469  2322 pending_rounds.cc:85] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 9
I20260709 13:00:25.130872  2322 pending_rounds.cc:107] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:00:25.131412  2322 raft_consensus.cc:2889] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.128201  4719 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:25.025110  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.137643  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.019714  1634 raft_consensus.cc:2393] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:25.013520  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.013746  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.028496  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:25.028784  2323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 699) took 2622 ms (client timeout 2143 ms). Trace:
I20260709 13:00:25.002517  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:25.030349  1633 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:25.026098  1703 pending_rounds.cc:107] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:00:25.033476  4655 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.039162  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:25.044667  2320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 696) took 2667 ms (client timeout 2875 ms). Trace:
I20260709 13:00:24.818599  1709 rpcz_store.cc:276] 0709 13:00:23.439956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.442025 (+  2069us) service_pool.cc:224] Handling call
0709 13:00:23.442410 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.442661 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:23.584127 (+141466us) log.cc:844] Serialized 14 byte log entry
0709 13:00:24.817852 (+1233725us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.817905 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:24.817947 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.818009 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.818140 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135209,"prepare.queue_time_us":258364,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":5188,"thread_start_us":1338716,"threads_started":2,"wal-append.queue_time_us":1213966}
W20260709 13:00:25.047235  1673 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.723s (SENT)
I20260709 13:00:25.085929  4497 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.185391  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:25.186259  1709 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.054535  1702 rpcz_store.cc:276] 0709 13:00:23.428549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.428755 (+   206us) service_pool.cc:224] Handling call
0709 13:00:23.477260 (+ 48505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.477636 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.477671 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.501450 (+ 23779us) log.cc:844] Serialized 564 byte log entry
0709 13:00:24.819526 (+1318076us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:24.819566 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.819632 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.929763 (+110131us) raft_consensus.cc:1685] finished
0709 13:00:24.929801 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.930151 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1317728,"threads_started":1,"wal-append.queue_time_us":1337402}
I20260709 13:00:25.189702  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:25.191708  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:25.111459  4685 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:24.994913  1632 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:25.194159  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 589) took 1448 ms. Trace:
I20260709 13:00:25.194579  1632 rpcz_store.cc:276] 0709 13:00:23.745689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.569699 (+824010us) service_pool.cc:224] Handling call
0709 13:00:25.194071 (+624372us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:25.118278  1554 rpcz_store.cc:269] 0709 13:00:23.316278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.316405 (+   127us) service_pool.cc:224] Handling call
0709 13:00:24.990749 (+1674344us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54002292d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:24.990970 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3659150208}
I20260709 13:00:24.995218  4310 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:25.021446  1559 raft_consensus.cc:1275] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 2. (term mismatch)
I20260709 13:00:25.201465  1559 pending_rounds.cc:85] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 1
I20260709 13:00:25.201895  1559 pending_rounds.cc:107] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:00:25.202237  1559 raft_consensus.cc:2889] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.202620  1559 pending_rounds.cc:107] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:00:25.202978  1559 raft_consensus.cc:2889] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.203903  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 1927) took 1826 ms. Trace:
I20260709 13:00:25.204005  4502 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:25.129467  4680 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:25.139961  1703 raft_consensus.cc:2889] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.205238  1673 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:25.188797  4677 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.207216  4677 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:25.136842  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:25.209050  1704 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:25.145344  1630 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:25.211148  4677 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:25.211926  1630 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:25.145470  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.146261  1628 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:25.204394  1559 rpcz_store.cc:276] 0709 13:00:23.377303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.385240 (+  7937us) service_pool.cc:224] Handling call
0709 13:00:23.385822 (+   582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.203541 (+1817719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.203827 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.214938  1628 raft_consensus.cc:1240] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:25.215217  1626 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:25.215736  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 587) took 1625 ms. Trace:
I20260709 13:00:25.150434  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 578) took 1697 ms. Trace:
I20260709 13:00:25.198920  1702 raft_consensus.cc:1813] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Handling vote request from an unknown peer 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:25.216804  1634 rpcz_store.cc:276] 0709 13:00:23.453418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.149206 (+1695788us) service_pool.cc:224] Handling call
0709 13:00:25.149634 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.149947 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.149983 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.150055 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:25.150102 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.150166 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.150305 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:25.218477  4759 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:00:25.152088  1553 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:25.142478  4655 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:25.233930  1635 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:25.157188  2324 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:25.148113  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:25.106693  1700 rpcz_store.cc:276] 0709 13:00:23.475051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.569839 (+ 94788us) service_pool.cc:224] Handling call
0709 13:00:23.597754 (+ 27915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.597988 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:23.973516 (+375528us) log.cc:844] Serialized 14 byte log entry
0709 13:00:25.105703 (+1132187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.105819 (+   116us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:25.105919 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.106018 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.106253 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15169,"prepare.queue_time_us":533778,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":20694,"thread_start_us":1323747,"threads_started":2,"wal-append.queue_time_us":978490}
I20260709 13:00:25.167404  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 577) took 1689 ms. Trace:
I20260709 13:00:25.236838  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 586) took 1657 ms. Trace:
I20260709 13:00:25.168684  1701 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
W20260709 13:00:25.139459  2323 rpcz_store.cc:269] 0709 13:00:22.405774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.406343 (+   569us) service_pool.cc:224] Handling call
0709 13:00:25.028003 (+2621660us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b5400566654. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:25.028541 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1794278656}
W20260709 13:00:25.142828  2320 rpcz_store.cc:269] 0709 13:00:22.376929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.378479 (+  1550us) service_pool.cc:224] Handling call
0709 13:00:22.950994 (+572515us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b5800003c98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 13:00:25.044211 (+2093217us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54004376d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:25.044479 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531445504}
I20260709 13:00:25.236232  1633 rpcz_store.cc:276] 0709 13:00:23.453150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.029308 (+1576158us) service_pool.cc:224] Handling call
0709 13:00:25.029836 (+   528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.142544 (+112708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.142784 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.043355  1708 rpcz_store.cc:276] 0709 13:00:23.467453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.467596 (+   143us) service_pool.cc:224] Handling call
0709 13:00:23.483556 (+ 15960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.483834 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:23.778745 (+294911us) log.cc:844] Serialized 14 byte log entry
0709 13:00:25.041547 (+1262802us) log.cc:844] Serialized 14 byte log entry
0709 13:00:25.042242 (+   695us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.042319 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:25.042490 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.042600 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.042822 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":492519,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":97,"raft.queue_time_us":399,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":294,"thread_start_us":1536540,"threads_started":2,"wal-append.queue_time_us":1077550}
W20260709 13:00:25.173560  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 1977) took 1803 ms (client timeout 1849 ms). Trace:
W20260709 13:00:25.174870  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 163711us
W20260709 13:00:25.175953  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 92945.7us
I20260709 13:00:25.176244  4535 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:25.176959  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:25.181252  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 91749.6us
I20260709 13:00:25.196357  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 585) took 1645 ms. Trace:
I20260709 13:00:25.245729  1627 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:25.246361  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:25.199527  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:25.200141  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:25.200558  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:25.219216  1672 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:25.217335  1702 raft_consensus.cc:2410] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:00:25.186333  1601 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:25.216135  1628 rpcz_store.cc:276] 0709 13:00:23.595948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.213771 (+1617823us) service_pool.cc:224] Handling call
0709 13:00:25.214343 (+   572us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:25.215408 (+  1065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.215606 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.219859  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:25.237398  1630 rpcz_store.cc:276] 0709 13:00:23.563161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.210467 (+1647306us) service_pool.cc:224] Handling call
0709 13:00:25.211391 (+   924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.212571 (+  1180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.220194 (+  7623us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.244830  4658 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:25.243129  1631 rpcz_store.cc:269] 0709 13:00:23.370018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.370121 (+   103us) service_pool.cc:224] Handling call
0709 13:00:25.173024 (+1802903us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400247054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:25.173331 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255299328}
I20260709 13:00:25.245406  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 579) took 1786 ms. Trace:
I20260709 13:00:25.246435  1632 rpcz_store.cc:276] 0709 13:00:23.551010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.195349 (+1644339us) service_pool.cc:224] Handling call
0709 13:00:25.195739 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.195959 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.195994 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.196066 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:25.196119 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.196196 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.196297 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.242148  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:25.253738  4539 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:25.250695  1635 rpcz_store.cc:276] 0709 13:00:23.453654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.182650 (+1728996us) service_pool.cc:224] Handling call
0709 13:00:25.183018 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.239696 (+ 56678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.239913 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.261302  4729 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.262141  4310 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:25.268862  1626 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:25.274401  1634 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:00:25.271186  1554 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:25.236259  4655 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.282665  1704 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:25.285995  2321 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.285742  1633 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 13:00:25.286015  2328 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:25.287277  4612 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.287864  4612 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:25.288861  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 106679us
I20260709 13:00:25.290829  1672 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:25.291571  1552 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:25.291988  4719 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:25.292891  4719 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.293363  4719 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.293363  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:25.296476  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:25.304531  4698 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:00:25.307673  4594 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:25.313130  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 266001us
I20260709 13:00:25.316423  4662 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.319253  4662 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:25.319679  4662 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:25.320165  1560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1917) took 2283 ms (client timeout 2606 ms). Trace:
W20260709 13:00:25.320749  1560 rpcz_store.cc:269] 0709 13:00:23.036266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.036426 (+   160us) service_pool.cc:224] Handling call
0709 13:00:25.319697 (+2283271us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54001171d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:25.319903 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376292224}
I20260709 13:00:25.322424  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:25.315990  1523 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:25.326326  4502 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:25.327032  4502 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:25.327222  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:25.327696  4502 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.327955  4702 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:25.328892  4623 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:25.339125  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 152977us
I20260709 13:00:25.340143  1601 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:25.341454  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:25.341861  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:25.316948  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:25.342818  4729 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.343819  1553 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:25.345499  4729 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:25.345721  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 583) took 1843 ms. Trace:
I20260709 13:00:25.346964  4746 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:25.347815  4746 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:25.274459  2286 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:25.349272  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 85972.3us
I20260709 13:00:25.346134  4729 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.296799  4571 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:25.359462  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:25.360256  4745 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.365345  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:25.346627  1629 rpcz_store.cc:276] 0709 13:00:23.502152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.195114 (+1692962us) service_pool.cc:224] Handling call
0709 13:00:25.235066 (+ 39952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.250333 (+ 15267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.250361 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.250405 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:25.250444 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.250511 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.345276 (+ 94765us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b5400125a50. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:25.345426 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57276672}
I20260709 13:00:25.372803  2324 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:00:25.376061  1673 leader_election.cc:336] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.866s (SENT)
I20260709 13:00:25.378515  2286 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:25.380873  4547 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:25.381466  4547 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:25.381974  4547 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.384459  4703 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:25.385013  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 101002us
I20260709 13:00:25.385172  4703 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.386590  4502 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.387091  4663 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:25.389464  4660 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:25.391062  4502 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:25.375735  4745 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.394316  4745 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.395058  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:25.396057  1708 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.402480  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:25.403529  1553 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:25.404693  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 53006.3us
I20260709 13:00:25.315644  4535 raft_consensus.cc:697] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:25.414431  1673 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:25.414510  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 63523.3us
I20260709 13:00:25.388195  4703 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:25.349272  4746 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.430176  1706 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.432471  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:25.438906  2323 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.456179  1704 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:25.443341  4684 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:25.497228  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.497056  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:25.443822  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:25.464560  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.499014  1559 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:25.477072  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:25.500370  1702 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:25.506039  1554 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:25.370590  4497 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.461257  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:25.471661  4612 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:25.515669  1709 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
I20260709 13:00:25.516016  1708 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:25.516503  1706 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
W20260709 13:00:25.473951  1526 connection.cc:256] RPC call timeout handler was delayed by -1.5313906640000141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 13:00:25.517709  1526 connection.cc:256] RPC call timeout handler was delayed by -1.5205906640000535s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
W20260709 13:00:25.518047  1526 connection.cc:256] RPC call timeout handler was delayed by -1.509790664000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 13:00:25.492484  1598 connection.cc:256] RPC call timeout handler was delayed by -1.0283245109999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
I20260709 13:00:25.514699  2325 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:25.518038  2321 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:25.481204  4684 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.529995  2329 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 6: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:25.492990  4561 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:25.530941  1523 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:24.213058   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:25.538982  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:25.458452  4310 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:25.540768  1526 connection.cc:256] RPC call timeout handler was delayed by -1.486390664000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 13:00:25.532810  4684 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.543823  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:25.493953  4633 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:25.551245  4647 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:25.551968  4647 raft_consensus.cc:697] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:25.553154  4647 consensus_queue.cc:237] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.555025  1555 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:25.555101  4745 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.555701  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 562) took 1344 ms. Trace:
I20260709 13:00:25.556051  1555 rpcz_store.cc:276] 0709 13:00:24.211093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.460809 (+1249716us) service_pool.cc:224] Handling call
0709 13:00:25.555637 (+ 94828us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.557355  1634 raft_consensus.cc:1275] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 2. (index mismatch)
I20260709 13:00:25.538314  2286 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:25.546422  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:25.561363  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:25.564394  1526 connection.cc:256] RPC call timeout handler was delayed by -1.4674906640000245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 13:00:25.546413  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 195030us
I20260709 13:00:25.570093  1553 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:25.571938  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.463938  4719 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:25.577930  1526 connection.cc:256] RPC call timeout handler was delayed by -1.4359906640000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260709 13:00:25.578632  1526 connection.cc:256] RPC call timeout handler was delayed by -1.4215906640000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
I20260709 13:00:25.574227  1554 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
W20260709 13:00:25.582877  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 54536.3us
W20260709 13:00:25.589340  1526 connection.cc:256] RPC call timeout handler was delayed by -1.4107906640000465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260709 13:00:25.589922  1526 connection.cc:256] RPC call timeout handler was delayed by -1.3747906640000451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 13:00:25.590319  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1272906640000429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 13:00:25.591621  1673 leader_election.cc:336] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.933s (SENT)
I20260709 13:00:25.592128  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:25.592170  1629 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:25.593570  1633 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:25.595264  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:25.595104  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:25.595613  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:25.596113  2328 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.591984  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:25.461195  4535 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.608026  1634 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.617237  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:25.618103  1706 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:25.620337  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:25.622540  4599 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:25.623556  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1074906640000108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
W20260709 13:00:25.624136  1526 connection.cc:256] RPC call timeout handler was delayed by -1.102090664000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
I20260709 13:00:25.625259  1526 leader_election.cc:400] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6.
I20260709 13:00:25.625545  1526 leader_election.cc:403] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:25.627290  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:25.628844  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:25.601055  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.697926  1631 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:25.612816  4310 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.628942  4502 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.629094  1454 catalog_manager.cc:5697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:25.630550  4719 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:25.631811  2329 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:25.634799  2325 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:25.634660  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.635388  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:25.708881  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:25.636857  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:25.608142  4547 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.637328  4628 consensus_queue.cc:1059] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:00:25.637629  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:25.592000  4757 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:00:25.603719  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:25.560256  4662 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.627856  4655 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.644070  1672 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:25.646028  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:25.643436  2286 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:25.649104  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.723999  1630 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:25.651548  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:25.653585  4736 raft_consensus.cc:3055] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:25.654093  4497 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:25.654996  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 69361.1us
I20260709 13:00:25.661583  4633 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.662338  1549 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c1e1be9de68405393292149e41c0724 with delete_type TABLET_DATA_TOMBSTONED (TS e4c78b411eb34b3d92183a86d34a81f1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:47896
I20260709 13:00:25.663410  1704 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:25.604099  4658 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:25.665284  1700 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:00:25.732260  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 88908.8us
I20260709 13:00:25.666046  4623 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:25.740973  4655 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:25.668851  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:25.740600  1454 catalog_manager.cc:5697] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:25.742332  1701 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:25.646601  4680 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6.
I20260709 13:00:25.725749  4736 raft_consensus.cc:740] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:25.743912  4662 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:25.744206  1454 catalog_manager.cc:5697] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:25.745031  4736 consensus_queue.cc:260] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:25.745986  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:25.746469  4736 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.746645  1559 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.748898  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.749884  1630 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:25.751016  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:25.751912  4633 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.672389  4561 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.753320  4561 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:25.753979  1554 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:25.754514  4633 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:25.755635  4561 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:25.672878  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.676090  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:25.676818  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 104547us
I20260709 13:00:25.756450  1628 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:25.757669  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.758816  4547 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:25.757615  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.759286  1598 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:25.681288  4745 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:25.681669  4635 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:25.693014  1634 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:25.790113  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:25.698734  2328 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:25.680974  4703 raft_consensus.cc:2955] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:25.790740  1634 raft_consensus.cc:2376] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6. Re-sending same reply.
I20260709 13:00:25.717177  1635 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:25.717474  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:25.723109  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.725422  2327 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:25.722151  1629 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
W20260709 13:00:25.742245  4763 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.222s	user 0.000s	sys 0.004s
I20260709 13:00:25.729038  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:25.725771  4502 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:25.737202  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.797380  2325 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.737893  1557 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:00:25.738042  1673 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.935s (SENT) [suppressed 29 similar messages]
I20260709 13:00:25.738292  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:25.798552  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 60535.3us
I20260709 13:00:25.738574  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:25.677680  2323 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:25.799212  1554 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:25.760860  1628 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:00:25.738919  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.671816  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:25.800518  1551 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:25.751543  4684 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:25.762629  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 123300us
I20260709 13:00:25.765319  1706 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:00:25.765861  4628 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.767948  4663 raft_consensus.cc:2764] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:00:25.742162  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.772254  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.726956  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:25.794934  2324 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:25.797289  1709 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:25.798808  1704 raft_consensus.cc:2410] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 9 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:00:25.738888  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.801178  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.737248  1555 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:25.805480  2329 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:25.807412  1598 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:25.802325  4502 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:25.819864  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.820154  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:25.792750  1454 catalog_manager.cc:5697] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:25.827538  1629 raft_consensus.cc:2393] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:25.820226  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:25.832506  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 203783us
I20260709 13:00:25.773846  4658 raft_consensus.cc:697] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:00:25.803012  4397 consensus_meta.cc:287] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.731s	user 0.011s	sys 0.007s
I20260709 13:00:25.840626  2326 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:25.842130  2328 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:25.848999  1454 catalog_manager.cc:5697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:25.828940  4633 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:25.853053  1673 leader_election.cc:336] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.136s (SENT)
W20260709 13:00:25.853713  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 46401.3us
I20260709 13:00:25.829139  4502 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:25.859896  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:25.872394  1673 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:25.875427  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 43604.4us
I20260709 13:00:25.887620  1675 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:25.882853  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:25.891032  1701 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:25.838150  4628 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:25.893935  1454 catalog_manager.cc:5697] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 4 to 7, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:25.895532  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 434756us
I20260709 13:00:25.849234  4310 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.839365  4655 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 13:00:25.896160  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.838021  4746 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:00:25.846858  4662 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:00:25.900177  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:25.927999  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:25.918934  1635 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:25.936017  1551 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:25.927572  2329 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:00:25.947296  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 94277.7us
W20260709 13:00:25.954689  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44604.5us
I20260709 13:00:25.900102  1553 raft_consensus.cc:2955] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:25.899161  4660 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.931044  4719 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.946449  4633 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:26.007822  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 46061.9us
W20260709 13:00:25.999934  1455 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41160 (request call id 296) took 19449 ms (client timeout 15000 ms). Trace:
I20260709 13:00:25.950663  1454 catalog_manager.cc:5697] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 1 to 4, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:26.033349  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 132936us
I20260709 13:00:25.879405  4663 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 13:00:25.956128  4725 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:26.044723  1598 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:25.999759  4719 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:26.069170  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 198052us
I20260709 13:00:26.005760  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:26.075856  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 237264us
I20260709 13:00:26.082051  1598 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:26.052683  4725 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.068930  4513 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.095603  1454 catalog_manager.cc:5697] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 1 to 4, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:26.097327  4765 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.426s	user 0.005s	sys 0.002s
I20260709 13:00:26.097582  4513 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:26.098186  4611 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.099047  4684 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:26.098875  4611 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:26.099751  4661 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.101678  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 706) took 1086 ms. Trace:
I20260709 13:00:26.102344  2322 rpcz_store.cc:276] 0709 13:00:25.015590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.020833 (+  5243us) service_pool.cc:224] Handling call
0709 13:00:25.021601 (+   768us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:25.217070 (+195469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.217104 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:25.217970 (+   866us) log.cc:844] Serialized 52 byte log entry
0709 13:00:25.422601 (+204631us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:25.428572 (+  5971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.440332 (+ 11760us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.938131 (+497799us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:26.100950 (+162819us) raft_consensus.cc:1685] finished
0709 13:00:26.101154 (+   204us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.101579 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56489,"raft.queue_time_us":85430,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":25698560,"thread_start_us":191344,"threads_started":1,"wal-append.queue_time_us":452613}
I20260709 13:00:26.106902  4611 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:26.107226  1673 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:26.107764  4611 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.108842  4781 tablet_replica.cc:333] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:00:26.108624  4611 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:26.101269  4502 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.069401  4719 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.061666  4670 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.124876  1526 leader_election.cc:400] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5.
I20260709 13:00:26.125201  4670 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:26.126528  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:26.115670  2288 connection.cc:256] RPC call timeout handler was delayed by -1.4192741189999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 13:00:26.128377  2288 connection.cc:256] RPC call timeout handler was delayed by -1.0075797939999802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
I20260709 13:00:26.099020  1454 catalog_manager.cc:5697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 2 to 3, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.005355  4310 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.121336  4660 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:26.122735  4702 raft_consensus.cc:3055] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:26.104104  4612 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:00:26.020910  4658 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.111416  4725 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:26.141479  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 281738us
W20260709 13:00:26.197182  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.111618  4397 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:00:26.136085  4702 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:26.204859  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 97725.3us
I20260709 13:00:26.232836  1526 leader_election.cc:400] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6.
I20260709 13:00:26.233577  1526 leader_election.cc:403] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:26.152225  1599 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:26.207049  4558 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:26.209232  4628 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:26.210057  4310 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:26.209846  1454 catalog_manager.cc:5697] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 2 to 5, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.216032  4663 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.217900  4502 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:26.218827  1558 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:26.218112  4787 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:26.220422  1632 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
W20260709 13:00:26.221339  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 83522.9us
I20260709 13:00:26.222651  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:26.223704  4397 consensus_queue.cc:1243] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:26.250053  4702 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.203806  4611 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:26.285142  4698 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:26.017078  1455 rpcz_store.cc:269] 0709 13:00:06.280749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.284743 (+  3994us) service_pool.cc:224] Handling call
0709 13:00:25.724435 (+19439692us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:17.855003 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:18.305705 (+450702us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:18.305759 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:00:18.305795 (+    36us) tablet.cc:662] Decoding operations
0709 13:00:18.356506 (+ 50711us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:18.411177 (+ 54671us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:18.413101 (+  1924us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:00:18.552330 (+139229us) tablet.cc:701] Row locks acquired
0709 13:00:18.552462 (+   132us) write_op.cc:260] PREPARE: finished
0709 13:00:18.552796 (+   334us) write_op.cc:270] Start()
0709 13:00:18.552997 (+   201us) write_op.cc:276] Timestamp: P: 1783602018552690 usec, L: 0
0709 13:00:18.553022 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:00:18.553905 (+   883us) log.cc:844] Serialized 7089 byte log entry
0709 13:00:18.692841 (+138936us) op_driver.cc:464] REPLICATION: finished
0709 13:00:18.773034 (+ 80193us) write_op.cc:301] APPLY: starting
0709 13:00:18.773162 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:18.773644 (+   482us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:18.776864 (+  3220us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:18.857044 (+ 80180us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:18.857477 (+   433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:00:18.857545 (+    68us) write_op.cc:312] APPLY: finished
0709 13:00:18.858082 (+   537us) log.cc:844] Serialized 125 byte log entry
0709 13:00:18.858302 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:18.858459 (+   157us) write_op.cc:454] Released schema lock
0709 13:00:18.858536 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:18.859063 (+   527us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:18.859096 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43667,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":79795,"apply.run_cpu_time_us":6883,"apply.run_wall_time_us":86010,"num_ops":18,"prepare.queue_time_us":819100,"prepare.run_cpu_time_us":24827,"prepare.run_wall_time_us":785353,"raft.queue_time_us":97213,"raft.run_cpu_time_us":5343,"raft.run_wall_time_us":34150,"replication_time_us":139660,"spinlock_wait_cycles":58368,"thread_start_us":608540,"threads_started":4,"wal-append.queue_time_us":28631,"wal-append.run_cpu_time_us":19427,"wal-append.run_wall_time_us":1311084}]]}
W20260709 13:00:26.257462  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 90183.7us
I20260709 13:00:26.307422  1526 leader_election.cc:400] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5.
I20260709 13:00:26.307802  1526 leader_election.cc:403] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:00:26.258090  4685 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6.
I20260709 13:00:26.258468  4661 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:26.260895  1559 consensus_meta.cc:287] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.002s
I20260709 13:00:26.309155  1559 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:26.286677  4310 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:26.265434  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 113399us
I20260709 13:00:26.267349  2325 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
W20260709 13:00:26.288511  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 183056us
I20260709 13:00:26.268162  4680 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:26.301139  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2483) took 1259 ms. Trace:
I20260709 13:00:26.266505  4558 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:26.255242  1673 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:26.265329  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.306260  1454 catalog_manager.cc:5697] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 3 to 7, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.283847  4719 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:26.319895  1627 rpcz_store.cc:276] 0709 13:00:25.028553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.252003 (+223450us) service_pool.cc:224] Handling call
0709 13:00:25.294809 (+ 42806us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:25.313837 (+ 19028us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:25.428876 (+115039us) log.cc:844] Serialized 14 byte log entry
0709 13:00:26.014423 (+585547us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:26.051956 (+ 37533us) log.cc:844] Serialized 52 byte log entry
0709 13:00:26.052179 (+   223us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:26.073125 (+ 20946us) log.cc:844] Serialized 14 byte log entry
0709 13:00:26.090981 (+ 17856us) log.cc:844] Serialized 14 byte log entry
0709 13:00:26.214941 (+123960us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b180020a2e0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:00:26.275140 (+ 60199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.287992 (+ 12852us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:26.288055 (+    63us) raft_consensus.cc:1685] finished
0709 13:00:26.288073 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.288228 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93928,"prepare.queue_time_us":398817,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":103,"raft.queue_time_us":137867,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":46345,"spinlock_wait_cycles":20705920,"thread_start_us":729601,"threads_started":3,"wal-append.queue_time_us":621533}
W20260709 13:00:26.326278  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 244271us
I20260709 13:00:26.302738  4787 raft_consensus.cc:697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:26.325701  1454 catalog_manager.cc:5697] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 2 to 4, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.306581  4698 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.333535  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:26.301880  2322 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:26.286918  4663 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:26.344920  2329 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:26.344321  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:26.346119  2324 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:26.347077  4787 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:26.355703  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.354882  2321 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:00:26.355098  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 100106us
I20260709 13:00:26.315847  4611 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5.
W20260709 13:00:26.357702  4780 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.095s	user 0.004s	sys 0.000s
I20260709 13:00:26.354439  4661 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:26.358946  4661 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:26.359401  4661 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:26.359594  2326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 713) took 1161 ms (client timeout 1540 ms). Trace:
W20260709 13:00:26.356562  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49327.1us
I20260709 13:00:26.326632  4558 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:26.360039  2326 rpcz_store.cc:269] 0709 13:00:25.197844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.200275 (+  2431us) service_pool.cc:224] Handling call
0709 13:00:26.359397 (+1159122us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54006446d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:26.359508 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363012352}
I20260709 13:00:26.339924  4702 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:26.371675  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.372536  2286 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:26.372424  4599 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:26.378443  4680 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:26.403389  4680 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.403220  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:26.406380  1553 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.409160  4591 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:26.409718  4591 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:26.410925  4591 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.412067  4591 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.414284  1601 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:26.382357  4513 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:26.393513  4782 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
I20260709 13:00:26.351123  4698 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:26.415217  4783 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:00:26.398787  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:26.417270  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:26.417747  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.418622  4784 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:00:26.420843  4722 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:26.421500  4670 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:26.421521  4722 raft_consensus.cc:697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:26.401527  4397 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:26.426402  1553 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:26.404247  4736 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:26.380856  1454 catalog_manager.cc:5697] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 3 to 5, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:26.422981  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 71841us
W20260709 13:00:26.401340  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 84588.2us
I20260709 13:00:26.434749  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:26.379513  4633 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:26.328806  4310 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.403218  1523 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:26.423547  1673 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:26.434831  1454 catalog_manager.cc:5697] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 4 to 5, term changed from 2 to 6, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196), VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New cstate: current_term: 6 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:26.450285  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 47155.9us
I20260709 13:00:26.453509  1557 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:26.456856  4611 consensus_queue.cc:1059] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:26.457592  4781 raft_consensus.cc:2243] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.457906  4611 raft_consensus.cc:3055] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:26.458390  4611 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:26.458585  4781 raft_consensus.cc:2272] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.459240  4611 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:26.461138  4502 consensus_queue.cc:1059] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:26.462061  4502 raft_consensus.cc:3055] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:26.462445  4502 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:26.463110  4685 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:26.463629  4685 raft_consensus.cc:697] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:26.464917  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:26.465598  4791 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:26.467742  2286 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:26.472996  4647 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:26.473836  4599 consensus_queue.cc:1059] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:00:26.474845  4772 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.223s	user 0.004s	sys 0.000s
I20260709 13:00:26.474989  4599 raft_consensus.cc:3055] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:26.475487  4599 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:26.464511  4685 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.477591  4663 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:26.480801  1454 catalog_manager.cc:5697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 1 to 3, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.483158  2288 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:26.483917  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:26.484838  4684 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:26.449193  4670 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:26.485702  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49847.7us
I20260709 13:00:26.489511  4535 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:26.482666  1454 catalog_manager.cc:5697] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 3 to 5, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.423970  4725 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.421109  4661 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.435456  4736 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:26.554140  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 66593.9us
W20260709 13:00:26.556396  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 132908us
I20260709 13:00:26.557672  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:26.476330  4599 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:26.559166  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 74699.1us
I20260709 13:00:26.559520  4599 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.560364  4725 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:26.560855  4781 ts_tablet_manager.cc:1916] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:26.561264  2320 raft_consensus.cc:2368] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7.
I20260709 13:00:26.554209  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:26.570593  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 93145.1us
W20260709 13:00:26.572177  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 82845.3us
I20260709 13:00:26.516312  4611 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.582952  4647 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:00:26.591159  4698 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:26.594310  4698 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:26.594751  4661 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:26.591308  4558 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.596289  1558 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:26.597877  4558 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:26.595592  4535 raft_consensus.cc:697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:00:26.604650  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44679.3us
I20260709 13:00:26.609105  4591 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:26.621044  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:26.621821  1558 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:26.629565  4310 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:26.612125  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:26.630235  4502 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.633186  4502 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:26.613106  4703 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 13:00:26.587970  4722 consensus_queue.cc:237] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:26.640048  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.616547  4670 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:26.645680  4736 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.647432  4736 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:26.648985  4781 ts_tablet_manager.cc:1929] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:26.564254  4680 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.629809  1558 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:26.609818  4535 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.658619  1454 catalog_manager.cc:5697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 1 to 4, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.663937  4684 consensus_queue.cc:1059] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:26.662770  2286 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:26.683323  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 121486us
I20260709 13:00:26.684159  1454 catalog_manager.cc:5697] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:26.687223  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 87813.6us
I20260709 13:00:26.696853  4795 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:26.697176  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 139583us
I20260709 13:00:26.697755  4795 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:26.699229  4795 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.700754  4662 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.701390  4662 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.702584  4680 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:26.703451  4658 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:26.703787  4662 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:26.704499  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.704880  4655 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:26.705842  4655 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.708150  4655 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:26.708806  4791 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:26.704804  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 239978us
W20260709 13:00:26.713183  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 141295us
I20260709 13:00:26.663631  4781 log.cc:1199] T 5c1e1be9de68405393292149e41c0724 P e4c78b411eb34b3d92183a86d34a81f1: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-0-root/wals/5c1e1be9de68405393292149e41c0724
I20260709 13:00:26.717697  4781 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47896 (request call id 84) took 1056 ms. Trace:
I20260709 13:00:26.718422  4781 rpcz_store.cc:276] 0709 13:00:25.661790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.662054 (+   264us) service_pool.cc:224] Handling call
0709 13:00:26.108040 (+445986us) ts_tablet_manager.cc:1151] Deleting tablet 5c1e1be9de68405393292149e41c0724
0709 13:00:26.108151 (+   111us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:00:26.612758 (+504607us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:26.648836 (+ 36078us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:26.717594 (+ 68758us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":339465,"tablet-delete.queue_time_us":360135,"thread_start_us":293436,"threads_started":1}
I20260709 13:00:26.682142  4661 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:26.725147  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 171018us
I20260709 13:00:26.720479  1443 catalog_manager.cc:5028] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): tablet 5c1e1be9de68405393292149e41c0724 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 13:00:26.727531  1672 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:26.683109  4591 consensus_queue.cc:1059] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:00:26.734731  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:26.746529  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.704553  4662 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:26.682145  4746 consensus_queue.cc:1059] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:00:26.726536  4658 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:26.752410  1672 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:26.761129  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:26.766108  1557 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:26.727919  4599 consensus_queue.cc:1059] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:00:26.769980  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:26.770669  1560 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:26.756518  4655 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:26.727006  4513 consensus_queue.cc:1059] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:00:26.767967  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:26.774183  1556 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
W20260709 13:00:26.777601  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 88815.8us
I20260709 13:00:26.785564  1672 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:26.727519  4791 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:00:26.737691  4661 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.741572  4660 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:00:26.806656  4571 raft_consensus.cc:3055] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:26.807205  4571 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:26.791399  4663 raft_consensus.cc:2764] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:26.788544  4655 raft_consensus.cc:697] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:00:26.817344  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 131354us
W20260709 13:00:26.818020  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 81891us
I20260709 13:00:26.803434  4591 raft_consensus.cc:3055] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:26.764776  4662 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.797475  4623 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.795576  4703 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:26.826581  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.777825  4628 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:00:26.809103  4719 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:26.845371  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 67038.6us
I20260709 13:00:26.810561  4790 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:26.837157  4661 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:26.867061  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 53108.5us
I20260709 13:00:26.828025  4591 raft_consensus.cc:740] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:26.878162  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:26.879993  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1665439410000431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25680000000000003s for a response
I20260709 13:00:26.851783  4790 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:26.889708  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 44598.2us
I20260709 13:00:26.890920  1601 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:26.868894  4684 raft_consensus.cc:3055] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:26.873047  4670 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:26.898273  4787 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:00:26.905468  4591 consensus_queue.cc:260] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.907343  4809 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:00:26.907974  4397 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:26.913996  4662 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:26.916821  4805 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:00:26.916707  4810 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:26.919706  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.978384  1599 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:26.921106  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 43858.5us
I20260709 13:00:26.895363  4790 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:26.922307  4802 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:26.848376  4623 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:26.880206  4719 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.851677  4703 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.871553  4658 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:26.936169  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:26.810387  4571 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:27.013144  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:27.019272  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 83177.9us
I20260709 13:00:27.021026  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:26.958045  1560 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:26.969558  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:26.971443  2322 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:26.975047  4397 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.967733  4655 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:27.023892  1704 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:26.975479  4591 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.975066  4624 raft_consensus.cc:3055] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:26.986409  4746 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.037189  1703 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 7: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:26.975661  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:26.981307  1705 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:26.988971  4788 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:26.989220  1599 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:26.955991  4684 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:00:26.996943  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 211467us
W20260709 13:00:27.010828  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.030520  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:27.034981  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.970192  4670 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:27.044348  1556 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:27.041072  1700 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
W20260709 13:00:27.063802  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 201306us
I20260709 13:00:27.023828  4736 raft_consensus.cc:3055] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:27.013327  4685 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:27.073732  1703 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:27.084913  1708 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 3.
I20260709 13:00:27.030347  4397 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:27.033003  4812 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:27.086661  1672 leader_election.cc:400] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7.
I20260709 13:00:27.102984  1672 leader_election.cc:403] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:00:27.037726  4796 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:27.036887  4624 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:27.052994  4788 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.122960  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:27.085616  4771 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:00:27.105286  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:27.048038  4787 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:00:27.013624  4719 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:27.129215  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 140073us
W20260709 13:00:27.102514  4811 log.cc:927] Time spent T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:00:26.994895  4810 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:27.127049  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 68516.8us
I20260709 13:00:27.149454  1708 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:27.043521  4809 consensus_queue.cc:1059] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:00:27.071693  4736 raft_consensus.cc:740] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:27.053361  4746 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:27.159279  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:27.128345  4788 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:27.161904  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 119293us
I20260709 13:00:27.168700  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:27.167956  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:27.161337  1599 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:27.121924  4786 consensus_queue.cc:1059] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260709 13:00:27.139098  4795 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:27.137048  4819 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:27.181068  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:27.183387  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:27.211156  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:27.175192  4663 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:27.222045  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.222759  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:27.232839  1704 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:27.182469  4680 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:27.182049  4791 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:27.230629  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:27.273962  1705 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:27.231019  1703 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:27.238895  4810 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:27.239617  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:27.240267  4624 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:27.243407  4623 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:27.245826  4736 consensus_queue.cc:260] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:27.244657  4663 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:27.249413  2324 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:00:27.253566  4804 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:00:27.255059  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 74219.4us
W20260709 13:00:27.256726  4816 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:00:27.182304  4795 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:27.261797  1673 leader_election.cc:336] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.568s (SENT)
I20260709 13:00:27.352830  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:27.230090  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:27.340487  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 289323us
I20260709 13:00:27.229966  4655 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:27.210758  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:27.354617  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 249378us
W20260709 13:00:27.348685  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.272794  4812 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:27.261941  4680 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:27.372090  1556 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:00:27.372666  1556 pending_rounds.cc:85] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 6
I20260709 13:00:27.372959  1556 pending_rounds.cc:107] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:27.373243  1556 raft_consensus.cc:2889] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:27.367166  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:27.367915  1704 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:27.357853  4810 raft_consensus.cc:3055] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:27.167616  4684 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:27.379493  2288 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:27.379706  4810 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:27.385435  4810 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:27.387296  4810 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:27.381695  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 202002us
I20260709 13:00:27.355361  4719 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:27.355791  4795 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:27.414306  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:27.415181  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 153385us
I20260709 13:00:27.420081  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:27.433523  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 66465.7us
I20260709 13:00:27.379070  4680 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:27.437705  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:27.431986  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:27.354691  4655 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:27.434645  1675 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:27.420455  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.369627  4662 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:27.339692  4791 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:27.449872  1673 leader_election.cc:336] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.644s (SENT)
I20260709 13:00:27.437546  4812 raft_consensus.cc:697] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:27.451624  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.388936  4661 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:27.437201  2320 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:27.464713  1557 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:27.408986  4310 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:27.484838  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:27.485148  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.435599  4809 raft_consensus.cc:2764] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:27.489464  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:27.492810  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:27.442237  4624 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:27.458864  4655 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:27.458638  4719 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:27.573107  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 854) took 1123 ms. Trace:
I20260709 13:00:27.592787  2322 rpcz_store.cc:276] 0709 13:00:26.450012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.455819 (+  5807us) service_pool.cc:224] Handling call
0709 13:00:27.572949 (+1117130us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54005d0a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:27.573048 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465600768}
W20260709 13:00:27.573730  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 179435us
W20260709 13:00:27.574232  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 139814us
W20260709 13:00:27.575052  4820 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:00:27.575500  4834 raft_consensus.cc:2764] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:27.575933  4829 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:27.576363  4789 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:00:27.576694  4832 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.577270  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:27.578052  4824 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.578572  4797 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:27.579800  4848 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:00:27.580646  1632 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:27.581269  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:27.588567  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:27.687034  4857 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:27.738735  4698 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:27.741955  4591 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.695s	user 0.008s	sys 0.003s
I20260709 13:00:27.675314  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:27.696189  4663 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:27.481739  4662 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:27.409353  4830 consensus_queue.cc:1059] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.185s
I20260709 13:00:27.686462  4670 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:27.686163  4791 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:27.743448  4786 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:27.666137  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.672211  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:27.870451  1628 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:27.740432  4746 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:27.674934  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:27.664788  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 69441.7us
I20260709 13:00:27.687640  4719 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:00:27.665848  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 70247.3us
I20260709 13:00:27.687244  4310 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:27.712005  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.566038  4661 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:27.776366  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2253) took 1022 ms. Trace:
W20260709 13:00:27.609006  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:27.816370  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.839277  1558 raft_consensus.cc:2410] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 8 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:00:27.826098  4790 consensus_meta.cc:287] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.835s	user 0.006s	sys 0.008s
I20260709 13:00:27.796715  4829 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.846292  4741 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:27.874248  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 102062us
I20260709 13:00:27.963332  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:27.965425  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:27.969475  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:27.969832  4310 raft_consensus.cc:697] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:27.970655  1630 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:27.971329  4310 consensus_queue.cc:237] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:27.972101  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:27.972980  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 523057us
W20260709 13:00:27.922614  4788 consensus_meta.cc:287] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.736s	user 0.010s	sys 0.003s
I20260709 13:00:27.914055  1675 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:27.976424  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 303576us
I20260709 13:00:27.966763  1554 rpcz_store.cc:276] 0709 13:00:26.754388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.762388 (+  8000us) service_pool.cc:224] Handling call
0709 13:00:26.784890 (+ 22502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.785232 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.785272 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:26.800720 (+ 15448us) log.cc:844] Serialized 26 byte log entry
0709 13:00:27.123929 (+323209us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:27.123983 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.124053 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:27.776016 (+651963us) raft_consensus.cc:1685] finished
0709 13:00:27.776048 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.776274 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99454,"raft.queue_time_us":2588,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":6599,"thread_start_us":284551,"threads_started":1,"wal-append.queue_time_us":594272}
I20260709 13:00:27.931918  4746 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:27.981398  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:27.981954  4746 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:27.921737  4670 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:27.940968  4848 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:00:27.840730  4832 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:27.989241  4833 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:27.990227  1523 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:27.991245  4746 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:27.992057  1673 leader_election.cc:336] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.887s (SENT)
I20260709 13:00:27.993619  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.002159  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:28.003815  1601 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:27.839941  4812 consensus_queue.cc:237] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:27.999060  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 85328.8us
I20260709 13:00:27.862566  4843 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:27.910881  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 188282us
I20260709 13:00:27.845690  4797 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:27.932009  4821 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 13:00:27.921100  4611 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.861845  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:27.908195  4834 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:27.984855  4829 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.014886  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:28.035102  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.007416  1599 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:27.856057  4824 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:27.858794  4698 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:27.985468  4809 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.870980  4680 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:28.059224  4680 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:28.060137  4856 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:00:28.016078  2325 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:27.856467  4857 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:28.029057  4851 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:28.047962  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.062774  4851 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:28.047925  2320 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:28.063257  4851 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:28.048216  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2252) took 1294 ms. Trace:
I20260709 13:00:28.056718  4809 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:27.993718  4788 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:28.047019  4801 raft_consensus.cc:2764] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:00:28.064071  1559 rpcz_store.cc:276] 0709 13:00:26.754035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.762478 (+  8443us) service_pool.cc:224] Handling call
0709 13:00:26.784574 (+ 22096us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.786453 (+  1879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.786492 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:26.787050 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:00:27.151698 (+364648us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:27.151732 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.151795 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.047976 (+896181us) raft_consensus.cc:1685] finished
0709 13:00:28.048007 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.048152 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":337443,"threads_started":1,"wal-append.queue_time_us":642043}
I20260709 13:00:27.983907  4670 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:28.047019  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 54969.1us
I20260709 13:00:28.067284  4832 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.067906  4670 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:28.058892  4719 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:28.062996  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.076761  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 69425.3us
I20260709 13:00:28.076992  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.077653  1627 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:28.077726  1632 raft_consensus.cc:1240] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:28.066036  4809 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:28.062304  4698 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.060047  4680 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:28.033560  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:28.052217  1630 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:28.007913  4796 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.994081  4790 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:28.081563  4397 consensus_meta.cc:287] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.957s	user 0.007s	sys 0.008s
W20260709 13:00:28.083772  4795 consensus_meta.cc:287] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.627s	user 0.005s	sys 0.006s
I20260709 13:00:28.066039  4788 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:28.116483  1626 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:28.117581  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:28.081777  4864 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:28.121286  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:28.129933  1707 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:28.020331  4843 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.109305  4796 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.133077  2288 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:28.133515  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:28.134195  1706 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:28.134310  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:28.054147  4611 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.123073  4397 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:28.136554  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 155519us
I20260709 13:00:28.137137  4397 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:28.137362  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:28.140873  4834 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:28.137380  4591 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:28.141501  4834 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:28.141855  4591 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:28.142536  4834 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:28.114444  4852 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.146152  4736 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:28.147454  4819 consensus_meta.cc:287] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.930s	user 0.009s	sys 0.002s
I20260709 13:00:28.147965  4819 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7.
I20260709 13:00:28.145818  4852 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.148766  4698 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.148924  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 56773.1us
I20260709 13:00:28.149305  4698 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.150700  4852 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.137174  4611 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.151576  4698 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.151700  4611 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:28.155510  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:28.156232  2320 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:28.156997  4851 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:28.113135  4623 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:28.159143  4623 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.159598  4623 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:28.159649  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:28.160717  4797 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.134794  4796 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.162045  1709 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:28.166121  1628 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:28.162976  1703 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
W20260709 13:00:28.167699  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 178532us
W20260709 13:00:28.174153  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.176687  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.178417  1628 raft_consensus.cc:2410] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:28.159214  4851 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:28.128731  4795 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:28.181947  4795 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:28.163571  4680 raft_consensus.cc:697] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:28.169965  4846 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:28.183431  4680 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:28.184875  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 44343.9us
I20260709 13:00:28.185899  1526 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:28.186514  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:28.187868  4571 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.189144  1634 raft_consensus.cc:2393] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:28.190954  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.191308  1708 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:28.191883  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:28.192400  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:28.193048  1708 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
I20260709 13:00:28.125978  4310 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.186923  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:28.196130  4310 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.196502  1702 raft_consensus.cc:2376] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8. Re-sending same reply.
I20260709 13:00:28.186857  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.198331  1629 raft_consensus.cc:2410] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:00:28.199652  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.195659  4829 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.203735  4829 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:28.204259  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:28.205246  1559 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:28.130511  4809 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:00:28.134399  4843 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.167655  4513 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.208086  4513 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.210325  4513 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.211155  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.212006  1627 raft_consensus.cc:2410] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:28.212908  1634 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:28.214006  1557 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:28.214766  1634 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:28.186602  1701 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:28.188241  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:28.217587  1705 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:28.219561  1629 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 4: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:28.225049  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:28.226487  1706 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:28.228055  1631 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:28.175866  4796 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.231251  4796 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.178527  4797 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.247210  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.248085  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 62289.8us
I20260709 13:00:28.251441  1630 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:28.253712  1558 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:28.253938  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:28.254312  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2239) took 1061 ms. Trace:
I20260709 13:00:28.254674  1559 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:28.254765  4867 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:28.256071  1672 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:28.257087  4851 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:28.241880  4801 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:28.257825  2288 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:28.260622  4662 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:28.256378  4624 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:00:28.267197  1557 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:28.268712  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:28.270885  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:28.273592  1709 rpcz_store.cc:276] 0709 13:00:27.192550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.192937 (+   387us) service_pool.cc:224] Handling call
0709 13:00:27.230132 (+ 37195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.168402 (+938270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.254087 (+ 85685us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54002cc254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:28.254250 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142587392}
I20260709 13:00:28.328509  1704 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
W20260709 13:00:28.276770  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.288177  1556 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:28.277287  2286 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:28.318554  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 62554.6us
I20260709 13:00:28.332026  1672 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:28.320287  1701 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:28.229233  4663 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:28.315245  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 311468us
I20260709 13:00:28.236363  4824 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:28.339277  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:28.343268  1675 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:28.352902  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 77856.9us
I20260709 13:00:28.227873  4310 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.288309  4833 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.365698  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:28.372964  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 115192us
I20260709 13:00:28.373622  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:28.374622  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:28.334110  4624 consensus_queue.cc:1243] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer 8106dfc0bda54df0ae10ba13c28ccc18 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:00:28.376572  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 44667.6us
I20260709 13:00:28.334333  4819 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:28.328497  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:28.384166  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:28.363862  4801 raft_consensus.cc:697] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:28.361483  4591 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:28.387234  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:28.393819  1552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.000s	sys 0.022s
I20260709 13:00:28.383100  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:28.388079  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 117305us
I20260709 13:00:28.394714  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:28.364135  4852 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:28.364517  4830 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:28.366807  4703 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.392740  2326 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:28.327497  4867 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:28.287597  4797 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.398444  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:28.393134  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:28.389060  4819 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:28.400233  1552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.000s	sys 0.022s
I20260709 13:00:28.367198  4809 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:00:28.388737  4719 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:28.412456  2324 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 7: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:28.412606  2325 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:28.363093  4663 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:28.457584  4867 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:28.397615  4852 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.416549  2323 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:28.393360  4611 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:28.404567  4655 consensus_meta.cc:287] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.002s
I20260709 13:00:28.444877  4719 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.397471  4830 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.458387  4513 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.454509  4819 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:28.467913  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2261) took 1231 ms. Trace:
I20260709 13:00:28.461351  4860 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:28.397696  2320 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:28.472213  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:28.470288  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:28.376317  4833 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.492379  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.492693  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:28.438171  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:28.494144  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.397106  4535 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:00:28.498811  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:28.449973  1598 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:28.470588  4852 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:28.460888  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.546051  1628 raft_consensus.cc:2410] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:28.498941  4830 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:28.517122  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:28.549746  1703 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:28.521335  4796 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.521930  4684 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:28.527724  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:28.553438  1707 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:28.536504   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:28.411466  4846 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:00:28.539628  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:28.471599  4663 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:28.544235  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 94364us
I20260709 13:00:28.492115  4851 consensus_queue.cc:1059] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:00:28.476337  4853 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:28.461066  4870 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:28.597538  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:28.495759  4611 raft_consensus.cc:697] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:28.612915  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:28.612450  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:28.499954  4741 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.552065  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 176830us
I20260709 13:00:28.511911  1552 rpcz_store.cc:276] 0709 13:00:27.264639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.328831 (+ 64192us) service_pool.cc:224] Handling call
0709 13:00:27.329222 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.329503 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:27.370804 (+ 41301us) log.cc:844] Serialized 14 byte log entry
0709 13:00:27.746217 (+375413us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b1800402ac0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed962523a 00007f0ed9a8fa2a
0709 13:00:28.467598 (+721381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:28.467651 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:28.467697 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.467757 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.467858 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32354,"prepare.queue_time_us":39722,"prepare.run_cpu_time_us":214,"prepare.run_wall_time_us":215,"raft.queue_time_us":28837,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":21121,"spinlock_wait_cycles":18948480,"thread_start_us":692410,"threads_started":1}
I20260709 13:00:28.530696  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:28.618016  2322 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:28.555366  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.539916  4790 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.514578  4513 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:28.513083  4869 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:28.563548  1598 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:28.492440  4719 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.568513  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:28.498688  4871 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:00:28.496282  4655 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.550781  4814 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:28.539829  4860 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.563370  4591 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:00:28.627179  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.626736  4835 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.249s
I20260709 13:00:28.598570  4703 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.630805  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:28.648669  1705 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.630963  1706 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:28.631629  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:28.632211  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:28.651698  2288 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:28.634614  4874 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:00:28.635464  4872 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 13:00:28.637626  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 74150.3us
I20260709 13:00:28.659600  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:28.640208  1700 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:28.643368  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 245025us
W20260709 13:00:28.656080  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 261414us
I20260709 13:00:28.657521  2288 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:28.678691  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:28.631544  4870 raft_consensus.cc:697] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:28.647876  4860 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:28.549067  4801 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.640008  4599 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:00:28.725903  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:28.660989  4624 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:28.672884  4829 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:28.727896  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:28.741799  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.798450  4876 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:00:28.799810  4725 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:28.800832  4611 consensus_queue.cc:237] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:28.801589  4870 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:28.804175  4623 consensus_meta.cc:287] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.644s	user 0.002s	sys 0.008s
I20260709 13:00:28.804876  4797 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.637581  4741 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.806186  4858 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:28.807716  4873 log.cc:927] Time spent T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:00:28.726445  4889 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:28.809074  4878 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:00:28.809216  4833 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:28.809352  4889 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:28.726104  4884 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
W20260709 13:00:28.810400  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 152915us
I20260709 13:00:28.821750  1703 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:28.824333  1705 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:28.825606  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:28.697824  4628 raft_consensus.cc:3055] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:28.826433  2327 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:28.865522  1523 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:28.867076  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:28.869768  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 210271us
W20260709 13:00:28.867199  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 53852.1us
W20260709 13:00:28.876498  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.642180  4869 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:28.734557  4846 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:28.965363  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.810390  4889 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:28.985517  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.986536  1635 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:28.858286  4663 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.808400  4741 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:29.019268  1635 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:00:29.032953  1635 pending_rounds.cc:85] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 7
I20260709 13:00:29.033265  1635 pending_rounds.cc:107] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:00:28.811578  4829 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:28.948266  4871 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:29.020562  1673 leader_election.cc:336] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.679s (SENT)
I20260709 13:00:29.033545  1635 raft_consensus.cc:2889] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:29.031268  4851 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.077759  4663 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:29.095616  1629 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:28.973910  4846 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:28.987504  4835 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.170557  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:29.171553  1635 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:29.068298  2288 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:29.056522  4814 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:29.079381  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:29.009483  4884 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:29.031908  4879 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.420s	user 0.000s	sys 0.001s
I20260709 13:00:28.813264  4623 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:29.054666  4875 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:00:28.865162  4628 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:29.055477  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 119321us
I20260709 13:00:29.063385  4513 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:28.963344  4834 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.948642  4809 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.967058  4680 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:29.179177  4851 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:29.203634  1674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.034s	sys 0.050s
W20260709 13:00:29.349594  1674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.035s	sys 0.050s
I20260709 13:00:29.203928  1630 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 7: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:29.202665  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:28.735278  4703 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:29.078143  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:29.153648  4829 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:29.225327  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 204771us
W20260709 13:00:29.233631  1708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.079s	sys 0.248s
W20260709 13:00:29.382685  1708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.079s	sys 0.248s
I20260709 13:00:29.173132  4824 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.244874  4814 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:29.234051  4833 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.256098  4663 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:29.241231  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:29.184988  4846 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:29.425172  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 184187us
W20260709 13:00:29.383486  1673 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.585s (SENT)
I20260709 13:00:29.383558  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2246) took 1133 ms. Trace:
I20260709 13:00:29.426617  1708 rpcz_store.cc:276] 0709 13:00:28.250288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.270415 (+ 20127us) service_pool.cc:224] Handling call
0709 13:00:28.301563 (+ 31148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.301859 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:28.475589 (+173730us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.383199 (+907610us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.383253 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:29.383304 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.383371 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.383498 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":261124,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":6277,"thread_start_us":1016717,"threads_started":2}
W20260709 13:00:29.358711  2320 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.006s	sys 0.012s
I20260709 13:00:29.421627  4824 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:29.423274  4833 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:29.389078  4879 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:00:29.349345  4680 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.217226  4835 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:29.489657  1628 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:29.503232  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2010) took 1583 ms. Trace:
W20260709 13:00:29.505733  1626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2006) took 1586 ms (client timeout 1864 ms). Trace:
W20260709 13:00:29.510303  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 126826us
W20260709 13:00:29.488456  2320 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.008s	sys 0.013s
W20260709 13:00:29.525890  1673 leader_election.cc:336] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.802s (SENT)
I20260709 13:00:29.539444  1673 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:29.226688  4884 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:29.521061  1626 rpcz_store.cc:269] 0709 13:00:27.918934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.921425 (+  2491us) service_pool.cc:224] Handling call
0709 13:00:29.505498 (+1584073us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b54000f55d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:29.505668 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126608640}
I20260709 13:00:29.520859  1633 rpcz_store.cc:276] 0709 13:00:27.920196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.922746 (+  2550us) service_pool.cc:224] Handling call
0709 13:00:27.984953 (+ 62207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.110783 (+125830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.110829 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.119576 (+  8747us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.404772 (+285196us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:28.404815 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.537422 (+132607us) spinlock_profiling.cc:243] Waited 63.3 ms on lock 0x7b54000d98d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:28.537467 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.502849 (+965382us) raft_consensus.cc:1685] finished
0709 13:00:29.502876 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.503135 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42686,"raft.queue_time_us":55642,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":9728,"spinlock_wait_cycles":145495936,"thread_start_us":221188,"threads_started":1,"wal-append.queue_time_us":333423}
I20260709 13:00:29.544991  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:29.543720  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:29.549690  1708 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.348856  4834 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:29.493502  4633 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:29.550279  1630 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:29.545794  1709 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:00:29.554430  1702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.115s	user 0.027s	sys 0.051s
W20260709 13:00:29.555375  1702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.028s	sys 0.051s
I20260709 13:00:29.557417  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:29.558899  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2245) took 1308 ms. Trace:
I20260709 13:00:29.367758  4809 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:29.520767  4680 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.590008  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:29.504967  4513 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
W20260709 13:00:29.628439  1632 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.015s	sys 0.022s
W20260709 13:00:29.628949  1632 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.015s	sys 0.022s
I20260709 13:00:29.516525  4703 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:29.610728  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.007s	sys 0.027s
W20260709 13:00:29.535188  2286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.014s	sys 0.061s
I20260709 13:00:29.559896  1702 rpcz_store.cc:276] 0709 13:00:28.250018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.255133 (+  5115us) service_pool.cc:224] Handling call
0709 13:00:28.255403 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.255600 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:28.438907 (+183307us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.556142 (+1117235us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.556217 (+    75us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:29.556296 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.556389 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.558768 (+  2379us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":286435,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":63,"raft.queue_time_us":117,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":28324,"thread_start_us":1299695,"threads_started":2}
W20260709 13:00:29.608880  4611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.017s	sys 0.017s
I20260709 13:00:29.650110  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:29.559670  4633 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.558481  4741 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:29.660543  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 134677us
W20260709 13:00:29.662319  1673 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.935s (SENT)
W20260709 13:00:29.663913  1554 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.030s	sys 0.087s
I20260709 13:00:29.608446  4788 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:29.664366  1554 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.030s	sys 0.087s
W20260709 13:00:29.648904  4880 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:00:29.633453  4887 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.543813  4814 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:29.626354  4857 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:29.658458  4611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.017s	sys 0.017s
W20260709 13:00:29.668220  4801 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.015s	sys 0.025s
W20260709 13:00:29.665669  4852 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.114s	user 0.000s	sys 0.011s
I20260709 13:00:29.659833  4633 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:29.690383  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:29.695578  2288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.026s
W20260709 13:00:29.695962  2288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.000s	sys 0.026s
W20260709 13:00:29.696357  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 628050us
I20260709 13:00:29.705945  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:29.694736  4801 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.016s	sys 0.025s
I20260709 13:00:29.712203  4801 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:29.712776  4801 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:29.715085  4801 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:29.716187  4801 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:29.720638  1633 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:29.640161  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:29.725469  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 85390.3us
W20260709 13:00:29.641100  2286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.015s	sys 0.061s
W20260709 13:00:29.727799  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 1.05281e+06us
I20260709 13:00:29.731840  1675 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:29.640712  1706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.019s	sys 0.018s
I20260709 13:00:29.637634  1708 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
W20260709 13:00:29.640825  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.007s	sys 0.027s
W20260709 13:00:29.733323  1706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.019s	sys 0.018s
I20260709 13:00:29.683821  4788 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:29.722246  1701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.017s	sys 0.039s
W20260709 13:00:29.745608  1673 leader_election.cc:336] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.069s (SENT)
I20260709 13:00:29.746553  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:29.747234  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:29.747208  1701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.017s	sys 0.039s
I20260709 13:00:29.755620  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2249) took 1504 ms. Trace:
I20260709 13:00:29.672160  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 594) took 1469 ms. Trace:
I20260709 13:00:29.721256  4623 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:29.769759  1673 leader_election.cc:336] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.194s (SENT)
I20260709 13:00:29.770555  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:29.646019  4885 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 13:00:29.697913  4852 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:29.785796  4809 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:29.786046  4852 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:29.742409  4857 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:29.770066  4891 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:00:29.789881  4788 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:29.692155  4887 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:29.720912  4801 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:29.793061  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:29.793999  1557 raft_consensus.cc:2410] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:29.794113  4903 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:29.794327  4801 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:29.794813  4903 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:29.795622  4801 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:29.797902  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:29.798549  1560 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:29.799867  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:29.800952  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:29.801224  4890 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:00:29.802109  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:29.801679  4846 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:29.803529  4892 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:00:29.804307  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:29.805187  1705 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:29.806143  4662 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:29.807209  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:29.808207  1556 raft_consensus.cc:2410] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:00:29.808805  4830 consensus_meta.cc:287] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.248s	user 0.009s	sys 0.004s
I20260709 13:00:29.809008  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 610) took 1629 ms. Trace:
I20260709 13:00:29.790164  4893 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:29.809351  4830 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:29.809989  4893 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.810526  4835 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:29.810667  4893 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:29.810916  2325 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 6: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:29.811342  4835 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:29.789880  4834 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:29.813264  4851 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:29.814333  4829 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:29.815085  4884 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:29.816514  4846 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:29.816781  2327 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:29.817101  4814 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:29.817242  4846 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:29.818065  4846 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.813763  4834 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.769281  4869 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:29.818095  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:29.818980  4834 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:29.819780  1559 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:29.747818  4833 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:29.800515  1560 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:29.824893  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:29.796141  4801 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:29.825747  1558 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.792277  4896 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:00:29.742319  4877 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.002s	sys 0.044s
W20260709 13:00:29.748572  4870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.019s	sys 0.008s
I20260709 13:00:29.762867  1554 rpcz_store.cc:276] 0709 13:00:28.202429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.207815 (+  5386us) service_pool.cc:224] Handling call
0709 13:00:28.208198 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.208449 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:28.208867 (+   418us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.398072 (+189205us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.525293 (+127221us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b1800406000. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6998522 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:00:29.066342 (+541049us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b1800406000. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a8f716 00007f0ed9aa0287 00007f0ed9aa0208
0709 13:00:29.671669 (+605327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.671752 (+    83us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:29.671823 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.671924 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.672089 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33669,"prepare.queue_time_us":4193,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":41153,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":28736,"spinlock_wait_cycles":12051200,"thread_start_us":791890,"threads_started":2,"wal-append.queue_time_us":338191}
I20260709 13:00:29.809509  1627 rpcz_store.cc:276] 0709 13:00:28.179964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.212713 (+ 32749us) service_pool.cc:224] Handling call
0709 13:00:28.213133 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:28.213602 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.213632 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:28.214198 (+   566us) log.cc:844] Serialized 52 byte log entry
0709 13:00:28.639223 (+425025us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:29.008393 (+369170us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.009602 (+  1209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.009674 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.808751 (+799077us) raft_consensus.cc:1685] finished
0709 13:00:29.808779 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.808939 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5568,"prepare.queue_time_us":852797,"raft.queue_time_us":15510,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":49455,"spinlock_wait_cycles":34748288,"thread_start_us":754327,"threads_started":2,"wal-append.queue_time_us":1215156}
I20260709 13:00:29.806052  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 866) took 1532 ms. Trace:
I20260709 13:00:29.833032  1633 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
W20260709 13:00:29.840852  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 60350.5us
W20260709 13:00:29.850009  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2024) took 1402 ms (client timeout 1584 ms). Trace:
W20260709 13:00:29.855211  1629 rpcz_store.cc:269] 0709 13:00:28.447079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.470028 (+ 22949us) service_pool.cc:224] Handling call
0709 13:00:29.849758 (+1379730us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54000d9dd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:29.849920 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264828288}
I20260709 13:00:29.861614  1558 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:29.821841  4834 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:29.830544  4809 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:29.812376  4835 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:29.988010  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2248) took 1737 ms. Trace:
W20260709 13:00:30.035640  2287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.033s	sys 0.025s
I20260709 13:00:29.898233  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:30.128245  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 358470us
I20260709 13:00:29.852075  4896 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.130179  1633 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:30.130565  1673 leader_election.cc:336] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 4.479s (SENT)
I20260709 13:00:30.127969  1701 rpcz_store.cc:276] 0709 13:00:28.250819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.362058 (+111239us) service_pool.cc:224] Handling call
0709 13:00:28.362439 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.371532 (+  9093us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:28.866224 (+494692us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.755432 (+889208us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.791513 (+ 36081us) log.cc:844] Serialized 26 byte log entry
0709 13:00:29.791731 (+   218us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:29.791777 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.791874 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.987640 (+195766us) raft_consensus.cc:1685] finished
0709 13:00:29.987668 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.987918 (+   250us) inbound_call.cc:177] Queueing success response
0709 13:00:29.991206 (+  3288us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b48001701d8. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ede9aeaa1 00007f0ede9a5b37 00007f0ede9a59ca 00007f0edea9d26f 00007f0edea9cf37 00007f0edeab155c 00007f0edeab1508 00007f0edeab1488 00007f0edeab1443 00007f0edeab06ec 00007f0edd9daa96
Metrics: {"mutex_wait_us":4036,"prepare.queue_time_us":260184,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":2852,"raft.queue_time_us":21517,"raft.run_cpu_time_us":3430,"raft.run_wall_time_us":234480,"spinlock_wait_cycles":102709504,"thread_start_us":1129066,"threads_started":2,"wal-append.queue_time_us":1013225}
W20260709 13:00:30.129626  2287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.034s	sys 0.028s
I20260709 13:00:29.853353  2329 rpcz_store.cc:276] 0709 13:00:28.273765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.273878 (+   113us) service_pool.cc:224] Handling call
0709 13:00:28.532389 (+258511us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b5800003c98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 13:00:28.532712 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.533212 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.533253 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.533897 (+   644us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.956782 (+422885us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:28.956847 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.956966 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.805655 (+848689us) raft_consensus.cc:1685] finished
0709 13:00:29.805676 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.805892 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1459,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":118,"spinlock_wait_cycles":7240448,"thread_start_us":422365,"threads_started":1,"wal-append.queue_time_us":825300}
I20260709 13:00:30.155622  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:29.830113  4846 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:30.112691  1526 connection.cc:256] RPC call timeout handler was delayed by -3.1001239400000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 13:00:30.190717  1526 connection.cc:256] RPC call timeout handler was delayed by -3.0299239400000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 13:00:29.898434  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:30.191159  1526 connection.cc:256] RPC call timeout handler was delayed by -2.9480239400000414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260709 13:00:30.191898  1526 connection.cc:256] RPC call timeout handler was delayed by -2.8652239400000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 13:00:30.192284  1526 connection.cc:256] RPC call timeout handler was delayed by -2.7716239400000404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
W20260709 13:00:30.192644  1526 connection.cc:256] RPC call timeout handler was delayed by -2.7401239399999895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260709 13:00:30.193502  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.015s	sys 0.022s
I20260709 13:00:30.193320  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:30.193845  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.015s	sys 0.022s
I20260709 13:00:30.194818  1633 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
W20260709 13:00:30.195015  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 580523us
I20260709 13:00:30.195398  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 616) took 1107 ms. Trace:
I20260709 13:00:30.195793  1633 rpcz_store.cc:276] 0709 13:00:29.088289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.897898 (+809609us) service_pool.cc:224] Handling call
0709 13:00:30.195339 (+297441us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:29.966645  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:29.963640  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.004s	sys 0.012s
W20260709 13:00:30.077128  1525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.002s	sys 0.018s
W20260709 13:00:30.198136  1525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.005s	sys 0.020s
W20260709 13:00:29.844169  4877 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.002s	sys 0.045s
W20260709 13:00:29.856643  4870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.019s	sys 0.008s
I20260709 13:00:30.132303  4835 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:30.188704  1632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.002s	sys 0.024s
I20260709 13:00:30.205860  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:30.206420  1632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.003s	sys 0.024s
W20260709 13:00:30.190318  4684 consensus_meta.cc:287] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.627s	user 0.007s	sys 0.007s
W20260709 13:00:29.930612  2285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.020s	sys 0.040s
W20260709 13:00:30.215277  2285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.022s	sys 0.054s
W20260709 13:00:29.967669  1631 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.003s	sys 0.013s
W20260709 13:00:30.199139  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.006s	sys 0.020s
W20260709 13:00:30.201478  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 69097.9us
I20260709 13:00:30.190860  1557 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:30.216070  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2490) took 1149 ms. Trace:
I20260709 13:00:30.216441  1633 rpcz_store.cc:276] 0709 13:00:29.067068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.205466 (+1138398us) service_pool.cc:224] Handling call
0709 13:00:30.215996 (+ 10530us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:30.217443  1673 leader_election.cc:336] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.598s (SENT)
I20260709 13:00:30.217994  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:29.898007  4851 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:30.086922  4661 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:29.900054  4897 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:30.086560  4900 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:30.224501  1673 leader_election.cc:336] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.606s (SENT)
I20260709 13:00:30.231484  1673 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:30.134196  4824 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:29.967496  4889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.017s	sys 0.000s
W20260709 13:00:30.221755  1700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.023s	sys 0.008s
I20260709 13:00:29.980906  4903 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:29.992552  4310 raft_consensus.cc:3055] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:30.223973  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.196359  1601 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:30.225729  1631 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.003s	sys 0.028s
I20260709 13:00:30.144368  4899 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:30.214879  4801 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:30.132501  4896 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:30.228523  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:30.214447  4860 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.487s	user 0.010s	sys 0.003s
I20260709 13:00:30.265681  1633 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:30.266369  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2492) took 1193 ms. Trace:
I20260709 13:00:30.266624  1633 rpcz_store.cc:276] 0709 13:00:29.073034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.234282 (+1161248us) service_pool.cc:224] Handling call
0709 13:00:30.265487 (+ 31205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.266099 (+   612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.266310 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:30.229527  2288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.006s	sys 0.025s
I20260709 13:00:30.229907  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:30.269372  2288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.006s	sys 0.026s
W20260709 13:00:30.269788  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 563816us
I20260709 13:00:30.233590  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:30.270972  2323 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:30.233702  1627 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:30.234776  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.235250  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:30.273818  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2489) took 1207 ms. Trace:
I20260709 13:00:30.235775  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:30.274314  1627 rpcz_store.cc:276] 0709 13:00:29.066786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.217426 (+1150640us) service_pool.cc:224] Handling call
0709 13:00:30.233524 (+ 16098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.273422 (+ 39898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.273753 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:30.235504  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2027) took 1787 ms. Trace:
I20260709 13:00:30.275604  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.238709  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:30.245008  4889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.017s	sys 0.010s
I20260709 13:00:30.277005  1557 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:30.236898  1629 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:30.245784  4870 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:30.253142  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 59890.6us
I20260709 13:00:30.221372  4741 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:30.225317  2321 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:30.222357  4905 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:30.255790  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 59529.4us
I20260709 13:00:30.292865  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:30.293303  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:30.214288  4852 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:00:30.252555  4310 raft_consensus.cc:740] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:30.264884  2329 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:30.277962  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2491) took 1205 ms. Trace:
I20260709 13:00:30.297729  1629 rpcz_store.cc:276] 0709 13:00:29.072754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.898185 (+825431us) service_pool.cc:224] Handling call
0709 13:00:30.277901 (+379716us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:30.245272  1700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.023s	sys 0.008s
I20260709 13:00:30.275180  2326 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
W20260709 13:00:30.299165  1630 consensus_meta.cc:287] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.002s
I20260709 13:00:30.268047  4703 raft_consensus.cc:2764] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:30.193830  4809 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.238072  4661 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:30.275533  1632 rpcz_store.cc:276] 0709 13:00:28.447730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.018433 (+570703us) service_pool.cc:224] Handling call
0709 13:00:29.076974 (+ 58541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.077219 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:29.629558 (+552339us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.225536 (+595978us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.235150 (+  9614us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.235203 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:30.235254 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.235330 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.235449 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7102,"prepare.queue_time_us":905352,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":96,"raft.queue_time_us":24520,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6032,"spinlock_wait_cycles":61800064,"thread_start_us":1129019,"threads_started":2}
I20260709 13:00:30.309980  1556 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:30.293761  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:30.312235  1601 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:30.313395  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:30.263983  2320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.025s	sys 0.027s
I20260709 13:00:30.260063  4790 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.300024  1630 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:30.274596  2322 raft_consensus.cc:2410] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:30.304117  1629 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:30.304674  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:30.289090  4611 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.308568  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.323854  1553 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:30.291368  4591 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.323918  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2497) took 1242 ms. Trace:
I20260709 13:00:30.293913  2323 raft_consensus.cc:2410] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:00:30.305137  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:30.323733  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2485) took 1258 ms. Trace:
W20260709 13:00:30.310915  4819 consensus_meta.cc:287] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.793s	user 0.016s	sys 0.000s
I20260709 13:00:30.348965  1630 rpcz_store.cc:276] 0709 13:00:29.065569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.667031 (+601462us) service_pool.cc:224] Handling call
0709 13:00:30.323673 (+656642us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:30.240875  4900 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:30.325335  4912 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.315989  4824 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:30.334344  4809 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:30.303071  4905 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:30.335793  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 53169.3us
I20260709 13:00:30.266062  4899 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.337370  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 869) took 1398 ms. Trace:
I20260709 13:00:30.340334  1599 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:30.326922  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2495) took 1245 ms. Trace:
W20260709 13:00:30.387611  1673 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.707s (SENT)
W20260709 13:00:30.331331  4901 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:00:30.325028  1629 rpcz_store.cc:276] 0709 13:00:29.081677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.303449 (+1221772us) service_pool.cc:224] Handling call
0709 13:00:30.303806 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.323588 (+ 19782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.323854 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:30.308944  4889 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:30.315522  2320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.026s	sys 0.027s
I20260709 13:00:30.352241  1632 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:30.347568  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:30.351080  4835 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:30.359236  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 618) took 1261 ms. Trace:
I20260709 13:00:30.389544  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 617) took 1301 ms. Trace:
I20260709 13:00:30.389990  1632 rpcz_store.cc:276] 0709 13:00:29.088570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.310150 (+1221580us) service_pool.cc:224] Handling call
0709 13:00:30.339158 (+ 29008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.389186 (+ 50028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.389411 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:30.391180  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:30.391574  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 51339us
I20260709 13:00:30.385660  2327 rpcz_store.cc:276] 0709 13:00:28.939120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.939319 (+   199us) service_pool.cc:224] Handling call
0709 13:00:28.939735 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.817159 (+877424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.337055 (+519896us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b5400104354. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:30.337295 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2016342784}
I20260709 13:00:30.318920  4513 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:30.331859  4898 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:00:30.319281  4788 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:30.381531  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:30.397032  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 82157.7us
I20260709 13:00:30.382594  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:30.384079  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 189423us
I20260709 13:00:30.397114  4889 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:30.331271  4591 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.278899  4860 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.389562  1629 pending_rounds.cc:85] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 8
I20260709 13:00:30.422835  1629 pending_rounds.cc:107] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:00:30.423461  1629 raft_consensus.cc:2889] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:30.371925  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 184058us
I20260709 13:00:30.340162  4611 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:30.389688  1630 rpcz_store.cc:276] 0709 13:00:29.088860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.349733 (+1260873us) service_pool.cc:224] Handling call
0709 13:00:30.350073 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.350411 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.350443 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.350482 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:30.350522 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.350580 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.350664 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:30.409008  1673 leader_election.cc:336] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.716s (SENT)
W20260709 13:00:30.427030  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 79549.3us
I20260709 13:00:30.316035  4897 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:00:30.359076  4819 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.386989  1633 rpcz_store.cc:276] 0709 13:00:29.081183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.299035 (+1217852us) service_pool.cc:224] Handling call
0709 13:00:30.316447 (+ 17412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.326590 (+ 10143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.326621 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.326663 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:30.326696 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.326757 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.326870 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168,"raft.queue_time_us":28784,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":7960}
I20260709 13:00:30.359885  4824 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:30.417657  4741 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.413715  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:30.440891  1707 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:30.393541  4809 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:00:30.317422  4910 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
W20260709 13:00:30.429051  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47617.7us
I20260709 13:00:30.452951  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:30.361523  4684 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:00:30.319077  4896 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 13:00:30.413516  4904 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.226s	user 0.001s	sys 0.001s
I20260709 13:00:30.333640  4790 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.441283  1598 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:30.396472  4633 consensus_meta.cc:287] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.696s	user 0.014s	sys 0.002s
I20260709 13:00:30.414388  4835 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:30.392131  4310 consensus_queue.cc:260] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:30.444139  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 51824us
I20260709 13:00:30.429530  4833 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:30.424826  4920 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:30.424445  4788 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:30.461802  1703 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:30.463524  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:30.435771  4858 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:30.443025  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.445819  4824 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:30.458734  4870 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:30.459164  4741 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.513967  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2021) took 2067 ms. Trace:
W20260709 13:00:30.530932  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 69086.2us
W20260709 13:00:30.497267  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 70468.4us
W20260709 13:00:30.567899  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 115009us
I20260709 13:00:30.571600  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:30.572587  1630 raft_consensus.cc:2368] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7.
I20260709 13:00:30.520988  4887 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:30.577850  1526 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:30.561372  1631 rpcz_store.cc:276] 0709 13:00:28.446457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.013326 (+566869us) service_pool.cc:224] Handling call
0709 13:00:29.163040 (+149714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.359854 (+196814us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:30.251380 (+891526us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.389895 (+138515us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.390674 (+   779us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.390787 (+   113us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:30.391383 (+   596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.513632 (+122249us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54001bc954. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:30.513696 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.513883 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3181,"prepare.queue_time_us":658361,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":3745,"raft.queue_time_us":56322,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":11955,"spinlock_wait_cycles":466393344,"thread_start_us":998702,"threads_started":2,"wal-append.queue_time_us":184004}
W20260709 13:00:30.551672  4921 log.cc:927] Time spent T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:00:30.567365  4680 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.913s	user 0.005s	sys 0.009s
I20260709 13:00:30.586817  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.546490  4858 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:30.596731  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.597339  1557 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:30.553474  4933 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:30.506582  4310 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.566046  4513 raft_consensus.cc:697] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:30.612068  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:30.615100  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:30.471954  4633 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.616849  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:30.605898  1675 leader_election.cc:400] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7.
I20260709 13:00:30.611176  1599 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:30.620162  1675 leader_election.cc:403] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:00:30.618607  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 181298us
I20260709 13:00:30.627987  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:30.628264  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:30.628669  1708 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:30.633149  4913 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:00:30.602118  4788 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:30.637125  4928 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:00:30.636991  4889 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:30.638442  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:30.611300  4883 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:00:30.639213  1701 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:30.639837  2320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 735) took 2195 ms. Trace:
W20260709 13:00:30.633309  4925 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:00:30.643638  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:30.612638  4933 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.598938  4858 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:30.638619  4819 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:30.650758  1705 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 4.
W20260709 13:00:30.669689  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58636.5us
I20260709 13:00:30.597942  4870 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:30.670459  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:30.661875  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:30.663869  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 200423us
I20260709 13:00:30.666091  1633 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:30.665575  1708 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
W20260709 13:00:30.638633  4929 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:00:30.666965  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:30.645984  2320 rpcz_store.cc:276] 0709 13:00:28.444502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.598279 (+153777us) service_pool.cc:224] Handling call
0709 13:00:28.636989 (+ 38710us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.602902 (+965913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.604519 (+  1617us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.683756 (+ 79237us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.388872 (+705116us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:30.388911 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.388981 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.639620 (+250639us) raft_consensus.cc:1685] finished
0709 13:00:30.639640 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.639770 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25166,"raft.queue_time_us":135950,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":1491678,"threads_started":2,"wal-append.queue_time_us":733464}
I20260709 13:00:29.756090  1706 rpcz_store.cc:276] 0709 13:00:28.251055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.858711 (+607656us) service_pool.cc:224] Handling call
0709 13:00:28.969481 (+110770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.969931 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:28.994908 (+ 24977us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.755291 (+760383us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.755361 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:29.755412 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.755470 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.755568 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8318,"prepare.queue_time_us":4538,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":1350,"raft.queue_time_us":20967,"spinlock_wait_cycles":344320,"thread_start_us":738391,"threads_started":1}
I20260709 13:00:30.640017  4853 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7.
I20260709 13:00:30.619518  4938 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:30.648576  4887 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.675935  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:30.669626  4719 consensus_meta.cc:287] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 2.018s	user 0.013s	sys 0.003s
I20260709 13:00:30.681244  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:30.662037  4905 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:30.603603  4680 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.684926  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:30.685647  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:30.673403  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:30.668625  4858 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:30.666922  4933 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.708573  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:30.695541  1631 raft_consensus.cc:2376] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4. Re-sending same reply.
I20260709 13:00:30.714795  4741 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:30.690096  4887 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.717381  4917 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:30.718317  1552 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:30.672909  4870 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:30.681629  4938 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.683085  4833 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:30.678211  4899 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:30.621392  4835 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.726460  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:30.676625  4846 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.737115  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.722745  4870 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:30.780666  1557 raft_consensus.cc:2368] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7.
I20260709 13:00:30.781522  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.782197  1560 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:30.697307  4900 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:30.783565  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:30.723744  4938 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:30.691217  4719 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:30.784482  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58092.9us
I20260709 13:00:30.724897  4916 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:30.734604  4860 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:30.788888  4942 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:30.792909  4943 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:30.793638  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.798130  4943 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.798579  4943 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.791236  1632 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:30.792079  4930 log.cc:927] Time spent T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:00:30.790875  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.801185  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.801843  1557 raft_consensus.cc:2410] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:30.802093  4628 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.797657  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.802793  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.792202  4940 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:30.796947  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.803974  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.804316  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.804668  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:30.805214  1557 raft_consensus.cc:2410] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:30.805747  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.806041  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.798575  1559 raft_consensus.cc:2410] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:30.802541  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.805100  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.789657  1599 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:30.809310  1553 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:30.803205  4628 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.791543  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:30.817019  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.818044  1553 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
W20260709 13:00:30.823549  1673 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.803s (SENT) [suppressed 42 similar messages]
W20260709 13:00:30.785223  4883 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:30.819597  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:30.826333  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.826627  1599 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:30.780437  4941 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:30.836778  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:30.783797  4914 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:30.839569  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.841220  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:30.841406  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.789914  4680 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:30.796968  4916 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:30.830739  4940 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:30.733040  4513 consensus_queue.cc:237] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:30.866629  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.870965  1553 raft_consensus.cc:2393] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:00:30.853643  4919 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.346s	user 0.000s	sys 0.002s
I20260709 13:00:30.843808  4941 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.837790  4788 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:30.839272  4917 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:30.872920  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.837540  4887 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:30.873490  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:30.878266  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:30.878715  1631 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:30.879115  2327 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.883128  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:30.870160  4940 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:30.887849  1559 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:30.889523  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:30.890331  1558 raft_consensus.cc:2368] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7.
I20260709 13:00:30.894768  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 612) took 2707 ms. Trace:
I20260709 13:00:30.876827  4633 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:30.877578  4941 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:30.895177  1634 rpcz_store.cc:276] 0709 13:00:28.180490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.215583 (+ 35093us) service_pool.cc:224] Handling call
0709 13:00:28.246331 (+ 30748us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:28.246690 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.246718 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:28.278284 (+ 31566us) log.cc:844] Serialized 52 byte log entry
0709 13:00:28.541527 (+263243us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:28.599380 (+ 57853us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.613902 (+ 14522us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.637769 (+ 23867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.637868 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.082030 (+444162us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b18003d33c0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6998522 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:00:30.395072 (+1313042us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b18003d33c0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:00:30.836300 (+441228us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18003d33c0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69662a6 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6998522 00007f0ed699a7c1
0709 13:00:30.887388 (+ 51088us) raft_consensus.cc:1685] finished
0709 13:00:30.887408 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.887557 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84320,"prepare.queue_time_us":2282578,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":92,"raft.queue_time_us":57887,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":9606,"spinlock_wait_cycles":48620032,"thread_start_us":170154,"threads_started":1,"wal-append.queue_time_us":266059}
I20260709 13:00:30.881655  4917 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.891382  4788 raft_consensus.cc:697] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:30.890895  4940 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.924260  1631 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
W20260709 13:00:30.929633  1551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 600) took 2680 ms (client timeout 1818 ms). Trace:
W20260709 13:00:30.930147  1551 rpcz_store.cc:269] 0709 13:00:28.248960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.253693 (+  4733us) service_pool.cc:224] Handling call
0709 13:00:30.929352 (+2675659us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54000578d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:30.929548 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3309743872}
I20260709 13:00:30.931146  4916 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.935726  4938 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:30.936993  2321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 722) took 3787 ms (client timeout 3314 ms). Trace:
W20260709 13:00:30.937423  2321 rpcz_store.cc:269] 0709 13:00:27.150037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.158942 (+  8905us) service_pool.cc:224] Handling call
0709 13:00:30.936801 (+3777859us) spinlock_profiling.cc:243] Waited 3.06 s on lock 0x7b5400671e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:30.936914 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7036023040}
I20260709 13:00:30.941646  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.902551  4917 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:30.942633  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:30.945546  1551 raft_consensus.cc:1240] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:30.942705  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:30.946732  1631 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:30.950719  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 557) took 1427 ms. Trace:
I20260709 13:00:30.950691  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:30.953789  1634 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:30.951340  1700 rpcz_store.cc:276] 0709 13:00:29.523481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.523739 (+   258us) service_pool.cc:224] Handling call
0709 13:00:29.557233 (+ 33494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.610810 (+ 53577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.610842 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.632974 (+ 22132us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.299136 (+666162us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:30.299183 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.299431 (+   248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.950524 (+651093us) raft_consensus.cc:1685] finished
0709 13:00:30.950546 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.950663 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23131,"raft.queue_time_us":23964,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":21355,"thread_start_us":614082,"threads_started":1,"wal-append.queue_time_us":792862}
I20260709 13:00:30.959161  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.959465  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.960654  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.961700  1553 raft_consensus.cc:2410] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:30.960708  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.962718  1551 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:30.945967  4846 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:30.913628  4719 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:30.966342  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.970502  4788 consensus_queue.cc:237] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:30.972990  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.973928  1557 raft_consensus.cc:2368] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7.
W20260709 13:00:30.976498  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.946480  4893 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.133s	user 0.016s	sys 0.000s
I20260709 13:00:30.986274  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:30.906919  4858 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.992249  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.993680  1558 raft_consensus.cc:2393] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 10: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:00:30.983683  4912 consensus_meta.cc:287] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.001s
I20260709 13:00:30.996076  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:30.997076  1551 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:31.003454  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:31.005189  2321 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.006433  2327 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:30.990823  4943 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:31.033809  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.053295  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.054620  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.036547  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.054663  4624 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:00:31.033751  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.056851  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:31.001698  4951 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:31.004575  4912 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:31.060619  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:31.005405  4824 consensus_meta.cc:287] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.004s
W20260709 13:00:31.071843  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.998135  4846 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:31.063930  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:31.059947  4870 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:30.992750  4893 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:31.002234  4858 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:31.067148  4943 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:31.067173  1706 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:31.067241  4940 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:31.069811  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:31.056087  1556 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:31.055997  1558 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:31.071828  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:31.058012  2321 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:31.085006  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:31.086217  1705 raft_consensus.cc:2410] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:31.086901  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:31.028806  4933 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:31.092648  1555 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:31.093557  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:31.095166  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:31.104648  1702 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:31.018451  4941 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:31.107053  1708 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.108934  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.109208  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:31.110285  1556 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 4: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:31.104640  1700 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:31.113581  1673 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:31.115314  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:31.116190  1705 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.123684  4941 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:31.124749  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:31.125250  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.125945  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:31.126514  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.127242  1556 raft_consensus.cc:2393] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 10: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:31.127635  4829 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:31.129618  4933 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:31.129973  4893 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:31.131625  4870 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:31.131738  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:31.132491  2328 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:31.133299  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 558) took 1609 ms. Trace:
I20260709 13:00:31.133663  4940 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:31.125325  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:31.137168  1551 raft_consensus.cc:2368] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7.
I20260709 13:00:31.063738  4624 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:31.126508  1700 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:31.139155  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:31.139312  4922 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:31.139581  4624 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:31.139776  4922 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:31.139919  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:31.139783  1700 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:31.141831  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:31.142408  1700 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:31.143139  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:31.143736  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:31.144109  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:31.144953  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:31.145169  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.145812  1556 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:31.146401  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:31.147513  1627 raft_consensus.cc:2410] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:31.148818  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:31.149542  1706 raft_consensus.cc:2368] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6.
I20260709 13:00:31.150292  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:31.150826  4830 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:31.151302  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:31.133682  1707 rpcz_store.cc:276] 0709 13:00:29.524175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.524346 (+   171us) service_pool.cc:224] Handling call
0709 13:00:29.557879 (+ 33533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.447850 (+889971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.133053 (+685203us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b5400398854. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:31.133241 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2029934336}
I20260709 13:00:31.152061  1706 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:31.152319  4611 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:31.152536  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:31.085487  4824 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:31.153168  1707 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:31.154469  4824 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:31.155539  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:31.155751  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:31.156065  1708 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:31.156495  1704 raft_consensus.cc:2410] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:31.157523  1702 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:31.158070  1700 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:31.155087  1630 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:31.163736  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:31.163818  4917 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:31.154150  4922 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:31.165050  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:31.146607  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.165844  1630 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:31.166800  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:31.167694  1558 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:31.168867  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.148469  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:31.158515  4655 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:31.159489  1628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2487) took 2093 ms (client timeout 1766 ms). Trace:
W20260709 13:00:31.171891  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58433us
W20260709 13:00:31.172251  1628 rpcz_store.cc:269] 0709 13:00:29.066193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.077772 (+ 11579us) service_pool.cc:224] Handling call
0709 13:00:31.159305 (+2081533us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b54000e6d54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:31.159425 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165849856}
I20260709 13:00:31.158121  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:31.174084  1626 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:31.161509  2328 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:31.170991  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:31.175956  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.165207  4922 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:31.168357  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2265) took 2690 ms. Trace:
I20260709 13:00:31.169855  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.181017  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:31.179450  1705 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:31.181972  1630 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:00:31.091414  4846 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:31.183157  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:31.185345  4846 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:31.186355  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:31.187196  1706 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:31.189811  1627 raft_consensus.cc:2393] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 9: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:31.190840  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:31.180289  1703 rpcz_store.cc:276] 0709 13:00:28.477717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.962612 (+484895us) service_pool.cc:224] Handling call
0709 13:00:28.969322 (+  6710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.481145 (+1511823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.168000 (+686855us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400265554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:31.168245 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3431521536}
I20260709 13:00:31.196755  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:31.197300  4684 raft_consensus.cc:3055] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:31.197793  4684 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:31.198603  4684 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:31.198911  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.199750  4684 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.200338  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.201725  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.207171  1705 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:31.209903  1705 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:31.214445  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.217381  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:31.217859  1556 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:00:31.218253  1556 pending_rounds.cc:85] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 3
I20260709 13:00:31.218519  1556 pending_rounds.cc:107] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:00:31.218966  1556 raft_consensus.cc:2889] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:31.219364  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:31.219537  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 94846.1us
I20260709 13:00:31.220997  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:31.221312  1703 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:31.222810  1703 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:31.180356  4893 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:31.229593  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:31.230593  1630 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:31.196866  4790 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:31.289851  1705 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:31.294327  1706 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:00:31.297812  1630 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:31.306730  1628 raft_consensus.cc:1240] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:31.310251  4310 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:31.337114  4960 log.cc:927] Time spent T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:00:31.338578  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 745) took 1115 ms. Trace:
I20260709 13:00:31.339040  2324 rpcz_store.cc:276] 0709 13:00:30.223576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.302321 (+ 78745us) service_pool.cc:224] Handling call
0709 13:00:30.318207 (+ 15886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.326275 (+  8068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.326321 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.343024 (+ 16703us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.031056 (+688032us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b1800092860. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:00:31.078688 (+ 47632us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:31.078733 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.078801 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.338262 (+259461us) raft_consensus.cc:1685] finished
0709 13:00:31.338281 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.338516 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18160,"raft.queue_time_us":21284,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":36194,"spinlock_wait_cycles":4785920,"thread_start_us":47430,"threads_started":1,"wal-append.queue_time_us":766525}
I20260709 13:00:31.348543  4917 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:31.350625  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:31.371119  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2276) took 1589 ms. Trace:
I20260709 13:00:31.371730  1552 rpcz_store.cc:276] 0709 13:00:29.781353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.781581 (+   228us) service_pool.cc:224] Handling call
0709 13:00:29.791366 (+  9785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.720918 (+929552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.370777 (+649859us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b540017e8d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:31.371039 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2131017472}
I20260709 13:00:31.375479  1556 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:31.378048  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.383249  1556 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:31.385274  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:31.387987  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:31.388918  1559 raft_consensus.cc:2410] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:31.383369  4943 consensus_queue.cc:1059] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:00:31.411161  4943 raft_consensus.cc:3055] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:31.411592  4943 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:31.412801  1626 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:31.398041  4915 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:00:31.412475  4943 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:31.449975  1628 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:31.474797  4943 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:31.474352  4310 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:31.502858  4310 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:31.545537  4310 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:31.547187  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:31.667119  4914 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.667778  4914 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:31.678124  4914 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:31.681874  4914 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:31.705407  2325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 738) took 3264 ms (client timeout 1672 ms). Trace:
W20260709 13:00:31.705953  2325 rpcz_store.cc:269] 0709 13:00:28.441503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.473193 (+ 31690us) service_pool.cc:224] Handling call
0709 13:00:31.705189 (+3231996us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54005c0154. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:31.705335 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2915698048}
I20260709 13:00:32.323494  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:32.324669  1553 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:32.325700  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1968) took 1341 ms. Trace:
I20260709 13:00:32.330269  1553 rpcz_store.cc:276] 0709 13:00:30.984405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.323168 (+1338763us) service_pool.cc:224] Handling call
0709 13:00:32.325621 (+  2453us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.353901  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:32.355088  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2275) took 1229 ms. Trace:
I20260709 13:00:32.357689  1704 rpcz_store.cc:276] 0709 13:00:31.126032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.353565 (+1227533us) service_pool.cc:224] Handling call
0709 13:00:32.355025 (+  1460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.371647  4852 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.373277  4852 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.377876  4852 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:32.399989  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2502) took 1271 ms. Trace:
I20260709 13:00:32.400885  1705 rpcz_store.cc:276] 0709 13:00:31.128547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.219688 (+ 91141us) service_pool.cc:224] Handling call
0709 13:00:31.219960 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.290341 (+ 70381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.399682 (+1109341us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b54002cbd54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:32.399918 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160247552}
I20260709 13:00:32.403088  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:32.404184  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1989) took 1334 ms. Trace:
I20260709 13:00:32.404642  1551 rpcz_store.cc:276] 0709 13:00:31.069373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.137815 (+ 68442us) service_pool.cc:224] Handling call
0709 13:00:32.402932 (+1265117us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 13:00:32.404122 (+  1190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6065920}
I20260709 13:00:32.407872  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:32.426944  1708 raft_consensus.cc:2410] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:32.427497  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2503) took 1298 ms. Trace:
W20260709 13:00:32.419049  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.452032  1555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 608) took 2167 ms (client timeout 2237 ms). Trace:
I20260709 13:00:32.452095  4852 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:32.452623  1555 rpcz_store.cc:269] 0709 13:00:30.284430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.382328 (+ 97898us) service_pool.cc:224] Handling call
0709 13:00:32.451582 (+2069254us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b540033c7d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:32.451892 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1564354432}
I20260709 13:00:32.452898  4852 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.460850  4852 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:32.420141  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.421743  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:32.467444  1705 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:32.423245  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:32.469528  1704 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:32.423951  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:32.472992  1707 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.424678  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:32.478036  1708 rpcz_store.cc:276] 0709 13:00:31.128823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.407605 (+1278782us) service_pool.cc:224] Handling call
0709 13:00:32.427441 (+ 19836us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:32.478837  1630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.156s	user 0.024s	sys 0.052s
W20260709 13:00:32.479223  1630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.024s	sys 0.052s
I20260709 13:00:32.479871  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2040) took 1906 ms. Trace:
I20260709 13:00:32.415405  4943 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.431257  1709 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5. Ops: [3.6-4.7]
I20260709 13:00:32.433565  4938 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:32.489168  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2497) took 1418 ms. Trace:
I20260709 13:00:32.489701  4938 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.489822  1709 rpcz_store.cc:276] 0709 13:00:31.070441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.430587 (+1360146us) service_pool.cc:224] Handling call
0709 13:00:32.430983 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:32.488845 (+ 57862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.489112 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.481253  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:32.488822  4943 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:32.493865  1552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.012s	sys 0.005s
I20260709 13:00:32.494087  4943 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:32.429864  4933 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:32.496147  4933 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.490294  4938 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.499974  4938 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:32.494271  1552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.014s	sys 0.006s
I20260709 13:00:32.494691  4943 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:00:32.503392  4943 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:32.503794  4943 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:32.504689  4943 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:32.505892  4943 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:32.505976  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:32.507534  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:32.508126  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 628) took 1656 ms. Trace:
I20260709 13:00:32.509320  4933 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:32.508739  1628 rpcz_store.cc:276] 0709 13:00:30.851733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.454379 (+602646us) service_pool.cc:224] Handling call
0709 13:00:31.468953 (+ 14574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.413125 (+944172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.413156 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.413656 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:00:32.507796 (+ 94140us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:32.507833 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.507897 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:32.507953 (+    56us) raft_consensus.cc:1685] finished
0709 13:00:32.507965 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.508074 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":943706,"raft.queue_time_us":951461,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":93805,"threads_started":1,"wal-append.queue_time_us":91899}
I20260709 13:00:32.501119  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2299) took 1130 ms. Trace:
I20260709 13:00:32.511287  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:32.512897  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2501) took 3333 ms. Trace:
I20260709 13:00:32.508306  1635 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:32.552383  1635 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:32.510815  1552 rpcz_store.cc:276] 0709 13:00:31.370684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.406760 (+ 36076us) service_pool.cc:224] Handling call
0709 13:00:31.421685 (+ 14925us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.421878 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:31.425122 (+  3244us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.500773 (+1075651us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.500833 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:32.500875 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.500943 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.501060 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1871,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":37,"thread_start_us":1075320,"threads_started":1,"wal-append.queue_time_us":118868}
I20260709 13:00:32.553224  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2506) took 1479 ms. Trace:
I20260709 13:00:32.553601  1635 rpcz_store.cc:276] 0709 13:00:31.073927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.551886 (+1477959us) service_pool.cc:224] Handling call
0709 13:00:32.552209 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.552811 (+   602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.553170 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.555091  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2515) took 1449 ms. Trace:
I20260709 13:00:32.555421  1635 rpcz_store.cc:276] 0709 13:00:31.105891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.554289 (+1448398us) service_pool.cc:224] Handling call
0709 13:00:32.554627 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.554796 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.554820 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.554860 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:32.554896 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.554944 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.555040 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.556295  4684 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.556998  4684 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.559244  4684 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:32.559749  4684 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:32.562075  1675 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:32.488286  1707 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:32.566042  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:32.566754  1707 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:32.568238  1707 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:00:32.569291  1635 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:32.570880  4884 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:00:32.572440  1673 leader_election.cc:336] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.521s (SENT)
I20260709 13:00:32.572952  4937 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:32.573516  4937 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:32.574564  1673 leader_election.cc:336] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.540s (SENT)
I20260709 13:00:32.575636  4937 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:32.564113  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:32.579524  1673 leader_election.cc:336] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.584s (SENT)
I20260709 13:00:32.580612  1707 pending_rounds.cc:85] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 3
I20260709 13:00:32.513115  1628 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:32.581003  1707 pending_rounds.cc:107] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:00:32.501119  4938 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:32.581324  1707 raft_consensus.cc:2889] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:32.526027  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:32.526855  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:32.527648  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:32.583026  1704 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:32.528465  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:32.531441  2323 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:32.531435  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:32.584489  2329 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:32.532680  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:32.586091  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.534682  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:32.536222  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:32.587203  2328 raft_consensus.cc:2410] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:32.587472  2324 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:00:32.588624  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:32.588748  4310 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:32.589203  1706 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:32.589603  4310 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:32.536823  2321 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:32.539235  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:32.540895  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:32.541659  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:32.598443  1673 leader_election.cc:336] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.763s (SENT)
I20260709 13:00:32.597110  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 603) took 2340 ms. Trace:
I20260709 13:00:32.599613  1554 rpcz_store.cc:276] 0709 13:00:30.257081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.259781 (+  2700us) service_pool.cc:224] Handling call
0709 13:00:30.260194 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.278856 (+ 18662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.278892 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.343040 (+ 64148us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b4800290358. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ede9aeaa1 00007f0ede9a5b37 00007f0ede9a59ca 00007f0edea9d26f 00007f0edea9cf37 00007f0edeab155c 00007f0edeab1508 00007f0edeab1488 00007f0edeab1443 00007f0edeab06ec 00007f0edd9daa96
0709 13:00:32.503610 (+2160570us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b2c00000658. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2
0709 13:00:32.504101 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:00:32.575404 (+ 71303us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:32.575443 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.575508 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:32.596680 (+ 21172us) raft_consensus.cc:1685] finished
0709 13:00:32.596710 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.596990 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20368,"raft.queue_time_us":20854,"raft.run_cpu_time_us":1161,"raft.run_wall_time_us":53499,"spinlock_wait_cycles":16730752,"thread_start_us":70937,"threads_started":1,"wal-append.queue_time_us":69988}
I20260709 13:00:32.541843  4916 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:32.542315  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 619) took 3453 ms. Trace:
W20260709 13:00:32.542464  1598 leader_election.cc:336] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Timed out: RequestConsensusVote RPC to 127.0.107.196:39387 timed out after 1.672s (SENT)
I20260709 13:00:32.544552  1705 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:32.549499  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:32.605366  1700 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
W20260709 13:00:32.549763  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.604307  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 61955.7us
I20260709 13:00:32.480189  1630 rpcz_store.cc:276] 0709 13:00:30.573931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.299176 (+725245us) service_pool.cc:224] Handling call
0709 13:00:31.312737 (+ 13561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.313059 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.313100 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.313533 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:00:32.479542 (+1166009us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:32.479580 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.479647 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:32.479686 (+    39us) raft_consensus.cc:1685] finished
0709 13:00:32.479697 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.479811 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1740,"raft.queue_time_us":1998,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":2935,"thread_start_us":1156727,"threads_started":1,"wal-append.queue_time_us":214816}
I20260709 13:00:32.534539  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:32.556787  1632 rpcz_store.cc:276] 0709 13:00:29.179966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.391111 (+1211145us) service_pool.cc:224] Handling call
0709 13:00:30.416516 (+ 25405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.799197 (+382681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.512647 (+1713450us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b5400205b54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:32.512830 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861073664}
I20260709 13:00:32.607098  1633 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:32.608115  1704 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
W20260709 13:00:32.605763  1673 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.833s (SENT)
I20260709 13:00:32.610040  1673 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:32.560195  4684 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:32.608670  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 89485.1us
I20260709 13:00:32.629777  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:32.613847  1706 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:32.601511  1629 rpcz_store.cc:276] 0709 13:00:29.089092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.388847 (+1299755us) service_pool.cc:224] Handling call
0709 13:00:30.389367 (+   520us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:30.437794 (+ 48427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.437829 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:30.438385 (+   556us) log.cc:844] Serialized 52 byte log entry
0709 13:00:30.604935 (+166550us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:30.682869 (+ 77934us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.716927 (+ 34058us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.717104 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.717173 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.142332 (+425159us) spinlock_profiling.cc:243] Waited 8.56 ms on lock 0x7b18003cc280. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6998522 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:00:31.289155 (+146823us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b18003cc280. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69662a6 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1
0709 13:00:31.644983 (+355828us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b18003cc280. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6998522 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:00:32.536825 (+891842us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b18003cc280. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:00:32.542101 (+  5276us) raft_consensus.cc:1685] finished
0709 13:00:32.542121 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.542262 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62821,"prepare.queue_time_us":1011921,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":68,"raft.queue_time_us":146305,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":11107,"spinlock_wait_cycles":63956352,"thread_start_us":222374,"threads_started":2,"wal-append.queue_time_us":271975}
I20260709 13:00:32.622681  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:32.625630  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:32.631232  1556 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.631531  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:32.646934  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:00:32.650177  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.651296  1601 connection.cc:256] RPC call timeout handler was delayed by -1.5202200159999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 13:00:32.651903  1601 connection.cc:256] RPC call timeout handler was delayed by -1.1107200160000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260709 13:00:32.656255  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:32.656967  1551 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:32.657800  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:32.658435  1552 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.661432  4884 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:32.661907  4884 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:32.662436  4884 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:32.645747  4916 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.667467  4916 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:32.668330  4684 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:32.661871  2325 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:32.669902  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:32.669986  4933 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:32.670755  2325 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.670849  4933 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.659364  4824 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.675392  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:32.679382  2325 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:32.592464  4310 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:32.682482  4933 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:32.673182  4824 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.659792  4937 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:32.683259  4937 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:32.683683  4937 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:32.682889  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:32.684885  4824 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:32.685232  2288 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:32.686233  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:32.686890  4684 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:32.689396  4893 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:32.690011  4893 raft_consensus.cc:697] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:32.690050  4684 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:32.691237  4684 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:32.691942  4684 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:32.692397  4684 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:32.691182  4893 consensus_queue.cc:237] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:32.693408  2350 debug-util.cc:398] Leaking SignalData structure 0x7b0800334300 after lost signal to thread 434
I20260709 13:00:32.694473  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:32.695606  1555 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:32.682713  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:32.702468  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:32.703421  1555 raft_consensus.cc:3055] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:32.703748  2327 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.703795  1555 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:32.693715  4938 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:32.705232  4938 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.701176  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:32.705295  1555 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:32.705891  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:32.701390  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:32.706373  1558 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:32.706773  1702 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:32.707458  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2505) took 1578 ms. Trace:
I20260709 13:00:32.707773  1702 rpcz_store.cc:276] 0709 13:00:31.129295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.705635 (+1576340us) service_pool.cc:224] Handling call
0709 13:00:32.707399 (+  1764us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.708451  2325 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:32.711549  1552 raft_consensus.cc:2410] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:32.702756  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:32.706795  1555 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:32.714718  1556 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:32.715667  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:32.682618  4310 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.716910  4916 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:32.717005  4310 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.717028  4979 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:32.717638  4916 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.723453  2325 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:32.724500  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:32.725330  2325 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:32.728278  2327 raft_consensus.cc:2410] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:00:32.731662  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 125904us
W20260709 13:00:32.747484  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 183735us
W20260709 13:00:32.747861  1673 leader_election.cc:336] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.927s (SENT)
I20260709 13:00:32.749513  1673 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:32.749545  1599 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:32.750774  2325 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:32.752457  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:32.753091  2323 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:32.727087  4938 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:32.755260  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 106103us
I20260709 13:00:32.784987  1706 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:32.786300  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:32.789455  1703 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:32.748648  4979 raft_consensus.cc:697] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:32.791435  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:32.794194  1700 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:32.795318  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:32.796344  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:32.796988  1633 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:32.808151  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:32.819466  1630 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:32.809558  2323 raft_consensus.cc:2376] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5. Re-sending same reply.
I20260709 13:00:32.809813  1705 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
W20260709 13:00:32.797694  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 47235.6us
I20260709 13:00:32.813323  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:32.797298  1704 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:32.812556  1551 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:32.826934  1709 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:32.770653  4980 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.829090  1599 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:32.830032  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 82192.5us
W20260709 13:00:32.838178  1673 leader_election.cc:336] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.928s (SENT)
I20260709 13:00:32.763794  4684 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.828111  4985 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:32.843164  4985 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:32.784366  4870 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:32.844736  4684 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:32.844838  4870 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:32.849038  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:32.845503  4684 raft_consensus.cc:3055] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:32.861321  4870 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:32.841940  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:32.861575  4684 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:32.861433  4893 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:32.861476  4982 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:32.862658  4979 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.848754  4985 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:32.871558  4893 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:32.872014  4893 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:32.850659  2323 raft_consensus.cc:2410] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:32.850533  1673 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:32.873353  4988 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:32.872947  4893 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.873569  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:32.874574  1673 leader_election.cc:336] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.943s (SENT)
W20260709 13:00:32.875967  1673 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.961s (SENT)
I20260709 13:00:32.876471  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:32.796479  4986 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:32.877974  1673 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.040s (SENT)
W20260709 13:00:32.880376  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 84825.6us
I20260709 13:00:32.882936  1673 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:32.785104  4884 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:32.889918  1526 connection.cc:256] RPC call timeout handler was delayed by -1.3759856709999667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2811s for a response
W20260709 13:00:32.892798  1673 leader_election.cc:336] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.104s (SENT)
I20260709 13:00:32.899524  4937 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.864987  4978 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:00:32.901021  4310 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:32.907685  1702 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:32.907716  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:32.912392  1708 raft_consensus.cc:2376] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5. Re-sending same reply.
I20260709 13:00:32.874619  2323 raft_consensus.cc:2410] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:32.909258  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:32.909900  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.910303  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:32.914700  1709 raft_consensus.cc:2393] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 7: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:32.914989  1707 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 7: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:32.916257  1630 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:32.920967  1633 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
W20260709 13:00:32.916793  1673 leader_election.cc:336] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.111s (SENT)
I20260709 13:00:32.924017  1673 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:32.925663  1673 leader_election.cc:336] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.257s (SENT)
I20260709 13:00:32.926281  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:32.921080  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:32.929975  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:32.931416  1708 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
W20260709 13:00:32.932134  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.886615  4988 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:32.933255  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 62190.9us
I20260709 13:00:32.943444  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:32.870795  4684 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:32.943759  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 101928us
I20260709 13:00:32.911309  4986 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:32.950908  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:32.951547  1627 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:32.945628  1707 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:32.964397  1551 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:32.965773  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 212907us
I20260709 13:00:32.964936  1673 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:32.965802  1551 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:32.968999  1675 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:32.970484  2288 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:32.965121  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:32.945144  4985 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.972573  1630 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:32.979743  1598 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:32.944054  4938 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:32.940826  4870 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:32.986502  4998 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:32.987185  4998 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.941555  4852 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:32.976518  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:32.994469  4988 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.994253  2329 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:32.977792  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:32.996930  1632 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:32.978025  4905 raft_consensus.cc:3055] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:32.978461  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:32.992504  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:32.985013  4938 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.984071  4513 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:32.982688  1598 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:33.020008  1598 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:32.971576  1551 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:32.940945  4933 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.991704  4684 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.963600  4978 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.991438  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:32.999240  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:33.098412  2329 raft_consensus.cc:2376] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5. Re-sending same reply.
I20260709 13:00:32.979380  4986 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:32.952081  4824 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:33.113425  2323 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 6: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:32.865760  4980 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.008296  4884 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:33.126399  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:33.127308  2323 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:33.128314  4884 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:33.128961  4884 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:33.009884  4937 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:33.011073  4940 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:33.001102  4905 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:33.015084  1673 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:33.133973  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:33.134424  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 119417us
I20260709 13:00:33.135037  2323 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:33.135512  1673 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:33.021926  1551 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.135870  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:32.991546  4870 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:32.984287  4985 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:33.044071  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.137780  4858 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:33.141067  4858 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:33.051229  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.141423  4858 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:32.992192  4914 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:33.142038  4914 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:33.144150  4914 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:32.993639  4916 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:33.108143  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:32.997366  4991 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:33.021476  4938 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:33.098662  4974 log.cc:927] Time spent T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:00:33.119277  1555 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:00:33.171629  1555 pending_rounds.cc:85] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 3
I20260709 13:00:33.172060  1555 pending_rounds.cc:107] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:00:33.172365  1555 raft_consensus.cc:2889] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:33.125214  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:33.174237  2322 raft_consensus.cc:2376] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8. Re-sending same reply.
I20260709 13:00:33.116329  4986 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:33.136318  5000 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:33.076784  4990 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:33.129467  4884 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.147958  1551 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:00:33.213230  1551 pending_rounds.cc:85] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 4
I20260709 13:00:33.213649  1551 pending_rounds.cc:107] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:00:33.213967  1551 raft_consensus.cc:2889] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:33.136684  2323 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 8: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:00:33.153771  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.168768  1706 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:33.197458  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 226987us
I20260709 13:00:33.198263  4513 raft_consensus.cc:697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:33.105108  4852 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:00:33.139183  4905 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.203513  2322 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:33.205724  2327 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:33.108781  4988 consensus_queue.cc:1059] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:00:33.239202  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:33.239713  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:33.240415  1634 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.240331  1632 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:33.219959  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:33.244302  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:33.245437  2327 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
W20260709 13:00:33.247089  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 111620us
I20260709 13:00:33.214555  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:33.140260  4998 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:33.099368  4933 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.259101  4933 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:33.230309  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 265015us
I20260709 13:00:33.232116  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:33.216807  4916 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:33.261936  2325 raft_consensus.cc:2410] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:33.263103  4916 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:33.263666  4916 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.264058  4916 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.265882  4990 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:33.266229  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:33.267088  4990 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.267930  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:33.277012  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:33.277993  5005 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:33.278748  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64252.8us
I20260709 13:00:33.278653  5005 consensus_queue.cc:1059] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:33.279819  5005 raft_consensus.cc:3055] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:33.280160  5005 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:33.280871  1526 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:33.280978  5005 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.302704  1601 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:33.241282  5000 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:33.293874  4914 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:33.303014  4905 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.333879  1601 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:33.341261  5002 log.cc:927] Time spent T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:00:33.341434  4513 consensus_queue.cc:237] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.344761  4999 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:33.345625  4999 consensus_queue.cc:1059] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:33.346226  1560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1969) took 2361 ms (client timeout 2104 ms). Trace:
W20260709 13:00:33.346634  1560 rpcz_store.cc:269] 0709 13:00:30.984756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.345848 (+2361092us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:33.346126 (+   278us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:00:33.348917  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:33.350746  1626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.923s	user 0.010s	sys 0.027s
I20260709 13:00:33.323813  5005 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:33.366791  2350 debug-util.cc:398] Leaking SignalData structure 0x7b0800339a60 after lost signal to thread 1455
W20260709 13:00:33.367656  2350 debug-util.cc:398] Leaking SignalData structure 0x7b0800330ac0 after lost signal to thread 1458
I20260709 13:00:33.370059  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:33.370854  1626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.943s	user 0.011s	sys 0.029s
W20260709 13:00:33.370975  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 148996us
I20260709 13:00:33.363229  4981 raft_consensus.cc:3055] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:33.329149  4914 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:33.334936  4940 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.376948  2288 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:33.346607  4999 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:33.378031  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:33.380499  2288 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:33.382818  1634 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:33.383949  4996 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:33.369925  4998 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:00:33.385399  4846 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:33.320293  5000 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.387068  4980 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:33.388667  4985 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:33.374672  4981 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:33.391324  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:33.391528  4937 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:33.401057  4870 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:33.402347  4893 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.403113  4628 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:33.404441  5012 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:33.404752  4987 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:33.402992  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2042) took 2807 ms. Trace:
I20260709 13:00:33.405651  1601 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:33.402347  4858 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.384430  4940 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.410327  1633 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:33.466339  5000 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:33.415352  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:33.419257  4591 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:33.423133  1672 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:33.427029  1629 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:33.377383  4914 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:33.431254  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 50853.7us
I20260709 13:00:33.433575  1627 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:33.436183  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:33.435783  4999 raft_consensus.cc:697] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:33.543865  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 120584us
I20260709 13:00:33.520569  1626 rpcz_store.cc:276] 0709 13:00:30.595592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.413924 (+818332us) service_pool.cc:224] Handling call
0709 13:00:31.414300 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.414585 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:31.427057 (+ 12472us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.402502 (+1975445us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:33.402559 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:33.402611 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.402791 (+   180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.402926 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20575,"prepare.queue_time_us":12788,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":32484,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":302,"spinlock_wait_cycles":10496,"thread_start_us":1943933,"threads_started":1,"wal-append.queue_time_us":114070,"wal-append.run_cpu_time_us":1683,"wal-append.run_wall_time_us":1002839}
I20260709 13:00:33.545900  1672 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:00:33.546253  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 258931us
W20260709 13:00:33.441283  5013 log.cc:927] Time spent T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:33.441659  5011 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:33.450425  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.460840  5028 consensus_queue.cc:1059] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:33.463107  1630 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:33.527864  5017 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:33.471802  1632 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:00:33.550078  1672 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:00:33.521253  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 115644us
I20260709 13:00:33.464356  4846 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.413296  4986 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:33.532213  1551 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
W20260709 13:00:33.537796  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:33.541302  1557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 1970) took 2546 ms (client timeout 1584 ms). Trace:
I20260709 13:00:33.540784  2288 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:00:33.560259  1557 rpcz_store.cc:269] 0709 13:00:30.987568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.531520 (+2543952us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:33.531682 (+   162us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:33.373991  5016 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:00:33.562055  2288 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:33.563333  1526 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:33.564817  4996 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:33.565424  4996 raft_consensus.cc:697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:33.566473  4996 consensus_queue.cc:237] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.312507  4916 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:33.547730  4988 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:33.564028  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:33.576136  2288 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:33.530296  4824 raft_consensus.cc:697] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:33.558609  1672 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:33.570242  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:33.579932  1630 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:33.579838  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:33.539785  4938 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:33.553483  4980 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:33.588408  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:33.559510  5011 raft_consensus.cc:697] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:33.560529  4852 raft_consensus.cc:2764] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:33.560797  4846 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:33.591802  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:33.593570  1672 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:33.594046  1629 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:33.594856  4980 raft_consensus.cc:697] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:33.595544  5023 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:33.596813  1633 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:33.584904  5027 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:33.585670  5009 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:33.607797  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:33.601511  1672 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:33.574966  4988 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.613067  1629 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:33.604375  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:33.614116  1633 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:33.572942  4591 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:33.589298  4922 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:33.605966  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:33.606702  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:33.605144  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:33.629676  1626 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:33.621122  1703 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:33.620669  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:33.631996  1627 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:33.600914  4986 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:33.634217  2321 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:33.643649  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:33.604833  4998 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:33.585137  5000 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:00:33.644816  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:33.644882  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:33.646250  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:33.612874  5009 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.612082  4655 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:33.618232  4988 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:33.617596  5024 raft_consensus.cc:3055] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:33.651381  1709 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
W20260709 13:00:33.665623  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 77294.3us
I20260709 13:00:33.657737  4940 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:33.659777  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:33.552048  4981 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.629012  4922 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.625161  5027 raft_consensus.cc:697] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:33.624284  5023 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:33.675683  5027 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.606392  5008 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:00:33.648156  5028 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:33.682749  5028 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:33.683216  5028 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.683689  4858 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:33.668641  4824 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.661680  4998 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:33.689429  4998 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.653533  5009 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.693349  4884 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.696089  4884 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:33.698446  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.666513  5024 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:33.668607  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:33.651644  4852 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.667748  1559 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:33.674114  4916 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:33.674547  4922 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:33.675843  5023 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.627859  5021 consensus_queue.cc:1059] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:00:33.702157  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:33.699793  5024 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:33.728346  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:33.733618  1558 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.662808  5031 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:33.735307  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:33.700086  5028 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:33.676841  5016 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.699812  4938 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:33.741848  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:33.744442  5024 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.731441  4981 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.726258  5008 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:33.751571  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:33.677208  5011 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.621384  4999 consensus_queue.cc:237] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:33.728964  4852 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:33.766163  1632 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:33.737262  5031 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:33.791105  1558 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:33.750428  5004 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:33.747570  4916 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:33.740522  5033 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:33.791559  5026 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.138s	user 0.002s	sys 0.000s
W20260709 13:00:33.797468  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 151576us
I20260709 13:00:33.827585  2288 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:33.828462  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 52492.5us
I20260709 13:00:33.753269  5008 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:33.829850  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:33.671561  4980 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.753376  5034 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:33.794854  5031 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.801970  4916 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:33.774571  5029 consensus_queue.cc:1059] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:00:33.832602  5008 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.872007  4655 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:33.872745  4655 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:33.876461  5005 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.001s
I20260709 13:00:33.750694  5016 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:33.854862  4905 consensus_meta.cc:287] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.002s
I20260709 13:00:33.847174  5034 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:33.855319  5011 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:33.858335  4591 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:33.865667  4916 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:33.883826  5033 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:33.893388  5034 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.866061  4914 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:33.884573  4684 consensus_meta.cc:287] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.779s	user 0.013s	sys 0.001s
I20260709 13:00:33.866462  4884 consensus_queue.cc:1059] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:00:33.802480  5004 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:33.914894  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 85118.9us
I20260709 13:00:33.900067  4655 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:33.912802  5049 consensus_queue.cc:1059] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:00:33.910946  5028 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:33.903247  5011 raft_consensus.cc:697] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:33.904526  4852 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:33.927416  5041 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:00:33.935148  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 101867us
I20260709 13:00:33.952495  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:33.898869  5037 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:00:33.957072  5028 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:33.978966  1559 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:33.981861  4870 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:00:33.983247  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.983935  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:33.985810  5043 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:33.986446  5043 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:33.987412  4884 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:33.988104  4884 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:33.989207  4884 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:33.990434  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 573) took 1083 ms. Trace:
I20260709 13:00:33.991009  1706 rpcz_store.cc:276] 0709 13:00:32.906569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.910844 (+  4275us) service_pool.cc:224] Handling call
0709 13:00:32.943227 (+ 32383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.215384 (+272157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.990095 (+774711us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540012d4d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:33.990371 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517630848}
I20260709 13:00:33.985476  4846 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:34.007791  1523 connection.cc:256] RPC call timeout handler was delayed by -1.7197750310000401s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
W20260709 13:00:34.008713  1523 connection.cc:256] RPC call timeout handler was delayed by -1.5595750310000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24260000000000004s for a response
W20260709 13:00:34.009287  1523 connection.cc:256] RPC call timeout handler was delayed by -1.4794245779999642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
I20260709 13:00:34.014470  4914 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:34.019447  2350 debug-util.cc:398] Leaking SignalData structure 0x7b080004db60 after lost signal to thread 1492
W20260709 13:00:34.020078  2350 debug-util.cc:398] Leaking SignalData structure 0x7b0800339a40 after lost signal to thread 1512
W20260709 13:00:34.021662  2350 debug-util.cc:398] Leaking SignalData structure 0x7b0800344b40 after lost signal to thread 1584
W20260709 13:00:34.022087  2350 debug-util.cc:398] Leaking SignalData structure 0x7b0800342f60 after lost signal to thread 1585
I20260709 13:00:33.987548  5043 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:34.026705  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2510) took 1259 ms. Trace:
I20260709 13:00:34.027168  1702 rpcz_store.cc:276] 0709 13:00:32.767747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.767957 (+   210us) service_pool.cc:224] Handling call
0709 13:00:34.026504 (+1258547us) spinlock_profiling.cc:243] Waited 84 ms on lock 0x7b540012bbd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:34.026619 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193291520}
W20260709 13:00:34.032650  2350 debug-util.cc:398] Leaking SignalData structure 0x7b08002ddb60 after lost signal to thread 1659
W20260709 13:00:34.034453  2350 debug-util.cc:398] Leaking SignalData structure 0x7b0800329da0 after lost signal to thread 1733
W20260709 13:00:34.035291  2350 debug-util.cc:398] Leaking SignalData structure 0x7b0800329e40 after lost signal to thread 1734
I20260709 13:00:33.976413  4790 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:34.039301  1599 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:34.041373  1523 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:34.042953  1523 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:34.015990  4310 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:34.045565  4310 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:33.970958  5044 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:34.050345  1599 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:34.052428  5044 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:34.059366  5044 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.058815  4310 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:34.060456  4310 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.040974  4790 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:34.062366  4790 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:34.011312  4591 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:34.063663  4790 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:34.074929  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:34.075781  1630 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.077991  1556 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:34.084486  1626 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:34.094298  1630 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:34.064327  5024 consensus_queue.cc:1059] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:00:34.097541  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:34.098170  5029 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:34.100121  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:34.226830  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 170961us
W20260709 13:00:34.122812  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.058836  4981 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:34.064764  4788 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:34.153870  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.150079  5017 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:00:34.039222  4988 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:34.171222  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 255158us
I20260709 13:00:34.084544  5004 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:34.018987  5011 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:34.085673  4938 consensus_queue.cc:1059] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:00:34.185101  5016 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:34.186282  5009 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:34.188777  5055 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:34.100914  5037 consensus_queue.cc:1059] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:00:34.081804  4922 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:34.255106  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 104615us
I20260709 13:00:34.240034  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:34.259001  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:34.242779  5051 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:34.233361  4981 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.277864  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:34.275590  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:34.289058  1704 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:34.289834  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:34.290032  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:34.282817  2288 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:34.285938  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:34.274505  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:34.293486  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 248469us
I20260709 13:00:34.293623  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:34.294252  1630 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.297797  1627 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:34.300329  1554 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:34.300740  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:34.301923  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:34.299628  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:34.302534  1704 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:34.302557  1707 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:34.303478  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:34.304085  1704 raft_consensus.cc:2376] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10. Re-sending same reply.
I20260709 13:00:34.308233  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:34.312124  1627 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:00:34.321146  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:34.322387  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:34.323081  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:34.323450  1705 raft_consensus.cc:2368] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6.
I20260709 13:00:34.325268  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:34.325591  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:34.254273  4998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.000s	sys 0.035s
I20260709 13:00:34.328114  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:34.328779  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:34.329509  1702 raft_consensus.cc:2376] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5. Re-sending same reply.
I20260709 13:00:34.329685  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:34.328207  1701 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:34.330407  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:34.285912  5029 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:34.286223  5051 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:34.333499  1556 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:34.286013  4788 raft_consensus.cc:697] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:34.335253  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:34.293025  4981 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.351001  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:34.349620  2350 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5260 after lost signal to thread 2353
I20260709 13:00:34.360348  1559 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:34.355360  1701 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:34.367383  1701 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:00:34.367939  1626 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:00:34.368436  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:34.366775  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:34.365267  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:34.305774  5049 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 13:00:34.359321  4919 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:00:34.330629  4998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.002s	sys 0.036s
I20260709 13:00:34.336052  1447 maintenance_manager.cc:419] P 1d002eece69f4b28add96a7bb163d0f2: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033342
I20260709 13:00:34.377964  4922 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:34.358613  5027 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:34.337325  5029 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:34.361517  5053 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.152s	user 0.000s	sys 0.002s
I20260709 13:00:34.328245  4884 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:34.299569  5054 consensus_queue.cc:1059] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
W20260709 13:00:34.387362  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:34.390257  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 95652.2us
I20260709 13:00:34.364272  5063 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:34.393828  1626 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:00:34.417611  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:34.379746  4990 raft_consensus.cc:3055] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:34.396988  4788 consensus_queue.cc:237] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:34.398068  5031 consensus_meta.cc:287] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.006s
I20260709 13:00:34.398854  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:34.399375  4905 raft_consensus.cc:3055] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:34.406453  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:34.406858  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:34.345098  1630 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:34.407706  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:34.351547  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:34.427188  1707 raft_consensus.cc:1275] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:34.432156  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:34.434196  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:34.418915  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:34.437703  1700 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:00:34.523026  1553 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:34.450536  1704 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:34.590112  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 158064us
I20260709 13:00:34.524542  1701 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.533206  4993 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.440239  4990 raft_consensus.cc:740] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:00:34.538563  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 104462us
I20260709 13:00:34.616119  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:34.617444  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:34.408445  5037 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.400348  5027 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:34.418526  5029 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.382422  5008 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:34.439500  4917 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:34.444519  4905 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:34.587894  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:34.443130  4884 raft_consensus.cc:697] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:00:34.536547  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 100311us
I20260709 13:00:34.605888  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:34.440780  5063 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:34.416400  5051 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:34.618237  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:34.661782  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:34.648634  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:34.692163  1560 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:34.694305  1704 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:34.571973  5049 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:34.691557  1553 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:34.522136  5031 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:34.613893  5016 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:34.728307  1700 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:34.581171  5028 raft_consensus.cc:3055] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:34.663014  5066 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:00:34.670650  4916 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.763s	user 0.010s	sys 0.006s
I20260709 13:00:34.708878  1552 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:34.709432  1706 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:34.609580  5022 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:34.664849  5059 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 13:00:34.637504  4993 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:34.662915  5057 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:00:34.730851  5028 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:34.716598  1554 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:34.717070  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:34.663503  5061 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:00:34.607583  5021 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:34.570183  5055 consensus_queue.cc:1059] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.150s
I20260709 13:00:34.649384  4988 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:34.725129  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:34.726197  1701 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:34.730701  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:34.668365  5063 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:34.772125  4790 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.708s	user 0.012s	sys 0.002s
I20260709 13:00:34.643970  2320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:00:34.727125  5051 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:34.699687  4917 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:34.700708  5037 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:34.732388  5049 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:34.792081  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:34.814808  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:34.816205  1630 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:34.792927  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:34.793584  2286 leader_election.cc:336] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.849s (SENT)
I20260709 13:00:34.797075  1560 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:34.819834  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:34.797600  1553 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
W20260709 13:00:34.799815  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 182415us
I20260709 13:00:34.821992  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:34.802043  2320 raft_consensus.cc:606] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:34.823916  2320 raft_consensus.cc:614] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:34.809507  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:34.781471  5071 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:34.776260  4916 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:34.733457  5016 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:34.830212  1704 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:34.791671  5070 raft_consensus.cc:2764] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:34.832610  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:34.731961  4990 consensus_queue.cc:260] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:34.831051  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:34.840148  1553 raft_consensus.cc:2393] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:34.772778  4905 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:34.841944  1526 leader_election.cc:400] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6.
I20260709 13:00:34.821175  5049 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.791075  5022 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:34.836006  5055 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:34.834478  5009 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:34.865799  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:34.843075  5028 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:34.872885  5069 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 13:00:34.874754  5058 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:00:34.875723  5067 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:00:34.878825  5075 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:00:34.888828  5064 consensus_queue.cc:1059] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:34.849013  5071 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:34.948483  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 140402us
W20260709 13:00:34.970309  2286 leader_election.cc:336] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.608s (SENT)
W20260709 13:00:34.970877  1673 leader_election.cc:336] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.540s (SENT)
I20260709 13:00:34.856129  4990 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.981709  1673 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:34.980834  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:34.866166  4905 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:34.982542  1601 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:34.970587  5034 consensus_meta.cc:287] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.056s	user 0.010s	sys 0.005s
I20260709 13:00:34.796001  4884 consensus_queue.cc:237] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:34.993535  5022 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:34.994441  5034 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:34.996950  5080 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:34.988092  4790 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.013510  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:35.014225  2328 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:34.997475  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:34.998281  5031 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:34.999271  5078 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:00:35.002205  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:35.003630  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 137886us
I20260709 13:00:35.029759  2325 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:35.004650  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:35.030335  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2335) took 1443 ms. Trace:
I20260709 13:00:34.898041  5055 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:35.008549  1558 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:34.986178  5044 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.926s	user 0.015s	sys 0.000s
I20260709 13:00:35.015941  1635 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:35.044782  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2055) took 1452 ms. Trace:
I20260709 13:00:35.045192  1635 rpcz_store.cc:276] 0709 13:00:33.592772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.594233 (+  1461us) service_pool.cc:224] Handling call
0709 13:00:34.997333 (+1403100us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b5800153f98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 13:00:35.044701 (+ 47368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5722496}
I20260709 13:00:35.009889  5028 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.983461  5024 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:35.047802  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 51371.7us
I20260709 13:00:35.022855  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:35.024008  2320 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:35.024529  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:35.050369  2326 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.025449  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:34.982411  5008 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:34.989097  5009 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:35.028496  1673 leader_election.cc:336] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.681s (SENT)
I20260709 13:00:35.031193  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:35.031795  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:35.057837  1673 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:35.030900  1557 rpcz_store.cc:276] 0709 13:00:33.587284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.588147 (+   863us) service_pool.cc:224] Handling call
0709 13:00:33.588465 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.800037 (+211572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.800087 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.806934 (+  6847us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.331807 (+524873us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:34.331922 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.332005 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:35.030091 (+698086us) raft_consensus.cc:1685] finished
0709 13:00:35.030112 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.030285 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14259,"raft.queue_time_us":23469,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8912,"thread_start_us":694782,"threads_started":2,"wal-append.queue_time_us":883272}
I20260709 13:00:35.058710  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:35.059888  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:35.021015  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:35.010497  5080 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.062666  5080 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:35.060010  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:35.063804  1556 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:35.066841  2325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
W20260709 13:00:35.092211  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 66604.5us
W20260709 13:00:35.095970  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64920.8us
I20260709 13:00:35.097491  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:35.034893  4996 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.034499  4591 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:35.036024  5027 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:35.106796  5037 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:35.099339  5081 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:35.117473  5082 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:00:35.121205  4916 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:35.124450  5016 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:35.125677  4591 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.115792  5006 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:00:35.131219  5055 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:35.138486  2326 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:35.138720  4591 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:35.142485  4981 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.770s	user 0.005s	sys 0.014s
I20260709 13:00:35.142751  5081 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:35.094213  4790 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:35.152508  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:35.168550  1673 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.803s (SENT)
I20260709 13:00:35.169318  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:35.113734  4996 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.056788  5044 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:35.176554  4790 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:35.190521  4790 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:35.192890  4790 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:35.194440  5011 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.195061  5011 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.195552  5063 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:35.197100  2328 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:35.199388  2326 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:35.184254  5016 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:35.143011  4981 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.185194  5006 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:00:35.185247  4990 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:00:35.186161  4986 consensus_queue.cc:1059] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:00:35.201375  4591 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.205210  5068 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.206492  5063 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:35.216145  5029 consensus_meta.cc:287] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.006s
I20260709 13:00:35.218030  5011 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:35.217027  5044 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:35.218272  5029 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.215865  5068 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.219424  5016 raft_consensus.cc:3055] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:35.219820  5033 raft_consensus.cc:3055] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:35.220065  5016 raft_consensus.cc:740] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:35.221235  5068 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:35.221613  5016 consensus_queue.cc:260] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:35.220218  5033 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:35.225339  5033 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.228176  5034 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:35.232602  5029 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:35.238140  5071 raft_consensus.cc:3055] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:35.238629  5071 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:35.240013  5071 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.245106  5071 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.300187  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:35.302055  1551 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:35.305687  1559 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:35.229311  5016 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:35.381620  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 82144.7us
I20260709 13:00:35.384289  5060 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:35.365381  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.365998  1627 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:35.366518  2286 leader_election.cc:336] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.237s (SENT)
I20260709 13:00:35.368783  4996 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:35.369817  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 186909us
I20260709 13:00:35.377255  4591 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.393083  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:35.383342  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:35.396250  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:35.397109  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:35.397243  2286 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:35.397684  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:35.398247  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:35.394155  4591 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:35.401438  2323 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:35.405346  2328 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:35.404634  2320 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:35.404712  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:35.416119  2329 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:35.419327  4981 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:35.421253  5099 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:35.421612  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 55355.9us
W20260709 13:00:35.426184  2286 leader_election.cc:336] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.958s (SENT)
I20260709 13:00:35.434127  4986 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:35.435477  4986 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.435228  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:35.436636  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:35.436062  4986 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:35.444921  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 61867.4us
I20260709 13:00:35.446977  2322 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:00:35.447644  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:35.451144  2325 raft_consensus.cc:606] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:35.452037  2325 raft_consensus.cc:614] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:35.459918  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2006) took 1111 ms. Trace:
I20260709 13:00:35.462383  4981 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:35.468415  4981 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.472491  4981 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:35.473178  5054 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:35.473410  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 80645.5us
I20260709 13:00:35.473855  5054 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.474349  5054 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.478596  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:35.488086  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2298) took 1863 ms. Trace:
I20260709 13:00:35.480543  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2054) took 1888 ms. Trace:
W20260709 13:00:35.486068  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2291) took 1875 ms (client timeout 2209 ms). Trace:
W20260709 13:00:35.484692  1703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 581) took 1905 ms (client timeout 1629 ms). Trace:
W20260709 13:00:35.496299  1708 rpcz_store.cc:269] 0709 13:00:33.610927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.644661 (+ 33734us) service_pool.cc:224] Handling call
0709 13:00:35.485609 (+1840948us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54003eb7d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:35.485863 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":932421504}
I20260709 13:00:35.502020  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:35.502657  2322 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:35.502858  1555 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:35.503032  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:35.503695  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2350) took 1222 ms. Trace:
I20260709 13:00:35.504101  1555 rpcz_store.cc:276] 0709 13:00:34.281764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.281979 (+   215us) service_pool.cc:224] Handling call
0709 13:00:35.463714 (+1181735us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960eee 0000000000375939 00007f0ede9d41e0 00007f0edea9d0c4 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 13:00:35.464196 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.503391 (+ 39195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.503568 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4077696}
I20260709 13:00:35.505415  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:35.505935  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:35.507875  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:35.504180  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:35.482916  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:35.491885  1709 rpcz_store.cc:276] 0709 13:00:33.624224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.680467 (+ 56243us) service_pool.cc:224] Handling call
0709 13:00:34.030352 (+349885us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.030736 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.030764 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.038276 (+  7512us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.253985 (+215709us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:34.285452 (+ 31467us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.285668 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.285751 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:35.108516 (+822765us) raft_consensus.cc:1685] finished
0709 13:00:35.108536 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.487709 (+379173us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b540012bbd0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:35.487886 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32145,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":4824,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":15469,"spinlock_wait_cycles":744626560,"thread_start_us":168613,"threads_started":1,"wal-append.queue_time_us":545773}
I20260709 13:00:35.483840  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:00:35.496948  1703 rpcz_store.cc:269] 0709 13:00:33.578669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.579475 (+   806us) service_pool.cc:224] Handling call
0709 13:00:35.484213 (+1904738us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b5400396f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:35.484406 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92887552}
I20260709 13:00:35.466981  1554 rpcz_store.cc:276] 0709 13:00:34.347846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.531831 (+183985us) service_pool.cc:224] Handling call
0709 13:00:35.459454 (+927623us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b5400056ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:35.459672 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100695936}
I20260709 13:00:35.520244  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:35.521636  1554 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:35.520797  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2013) took 1066 ms. Trace:
I20260709 13:00:35.522945  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:35.523042  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:35.522680  1556 rpcz_store.cc:276] 0709 13:00:34.429586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.299683 (+870097us) service_pool.cc:224] Handling call
0709 13:00:35.300744 (+  1061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.351431 (+ 50687us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:35.440450 (+ 89019us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.495477 (+ 55027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.495532 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:35.495591 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.495784 (+   193us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.496286 (+   502us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3303,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":177,"thread_start_us":109232,"threads_started":2}
I20260709 13:00:35.524816  4978 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.525228  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:35.526857  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:35.529192  1556 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
W20260709 13:00:35.531445  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.535631  4993 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:35.558789  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:35.559913  1708 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:35.543568  2326 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:35.543855  5033 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:35.563261  5029 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:35.563584  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.564431  5095 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:35.565330  5095 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.492283  1628 rpcz_store.cc:276] 0709 13:00:33.592482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.594902 (+  2420us) service_pool.cc:224] Handling call
0709 13:00:35.478096 (+1883194us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b5800153f98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 13:00:35.480442 (+  2346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5095296}
I20260709 13:00:35.553100  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:35.553130  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:35.557402  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:35.561435  1627 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:00:35.553200  1555 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
W20260709 13:00:35.564383  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:35.572196  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 67231.3us
I20260709 13:00:35.573668  5060 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:35.575838  1703 raft_consensus.cc:2368] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8.
I20260709 13:00:35.576043  5005 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.576913  5005 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:35.578001  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.579432  5005 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:35.580287  4914 raft_consensus.cc:3055] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:35.580788  4914 raft_consensus.cc:740] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:35.581864  1630 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:35.582316  4914 consensus_queue.cc:260] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:35.587689  5028 consensus_meta.cc:287] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.522s	user 0.006s	sys 0.013s
I20260709 13:00:35.588930  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:35.558904  5054 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.595530  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2048) took 2004 ms. Trace:
W20260709 13:00:35.596657  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 113165us
I20260709 13:00:35.597321  5054 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:35.589545  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:35.609442  1707 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:35.592260  4978 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:35.610674  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:35.611456  4978 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.599292  5072 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:35.612833  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:35.614005  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:35.614355  4978 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:35.600065  5035 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:35.615435  5035 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:35.600207  4917 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:35.600448  5029 consensus_queue.cc:1059] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:35.598323  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:35.590404  2320 raft_consensus.cc:2410] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:35.601599  4846 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:35.595621  5043 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.599470  5060 consensus_queue.cc:1059] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:35.605657  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:35.612988  5072 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:35.626991  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:35.616472  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2012) took 1187 ms. Trace:
I20260709 13:00:35.601624  1709 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 5.
I20260709 13:00:35.631374  1523 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:35.633870  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2534) took 1200 ms. Trace:
I20260709 13:00:35.618860  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:35.617633  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2343) took 1541 ms. Trace:
I20260709 13:00:35.596290  1632 rpcz_store.cc:276] 0709 13:00:33.590764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.591319 (+   555us) service_pool.cc:224] Handling call
0709 13:00:33.765914 (+174595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.766669 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.595080 (+1828411us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54000d93d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:35.595286 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354408320}
I20260709 13:00:35.598383  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:35.644111  1551 rpcz_store.cc:276] 0709 13:00:34.075812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.076297 (+   485us) service_pool.cc:224] Handling call
0709 13:00:34.076682 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.380207 (+1303525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.617346 (+237139us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001f7054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:35.617577 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2815896320}
I20260709 13:00:35.646158  1708 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:35.627375  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:35.617681  5049 consensus_meta.cc:287] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.757s	user 0.009s	sys 0.018s
I20260709 13:00:35.642774  1559 rpcz_store.cc:276] 0709 13:00:34.429294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.803812 (+374518us) service_pool.cc:224] Handling call
0709 13:00:35.616226 (+812414us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b5400050fd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:35.616416 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1103000320}
I20260709 13:00:35.649766  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:35.650545  1559 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:35.650585  1560 raft_consensus.cc:2410] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:00:35.648345  1633 raft_consensus.cc:2368] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8.
I20260709 13:00:35.651126  1557 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:35.627401  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:35.643751  1700 rpcz_store.cc:276] 0709 13:00:34.433705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.525475 (+ 91770us) service_pool.cc:224] Handling call
0709 13:00:34.728062 (+202587us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.728739 (+   677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.633063 (+904324us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540012cfd0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:35.633557 (+   494us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465068288}
I20260709 13:00:35.656464  1626 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:35.617380  5035 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.657048  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:35.656337  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:35.659951  5035 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:35.665120  1703 raft_consensus.cc:2410] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:35.633245  5044 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.666442  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:35.672330  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.633424  5070 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:35.678561  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:35.681422  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:35.673751  5024 raft_consensus.cc:3055] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:35.691253  2286 leader_election.cc:336] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.084s (SENT)
I20260709 13:00:35.671192  5000 raft_consensus.cc:3055] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:35.670053  5077 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.564s	user 0.005s	sys 0.000s
I20260709 13:00:35.674376  4978 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.695086  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:35.700035  1630 raft_consensus.cc:2368] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8.
I20260709 13:00:35.698691  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:35.701550  5068 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:35.701085  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:35.703222  2324 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 10: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:35.703811  2323 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:35.674129  5044 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.707115  5044 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:35.654758  5005 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:00:35.709040  2322 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:00:35.709784  2322 pending_rounds.cc:85] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 5
I20260709 13:00:35.710245  2322 pending_rounds.cc:107] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:00:35.710088  5070 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:35.710866  2322 raft_consensus.cc:2889] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:35.673614  5072 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.713194  5022 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:35.713959  5022 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:35.717211  4790 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.718134  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:35.717973  4790 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.701289  5051 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:35.691679  5024 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:35.726469  5024 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:35.727140  1673 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.341s (SENT)
I20260709 13:00:35.727705  1673 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:35.728139  5024 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.729187  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 588) took 1058 ms. Trace:
I20260709 13:00:35.694104  5000 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:35.731180  5021 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:35.732043  5021 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:35.732192  5000 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:35.733563  5000 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:35.692051  5043 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.736146  5021 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:35.738147  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:35.736739  4978 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.738931  2327 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:00:35.737100  4990 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:35.740146  4985 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:35.739917  4990 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:35.740741  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2338) took 1765 ms. Trace:
I20260709 13:00:35.741341  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:35.741284  1558 rpcz_store.cc:276] 0709 13:00:33.975024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.975863 (+   839us) service_pool.cc:224] Handling call
0709 13:00:33.979260 (+  3397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.035374 (+1056114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.740205 (+704831us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400026f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:35.740522 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2365655808}
I20260709 13:00:35.742360  1555 raft_consensus.cc:2410] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:35.742630  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:35.742887  4990 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:00:35.737847  5016 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:35.729818  1704 rpcz_store.cc:276] 0709 13:00:34.670362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.775225 (+104863us) service_pool.cc:224] Handling call
0709 13:00:34.775694 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.830668 (+ 54974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.728494 (+897826us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b54003ec1d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:35.728954 (+   460us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87085440}
I20260709 13:00:35.740828  4985 raft_consensus.cc:697] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:35.743786  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:35.744076  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:35.745056  1555 raft_consensus.cc:2410] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:35.745296  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2340) took 1769 ms. Trace:
I20260709 13:00:35.744874  4985 consensus_queue.cc:237] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:35.745860  1551 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:35.746263  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.747176  5095 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:35.747637  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 116554us
I20260709 13:00:35.737531  5043 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:35.738489  5021 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.749284  5022 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:35.749971  5021 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:35.750157  5051 consensus_queue.cc:1059] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:35.745644  1552 rpcz_store.cc:276] 0709 13:00:33.975681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.976254 (+   573us) service_pool.cc:224] Handling call
0709 13:00:33.992929 (+ 16675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.783006 (+790077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.744775 (+961769us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54002f49d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:35.745138 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645904256}
I20260709 13:00:35.753175  5051 raft_consensus.cc:3055] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:35.753592  5051 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:35.732831  1633 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:35.754863  5051 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.756517  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:35.757234  5051 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:35.757967  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:35.759125  1633 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:35.729947  4790 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:35.763388  5060 raft_consensus.cc:3055] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:35.763518  5021 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:35.739485  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 50781.5us
W20260709 13:00:35.766254  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 70324.5us
I20260709 13:00:35.751874  1523 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:35.783886  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:35.775269  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 148246us
I20260709 13:00:35.787926  1554 raft_consensus.cc:2393] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 10: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:35.794282  5012 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:35.800398  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:35.675186  5049 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:35.786212  2288 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:35.803169  1626 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:35.806257  1556 raft_consensus.cc:2393] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 9: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:35.795648  5012 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.770053  5060 raft_consensus.cc:740] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:35.815768  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:35.817811  1709 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:35.826077  1555 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 10. Ops: []
I20260709 13:00:35.797993  4917 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:35.828763  1551 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:35.786727  5068 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:35.844798  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 616) took 1102 ms. Trace:
I20260709 13:00:35.845273  1555 rpcz_store.cc:276] 0709 13:00:34.724673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.773115 (+1048442us) service_pool.cc:224] Handling call
0709 13:00:35.816487 (+ 43372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.826704 (+ 10217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.826966 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:35.846737  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 158487us
I20260709 13:00:35.848428  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 617) took 1093 ms. Trace:
I20260709 13:00:35.848973  1551 rpcz_store.cc:276] 0709 13:00:34.736930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.772495 (+1035565us) service_pool.cc:224] Handling call
0709 13:00:35.821097 (+ 48602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.829421 (+  8324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.829687 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:35.859938  2286 leader_election.cc:336] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.159s (SENT)
I20260709 13:00:35.863026  1675 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:35.864169  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 265904us
W20260709 13:00:35.873063  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 121357us
I20260709 13:00:35.874862  1523 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:35.876725  1599 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.552s (SENT) [suppressed 48 similar messages]
W20260709 13:00:35.877499  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 57299.2us
I20260709 13:00:35.877763  1558 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:35.881269  1626 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:00:35.884754  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.876322  1523 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:35.876866  5080 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.016s
I20260709 13:00:35.878013  1631 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: [3.3-6.4]
W20260709 13:00:35.886921  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.890655  2286 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:35.896788  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64312.3us
I20260709 13:00:35.853976  5005 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:35.899260  1601 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:35.905092  1598 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:35.867268  4917 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:35.906576  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2056) took 2308 ms. Trace:
I20260709 13:00:35.866914  5070 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:35.896176  4914 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.909956  2288 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:00:35.914268  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.910524  1631 rpcz_store.cc:276] 0709 13:00:33.593174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.595185 (+  2011us) service_pool.cc:224] Handling call
0709 13:00:35.877146 (+2281961us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b5800153f98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 13:00:35.877545 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:35.893648 (+ 16103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.901680 (+  8032us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4432128}
I20260709 13:00:35.939479  4990 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.854336  5022 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 13:00:35.941015  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 64757.7us
I20260709 13:00:35.940534  5099 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:35.948208  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 53181.3us
W20260709 13:00:35.952749  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 121713us
I20260709 13:00:35.915943  5005 raft_consensus.cc:697] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:35.911999  5021 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:35.961222  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.941057  4985 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.929454  5016 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:35.963272  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 77644.6us
I20260709 13:00:35.966372  1553 raft_consensus.cc:2410] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:35.904891  5080 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.947357  5072 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:35.967876  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 63942.4us
I20260709 13:00:35.940227  4990 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.972878  5052 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:00:35.973562  4917 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.973842  5060 consensus_queue.cc:260] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.976359  5085 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:35.942976  5044 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:35.976817  5005 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:35.965085  1598 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:35.988260  5068 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:36.010733  5012 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:35.977124  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:36.027536  5016 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:36.033075  2288 leader_election.cc:400] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8.
I20260709 13:00:36.033320  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2015) took 1603 ms. Trace:
I20260709 13:00:36.037308  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 619) took 1221 ms. Trace:
I20260709 13:00:36.056195  2288 leader_election.cc:403] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:00:36.039942  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 622) took 1181 ms. Trace:
W20260709 13:00:36.037045  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 309727us
I20260709 13:00:36.056285  1558 rpcz_store.cc:276] 0709 13:00:34.430207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.773274 (+1343067us) service_pool.cc:224] Handling call
0709 13:00:35.815824 (+ 42550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.879295 (+ 63471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.033040 (+153745us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b540017f2d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:36.033260 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141458176}
I20260709 13:00:36.057226  1557 rpcz_store.cc:276] 0709 13:00:34.858776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.059459 (+200683us) service_pool.cc:224] Handling call
0709 13:00:36.039715 (+980256us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54001aa9d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:36.039868 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553536896}
I20260709 13:00:36.043452  1559 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:35.970688  5071 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:36.049558  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 50487.7us
I20260709 13:00:36.052277  1555 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:00:36.054507  1634 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:36.062314  1555 pending_rounds.cc:85] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 6
I20260709 13:00:36.063279  1555 pending_rounds.cc:107] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:36.063627  1555 raft_consensus.cc:2889] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:36.056401  1560 rpcz_store.cc:276] 0709 13:00:34.815535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.819563 (+  4028us) service_pool.cc:224] Handling call
0709 13:00:36.036884 (+1217321us) spinlock_profiling.cc:243] Waited 823 ms on lock 0x7b54000578d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:36.037213 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891995904}
W20260709 13:00:36.077114  5108 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.071s	user 0.002s	sys 0.002s
I20260709 13:00:36.059868  5043 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:36.078186  5043 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.078898  5043 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:36.079800  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.085013  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:36.100369  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:36.100802  4978 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:36.103456  4628 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:36.104172  4985 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.111672  4985 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:36.059644  5021 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:00:36.104538  1523 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:36.114974  5033 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:36.115203  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 123893us
I20260709 13:00:36.116003  1559 raft_consensus.cc:1275] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:00:36.116410  1559 pending_rounds.cc:85] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 3
I20260709 13:00:36.116273  5052 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8.
I20260709 13:00:36.116750  1559 pending_rounds.cc:107] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:00:36.117087  1559 raft_consensus.cc:2889] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:36.116021  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:36.118639  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:36.120183  4684 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:36.120420  5099 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:36.120669  4684 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.121305  4684 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.121003  5072 consensus_queue.cc:1059] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:36.122098  1701 raft_consensus.cc:1275] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:00:36.122457  1701 pending_rounds.cc:85] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 2
I20260709 13:00:36.122714  1701 pending_rounds.cc:107] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:00:36.122582  5072 consensus_queue.cc:1059] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:36.123023  1701 raft_consensus.cc:2889] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:36.123768  5072 consensus_queue.cc:1059] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:36.124657  5093 raft_consensus.cc:3055] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:36.125072  4943 raft_consensus.cc:3055] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:36.125443  5093 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:36.121140  4981 consensus_queue.cc:1059] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:00:36.126972  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:36.126766  5093 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:36.127573  5052 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:36.128114  5093 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:36.111057  4986 consensus_meta.cc:287] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.661s	user 0.013s	sys 0.000s
I20260709 13:00:36.127219  4981 raft_consensus.cc:3055] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:36.128218  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:36.129086  5016 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:36.125561  4943 raft_consensus.cc:740] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:36.120990  5099 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.108743  4914 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:36.127123  2288 leader_election.cc:400] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8.
I20260709 13:00:36.177249  2288 leader_election.cc:403] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:36.107390  5080 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:36.096518  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 141763us
W20260709 13:00:36.163733  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.141283  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2053) took 2506 ms (client timeout 2367 ms). Trace:
I20260709 13:00:36.121043  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:36.180408  1704 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:00:36.183831  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:36.186054  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:36.179749  1634 rpcz_store.cc:269] 0709 13:00:33.592217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.594621 (+  2404us) service_pool.cc:224] Handling call
0709 13:00:35.482334 (+1887713us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b5800153f98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 13:00:36.098549 (+616215us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b54001b9c54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:36.098674 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241755136}
I20260709 13:00:36.191929  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:36.200243  2327 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.203287  4943 consensus_queue.cc:260] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:36.204869  4943 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.096295  5085 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:00:36.209326  1558 raft_consensus.cc:1240] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:36.210700  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.212113  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:36.212673  4914 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:36.141325  4981 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:36.215319  4914 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:36.215430  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.216120  2326 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:00:36.175423  4986 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:36.216686  5052 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:00:36.216781  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 89828.4us
I20260709 13:00:36.217517  5030 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.217603  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:36.241025  1553 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.219846  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.220494  4937 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.209326  2328 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:36.221081  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:36.221393  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:36.222316  4985 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:36.222121  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:36.223507  5118 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.118s	user 0.002s	sys 0.000s
I20260709 13:00:36.224762  1558 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.178895  5099 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.228183  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:36.229866  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:36.232761  4684 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:36.233402  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.234988  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:36.247666  1707 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.235302  4824 raft_consensus.cc:3055] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:36.204341  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:36.243080  1557 raft_consensus.cc:2393] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:36.246573  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:36.245024  2288 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:36.254557  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:36.282066  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.320055  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:36.253795  4824 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:36.328334  1704 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 4. Current term is 5. Ops: [3.6-4.7]
W20260709 13:00:36.334594  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 309262us
I20260709 13:00:36.337139  2327 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:00:36.338810  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:36.340186  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 50919.7us
I20260709 13:00:36.342684  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:36.347460  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:36.347769  4824 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:36.349650  4824 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.320780  5016 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:36.349674  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:36.360671  1558 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:36.361006  1555 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:36.374886  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 153936us
W20260709 13:00:36.381417  2286 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.240s (SENT)
W20260709 13:00:36.344995  5000 consensus_meta.cc:287] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.611s	user 0.014s	sys 0.002s
I20260709 13:00:36.355106  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:36.392119  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:36.393110  1627 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:00:36.393780  1558 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:36.394109  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:36.395062  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 242133us
I20260709 13:00:36.401924  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:36.405129  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 50095.8us
I20260709 13:00:36.341862  5005 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.407351  5005 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:36.408952  5085 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:36.409595  5085 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.410421  5085 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.410566  5005 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:36.411360  5005 raft_consensus.cc:2764] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:36.288636  5021 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:00:36.386129  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:36.284691  4937 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:36.421703  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:36.422968  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:36.421954  1556 raft_consensus.cc:1275] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:36.425318  2322 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:36.425453  1558 raft_consensus.cc:1240] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:36.358877  5016 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:36.323302  5052 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:36.437939  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.444432  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.446009  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:36.344195  4978 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:00:36.417594  5019 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:36.442139  2325 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:36.450851  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:36.431660  5016 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.498805  1706 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:36.496548  1553 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:36.499101  2323 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 10: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:36.508872  2321 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:36.442597  4990 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:36.517180  1553 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:36.521229  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:36.442812  5022 consensus_queue.cc:1059] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
W20260709 13:00:36.549150  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 115990us
W20260709 13:00:36.553406  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 312963us
I20260709 13:00:36.497560  5000 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.556082  1553 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:36.557551  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:36.561414  2325 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 6: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:36.562381  1673 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:36.566109  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 143669us
I20260709 13:00:36.566655  2322 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:36.533816  4999 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:36.574970  1523 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:36.579008  1523 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:36.461104  4981 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:36.582974  2288 leader_election.cc:400] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8.
I20260709 13:00:36.522635  5019 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:36.590646  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.592885  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:36.580698  5113 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:00:36.605146  5119 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 13:00:36.607059  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.573195  4684 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:36.605378  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.576850  5051 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.621228  1553 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:00:36.619190  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44259.5us
I20260709 13:00:36.608814  2325 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:36.628417  2323 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:36.630425  1706 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:00:36.578087  4986 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:36.626946  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:36.588095  4978 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:36.623816  5044 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:36.631678  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 620) took 1790 ms. Trace:
W20260709 13:00:36.624377  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.650110  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:36.636541  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:36.647528  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:36.654099  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.651057  2321 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:36.647869  1554 rpcz_store.cc:276] 0709 13:00:34.832865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.788772 (+955907us) service_pool.cc:224] Handling call
0709 13:00:35.904470 (+115698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.925424 (+ 20954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.925471 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:35.944304 (+ 18833us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.193529 (+249225us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:36.193583 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.193671 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.608299 (+414628us) raft_consensus.cc:1685] finished
0709 13:00:36.608317 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.623270 (+ 14953us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9758,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":11971,"thread_start_us":156620,"threads_started":1,"wal-append.queue_time_us":355124}
I20260709 13:00:36.585435  5000 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:36.673014  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.590342  5024 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
W20260709 13:00:36.677925  5120 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.070s	user 0.001s	sys 0.001s
I20260709 13:00:36.678683  1706 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:36.682999  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.668323  4914 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:36.689051  1553 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:36.651226  5051 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:36.690368  5124 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:00:36.688669  5005 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:36.708678  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 146383us
I20260709 13:00:36.711376  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:36.711800  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:36.702147  5043 consensus_meta.cc:287] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.002s
W20260709 13:00:36.712599  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 152581us
I20260709 13:00:36.714531  1553 raft_consensus.cc:2410] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:36.715058  1554 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:36.726228  1601 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:36.730598  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:36.701081  5052 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:36.708649  4986 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.737443  1598 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:36.738145  5051 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:36.738526  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.738646  5130 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:00:36.726989  5044 raft_consensus.cc:697] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:36.702436  5004 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.169s
I20260709 13:00:36.720229  4937 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:36.751477  4943 consensus_meta.cc:287] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.006s
I20260709 13:00:36.769455  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.770452  1560 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:00:36.772279  5030 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.000s
I20260709 13:00:36.746454  4824 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:36.759538  4986 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:36.760802  5122 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:00:36.762199  5000 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:36.724473  5043 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:36.765981  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.756094  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:36.796391  2322 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.737507  5019 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:36.778636  1626 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:36.785809  1553 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:36.790717  1707 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:36.745936  5005 raft_consensus.cc:697] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:36.784866  4824 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.753784  5051 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.782389  5060 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.803171  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.803718  4824 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:36.804641  1553 raft_consensus.cc:1240] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:36.804980  5005 consensus_queue.cc:237] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:36.806210  5019 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:36.807147  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 56547.5us
I20260709 13:00:36.848173  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:36.808117  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 657) took 1183 ms. Trace:
I20260709 13:00:36.848893  1628 rpcz_store.cc:276] 0709 13:00:35.624464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.683340 (+ 58876us) service_pool.cc:224] Handling call
0709 13:00:36.807813 (+1124473us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b5400247a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:36.807945 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1918887808}
I20260709 13:00:36.809149  2320 raft_consensus.cc:2393] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:36.810273  4986 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:36.811884  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 74521.1us
I20260709 13:00:36.793509  5030 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8.
W20260709 13:00:36.816095  5099 consensus_meta.cc:287] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.000s
I20260709 13:00:36.820194  1560 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:00:36.851956  1703 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:00:36.812800  2322 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
W20260709 13:00:36.819094  5093 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.643s	user 0.006s	sys 0.004s
I20260709 13:00:36.776890  5070 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:36.846835  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 74246.3us
W20260709 13:00:36.835671  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.857276  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:36.856176  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:36.857908  1707 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:36.857988  1634 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.851982  1560 pending_rounds.cc:85] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 7
I20260709 13:00:36.860090  5049 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:36.861526  5143 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:36.861931  5143 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:36.862845  5143 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:36.864073  5143 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.865417  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:36.869357  1633 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:36.870416  5043 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:36.870656  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:36.871527  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:36.872653  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.876756  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 640) took 1504 ms. Trace:
I20260709 13:00:36.877231  1551 rpcz_store.cc:276] 0709 13:00:35.372707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.859493 (+486786us) service_pool.cc:224] Handling call
0709 13:00:35.889615 (+ 30122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.109571 (+219956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.109601 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:36.109645 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:36.109678 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.876511 (+766833us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54001d6ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:36.876559 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.876699 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":526,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"spinlock_wait_cycles":504904064}
I20260709 13:00:36.856001  5044 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:36.858505  5099 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:36.882081  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 618) took 2086 ms. Trace:
I20260709 13:00:36.882648  5099 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:36.884810  1631 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:36.882535  1552 rpcz_store.cc:276] 0709 13:00:34.795421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.772538 (+977117us) service_pool.cc:224] Handling call
0709 13:00:35.851910 (+ 79372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.084701 (+232791us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.084753 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:36.084821 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:36.084869 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.881827 (+796958us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54000b7cd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:36.881887 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.882021 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491968256}
I20260709 13:00:36.886615  1560 pending_rounds.cc:107] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:00:36.887032  1560 raft_consensus.cc:2889] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:36.889031  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:36.847347  5051 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:36.847360  5144 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 13:00:36.896482  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 102494us
I20260709 13:00:36.904327  5137 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:36.904808  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 53403.8us
I20260709 13:00:36.905036  5137 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:36.906021  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:36.907063  5072 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:36.907300  5137 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:36.908766  5072 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:36.910074  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.911751  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.912019  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:36.912319  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.913144  1558 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:36.912981  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.912545  1554 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:36.915630  4990 raft_consensus.cc:3055] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:36.919726  5126 log.cc:927] Time spent T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:00:36.901360  5085 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:36.927704  5085 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:36.929353  4943 consensus_queue.cc:1059] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:36.931317  4943 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:36.932839  1634 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:00:36.935128  1599 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:36.936081  5000 raft_consensus.cc:3055] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:36.936648  5093 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:36.854763  5109 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:36.938879  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:36.942104  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:36.942624  2286 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:36.942988  2321 raft_consensus.cc:2410] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:36.944092  5138 consensus_queue.cc:1059] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:36.945293  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.946275  1555 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:36.946749  5138 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:36.887470  1675 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:36.938313  1598 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:36.936434  1672 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:36.971014  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 112578us
W20260709 13:00:36.896386  5116 log.cc:927] Time spent T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.575s	user 0.000s	sys 0.004s
I20260709 13:00:36.972762  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:36.972324  5004 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:00:36.975239  4628 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:36.975925  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:36.996851  1708 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:36.976514  4986 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:36.972232  5043 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:00:37.015213  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 76982.8us
W20260709 13:00:36.980711  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.016175  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:36.972396  4917 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:00:36.966840  5130 raft_consensus.cc:3055] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:37.018049  5130 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:00:37.018368  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 47518.8us
I20260709 13:00:37.019430  1599 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:36.932412  4914 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:37.020128  4914 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.978456  4824 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:37.022430  5072 consensus_queue.cc:1059] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:37.023411  4824 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:37.023502  5072 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:36.981122  5070 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:36.916574  4990 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:37.025439  4990 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:37.026377  4999 raft_consensus.cc:3055] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:37.027501  4999 raft_consensus.cc:740] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:37.028472  1707 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:36.936455  5000 raft_consensus.cc:740] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:36.989182  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.993230  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.983034  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:36.983719  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.994694  1703 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:00:37.009814  5115 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.762s	user 0.000s	sys 0.002s
I20260709 13:00:37.011099  4986 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.015072  5052 consensus_queue.cc:1059] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:36.986518  5099 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:00:37.019018  5130 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:36.982102  5127 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:37.003094  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:36.997807  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:37.026445  4990 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.030284  1555 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:37.031863  1560 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:37.029063  5141 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:37.032838  5085 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:37.034214  5130 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:37.040947  5085 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:37.041450  5085 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:37.028919  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:37.044750  1705 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 10: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:37.028568  4999 consensus_queue.cc:260] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:37.051849  1598 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:37.053211  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:36.985096  5021 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:37.034970  1701 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:37.040166  1559 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:37.049687  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:37.061885  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:37.024515  4824 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:37.073043  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:37.074476  2324 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:37.073050  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:37.075202  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:37.077572  1598 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:37.078785  1598 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:37.079393  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.080332  1631 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:37.033469  5052 raft_consensus.cc:3055] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:37.085749  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:37.094235  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:37.032853  4986 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:37.098083  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:37.101125  5016 consensus_meta.cc:287] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 13:00:37.103214  5016 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.104321  1701 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:37.097441  1560 raft_consensus.cc:2410] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:37.106298  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:37.097095  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:37.060676  5021 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.128129  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:37.131052  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:37.133203  1633 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:37.133071  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:37.082151  5004 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:37.138573  1634 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:37.096905  5052 raft_consensus.cc:740] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:37.040455  5141 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:37.111881  4999 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.145622  1628 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:37.029834  5000 consensus_queue.cc:260] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:37.125217  5021 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:37.130772  5049 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.163746  5049 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.166301  5049 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:37.170543  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:37.171998  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:37.153503  1627 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:37.175423  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:37.180830  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.143153  5005 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:37.155715  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:37.155874  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:37.135030  4824 raft_consensus.cc:697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:37.156251  4938 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:37.186939  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:37.187614  1552 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.118556  2320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:00:37.162253  5051 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:37.180505  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:37.135154  5019 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:37.188616  2320 raft_consensus.cc:606] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:37.195012  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:37.195902  1632 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:37.197896  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:37.220860  2320 raft_consensus.cc:614] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:37.218686  5051 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.230223  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:37.230351  5051 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.232085  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:37.186117  4938 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:37.247376  1631 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 10: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:37.247884  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:37.242179  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:37.250478  1552 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:37.184777  5072 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.249471  1703 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
W20260709 13:00:37.261646  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.268375  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:37.273833  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:37.274734  1702 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:37.287955  1705 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:37.252678  5005 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:00:37.253759  4938 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.280416  5138 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:37.310348  4938 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.312841  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:37.315899  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:37.232522  4914 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.335783  2286 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:37.351946  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 273180us
I20260709 13:00:37.276233  5130 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:00:37.354704  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 65707.1us
I20260709 13:00:37.353520  1598 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:37.379657  5004 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:37.380359  5004 raft_consensus.cc:697] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:37.381589  5004 consensus_queue.cc:237] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.391140  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:37.406388  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.408046  1633 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:37.392699  1557 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:37.348155  5016 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:37.411522  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.357458  5005 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:37.419993  5005 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:37.281327  5052 consensus_queue.cc:260] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.426991  4938 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:37.431638  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:37.432214  1700 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:37.433893  5146 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:00:37.436497  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.423734  5140 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:00:37.439767  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:37.440965  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.453981  5072 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:37.454797  1705 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:37.443113  1632 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:37.456619  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:37.457486  1632 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:37.458346  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:37.431154  5143 consensus_meta.cc:287] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.005s
W20260709 13:00:37.440965  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 87543.4us
W20260709 13:00:37.468487  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.464221  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 102625us
I20260709 13:00:37.478601  1626 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:37.480037  1626 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: [3.3-6.4]
I20260709 13:00:37.484037  1675 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:37.485106  5109 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:37.452307  5021 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:37.485272  5141 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:37.485558  5109 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:37.472224  5016 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:37.486042  5109 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.487314  5021 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:37.488776  5052 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.430859  4985 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:37.491256  4985 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.493695  4985 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:37.496289  5005 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.357206  4824 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.500687  1706 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:37.479826  5130 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:00:37.464424  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.512943  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.514269  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.514647  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.518540  5070 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:37.521039  5030 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.529330  5030 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.532316  5030 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:37.542037  1702 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:00:37.502475  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:37.546950  1553 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:37.552208  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:37.553977  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:37.560178  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:37.562521  1673 leader_election.cc:336] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.501s (SENT)
I20260709 13:00:37.563158  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:37.564986  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:37.565634  1701 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.486466  5016 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:37.468324  5049 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.568709  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 66325.2us
I20260709 13:00:37.570582  1703 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 10: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:37.574011  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:37.508812  5024 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.510329  5072 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.458928  4986 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.580569  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:37.569540  5137 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.584340  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:37.626114  1675 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:37.630297  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 83484us
I20260709 13:00:37.578768  5021 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:37.634872  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 72411.5us
W20260709 13:00:37.566757  5085 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.002s
I20260709 13:00:37.654742  1705 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:37.669800  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 115869us
I20260709 13:00:37.572316  5030 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:00:37.623251  4985 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:37.623638  5138 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:37.678170  2288 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:37.635532  4978 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:37.717375  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:37.718276  1626 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:37.672523  4981 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.653249  5143 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:37.623979  5072 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:37.722903  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 96859.9us
I20260709 13:00:37.609818  5049 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:37.615257  5024 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:37.722298  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 102618us
I20260709 13:00:37.643136  5021 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:37.720177  5122 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:00:37.735751  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:37.738140  1627 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:37.755851  2320 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:37.756253  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:37.756989  2322 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 10: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:37.758643  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:37.759037  2320 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:37.760753  2320 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:37.766978  4978 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:37.767573  4978 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.767936  4978 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:37.779235  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 138359us
I20260709 13:00:37.672869  5085 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.719412  5060 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:00:37.729282  5070 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:37.803433  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 67861.2us
I20260709 13:00:37.670586  5137 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.749121  5021 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.825368  1629 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:37.807168  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:37.749078  5143 raft_consensus.cc:697] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:37.731199  4985 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.785285  5138 consensus_queue.cc:1059] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:00:37.858496  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 78255.6us
I20260709 13:00:37.853091  5030 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:37.876569  5185 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 13:00:37.891144  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.892913  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.894284  5165 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:00:37.899529  4985 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:37.879813  5187 raft_consensus.cc:3055] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:37.901242  5187 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:37.902372  5187 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:37.904150  5187 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:37.905306  4986 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:37.906229  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.950841  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:37.951740  2328 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:37.906860  4999 consensus_meta.cc:287] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.753s	user 0.011s	sys 0.000s
I20260709 13:00:37.950753  1701 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:37.954156  5035 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.954649  5035 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:37.948628  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 74838.4us
I20260709 13:00:37.959615  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:37.909715  5016 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:37.912698  5051 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:37.908450  1457 catalog_manager.cc:5697] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 2 to 3, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:37.921785  1454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57414 (request call id 190) took 19612 ms (client timeout 15000 ms). Trace:
I20260709 13:00:37.924407  5049 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:37.846046  5070 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:37.844211  5052 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:00:37.930234  5085 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:37.878892  5180 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:37.932715  4990 consensus_meta.cc:287] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.878s	user 0.012s	sys 0.001s
I20260709 13:00:38.034672  1635 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:37.934015  5143 consensus_queue.cc:237] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
W20260709 13:00:37.977608  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.000128  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 410131us
W20260709 13:00:38.001487  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.900503  4985 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.117s
W20260709 13:00:38.025694  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 66200.4us
I20260709 13:00:38.002878  5016 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:37.933526  5164 log.cc:927] Time spent T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
W20260709 13:00:38.073287  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.138621  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:38.006886  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 335466us
W20260709 13:00:38.080268  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 316893us
W20260709 13:00:38.031615  1700 consensus_meta.cc:287] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.570s	user 0.012s	sys 0.000s
I20260709 13:00:38.140372  1700 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
W20260709 13:00:38.089367  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.141734  1708 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:00:38.142387  1708 pending_rounds.cc:85] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 3
I20260709 13:00:38.142932  1708 pending_rounds.cc:107] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:00:38.025977  5051 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:37.996129  5004 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
W20260709 13:00:38.156018  1557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.013s	sys 0.008s
I20260709 13:00:38.067750  5049 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:38.227806  1558 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:00:38.017184  5019 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:38.234004  1557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.018s	sys 0.017s
W20260709 13:00:38.261214  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 583082us
I20260709 13:00:38.261543  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:38.267271  1556 raft_consensus.cc:2410] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:38.259820  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:38.260200  1558 pending_rounds.cc:85] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 5
I20260709 13:00:38.269682  1558 pending_rounds.cc:107] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:00:38.270028  1558 raft_consensus.cc:2889] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.270668  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:38.143299  1708 raft_consensus.cc:2889] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:38.089114  5109 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.601s	user 0.013s	sys 0.000s
I20260709 13:00:38.273284  5186 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:38.273789  5174 log.cc:927] Time spent T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.502s	user 0.000s	sys 0.001s
W20260709 13:00:38.288003  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 149376us
I20260709 13:00:38.303336  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:38.307143  5051 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:38.017627  4978 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:38.314505  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48951.7us
I20260709 13:00:38.315917  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:38.027717  4986 consensus_queue.cc:1059] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.214s
I20260709 13:00:38.240981  5193 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:38.326478  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:38.331537  2320 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:00:38.273368  5024 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:38.138089  5166 consensus_queue.cc:1059] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.174s
I20260709 13:00:38.237537  5049 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:38.082475  5180 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:38.480091  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.363408  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.438354  1598 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:38.495519  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.997823  1454 rpcz_store.cc:269] 0709 13:00:18.309182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.309602 (+   420us) service_pool.cc:224] Handling call
0709 13:00:37.921417 (+19611815us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:27.369663 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:27.678335 (+308672us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:27.678400 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:00:27.678418 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:27.680013 (+  1595us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:27.680103 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:27.680130 (+    27us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:00:27.743033 (+ 62903us) tablet.cc:701] Row locks acquired
0709 13:00:27.743088 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:00:27.743309 (+   221us) write_op.cc:270] Start()
0709 13:00:27.743598 (+   289us) write_op.cc:276] Timestamp: P: 1783602027743222 usec, L: 0
0709 13:00:27.743645 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:00:27.744480 (+   835us) log.cc:844] Serialized 7494 byte log entry
0709 13:00:28.873908 (+1129428us) op_driver.cc:464] REPLICATION: finished
0709 13:00:29.987234 (+1113326us) write_op.cc:301] APPLY: starting
0709 13:00:29.987442 (+   208us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:30.011032 (+ 23590us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:30.108774 (+ 97742us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:30.606859 (+498085us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:30.607392 (+   533us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:00:30.607465 (+    73us) write_op.cc:312] APPLY: finished
0709 13:00:30.608116 (+   651us) log.cc:844] Serialized 132 byte log entry
0709 13:00:30.713686 (+105570us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:30.714151 (+   465us) write_op.cc:454] Released schema lock
0709 13:00:30.714383 (+   232us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:30.715083 (+   700us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:30.715113 (+    30us) write_op.cc:454] Released schema lock
0709 13:00:31.135834 (+420721us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540029f754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a8232a 00007f0ed9a07f14 00007f0ed9a07ec3 00007f0ed9a07e38 00007f0ed9a07df3 00007f0ed9a070dc 00007f0ed9a30e16 00007f0ed9a18cbb 00007f0ed9a0339d 00007f0ed9a06d75
Metrics: {"mutex_wait_us":3658290,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":1036416,"apply.run_cpu_time_us":30290,"apply.run_wall_time_us":727817,"num_ops":19,"prepare.queue_time_us":365648,"prepare.run_cpu_time_us":52490,"prepare.run_wall_time_us":512273,"raft.queue_time_us":381468,"raft.run_cpu_time_us":74102,"raft.run_wall_time_us":2578257,"replication_time_us":960970,"spinlock_wait_cycles":267069824,"thread_start_us":1585007,"threads_started":5,"wal-append.queue_time_us":528718,"wal-append.run_cpu_time_us":42949,"wal-append.run_wall_time_us":3539356}]]}
I20260709 13:00:38.334584  1558 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:00:38.436152  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 363243us
I20260709 13:00:38.551575  1601 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:38.535658  2328 consensus_meta.cc:287] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.583s	user 0.027s	sys 0.003s
I20260709 13:00:38.552417  2328 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:00:38.556972  1672 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:38.429718  1556 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:38.543601  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 227764us
I20260709 13:00:38.562350  2326 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:38.485909  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:38.586367  1457 catalog_manager.cc:5697] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 3 to 5, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 5 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.448910  5016 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.598939  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:38.600224  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:38.592219  1523 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:38.571286  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:38.401147  4986 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.344074  5183 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:38.286114  5109 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:38.612432  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 174124us
I20260709 13:00:38.531956  5189 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:38.438822  5137 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:38.621915  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.028s	sys 0.043s
I20260709 13:00:38.478425  4943 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:38.564797  4981 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.836s	user 0.013s	sys 0.000s
I20260709 13:00:38.627686  5143 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.456455  5199 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.660061  5199 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:38.662721  5199 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:38.344955  5127 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:38.663489  5127 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:38.628665  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 77199us
I20260709 13:00:38.435837  5191 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:38.443823  5112 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:38.549096  5130 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:38.443653  5182 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.439297  5185 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:38.457341  5072 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:38.637729  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.029s	sys 0.043s
I20260709 13:00:38.332960  5019 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:38.598788  5016 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:38.643491  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 51380.4us
I20260709 13:00:38.614060  5024 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:38.636838  1598 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:38.322078  5184 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.352s
I20260709 13:00:38.624737  5161 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:38.650244  5141 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.658905  5202 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:38.658699  5143 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:38.343688  5005 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.288s
I20260709 13:00:38.631158  5183 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:38.665124  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.665596  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:38.465067  4824 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.179s
W20260709 13:00:38.673579  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 717048us
W20260709 13:00:38.673794  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 196725us
I20260709 13:00:38.676379  5019 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:38.627045  5030 consensus_queue.cc:1059] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:00:38.676895  5016 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:38.698518  5141 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:38.681806  5024 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:38.665187  4943 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:38.682698  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 45950.1us
I20260709 13:00:38.669162  5195 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.669399  5191 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:38.641175  5189 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:38.665776  5200 raft_consensus.cc:3055] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:38.665907  5197 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:38.694186  1457 catalog_manager.cc:5697] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 3 to 6, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 6 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.677335  5137 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:38.749053  5137 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:38.750289  5137 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:38.702099  5184 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:38.673269  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:38.721796  5161 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:38.708384  1630 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
W20260709 13:00:38.709980  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 137899us
W20260709 13:00:38.664515  5190 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.388s	user 0.000s	sys 0.001s
I20260709 13:00:38.672866  5182 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:38.718263  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 52771.4us
I20260709 13:00:38.697011  5130 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:38.637806  5070 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:38.641887  5156 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.719116  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:38.674755  5210 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:00:38.698057  5080 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:38.627712  4940 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.231s
I20260709 13:00:38.666430  5112 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:38.708029  5202 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:38.734272  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.703156  5035 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:38.636072  4986 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:38.673166  5185 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:38.742877  2321 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:38.744087  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:38.745983  4943 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:38.675808  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2547) took 1572 ms. Trace:
I20260709 13:00:38.754963  2320 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:00:38.789338  1553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 653) took 1731 ms (client timeout 2204 ms). Trace:
I20260709 13:00:38.783304  1633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
W20260709 13:00:39.289104  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 615871us
W20260709 13:00:39.288515  1553 rpcz_store.cc:269] 0709 13:00:37.057999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.058146 (+   147us) service_pool.cc:224] Handling call
0709 13:00:38.788967 (+1730821us) spinlock_profiling.cc:243] Waited 81.6 ms on lock 0x7b54000b72d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:38.789244 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187701120}
I20260709 13:00:39.289708  1633 raft_consensus.cc:606] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:38.780017  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2384) took 1060 ms. Trace:
I20260709 13:00:39.290127  1673 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:38.965142  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 108170us
I20260709 13:00:39.292873  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 671) took 2047 ms. Trace:
W20260709 13:00:38.832038  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 260782us
I20260709 13:00:38.924438  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:39.295373  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.895779  1551 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:38.785390  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2346) took 1233 ms. Trace:
W20260709 13:00:38.901757  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.293469  1631 rpcz_store.cc:276] 0709 13:00:37.245966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.350098 (+104132us) service_pool.cc:224] Handling call
0709 13:00:37.401624 (+ 51526us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:37.421269 (+ 19645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.421306 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:37.462596 (+ 41290us) log.cc:844] Serialized 52 byte log entry
0709 13:00:37.706700 (+244104us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:37.706742 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.706808 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:38.781261 (+1074453us) raft_consensus.cc:1685] finished
0709 13:00:38.781281 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.292791 (+511510us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25773,"raft.queue_time_us":3662,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5994,"thread_start_us":126662,"threads_started":1,"wal-append.queue_time_us":1193814}
I20260709 13:00:39.313683  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 661) took 2200 ms. Trace:
I20260709 13:00:39.314316  1557 rpcz_store.cc:276] 0709 13:00:37.112977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.491857 (+378880us) service_pool.cc:224] Handling call
0709 13:00:37.492161 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:37.492570 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.501784 (+  9214us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:37.512972 (+ 11188us) log.cc:844] Serialized 26 byte log entry
0709 13:00:38.264029 (+751057us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:38.264082 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.264169 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.313395 (+1049226us) raft_consensus.cc:1685] finished
0709 13:00:39.313424 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.313607 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":527497,"raft.queue_time_us":293,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":638207,"threads_started":1,"wal-append.queue_time_us":1045543}
I20260709 13:00:39.290908  1554 rpcz_store.cc:276] 0709 13:00:37.719900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.727211 (+  7311us) service_pool.cc:224] Handling call
0709 13:00:37.727475 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.875134 (+147659us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:37.887737 (+ 12603us) log.cc:844] Serialized 14 byte log entry
0709 13:00:38.036353 (+148616us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:38.036426 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:38.036634 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.779691 (+743057us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54002283d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:38.779767 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.779947 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15444,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":187004,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":35928,"spinlock_wait_cycles":338560896,"thread_start_us":148101,"threads_started":1,"wal-append.queue_time_us":854663}
W20260709 13:00:39.102530  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.297816  1704 rpcz_store.cc:276] 0709 13:00:37.552412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.641611 (+ 89199us) service_pool.cc:224] Handling call
0709 13:00:37.690383 (+ 48772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.773166 (+ 82783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.773207 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.773259 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:37.773299 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.785076 (+1011777us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b5400253fd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:38.785140 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.785310 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189740928}
I20260709 13:00:39.296506  1708 rpcz_store.cc:276] 0709 13:00:37.103144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.103317 (+   173us) service_pool.cc:224] Handling call
0709 13:00:37.103635 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:38.306386 (+1202751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.675403 (+369017us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b54002544d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:38.675681 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2249408768}
I20260709 13:00:39.339864  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:39.295262  1560 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:39.406234  1554 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
W20260709 13:00:39.342561  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 54797.5us
W20260709 13:00:39.408663  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 96253.9us
I20260709 13:00:39.408742  1601 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:38.739830  5191 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:38.978067  4938 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.016s
I20260709 13:00:39.414563  1554 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:39.416143  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:38.737375  5016 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:39.420958  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 88103.2us
W20260709 13:00:39.427014  1457 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.016s	sys 0.009s
W20260709 13:00:39.427367  1457 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.016s	sys 0.009s
W20260709 13:00:39.316682  5101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.006s	sys 0.015s
I20260709 13:00:38.739477  5200 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:38.771620  4914 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:39.428706  1601 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:39.429378  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.297803  5156 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.934399  5183 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:39.438215  2327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.002s	sys 0.023s
W20260709 13:00:39.422019  4938 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.002s	sys 0.033s
I20260709 13:00:38.895859  5179 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:39.431936  5101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.009s	sys 0.022s
I20260709 13:00:38.785589  4824 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:38.968871  4978 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:39.434087  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 714959us
I20260709 13:00:39.310308  5202 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:39.438836  2327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.002s	sys 0.023s
I20260709 13:00:38.769300  5212 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.771399  5024 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:39.036538  5186 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:39.339336  5030 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:39.420161  5035 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:38.754400  5184 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:39.339874  5051 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:39.434552  5188 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:00:39.420930  4985 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:39.425324  5191 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.443938  5019 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:39.434566  5004 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:39.415427  5080 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:39.534852  5222 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:39.534988  5200 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.432152  5161 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:39.442191  5216 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 13:00:39.599761  5161 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.555908  5030 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.602258  5161 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:39.431185  5180 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:38.734746  5049 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:39.577490  5035 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.603400  5049 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.602792  5030 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:39.603448  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 675) took 1886 ms. Trace:
W20260709 13:00:39.604521  5211 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
I20260709 13:00:39.604487  1632 rpcz_store.cc:276] 0709 13:00:37.716613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.716719 (+   106us) service_pool.cc:224] Handling call
0709 13:00:37.728732 (+ 12013us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:38.025421 (+296689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.025463 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:38.075472 (+ 50009us) log.cc:844] Serialized 52 byte log entry
0709 13:00:38.674622 (+599150us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b4800232758. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ede9aeaa1 00007f0ede9a5b37 00007f0ede9a59ca 00007f0edea9d26f 00007f0edea9cf37 00007f0edeab155c 00007f0edeab1508 00007f0edeab1488 00007f0edeab1443 00007f0edeab06ec 00007f0edd9daa96
0709 13:00:38.746012 (+ 71390us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b180047a940. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:00:38.978875 (+232863us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:38.979677 (+   802us) log.cc:844] Serialized 14 byte log entry
0709 13:00:39.011067 (+ 31390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.011524 (+   457us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.603231 (+591707us) raft_consensus.cc:1685] finished
0709 13:00:39.603249 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.603384 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":287599,"prepare.queue_time_us":275,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":435615,"raft.run_cpu_time_us":4336,"raft.run_wall_time_us":453798,"spinlock_wait_cycles":60687104,"thread_start_us":232612,"threads_started":1,"wal-append.queue_time_us":1182828}
I20260709 13:00:39.606400  5080 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.439134  4981 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:39.572013  4985 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.608975  4981 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.610786  4985 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:39.611164  4981 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:39.437674  5156 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.545640  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 788) took 1711 ms. Trace:
I20260709 13:00:39.458593  5197 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:39.617007  5223 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:38.741278  5195 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.616767  2322 rpcz_store.cc:276] 0709 13:00:37.757763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.757897 (+   134us) service_pool.cc:224] Handling call
0709 13:00:37.758190 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:38.007812 (+249622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.007844 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:38.072255 (+ 64411us) log.cc:844] Serialized 26 byte log entry
0709 13:00:38.334873 (+262618us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:38.334912 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.334977 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.468666 (+1133689us) raft_consensus.cc:1685] finished
0709 13:00:39.468691 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.468861 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15184,"raft.queue_time_us":114961,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":9819,"thread_start_us":315084,"threads_started":2,"wal-append.queue_time_us":446043}
I20260709 13:00:39.618253  5184 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.619666  5195 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:39.619937  5184 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.571218  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:39.437737  5052 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.118s
I20260709 13:00:38.783125  1619 tablet_service.cc:1558] Processing DeleteTablet for tablet f4ee010e653949d581d35eb9b09d59dd with delete_type TABLET_DATA_TOMBSTONED (TS 8106dfc0bda54df0ae10ba13c28ccc18 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60036
I20260709 13:00:39.442252  5178 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 13:00:39.625041  5200 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.625521  5197 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:39.628007  5197 raft_consensus.cc:697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:39.555460  5179 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.629400  5197 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.547046  4978 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:39.624682  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 53576.2us
I20260709 13:00:39.004351  5072 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.433336  5016 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.544430  5204 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:39.602658  5182 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:39.567945  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 663) took 2426 ms. Trace:
W20260709 13:00:39.624841  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2541) took 2603 ms (client timeout 2233 ms). Trace:
I20260709 13:00:39.567332  5186 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:39.569412  5187 consensus_meta.cc:287] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.621s	user 0.013s	sys 0.002s
I20260709 13:00:39.651777  1558 raft_consensus.cc:1813] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Handling vote request from an unknown peer 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:39.706334  1558 raft_consensus.cc:2410] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:00:39.707593  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 301442us
I20260709 13:00:39.704495  1599 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:39.709836  1599 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:39.712402  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 284863us
W20260709 13:00:39.648867  1635 rpcz_store.cc:269] 0709 13:00:37.021122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.049569 (+ 28447us) service_pool.cc:224] Handling call
0709 13:00:39.624650 (+2575081us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b5400327dd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:39.624762 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2019961216}
I20260709 13:00:39.717386  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:39.719811  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 429687us
I20260709 13:00:39.645370  1552 rpcz_store.cc:276] 0709 13:00:37.142045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.510163 (+368118us) service_pool.cc:224] Handling call
0709 13:00:37.567223 (+ 57060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:37.567440 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.567463 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:37.609579 (+ 42116us) log.cc:844] Serialized 26 byte log entry
0709 13:00:37.825875 (+216296us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:37.826057 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.826279 (+   222us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.567633 (+1741354us) raft_consensus.cc:1685] finished
0709 13:00:39.567666 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.567862 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":154904,"threads_started":1,"wal-append.queue_time_us":434484}
I20260709 13:00:39.634831  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:39.550709  4824 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:39.640268  5171 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.892s	user 0.014s	sys 0.008s
W20260709 13:00:39.654542  5218 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:39.653362  5186 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:39.638952  5035 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:39.636819  5215 raft_consensus.cc:3055] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:39.633172  4999 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.650017  5226 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:39.738577  5021 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.885s	user 0.015s	sys 0.000s
I20260709 13:00:39.766498  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:39.788977  1629 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:00:39.632509  5179 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:39.633237  5189 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:39.773515  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 138742us
I20260709 13:00:39.777427  1673 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:39.633908  4978 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:39.732999  4628 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:39.784287  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:39.806547  1557 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:39.729629  5093 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:39.817619  5093 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.818133  5093 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.825007  5189 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:39.730065  2288 connection.cc:256] RPC call timeout handler was delayed by -1.273203916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
I20260709 13:00:39.768170  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:39.718729  5187 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:00:39.646103  5016 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:39.643519  5072 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:39.735138  5195 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:39.735020  5024 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:39.737608  5141 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:39.809530  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.798527  5226 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.812108  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:39.617766  5223 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:39.814219  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.814574  4978 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:39.814882  4824 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:39.806110  5186 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:39.816346  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 69194.1us
I20260709 13:00:39.805974  4628 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.777822  5030 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:39.771661  5185 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:39.781479  5215 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:39.842005  1631 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:39.797576  4999 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.838044  5093 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:39.718313  5202 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.885366  5191 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.905236  5202 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:39.805998  5051 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.906430  5051 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:39.854326  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46112.7us
I20260709 13:00:39.892395  4628 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.909158  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:39.909598  5236 tablet_replica.cc:333] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:00:39.910884  5215 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:39.855592  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.856264  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.912894  5185 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:39.867336  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 427816us
I20260709 13:00:39.913483  5185 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:39.915879  5185 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:39.841241  2288 connection.cc:256] RPC call timeout handler was delayed by -1.2552039159999708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 13:00:39.916795  2288 connection.cc:256] RPC call timeout handler was delayed by -1.0590039159999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260709 13:00:39.918037  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:39.919343  2288 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:39.920123  5229 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.920295  4628 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:39.861176  5112 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:39.922811  4628 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:39.923539  5198 log.cc:927] Time spent T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 1.246s	user 0.008s	sys 0.008s
I20260709 13:00:39.925470  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 786) took 2170 ms. Trace:
I20260709 13:00:39.925976  2324 rpcz_store.cc:276] 0709 13:00:37.755427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.755632 (+   205us) service_pool.cc:224] Handling call
0709 13:00:37.755944 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:37.773048 (+ 17104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.773080 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:37.810693 (+ 37613us) log.cc:844] Serialized 26 byte log entry
0709 13:00:38.293128 (+482435us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:38.293170 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.293237 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.922750 (+1629513us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:39.925026 (+  2276us) raft_consensus.cc:1685] finished
0709 13:00:39.925057 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.925335 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21389,"raft.queue_time_us":105101,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":9424,"spinlock_wait_cycles":54745344,"thread_start_us":481888,"threads_started":1,"wal-append.queue_time_us":832987}
I20260709 13:00:39.929243  5191 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:39.929661  1708 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:39.933401  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:39.800007  5156 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:39.934324  1700 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:39.935374  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:39.936373  1701 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:39.860888  4986 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:39.894989  5186 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.938617  5178 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:39.939175  5178 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.939587  5178 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.877604  5130 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:39.942723  5130 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:39.945664  5223 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:39.954980  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 45887.3us
W20260709 13:00:39.887495  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 132525us
I20260709 13:00:39.799695  5021 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.861753  4943 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:39.956303  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:39.898567  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:39.853915  5195 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:39.965230  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:39.966097  1709 raft_consensus.cc:1813] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Handling vote request from an unknown peer 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:39.963193  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:39.967284  2288 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:39.969205  1709 raft_consensus.cc:2410] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:00:39.970736  1526 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:39.973727  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:39.936257  5156 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:39.974426  1703 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:39.958931  5215 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:39.994560  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.960052  5049 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:39.997623  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.998463  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.998576  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:39.960912  4943 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:39.964825  5186 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:39.968227  5202 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.008884  1707 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:00:40.010381  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:39.899734  5030 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:39.975222  5223 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.974226  5141 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:40.035766  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.036773  1706 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 8: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:40.037998  4990 raft_consensus.cc:3055] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:40.038496  4990 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:40.039542  4990 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.041540  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2342) took 2490 ms. Trace:
I20260709 13:00:39.977334  5191 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:40.042557  5191 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.043210  5191 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:40.020749  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 128630us
I20260709 13:00:40.022398  5195 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.045961  5093 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:40.048000  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2535) took 3220 ms (client timeout 1877 ms). Trace:
W20260709 13:00:40.048439  1630 rpcz_store.cc:269] 0709 13:00:36.827129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.848769 (+ 21640us) service_pool.cc:224] Handling call
0709 13:00:40.047816 (+3199047us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b5400125054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:40.047924 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4134875008}
I20260709 13:00:40.056218  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:40.057513  1557 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.027251  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 798) took 1240 ms. Trace:
W20260709 13:00:40.065521  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:40.065878  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:40.067940  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 53041.1us
I20260709 13:00:40.042126  1705 rpcz_store.cc:276] 0709 13:00:37.550896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.551061 (+   165us) service_pool.cc:224] Handling call
0709 13:00:37.565077 (+ 14016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.678869 (+113792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.041190 (+2362321us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b54003d9ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:40.041428 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182075648}
I20260709 13:00:40.070540  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:40.074777  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:40.080308  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:40.081142  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:40.012095  4943 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:40.081266  1554 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:40.012224  5051 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:40.012828  5024 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.062577  2325 rpcz_store.cc:276] 0709 13:00:38.786767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.786939 (+   172us) service_pool.cc:224] Handling call
0709 13:00:38.787765 (+   826us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.287945 (+500180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.287983 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.427497 (+139514us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.855097 (+427600us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:39.855136 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.855202 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.026996 (+171794us) raft_consensus.cc:1685] finished
0709 13:00:40.027019 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.027181 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127934,"raft.queue_time_us":543726,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":75238,"thread_start_us":388182,"threads_started":1,"wal-append.queue_time_us":537572}
I20260709 13:00:40.093927  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:40.109577  1556 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.095161  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:40.100178  4990 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.100634  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:40.101406  5021 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:40.077003  5203 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:40.104091  5226 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:40.105582  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:40.000631  5185 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:00:40.083560  5187 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:40.128043  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 88849.3us
I20260709 13:00:40.102260  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:40.139631  5184 consensus_meta.cc:287] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.519s	user 0.015s	sys 0.004s
I20260709 13:00:40.092924  5052 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.169487  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:40.170934  1630 raft_consensus.cc:2393] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:40.134614  4986 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.182690  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:40.153494  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:40.174410  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:40.164007  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 186246us
I20260709 13:00:40.135226  5051 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.181459  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:40.184389  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:40.181830  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:40.187292  1627 raft_consensus.cc:2410] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 13:00:40.204654  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 99177.6us
I20260709 13:00:40.206526  1673 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:40.207321  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.208781  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.210011  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.173972  5228 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.214840  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:40.219003  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:40.211788  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 48007.9us
I20260709 13:00:40.211535  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.211623  1557 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:40.224248  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.207356  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.225183  1706 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:00:40.208247  1705 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:40.152240  5187 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:40.221109  1599 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:40.166078  5080 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.164085  5068 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:40.232899  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:40.233121  1526 connection.cc:256] RPC call timeout handler was delayed by -2.6443965889999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
I20260709 13:00:40.235831  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.238235  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.231281  1599 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:40.240108  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.240348  4981 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:40.240782  1705 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 3.
I20260709 13:00:40.241154  4981 raft_consensus.cc:697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:40.241778  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.242383  1705 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:40.242422  4981 consensus_queue.cc:237] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:40.210067  5144 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.244561  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.245188  5144 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.163265  5203 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.254842  5203 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:40.259620  5201 raft_consensus.cc:993] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
W20260709 13:00:40.260330  5242 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:00:40.250869  5202 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.261849  5202 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.263983  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:40.264644  2325 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:40.249775  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1862041530000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
I20260709 13:00:40.225903  5072 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:00:40.270337  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:40.270929  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:40.298839  1557 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.246093  5200 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:40.270972  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:40.273389  5195 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.233975  5187 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:40.276948  5138 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:40.277395  5239 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:00:40.246829  5068 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:40.278529  5178 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.279023  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:40.260296  5201 raft_consensus.cc:1081] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 13:00:40.302505  5200 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.284881  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.349570  1702 raft_consensus.cc:2368] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8.
I20260709 13:00:40.285607  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.350485  1705 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
W20260709 13:00:40.287993  5220 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.688s	user 0.000s	sys 0.005s
I20260709 13:00:40.233704  5226 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:40.357087  2322 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 7: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:40.300105  1554 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:40.271039  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:40.296401  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.305718  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:40.309828  2325 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:00:40.183115  5052 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:40.319507  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 113052us
I20260709 13:00:40.214780  4986 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.215160  5051 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:40.323414  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:40.268042  5176 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:40.302953  5212 consensus_meta.cc:287] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.734s	user 0.012s	sys 0.001s
I20260709 13:00:40.254949  5144 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:40.341426  5068 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:40.341645  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.343449  5178 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:40.315584  5195 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.325070  5138 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.387725  1560 raft_consensus.cc:2410] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:40.394611  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.361745  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:40.361740  1708 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:40.362044  1557 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:40.316920  5197 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:40.366041  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.368669  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.374087  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.410174  1702 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:40.409109  1554 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.407691  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:40.407506  2323 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:40.405483  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:40.413230  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:40.413357  2325 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:40.248205  5080 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.410220  1705 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:40.392907  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.418782  1523 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:40.387259  5248 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:40.420025  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 114373us
I20260709 13:00:40.420488  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:40.420420  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 56633.4us
I20260709 13:00:40.416254  2329 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:40.358436  5200 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.416132  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 671) took 1738 ms. Trace:
W20260709 13:00:40.392035  5207 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.710s	user 0.004s	sys 0.015s
I20260709 13:00:40.422921  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:00:40.429967  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.430651  1523 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:40.369683  5030 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:40.433145  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.386373  5051 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:40.383721  5202 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:40.375970  5212 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:40.400331  5223 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:40.435496  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.504750  1702 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:40.493631  1631 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
W20260709 13:00:40.425120  5229 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.002s
I20260709 13:00:40.509650  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.510612  2329 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:40.495405  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.380188  5230 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:40.416620  5005 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.424823  1555 rpcz_store.cc:276] 0709 13:00:38.677778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.289733 (+1611955us) service_pool.cc:224] Handling call
0709 13:00:40.290120 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.290333 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:40.290667 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:00:40.415672 (+125005us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:40.415718 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:40.415893 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.415974 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.416086 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":940,"prepare.queue_time_us":1679,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":1152,"thread_start_us":123531,"threads_started":1}
W20260709 13:00:40.499226  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 86965.7us
I20260709 13:00:40.376693  5176 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.434600  5248 raft_consensus.cc:697] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:40.493242  5226 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:40.520393  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:40.521184  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:40.423480  5193 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:40.492406  2323 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:40.512463  1705 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:40.429502  5166 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.434302  4990 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:40.503111  1708 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:00:40.433257  4985 raft_consensus.cc:2764] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:40.423710  5197 raft_consensus.cc:697] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:40.401801  5191 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.521847  1706 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
W20260709 13:00:40.515336  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 107700us
I20260709 13:00:40.526626  1626 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:40.528690  1598 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:40.558817  1673 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:40.529943  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.531756  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.531852  5248 consensus_queue.cc:237] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:40.518113  5068 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:00:40.522027  5005 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.521924  5230 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.491387  4986 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:40.549472  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.562255  1673 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:40.565162  1598 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:40.566193  1556 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:40.580319  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.514688  5229 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.561182  1702 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:40.581004  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.587074  1705 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:00:40.588629  1708 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:40.593076  2327 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:40.592273  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.594323  2323 raft_consensus.cc:2410] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:40.538019  5226 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.596640  1705 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:40.597819  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:40.600031  1673 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:40.561581  5223 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:40.605630  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.606313  2329 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:40.584012  4917 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:40.517858  5237 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:00:40.587204  5212 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:40.624083  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.626320  1626 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:40.586846  5193 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:40.596421  5201 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:40.629690  2288 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:40.599483  5226 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:40.631664  1598 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:40.604863  4990 raft_consensus.cc:2764] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:40.636956  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.640041  5201 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:40.640627  5201 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.642416  2320 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:00:40.644155  2320 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:40.646032  2320 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:40.648659  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:40.650205  2329 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:40.609246  5228 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.656351  1701 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:00:40.670549  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 70622.2us
I20260709 13:00:40.671547  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:40.622593  4917 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:40.674281  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:40.608924  4986 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:00:40.659219  5004 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:40.664634  5030 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:40.579905  5166 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:40.708894  5085 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.681051  5195 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:40.684520  4917 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.678750  5021 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:40.683236  5228 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.681591  5093 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:00:40.719372  5004 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:00:40.732362  4943 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.604s	user 0.003s	sys 0.008s
I20260709 13:00:40.757519  1554 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:40.666425  5185 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:00:40.682034  4938 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:00:40.712173  5232 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 13:00:40.767233  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 86503.6us
I20260709 13:00:40.741899  5138 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:40.745256  5030 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:40.761543  5004 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.755393  5021 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:40.778018  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 104444us
I20260709 13:00:40.781849  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:40.780717  5021 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.783710  5176 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:40.776943  5080 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:40.781800  5191 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:40.746374  5085 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:40.786445  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:40.788161  1633 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:40.788667  5085 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:40.791546  5143 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:40.794395  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.794085  5191 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:40.794628  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:40.795262  1632 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:40.798383  5000 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.801034  5005 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:40.755072  5193 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.709877  5197 consensus_queue.cc:237] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:40.813537  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:40.815407  1705 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:00:40.810138  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.817615  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:40.827952  1633 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:40.829840  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:40.833380  1705 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:40.763062  4943 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.763002  5228 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.807964  4981 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:40.824236  5263 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:00:40.846655  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:40.816664  4986 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:40.835474  5208 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 2.170s	user 0.000s	sys 0.009s
I20260709 13:00:40.824499  4990 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:40.865094  5143 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:40.869309  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.816480  5192 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:00:40.870133  1705 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:40.870662  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:40.846928  5024 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:40.850719  4981 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:40.876770  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:40.857118  5230 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:40.865756  5085 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.885695  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:40.845942  5201 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.894052  1554 raft_consensus.cc:2368] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8.
I20260709 13:00:40.893952  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:40.886406  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:40.897535  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:40.898639  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:40.900751  1630 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:40.901674  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:40.871624  4990 raft_consensus.cc:697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:40.903419  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:40.900357  2288 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:40.906719  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:40.868556  5143 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.918277  4990 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.919703  4943 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:40.921288  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:40.922538  1555 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:40.923396  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:40.923969  1705 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:40.923911  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:40.921260  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 674) took 3205 ms. Trace:
W20260709 13:00:40.933131  5267 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:00:40.882668  5024 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.926676  1628 rpcz_store.cc:276] 0709 13:00:37.716252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.716386 (+   134us) service_pool.cc:224] Handling call
0709 13:00:37.733632 (+ 17246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:37.996260 (+262628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.996292 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:38.028843 (+ 32551us) log.cc:844] Serialized 26 byte log entry
0709 13:00:38.359204 (+330361us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:38.359266 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.359370 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.800320 (+2440950us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:40.914416 (+114096us) raft_consensus.cc:1685] finished
0709 13:00:40.914447 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.921170 (+  6723us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":360204,"raft.queue_time_us":410942,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":53207,"spinlock_wait_cycles":87211904,"thread_start_us":214636,"threads_started":1,"wal-append.queue_time_us":549820}
I20260709 13:00:40.968808  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:40.875613  5030 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.904765  5230 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:00:40.902208  5085 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.993119  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:40.921067  4981 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:41.008448  5209 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 2.369s	user 0.006s	sys 0.019s
I20260709 13:00:41.009069  5202 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:41.009697  4981 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:41.079495  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.032279  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 2390) took 1721 ms. Trace:
I20260709 13:00:41.012771  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.010834  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:41.075265  1705 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
W20260709 13:00:41.104815  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 112028us
I20260709 13:00:41.105432  1558 rpcz_store.cc:276] 0709 13:00:39.311133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.311297 (+   164us) service_pool.cc:224] Handling call
0709 13:00:41.032002 (+1720705us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54000b7cd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:41.032187 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525424000}
W20260709 13:00:40.994684  5261 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:00:41.115088  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:41.018359  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.119165  2329 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:41.117913  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:41.121232  1705 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:41.121495  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:41.105908  1628 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
W20260709 13:00:41.031553  5269 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:00:41.147141  1632 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:00:41.149153  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:41.057639  5273 log.cc:927] Time spent T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:00:41.125268  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:41.031441  5252 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:41.123745  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:41.039304  5191 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:41.132835  5127 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:41.011264  5202 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:41.135978  5143 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:41.136677  1557 raft_consensus.cc:2393] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:00:41.140251  5187 consensus_meta.cc:287] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.000s
I20260709 13:00:41.141702  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:41.142690  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:41.144402  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:41.161244  5060 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:41.174799  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:41.147085  1673 leader_election.cc:400] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8.
I20260709 13:00:41.175395  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:41.175810  1673 leader_election.cc:403] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:41.147627  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:41.176872  1673 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:41.177224  1705 raft_consensus.cc:2376] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7. Re-sending same reply.
I20260709 13:00:41.178063  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:41.178113  5213 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.178666  1705 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:41.178789  5213 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:41.179301  5127 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:41.179692  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:41.180148  5127 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:00:41.136355  5200 consensus_meta.cc:287] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.001s
I20260709 13:00:41.181679  5200 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:41.181851  5127 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:40.970178  5021 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:41.148218  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:41.031183  5248 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:41.123383  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.150200  1630 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 7: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:00:41.065383  5268 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:00:41.076721  5223 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:41.151582  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:41.152547  1558 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:41.156100  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:41.201941  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 45977.9us
I20260709 13:00:41.014464  5166 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:41.065564  5085 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:41.134366  4917 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:41.260907  4917 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:41.165030  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.236016  5184 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:41.263085  1626 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:41.122607  5193 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:41.126004  5024 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:41.171540  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:41.266251  1556 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:41.106832  5228 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:41.068719  5226 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:41.176899  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:41.186195  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:41.195495  1705 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:41.272100  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:41.273350  1705 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 8: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:41.203786  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:41.204149  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 657) took 4111 ms. Trace:
I20260709 13:00:41.274127  1555 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:41.273972  1551 rpcz_store.cc:276] 0709 13:00:37.093053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.146142 (+ 53089us) service_pool.cc:224] Handling call
0709 13:00:38.789585 (+1643443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.297285 (+507700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.203901 (+1906616us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54000b72d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:41.204058 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3695687424}
I20260709 13:00:41.174840  5060 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.207762  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.198334  5201 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:41.210482  5021 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:41.210736  1708 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:00:41.265372  5224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.618s	user 0.008s	sys 0.021s
I20260709 13:00:41.283767  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.211642  1554 raft_consensus.cc:1275] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:00:41.212841  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.197602  5248 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:41.188155  5278 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:41.215687  1629 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:41.165750  5191 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:41.219055  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:41.295157  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2098) took 1071 ms. Trace:
I20260709 13:00:41.219651  5109 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:41.184805  5277 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.184854  5230 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:41.180702  5187 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:41.227208  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.207058  5202 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:41.184533  5200 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:41.144383  5004 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:41.241487  5185 raft_consensus.cc:3055] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:41.243785  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2556) took 1030 ms. Trace:
I20260709 13:00:41.254417  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:41.255240  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:41.276999  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:41.281286  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.264380  5184 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:41.329546  2324 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:41.329917  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 75587.4us
I20260709 13:00:41.321569  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:41.317767  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:41.329290  1706 rpcz_store.cc:276] 0709 13:00:40.213123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.225856 (+ 12733us) service_pool.cc:224] Handling call
0709 13:00:41.243226 (+1017370us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54002f2454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:41.243404 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650028800}
I20260709 13:00:41.296031  5248 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.294176  1703 raft_consensus.cc:2368] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7.
I20260709 13:00:41.337258  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.295185  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:41.287177  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:41.338999  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.339311  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:41.297328  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:41.275969  5060 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:41.295560  1629 rpcz_store.cc:276] 0709 13:00:40.223943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.141408 (+917465us) service_pool.cc:224] Handling call
0709 13:00:41.295093 (+153685us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:41.288168  5224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.641s	user 0.009s	sys 0.021s
I20260709 13:00:41.342195  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:41.342833  1700 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:41.303123  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:41.334465  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 79289.5us
I20260709 13:00:41.332906  1673 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:41.344079  1632 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:41.290328  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:41.339210  1704 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.299093  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.314070  5202 raft_consensus.cc:697] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:41.302153  5230 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.347450  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.327863  5187 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:41.348055  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:41.329166  5185 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:41.355666  1601 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:41.347740  1599 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:41.371536  1599 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:41.302423  5201 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.326226  5191 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:41.361194  1635 raft_consensus.cc:2410] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:41.340797  1551 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.361770  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.341665  5197 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:41.364966  1706 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:41.366729  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.367075  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.378115  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:41.309098  5085 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:00:41.355851  5278 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:41.389467  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:41.365085  5230 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:41.341578  5259 consensus_queue.cc:1059] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:00:41.393246  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.398630  1706 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:41.341419  5138 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:00:41.391359  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:41.413997  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.395366  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.385123  5012 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:41.415680  1635 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:41.381356  5080 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:41.416685  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:41.424010  1700 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:00:41.396201  4917 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:41.428546  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:41.430059  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:41.431631  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:41.399679  5278 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:41.435575  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.441743  1632 raft_consensus.cc:2410] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:41.436772  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.438284  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.389381  5201 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:41.419437  5192 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:41.462455  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:41.465476  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:41.473882  1635 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:00:41.423292  5012 raft_consensus.cc:697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:41.389742  5184 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:41.472179  5202 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:41.505371  5184 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:41.505770  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 906) took 1355 ms. Trace:
I20260709 13:00:41.506290  2324 rpcz_store.cc:276] 0709 13:00:40.150721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.150963 (+   242us) service_pool.cc:224] Handling call
0709 13:00:40.175246 (+ 24283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.329943 (+1154697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.505458 (+175515us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400548154. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:41.505692 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2653914368}
W20260709 13:00:41.491822  5275 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.522s	user 0.000s	sys 0.003s
I20260709 13:00:41.496830  5201 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:41.508671  4999 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:41.476037  5049 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:41.509352  5049 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:41.452320  5044 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:41.509966  5049 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.510299  5044 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:41.510943  5044 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.497310  5226 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:41.497656  5219 log.cc:927] Time spent T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.876s	user 0.007s	sys 0.002s
I20260709 13:00:41.488440  5252 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:41.498001  5277 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8.
W20260709 13:00:41.489277  5284 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:41.498649  5192 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.499717  1703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 13:00:41.500154  2288 leader_election.cc:400] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7.
I20260709 13:00:41.522676  1551 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:41.544054  2288 leader_election.cc:403] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:00:41.544106  1703 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.544693  1703 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:41.544970  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 44965.5us
I20260709 13:00:41.500535  5004 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:41.451671  5080 raft_consensus.cc:697] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:41.452134  5278 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:41.424292  5185 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:41.477038  4990 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:41.512951  1701 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:41.513617  1634 raft_consensus.cc:2410] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:00:41.515805  1632 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:00:41.485687  5286 log.cc:927] Time spent T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:00:41.452080  5143 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:41.520303  1704 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:41.520608  1630 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:41.513002  5283 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:00:41.521610  5252 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:41.522845  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 915) took 1154 ms. Trace:
I20260709 13:00:41.587282  2325 rpcz_store.cc:276] 0709 13:00:40.364994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.365699 (+   705us) service_pool.cc:224] Handling call
0709 13:00:41.519551 (+1153852us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b5400829e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:41.519666 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7887744}
I20260709 13:00:41.542510  1700 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:00:41.548549  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 681) took 1300 ms (client timeout 1640 ms). Trace:
W20260709 13:00:41.588863  1631 rpcz_store.cc:269] 0709 13:00:40.248770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.249083 (+   313us) service_pool.cc:224] Handling call
0709 13:00:41.548356 (+1299273us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400125a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:41.548477 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378249984}
I20260709 13:00:41.551895  1706 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:41.548938  5138 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:41.567701  1630 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:41.592279  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 218515us
I20260709 13:00:41.572939  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2414) took 1156 ms. Trace:
I20260709 13:00:41.597810  1559 rpcz_store.cc:276] 0709 13:00:40.416210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.431755 (+ 15545us) service_pool.cc:224] Handling call
0709 13:00:40.432117 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.252792 (+820675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.252837 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.252890 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:41.252940 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.572665 (+319725us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b5400028354. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:41.572718 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.572886 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886535552}
I20260709 13:00:41.561200  5185 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.599539  5060 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:41.524971  5012 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:41.582237  1672 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:41.601341  1709 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:41.583932  5277 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.571533  5213 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:41.598553  1703 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:41.612015  2288 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.640s (SENT) [suppressed 13 similar messages]
W20260709 13:00:41.631620  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.562767  5143 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:41.626981  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 271355us
I20260709 13:00:41.650300  1703 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:41.650544  5213 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.664244  5213 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:41.604077  5225 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 1.975s	user 0.000s	sys 0.007s
I20260709 13:00:41.666796  5213 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:41.668185  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 678) took 1520 ms. Trace:
I20260709 13:00:41.645737  5228 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:41.669293  5230 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:41.668720  1553 rpcz_store.cc:276] 0709 13:00:40.147825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.148604 (+   779us) service_pool.cc:224] Handling call
0709 13:00:40.170325 (+ 21721us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.170693 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:40.170724 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.245454 (+1074730us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b18000729a0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69662a6 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a
0709 13:00:41.246721 (+  1267us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b2c00000658. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2
0709 13:00:41.247528 (+   807us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.402242 (+154714us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:41.402291 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.402386 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.667931 (+265545us) raft_consensus.cc:1685] finished
0709 13:00:41.667959 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.668116 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":296,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":36927,"spinlock_wait_cycles":99029120,"thread_start_us":154263,"threads_started":1,"wal-append.queue_time_us":352571}
I20260709 13:00:41.603600  5080 consensus_queue.cc:237] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:41.550734  5192 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:41.730518  1629 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:00:41.730934  1629 pending_rounds.cc:85] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 7
I20260709 13:00:41.731158  1629 pending_rounds.cc:107] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:00:41.731396  1629 raft_consensus.cc:2889] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:41.616806  2286 leader_election.cc:336] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.204s (SENT)
W20260709 13:00:41.741216  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 87225us
I20260709 13:00:41.587702  4990 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:41.657086  5143 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:41.603477  5060 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:41.751917  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 135129us
I20260709 13:00:41.756520  1601 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:41.758456  1601 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:41.731405  5228 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:41.742923  5138 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7.
I20260709 13:00:41.648288  5277 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:41.771909  1601 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:41.780175  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.754660  5127 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.761986  5085 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:41.788666  1601 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:41.809259  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 377816us
I20260709 13:00:41.810370  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:41.812633  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:41.770303  4917 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:41.822994  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:41.827359  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:41.809756  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:41.774796  5228 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:41.876780  5248 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.001s
W20260709 13:00:41.879889  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 113673us
I20260709 13:00:41.841594  1526 leader_election.cc:400] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8.
I20260709 13:00:41.943282  1526 leader_election.cc:403] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:41.865854  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:41.826339  4917 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:41.891234  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 130097us
I20260709 13:00:41.821664  5127 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:41.874557  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:41.859189  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:41.962651  1551 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:41.790308  5200 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:41.927316  1556 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:41.843513  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:41.824520  5005 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.031s	sys 0.059s
I20260709 13:00:41.840448  5202 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:41.825429  4981 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:41.936793  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 684) took 1643 ms. Trace:
I20260709 13:00:41.883677  5223 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:41.883819  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 619) took 1037 ms. Trace:
I20260709 13:00:41.944111  5301 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8.
I20260709 13:00:41.979398  1705 rpcz_store.cc:276] 0709 13:00:40.847548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.283932 (+436384us) service_pool.cc:224] Handling call
0709 13:00:41.284195 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.284394 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:41.549908 (+265514us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.883323 (+333415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.883396 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:41.883475 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.883584 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.883742 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":195165,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":4022,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":10815,"thread_start_us":584806,"threads_started":2}
I20260709 13:00:41.969081  5200 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:41.987077  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.987078  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:41.988328  2324 raft_consensus.cc:2410] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:00:41.933149  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 321100us
I20260709 13:00:41.809307  5230 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:41.865054  5044 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:41.968452  5187 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:00:41.994139  5044 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:41.944480  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 120857us
I20260709 13:00:41.943655  5248 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:41.900961  5197 consensus_meta.cc:287] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.004s
I20260709 13:00:41.995174  5127 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:41.995280  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:41.976899  4981 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.996995  5049 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:41.997238  4981 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:41.966626  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 139374us
I20260709 13:00:41.860286  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:41.971698  2286 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:41.963100  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.944631  5228 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:41.968861  5005 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.032s	sys 0.059s
I20260709 13:00:41.964259  5000 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:42.000147  5000 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.999549  1551 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:42.000631  5000 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:42.001186  5297 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:00:42.001206  5228 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:42.001888  5228 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:42.002580  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 622) took 1147 ms. Trace:
I20260709 13:00:42.002926  1708 rpcz_store.cc:276] 0709 13:00:40.855246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.284023 (+428777us) service_pool.cc:224] Handling call
0709 13:00:41.284356 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.301608 (+ 17252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.301648 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.309647 (+  7999us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.547221 (+237574us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:41.547264 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.547333 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.002353 (+455020us) raft_consensus.cc:1685] finished
0709 13:00:42.002374 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.002523 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":179,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":10932,"thread_start_us":186633,"threads_started":1,"wal-append.queue_time_us":453400}
I20260709 13:00:42.004155  5228 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:42.005167  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:41.977417  2325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4ce544917f545499da64014539a4ff2"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:00:41.962188  4917 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.995625  5197 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:42.006359  2325 raft_consensus.cc:606] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:42.005939  5228 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:42.007730  1675 leader_election.cc:336] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.595s (SENT)
I20260709 13:00:42.008069  1555 raft_consensus.cc:2410] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:41.973707  1627 rpcz_store.cc:276] 0709 13:00:40.293310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.260456 (+967146us) service_pool.cc:224] Handling call
0709 13:00:41.260928 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.261192 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:41.261571 (+   379us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.936197 (+674626us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.936386 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.936433 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:41.936489 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.936553 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.936727 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21672,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":3139,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":180,"spinlock_wait_cycles":18296960,"thread_start_us":673549,"threads_started":2,"wal-append.queue_time_us":512571}
I20260709 13:00:42.008306  1675 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:42.009694  5226 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:41.999694  1557 raft_consensus.cc:2410] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:00:42.011129  1675 leader_election.cc:336] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.674s (SENT)
I20260709 13:00:42.017966  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:42.019977  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:42.023316  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 51699.1us
I20260709 13:00:42.024801  5216 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:42.025224  5216 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:42.025585  5216 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:42.026041  5187 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:42.026492  5187 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:42.027472  5187 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:42.029134  5049 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:42.029486  5310 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:00:42.030705  5303 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:00:42.045329  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 50109.6us
I20260709 13:00:42.046135  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:42.047991  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:42.049600  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:42.049968  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:42.050374  1708 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 8: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:42.053069  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:42.054029  2326 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:42.054255  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:42.055222  1705 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 7: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:42.055220  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:42.058784  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:42.059475  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:42.059738  1708 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:42.064721  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:42.065208  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:42.066038  1703 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:42.072114  2326 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:42.073149  2329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:00:42.073781  2329 raft_consensus.cc:606] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:41.991011  5200 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:42.080003  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:42.032964  5187 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:42.081918  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:42.082782  2324 raft_consensus.cc:2376] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8. Re-sending same reply.
I20260709 13:00:42.075474  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:42.087982  4990 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:42.090188  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:42.093319  2322 raft_consensus.cc:2368] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9.
I20260709 13:00:42.097654  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:42.098625  2325 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:42.041811  5192 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:42.058669  5228 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:42.070101  5197 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:42.092236  5044 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:42.076675  5049 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:42.157814  5049 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:42.158336  5049 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:42.104629  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:42.100529  4986 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:42.142030  1598 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:42.108109  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:42.066367  5226 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:42.151289  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:42.101339  5024 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:42.166926  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 62443.8us
I20260709 13:00:42.138783  5000 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:42.162684  1557 raft_consensus.cc:2393] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:42.165695  1598 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:42.171535  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:42.165150  2322 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:42.153960  5228 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:42.170279  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 110870us
I20260709 13:00:42.173025  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:42.166850  5012 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:42.177215  1598 leader_election.cc:400] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9.
I20260709 13:00:42.177534  1598 leader_election.cc:403] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:42.150379  5197 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:42.178967  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:42.174960  1675 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:42.181455  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:42.181599  1708 raft_consensus.cc:1275] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:42.182181  1705 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:42.182358  1702 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:42.138345  5202 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:00:42.138160  5301 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:00:42.184799  1675 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:42.170212  5024 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.186091  1675 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:42.187119  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:42.186714  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:42.190172  1675 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:42.193076  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:42.173753  5185 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:42.196458  1705 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:00:42.175282  5299 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:42.201082  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:42.181957  5085 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:42.183293  5080 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:42.183557  5197 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:42.177404  5300 raft_consensus.cc:2764] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:00:42.195267  5252 consensus_meta.cc:287] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.590s	user 0.007s	sys 0.003s
W20260709 13:00:42.273281  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.199005  2324 raft_consensus.cc:2955] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:42.187517  5226 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:42.266153  5185 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:42.185317  4986 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:42.203724  4943 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:42.277184  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 82038.9us
I20260709 13:00:42.197636  5109 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:42.309615  2325 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:42.196521  5143 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:42.276929  5085 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.295288  5030 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.196370  5024 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:42.272626  5321 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:42.320797  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:42.333195  2327 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:42.321993  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:42.334506  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2372) took 1017 ms. Trace:
I20260709 13:00:42.325138  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:42.322939  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:42.305040  5185 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:42.291903  5299 raft_consensus.cc:697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:42.307862  4943 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.338898  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:42.335188  1709 rpcz_store.cc:276] 0709 13:00:41.317416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.321232 (+  3816us) service_pool.cc:224] Handling call
0709 13:00:42.334362 (+1013130us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400266454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:42.334453 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512969984}
I20260709 13:00:42.335980  2322 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:42.316851  5300 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:42.341281  5300 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:42.308137  4917 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:42.334918  5030 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:42.347110  4917 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:00:42.349637  2321 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:42.356117  1556 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:42.357195  5000 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:42.358412  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:42.359350  5143 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:42.361644  5319 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:00:42.327368  5085 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:42.295737  5252 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:42.298179  4990 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:00:42.332471  5301 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:42.401453  5236 raft_consensus.cc:2243] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:42.402930  5236 raft_consensus.cc:2272] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:42.406410  5316 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260709 13:00:42.348419  5030 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:42.408381  5236 ts_tablet_manager.cc:1916] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:42.410759  5252 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:42.412091  5320 raft_consensus.cc:3055] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:42.412679  5320 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:42.398464  5052 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:42.414762  5299 consensus_queue.cc:237] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:42.364219  4943 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:42.391389  5300 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:42.417250  5228 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:42.432664  2325 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:42.420019  5216 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:42.435549  2329 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:42.455986  4990 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:42.456925  4990 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:42.460948  4986 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:00:42.462002  5278 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.901s	user 0.008s	sys 0.005s
I20260709 13:00:42.462615  5278 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:42.473690  5024 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:42.443590  4981 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:42.479743  4981 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:42.493636  5080 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9.
I20260709 13:00:42.487525  5049 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:42.497608  5278 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:42.499673  5049 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:42.500635  5024 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:42.417613  5301 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:42.507390  5301 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:42.509429  5236 ts_tablet_manager.cc:1929] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:42.510505  5236 log.cc:1199] T f4ee010e653949d581d35eb9b09d59dd P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root/wals/f4ee010e653949d581d35eb9b09d59dd
I20260709 13:00:42.512363  5236 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60036 (request call id 81) took 3729 ms. Trace:
I20260709 13:00:42.512923  5236 rpcz_store.cc:276] 0709 13:00:38.782537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.782784 (+   247us) service_pool.cc:224] Handling call
0709 13:00:39.909190 (+1126406us) ts_tablet_manager.cc:1151] Deleting tablet f4ee010e653949d581d35eb9b09d59dd
0709 13:00:39.909288 (+    98us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:00:42.483721 (+2574433us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:42.509270 (+ 25549us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:42.512256 (+  2986us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2483437,"tablet-delete.queue_time_us":287936,"thread_start_us":151350,"threads_started":1}
I20260709 13:00:42.518612  5200 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:42.524317  1672 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:42.526897  1672 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:42.483716  5185 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:42.544802  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:42.503643  4943 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:42.594830  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 50145.1us
W20260709 13:00:43.062884  5143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.021s	sys 0.041s
W20260709 13:00:42.770217  5293 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.615s	user 0.003s	sys 0.001s
W20260709 13:00:42.952244  5335 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:00:42.606118  5326 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:42.552428  4986 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:42.553033  4990 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:42.554859  5278 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:42.553414  5216 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:43.125456  4986 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:43.132776  4986 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:43.127956  4990 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:43.144871  4990 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:43.163113  5185 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:43.165297  5085 consensus_meta.cc:287] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.767s	user 0.010s	sys 0.003s
I20260709 13:00:43.165956  5085 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:42.598511  5252 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:42.937330  5228 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:43.102892  5143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.021s	sys 0.042s
W20260709 13:00:43.130358  5197 consensus_meta.cc:287] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.837s	user 0.009s	sys 0.002s
I20260709 13:00:43.162153  4990 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:43.185416  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:43.125216  5200 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:43.190608  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:43.198933  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:43.183848  5326 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:43.197261  5226 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.185315  5228 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:43.185041  5252 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:43.189049  5197 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:43.204370  5226 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:43.207803  5085 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:43.213627  4943 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:43.293788  5226 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:43.295593  5197 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:43.301828  5252 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:43.309828  5228 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:00:43.220077  5326 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:43.412073  5228 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:43.554317  5228 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:43.557080  5228 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:43.566504  5278 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:43.637977  5252 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.692649  5252 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:43.696691  5341 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.697616  5341 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:43.698968  5252 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:43.700745  5341 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:43.560860  4986 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:43.723661  4986 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:43.743420  5278 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:43.743505  5143 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.001s	sys 0.008s
W20260709 13:00:43.773160  5143 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.001s	sys 0.008s
I20260709 13:00:43.773068  5278 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:43.744390  2324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.011s
W20260709 13:00:43.774638  2324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.001s	sys 0.011s
W20260709 13:00:43.746992  5138 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.000s	sys 0.012s
W20260709 13:00:43.775898  5138 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.000s	sys 0.013s
W20260709 13:00:43.747634  2288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.011s	sys 0.003s
W20260709 13:00:43.776477  2288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.011s	sys 0.003s
I20260709 13:00:43.749658  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:43.750869  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:43.778816  2322 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:43.780429  1626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 688) took 3124 ms (client timeout 2154 ms). Trace:
I20260709 13:00:43.762108  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 693) took 1729 ms. Trace:
I20260709 13:00:43.781319  1556 rpcz_store.cc:276] 0709 13:00:42.032820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.355559 (+322739us) service_pool.cc:224] Handling call
0709 13:00:42.355914 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.761855 (+1405941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.762050 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:43.780956  1626 rpcz_store.cc:269] 0709 13:00:40.656536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.657903 (+  1367us) service_pool.cc:224] Handling call
0709 13:00:43.780231 (+3122328us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54000f55d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:43.780362 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1352281472}
I20260709 13:00:43.744351  5228 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:43.782361  5228 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:43.783810  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2570) took 2816 ms. Trace:
I20260709 13:00:43.783468  5278 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:43.784237  1635 rpcz_store.cc:276] 0709 13:00:40.967660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.474960 (+507300us) service_pool.cc:224] Handling call
0709 13:00:41.548715 (+ 73755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.557387 (+  8672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.557431 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.572925 (+ 15494us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.586628 (+ 13703us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b18003a3a80. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:00:41.934686 (+348058us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:41.935117 (+   431us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.935695 (+   578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.935802 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.043448 (+107646us) raft_consensus.cc:1685] finished
0709 13:00:42.059070 (+ 15622us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.783633 (+1724563us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b5400125a50. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:43.783749 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9538,"prepare.queue_time_us":83546,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":8978,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":5801,"spinlock_wait_cycles":190861056,"thread_start_us":347690,"threads_started":1,"wal-append.queue_time_us":440778,"wal-append.run_cpu_time_us":2436,"wal-append.run_wall_time_us":1002470}
I20260709 13:00:43.794531  2322 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:43.797250  1672 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:43.797595  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:43.798240  2322 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:43.799479  1672 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:43.800933  5326 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:43.801342  5326 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:43.801720  5326 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:43.796876  5228 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:43.819329  5326 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:43.799177  5278 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:43.825160  5278 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:43.826385  5278 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:43.871487  5326 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:43.877313  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.896692  5353 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.897363  5353 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:43.900684  5353 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:43.901350  5353 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.902189  5353 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:43.903568  5354 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:43.905055  5353 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:43.913188  5353 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:43.913738  5353 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:43.915956  5353 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:43.916692  5354 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:43.919611  5354 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:43.927716  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2104) took 2787 ms. Trace:
I20260709 13:00:43.928287  1629 rpcz_store.cc:276] 0709 13:00:41.145990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.494951 (+348961us) service_pool.cc:224] Handling call
0709 13:00:41.495358 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.732085 (+236727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.927388 (+2195303us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400247a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:43.927630 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539868544}
I20260709 13:00:43.971626  5320 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:43.973222  5320 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:44.140143  5326 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.140983  5326 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:44.143980  5326 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:44.220227  5044 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:44.222021  5044 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:44.223340  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.926s	user 0.011s	sys 0.013s
W20260709 13:00:44.223942  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.927s	user 0.012s	sys 0.014s
W20260709 13:00:44.224332  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 1.93273e+06us
I20260709 13:00:44.225919  5060 consensus_queue.cc:1059] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:44.227360  1523 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:44.230248  5044 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:44.233455  5044 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:44.234171  5044 raft_consensus.cc:3055] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:44.234732  5353 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:44.236689  5353 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.237142  5353 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:44.246111  5353 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:44.235598  1523 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:44.247931  5354 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:44.247046  5044 raft_consensus.cc:740] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:44.253491  5044 consensus_queue.cc:260] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:44.255388  5044 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:44.254525  5354 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:44.258903  5354 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:44.260908  5354 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:44.264959  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:44.266597  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:44.267858  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:44.254081  1557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.072s	user 0.041s	sys 0.072s
W20260709 13:00:44.269204  1557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.087s	user 0.042s	sys 0.072s
W20260709 13:00:44.272933  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.268498  2326 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:00:44.280124  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:44.278957  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.290514  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:44.257902  5353 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:44.291070  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:44.283517  5354 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:44.287060  1556 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:44.291515  1552 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:44.288695  1553 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:00:44.291850  5354 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:44.291565  5353 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.292867  5353 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:44.294078  5354 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:44.295063  5353 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:44.302227  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:44.305570  1523 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:44.308167  5044 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:44.308732  5044 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.291268  1560 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:44.309183  5044 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:44.314855  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:44.315864  2324 raft_consensus.cc:2410] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:44.319700  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:44.321755  2328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.015s	sys 0.016s
I20260709 13:00:44.321529  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:44.322119  2328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.016s	sys 0.016s
I20260709 13:00:44.324806  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:44.325765  2328 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:44.349691  2320 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:44.353683  5202 consensus_queue.cc:1059] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:44.359514  2328 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:00:44.362715  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.448057  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.366321  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:44.368760  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:44.448925  1560 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:44.449721  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:44.449793  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:44.451447  2286 connection.cc:256] RPC call timeout handler was delayed by -1.3738368049999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
W20260709 13:00:44.451941  2286 connection.cc:256] RPC call timeout handler was delayed by -1.21273680500002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:00:44.452251  2286 connection.cc:256] RPC call timeout handler was delayed by -1.0390368050000234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
I20260709 13:00:44.370718  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:44.452872  1552 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:44.453061  2286 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:44.453933  5313 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:44.372460  5294 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 2.512s	user 0.011s	sys 0.007s
W20260709 13:00:44.391996  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.458161  5313 consensus_queue.cc:1059] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:44.445138  5109 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:44.459270  5187 raft_consensus.cc:3055] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:44.460085  5187 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:44.460968  5187 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:44.459200  5109 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:44.463639  5109 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:44.465435  2286 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:44.466835  5176 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:44.467231  5176 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.467548  5176 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:44.468478  1552 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:44.502346  5044 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:44.507458  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:44.508358  2328 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:44.514896  5044 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:44.520119  2328 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:00:44.530416  1523 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:44.552363  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 691) took 2527 ms. Trace:
I20260709 13:00:44.552973  1557 rpcz_store.cc:276] 0709 13:00:42.025083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.174461 (+149378us) service_pool.cc:224] Handling call
0709 13:00:42.174879 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.269604 (+2094725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.269638 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.270241 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.363655 (+ 93414us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:44.549244 (+185589us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.549570 (+   326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.551999 (+  2429us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.552068 (+    69us) raft_consensus.cc:1685] finished
0709 13:00:44.552088 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.552272 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129869,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":19186,"thread_start_us":2260490,"threads_started":3,"wal-append.queue_time_us":199370}
W20260709 13:00:44.563956  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 96214.4us
I20260709 13:00:44.569460  1556 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:00:44.589145  1556 pending_rounds.cc:85] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 5
W20260709 13:00:44.574905  1555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 683) took 2755 ms (client timeout 2028 ms). Trace:
I20260709 13:00:44.548344  5044 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:00:44.590241  1555 rpcz_store.cc:269] 0709 13:00:41.812480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.824820 (+ 12340us) service_pool.cc:224] Handling call
0709 13:00:44.567992 (+2743172us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b54001d83d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:44.568149 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142731648}
I20260709 13:00:44.589454  1556 pending_rounds.cc:107] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:00:44.594442  1556 raft_consensus.cc:2889] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:44.588115  5363 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 13:00:44.619128  1675 leader_election.cc:336] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.544s (SENT)
I20260709 13:00:44.620895  1675 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:44.626410  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:44.626965  2320 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:44.623441  5278 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:44.627995  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:44.628610  2326 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:44.605983  5044 raft_consensus.cc:697] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:44.635087  5044 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:44.636855  5176 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:44.638598  2326 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:44.639492  5369 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.640093  5369 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:44.643954  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 78834.3us
I20260709 13:00:44.644830  2286 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:44.657683  5369 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:44.667317  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.786052  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.822176  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.704217  5216 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:44.991371  5278 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.992179  5278 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.001355  5368 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.002131  5368 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:45.005466  5368 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:45.006312  5368 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:45.007121  5368 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.010008  5368 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:45.011736  1629 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:45.020229  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:45.021090  2325 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:45.025408  5317 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 2.724s	user 0.016s	sys 0.046s
I20260709 13:00:45.034067  1629 raft_consensus.cc:1240] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:45.035492  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.036346  1629 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:45.037375  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:45.038759  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 404840us
I20260709 13:00:45.042912  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:45.045200  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:45.052886  1627 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:45.049492  2325 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
W20260709 13:00:45.055063  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 433051us
I20260709 13:00:45.053815  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:45.040812  5278 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:45.062685  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.085258  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.093286  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 448446us
I20260709 13:00:45.057371  1672 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:45.097786  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:45.098675  2326 raft_consensus.cc:2368] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
I20260709 13:00:45.099916  1598 leader_election.cc:400] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
I20260709 13:00:45.100351  1598 leader_election.cc:403] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:45.103569  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 46764.7us
I20260709 13:00:45.105490  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:45.106321  2325 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:45.083179  5375 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:45.105521  5278 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:45.108629  5377 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:45.059721  5369 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:00:45.101379  5176 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:45.115620  1598 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:45.120959  5378 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:45.121452  5378 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.121799  5378 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:45.122303  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.125183  2326 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:45.112891  5375 raft_consensus.cc:697] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:45.124261  1627 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:45.128263  2320 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:45.141776  5324 consensus_queue.cc:1059] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:45.142989  5324 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:45.144333  5228 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.145066  5228 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:45.150326  4986 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.337s	user 0.015s	sys 0.012s
W20260709 13:00:45.151121  4986 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.338s	user 0.015s	sys 0.012s
I20260709 13:00:45.139251  5385 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:45.165603  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58186.5us
I20260709 13:00:45.171482  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:45.172021  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.172107  1560 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.172385  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:45.173099  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.183732  1552 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:45.170913  5278 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:45.193337  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:45.194336  1633 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:45.192817  1554 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:45.164054  5385 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:45.206777  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.196362  5390 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.217381  5383 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.218206  5383 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:45.221200  5386 consensus_queue.cc:1059] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:45.222314  5386 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:45.222654  5386 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:45.226320  5228 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:45.175632  5375 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.227835  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 688) took 3412 ms. Trace:
I20260709 13:00:45.237782  2321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 807) took 2918 ms. Trace:
I20260709 13:00:45.238281  2321 rpcz_store.cc:276] 0709 13:00:42.319521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.321551 (+  2030us) service_pool.cc:224] Handling call
0709 13:00:42.333483 (+ 11932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.350039 (+ 16556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.237471 (+2887432us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b5400431f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:45.237710 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36338432}
I20260709 13:00:45.228251  1551 rpcz_store.cc:276] 0709 13:00:41.815889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.970821 (+154932us) service_pool.cc:224] Handling call
0709 13:00:41.981719 (+ 10898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.000959 (+ 19240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.227590 (+3226631us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b54002288d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:45.227774 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40461056}
I20260709 13:00:45.242305  5364 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:45.243577  5364 raft_consensus.cc:3055] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:45.244024  5364 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:45.223433  5386 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.245329  5385 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:45.245087  5364 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.245836  5386 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.247283  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:45.247628  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:45.248742  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.250162  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:45.251420  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.250705  1446 maintenance_manager.cc:643] P 1d002eece69f4b28add96a7bb163d0f2: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 10.645s	user 0.196s	sys 0.122s Metrics: {"bytes_written":29825,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":238059,"dirs.run_cpu_time_us":457,"dirs.run_wall_time_us":5490,"drs_written":1,"lbm_read_time_us":451,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1763531,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":5,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":265864,"threads_started":2,"update_count":3,"wal-append.queue_time_us":58870}
I20260709 13:00:45.276340  1447 maintenance_manager.cc:419] P 1d002eece69f4b28add96a7bb163d0f2: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8939 bytes on disk
I20260709 13:00:45.263965  1560 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:45.280859  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:45.251922  5278 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.248785  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.300460  1557 raft_consensus.cc:2393] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:45.246482  5364 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:45.253969  5383 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:45.238170  5390 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:45.256731  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.257220  5187 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.257391  1554 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:45.261344  5378 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.270115  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 821) took 3159 ms. Trace:
I20260709 13:00:45.271548  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 680) took 3483 ms. Trace:
I20260709 13:00:45.293788  1633 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:00:45.282517  2286 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:45.297174  5387 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.297871  5369 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:45.308527  5228 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:45.320459  5369 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.321214  5228 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:45.322750  5369 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:45.297778  1446 maintenance_manager.cc:643] P 1d002eece69f4b28add96a7bb163d0f2: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.020s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":440,"lbm_reads_lt_1ms":4}
I20260709 13:00:45.323488  5228 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:45.304930  1673 connection.cc:256] RPC call timeout handler was delayed by -2.1649707199999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
I20260709 13:00:45.309608  5391 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:45.309870  5138 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:45.309645  5393 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.318122  5378 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:45.319630  5385 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:45.321635  2321 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:45.325730  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:45.332309  2320 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:00:45.309494  1559 rpcz_store.cc:276] 0709 13:00:41.789247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.810700 (+ 21453us) service_pool.cc:224] Handling call
0709 13:00:41.859266 (+ 48566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.859640 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.859669 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.867647 (+  7978us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.076964 (+209317us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:42.077018 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.077110 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.271272 (+3194162us) raft_consensus.cc:1685] finished
0709 13:00:45.271304 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.271476 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":472,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7281,"spinlock_wait_cycles":33280,"thread_start_us":164008,"threads_started":1,"wal-append.queue_time_us":251116,"wal-append.run_cpu_time_us":3164,"wal-append.run_wall_time_us":1265261}
I20260709 13:00:45.306030  2329 rpcz_store.cc:276] 0709 13:00:42.110814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.147693 (+ 36879us) service_pool.cc:224] Handling call
0709 13:00:42.165890 (+ 18197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.436089 (+270199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.269816 (+2833727us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b5400358254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:45.270028 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619419520}
I20260709 13:00:45.320248  5277 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:45.331557  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:45.339855  2326 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:45.343016  1598 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:45.329150  5228 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:45.349259  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 45317us
I20260709 13:00:45.329393  5389 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.334510  5138 raft_consensus.cc:697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:45.354095  5138 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.330981  5391 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.358592  5391 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:45.359268  2288 connection.cc:256] RPC call timeout handler was delayed by -1.5123178389999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 13:00:45.359781  2288 connection.cc:256] RPC call timeout handler was delayed by -1.5123178389999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 13:00:45.360124  2288 connection.cc:256] RPC call timeout handler was delayed by -1.4970178390000228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
I20260709 13:00:45.361809  5380 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:00:45.360416  2288 connection.cc:256] RPC call timeout handler was delayed by -1.4970178390000228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260709 13:00:45.363530  2288 connection.cc:256] RPC call timeout handler was delayed by -1.49521783900002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:00:45.363916  2288 connection.cc:256] RPC call timeout handler was delayed by -1.430553782000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:00:45.364356  2288 connection.cc:256] RPC call timeout handler was delayed by -1.397117838999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260709 13:00:45.364706  2288 connection.cc:256] RPC call timeout handler was delayed by -1.397117838999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260709 13:00:45.365355  2288 leader_election.cc:336] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.640s (SENT)
I20260709 13:00:45.365806  2288 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:45.367477  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:45.368283  2326 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:45.371125  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:45.347018  5277 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.331507  5386 consensus_queue.cc:1059] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 13:00:45.372886  1673 connection.cc:256] RPC call timeout handler was delayed by -1.9339328589999809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 13:00:45.374260  2288 connection.cc:256] RPC call timeout handler was delayed by -1.3531537819999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260709 13:00:45.375509  1673 connection.cc:256] RPC call timeout handler was delayed by -1.8314268220000258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 13:00:45.350976  5369 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:45.375983  1673 connection.cc:256] RPC call timeout handler was delayed by -1.6053307939999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260709 13:00:45.362785  5228 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:45.375566  2288 connection.cc:256] RPC call timeout handler was delayed by -1.3530178390000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
I20260709 13:00:45.377756  2320 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:00:45.378201  1559 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:45.376515  5277 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.336333  5356 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:00:45.350724  5378 consensus_queue.cc:1059] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:00:45.379793  2288 connection.cc:256] RPC call timeout handler was delayed by -1.3215178390000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
I20260709 13:00:45.382165  1598 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:45.383013  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:45.384140  1709 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:45.328693  5387 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.384486  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:45.375547  5391 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.387162  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:45.378216  5369 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:45.423090  5390 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:45.461056  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:45.425546  5387 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:45.379446  5382 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:45.385533  5383 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.331228  5393 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.433907  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:45.438587  1703 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:00:45.458768  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.460855  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:45.362397  5380 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.470407  5380 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:45.470963  5380 consensus_queue.cc:1059] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:00:45.477599  2288 connection.cc:256] RPC call timeout handler was delayed by -1.1793178390000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
W20260709 13:00:45.478516  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.479341  2288 connection.cc:256] RPC call timeout handler was delayed by -1.1656140129999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 13:00:45.479770  2288 connection.cc:256] RPC call timeout handler was delayed by -1.1280178389999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 13:00:45.480239  2288 connection.cc:256] RPC call timeout handler was delayed by -1.1280178389999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 13:00:45.481019  2288 connection.cc:256] RPC call timeout handler was delayed by -1.097254012999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 13:00:45.481467  2288 connection.cc:256] RPC call timeout handler was delayed by -1.0722178390000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
I20260709 13:00:45.421804  5359 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:45.485908  1703 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:45.459590  5391 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:45.364686  5389 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.513562  5391 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:45.515177  5389 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:45.515964  5277 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:45.517330  5228 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:45.517901  5392 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:45.489813  1709 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:45.459848  5369 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.457652  5237 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:45.493963  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:45.496021  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.198s	user 0.014s	sys 0.015s
W20260709 13:00:45.502204  1675 leader_election.cc:336] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 3.242s (SENT)
I20260709 13:00:45.506145  2320 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:45.463371  5377 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
I20260709 13:00:45.624192  1702 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:45.658529  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:45.650532  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 699) took 1278 ms. Trace:
W20260709 13:00:45.644670  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.503s	user 0.018s	sys 0.010s
I20260709 13:00:45.660457  1675 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:45.661705  1599 connection.cc:256] RPC call timeout handler was delayed by -2.6014545680000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
I20260709 13:00:45.631695  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:45.659930  1708 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
W20260709 13:00:45.664034  2327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 924) took 1401 ms (client timeout 1603 ms). Trace:
I20260709 13:00:45.664728  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:45.664566  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 162448us
I20260709 13:00:45.525561  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:45.610836  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:45.632858  2324 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:45.620699  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:45.668442  1706 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.603191  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:45.544481  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:45.664543  2327 rpcz_store.cc:269] 0709 13:00:44.262804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.493714 (+1230910us) service_pool.cc:224] Handling call
0709 13:00:45.663733 (+170019us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.670306  2321 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:45.671598  1703 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:45.578392  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:45.601804  5394 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:00:45.522675  5368 raft_consensus.cc:3055] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:45.677100  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:45.598141  5382 raft_consensus.cc:3055] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:45.680269  1704 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:45.599839  5393 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:45.501154  5383 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:45.682898  2326 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:45.678449  5237 raft_consensus.cc:697] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:45.691148  5237 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.670333  5404 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:45.682058  5382 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:45.679924  5368 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:45.695235  5368 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.696398  5368 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:45.695742  5382 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.699105  5382 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:45.692945  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 166019us
I20260709 13:00:45.690011  2325 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:45.510695  5359 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:45.700448  5216 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.010s	sys 0.005s
W20260709 13:00:45.705179  5216 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.010s	sys 0.006s
I20260709 13:00:45.705626  5216 raft_consensus.cc:697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:45.706656  5216 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.708212  5052 raft_consensus.cc:3055] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:45.708678  5052 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:45.709476  5052 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.717738  5383 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:45.720981  4938 raft_consensus.cc:3055] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:45.722925  4938 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:45.723412  5359 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:45.723770  4938 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.724898  4938 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.725176  5369 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.726181  5052 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.727502  5369 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:45.727653  5354 raft_consensus.cc:3055] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:45.728269  5354 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:45.729249  5354 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.730201  5354 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.739032  5372 raft_consensus.cc:3055] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:45.739497  5372 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:45.740178  5372 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:45.773298  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.777729  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.480s	user 0.018s	sys 0.025s
W20260709 13:00:45.779031  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.637s	user 0.020s	sys 0.010s
W20260709 13:00:45.619138  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.782697  1559 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:45.784335  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2059) took 4873 ms. Trace:
I20260709 13:00:45.785005  1558 rpcz_store.cc:276] 0709 13:00:40.910967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.201367 (+290400us) service_pool.cc:224] Handling call
0709 13:00:41.205157 (+  3790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.205513 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.205548 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.209019 (+  3471us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.335287 (+126268us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:41.427762 (+ 92475us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.428108 (+   346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.428207 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.643117 (+4214910us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b180038e060. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:00:45.783654 (+140537us) raft_consensus.cc:1685] finished
0709 13:00:45.783812 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.784120 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":267630,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":941,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":15984,"spinlock_wait_cycles":52690304,"thread_start_us":192766,"threads_started":2,"wal-append.queue_time_us":229644}
I20260709 13:00:45.790494  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:45.793280  1599 connection.cc:256] RPC call timeout handler was delayed by -2.4394545679999737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
I20260709 13:00:45.793450  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:45.794068  1599 connection.cc:256] RPC call timeout handler was delayed by -2.2293357799999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25579999999999997s for a response
W20260709 13:00:45.794754  1599 connection.cc:256] RPC call timeout handler was delayed by -2.2135545680000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23670000000000002s for a response
I20260709 13:00:45.794987  1627 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:45.795397  1626 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:45.795571  1599 connection.cc:256] RPC call timeout handler was delayed by -1.8305201309999575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
I20260709 13:00:45.790549  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:45.797557  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:45.249409  1445 catalog_manager.cc:5028] TS 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): tablet f4ee010e653949d581d35eb9b09d59dd (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 13:00:45.799331  1628 raft_consensus.cc:3055] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:45.799407  1626 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:45.793387  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:45.800249  1445 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 550762us
I20260709 13:00:45.801875  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.804327  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:45.802176  1634 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:45.809470  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.811517  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.796697  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:45.813834  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:45.815197  1709 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:45.798322  1633 raft_consensus.cc:2368] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12.
I20260709 13:00:45.823335  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.823979  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:45.828533  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.660000  1556 rpcz_store.cc:276] 0709 13:00:44.371645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.373023 (+  1378us) service_pool.cc:224] Handling call
0709 13:00:44.568309 (+195286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.595029 (+ 26720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.650204 (+1055175us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54001d83d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:45.650438 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448221568}
I20260709 13:00:45.831292  1629 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:45.824656  1631 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:45.834882  5378 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.835131  5368 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.836100  5368 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.837072  5374 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:45.837459  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.838495  1557 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:45.839332  5368 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:45.835835  5378 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.840657  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:45.841395  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.841715  1554 raft_consensus.cc:2393] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:45.842088  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.842196  1560 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
W20260709 13:00:45.833250  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.843097  1557 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:45.796495  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.800065  1628 raft_consensus.cc:740] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:45.843567  1551 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:45.831367  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:45.845393  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.849648  1628 consensus_queue.cc:260] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:45.852138  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:45.857110  2320 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:45.857949  1555 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:45.854192  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.855882  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:45.860834  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.861128  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:45.856810  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.862434  1557 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:45.859449  2320 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 13:00:45.863616  1656 debug-util.cc:398] Leaking SignalData structure 0x7b0800337d20 after lost signal to thread 434
I20260709 13:00:45.863875   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:45.860870  5383 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.856938  5372 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.863260  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:45.865388  1656 debug-util.cc:398] Leaking SignalData structure 0x7b080034f060 after lost signal to thread 1492
I20260709 13:00:45.866569  2323 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:00:45.868428  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7c20 after lost signal to thread 1584
I20260709 13:00:45.865141  2320 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:00:45.868889  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08002081e0 after lost signal to thread 1585
I20260709 13:00:45.865957  5383 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:45.873974  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.874773  5383 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:45.876495  1628 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:45.877794  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.880122  5378 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:45.878707  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.882004  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:45.884003  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.884617  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.855299  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:45.885332  1559 raft_consensus.cc:2393] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:45.886615  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.887200  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.888571  1559 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:45.889626  5248 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:45.887431  1630 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:45.893198  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:45.876266  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08000a70a0 after lost signal to thread 1659
I20260709 13:00:45.896327  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.896929  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:45.896366  1656 debug-util.cc:398] Leaking SignalData structure 0x7b080030f0c0 after lost signal to thread 1660
I20260709 13:00:45.897742  1633 raft_consensus.cc:2376] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6. Re-sending same reply.
I20260709 13:00:45.899241  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:45.905198  2329 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:45.907291  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:45.909245  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:45.910213  2328 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:45.910351  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.911931  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.909775  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.913441  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.914264  1555 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:45.914774  1706 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:00:45.915441  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.916463  1558 raft_consensus.cc:2393] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:45.917452  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.917848  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:45.918809  1557 raft_consensus.cc:2393] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:45.917532  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.921082  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.921628  1632 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:45.922071  1633 raft_consensus.cc:2410] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:45.922752  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.923074  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:45.923702  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 65212.7us
I20260709 13:00:45.924096  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:45.924412  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.919445  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:45.925143  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.925384  1630 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:00:45.919934  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.924412  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.927294  1633 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:45.927549  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.917433  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:45.918869  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:45.927686  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 107791us
W20260709 13:00:45.909720  1656 debug-util.cc:398] Leaking SignalData structure 0x7b080024de20 after lost signal to thread 1733
I20260709 13:00:45.925875  1630 pending_rounds.cc:85] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 7
I20260709 13:00:45.938566  1706 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:00:45.933904  1630 pending_rounds.cc:107] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:00:45.942251  1630 raft_consensus.cc:2889] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:45.949137  5386 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:45.950119  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:45.955436  5378 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:45.956468  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:45.959407  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:45.960384  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:45.960830  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:45.961580  1703 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:45.961745  1700 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.964812  1629 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:00:45.965075  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:45.965924  1706 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
W20260709 13:00:45.966230  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.974682  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:45.975991  1635 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:45.976794  2329 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:45.990702  1627 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:45.993510  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:45.994472  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.951612  5298 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:00:45.994710  1706 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 7: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:45.997817  2325 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
W20260709 13:00:45.999440  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 57607.8us
I20260709 13:00:46.002540  1628 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:46.004807  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:46.005645  1627 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:46.006402  1705 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.007s	sys 0.014s
W20260709 13:00:46.006848  1705 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.008s	sys 0.014s
I20260709 13:00:46.021235  5386 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:46.030040  1627 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:00:46.040225  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:46.034122  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:46.034488  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:46.039134  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:46.034883  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:46.040154  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:46.046478  1632 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:46.037566  1704 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:46.028469   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:46.029068  1598 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:46.051776  1700 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
W20260709 13:00:46.052253  1656 debug-util.cc:398] Leaking SignalData structure 0x7b080038a120 after lost signal to thread 2353
I20260709 13:00:46.038772  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:46.029891  1457 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41166 (request call id 325) took 35600 ms (client timeout 15000 ms). Trace:
W20260709 13:00:46.056263  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 115023us
I20260709 13:00:46.055035  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:46.059966  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.062083  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.063800  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:46.065382  1630 raft_consensus.cc:2410] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:00:46.066054  1629 raft_consensus.cc:2393] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:46.038664  5372 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.069876  1703 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:46.059507  5298 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:46.077988  1656 debug-util.cc:398] Leaking SignalData structure 0x7b0800375a20 after lost signal to thread 5276
I20260709 13:00:46.079013  1456 catalog_manager.cc:5697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:46.035272  5385 consensus_queue.cc:1059] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:00:46.085096  5372 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:46.090001  5248 consensus_queue.cc:1059] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:46.090312  1672 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:46.036931  5397 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:00:46.090690  1523 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:46.090929  5354 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:46.091344  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:46.090873  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:46.077793  5237 consensus_queue.cc:1059] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:00:46.105139  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:46.105026  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:46.118901  1629 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:46.039623  5404 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:00:46.092046  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:46.120731  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:46.124991  1701 raft_consensus.cc:2393] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:46.127985  1555 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:46.129186  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:46.129863  1629 raft_consensus.cc:2376] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6. Re-sending same reply.
I20260709 13:00:46.130313  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:46.132673  4938 raft_consensus.cc:3055] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:46.133064  4938 raft_consensus.cc:740] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:46.133180  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 820) took 1890 ms. Trace:
I20260709 13:00:46.134950  5397 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:46.135425  5397 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:46.135895  5397 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.133603  2322 rpcz_store.cc:276] 0709 13:00:44.227579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.876358 (+1648779us) service_pool.cc:224] Handling call
0709 13:00:45.877104 (+   746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.877601 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:45.878179 (+   578us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.094258 (+216079us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.094744 (+   486us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:46.094796 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:46.116967 (+ 22171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.117065 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.118399 (+  1334us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5698,"prepare.queue_time_us":449,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":101,"raft.queue_time_us":20604,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":295,"thread_start_us":177320,"threads_started":1}
I20260709 13:00:46.134267  4938 consensus_queue.cc:260] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:46.136801  1630 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:00:46.137471  4938 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.137620  5385 consensus_queue.cc:1243] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:46.137960  5372 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:46.054733  1457 rpcz_store.cc:269] 0709 13:00:10.434560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.504473 (+ 69913us) service_pool.cc:224] Handling call
0709 13:00:46.029458 (+35524985us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:39.605925 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:39.606541 (+   616us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:39.606585 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:00:39.606604 (+    19us) tablet.cc:662] Decoding operations
0709 13:00:39.607192 (+   588us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:39.607270 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:39.607305 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:00:39.607737 (+   432us) tablet.cc:701] Row locks acquired
0709 13:00:39.607783 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:00:39.608091 (+   308us) write_op.cc:270] Start()
0709 13:00:39.608362 (+   271us) write_op.cc:276] Timestamp: P: 1783602039608016 usec, L: 0
0709 13:00:39.608385 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:00:39.647105 (+ 38720us) log.cc:844] Serialized 1302 byte log entry
0709 13:00:41.033553 (+1386448us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed697b0ac 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b
0709 13:00:41.989910 (+956357us) op_driver.cc:464] REPLICATION: finished
0709 13:00:42.406474 (+416564us) write_op.cc:301] APPLY: starting
0709 13:00:42.406582 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:42.407054 (+   472us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:42.407096 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:42.407504 (+   408us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:42.407776 (+   272us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:00:42.407820 (+    44us) write_op.cc:312] APPLY: finished
0709 13:00:42.408138 (+   318us) log.cc:844] Serialized 35 byte log entry
0709 13:00:42.408320 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:42.408420 (+   100us) write_op.cc:454] Released schema lock
0709 13:00:42.408482 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:42.432404 (+ 23922us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:42.433233 (+   829us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3162302,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":356854,"apply.run_cpu_time_us":2574,"apply.run_wall_time_us":18977,"num_ops":3,"prepare.queue_time_us":826004,"prepare.run_cpu_time_us":33874,"prepare.run_wall_time_us":1762952,"raft.queue_time_us":367477,"raft.run_cpu_time_us":65029,"raft.run_wall_time_us":367630,"replication_time_us":2363375,"spinlock_wait_cycles":20805888,"thread_start_us":2861028,"threads_started":4,"wal-append.queue_time_us":1746819,"wal-append.run_cpu_time_us":17219,"wal-append.run_wall_time_us":2013790}]]}
I20260709 13:00:46.132354  1632 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:46.141494  1703 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.142560  5383 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:46.141721  1456 catalog_manager.cc:5697] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 5 to 8, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:46.125658  1598 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:46.153648  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:46.122243  5298 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.158883  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:46.159747  1630 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
W20260709 13:00:46.161557  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.150900  5383 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:46.163712  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 64409.3us
W20260709 13:00:46.172710  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.160845  5005 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:00:46.173945  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:46.181324  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 199588us
I20260709 13:00:46.152462  5385 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.187183  1632 raft_consensus.cc:2393] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 10: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:46.185976  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:46.175252  5372 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:46.166491  5383 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.162703  5298 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:46.192174  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 126360us
I20260709 13:00:46.195537  2329 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:46.194990  5372 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:46.199041  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:46.199784  2327 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:46.199620  5372 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:46.188314  2288 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:46.206035  1523 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:46.219823  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:46.230598  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.234712  2325 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:46.236387  1630 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:46.237298  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:46.244410  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:46.236996  5354 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:46.249079  5354 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:46.210146  1456 catalog_manager.cc:5697] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 3 to 6, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.250211  5354 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:46.251171  1456 catalog_manager.cc:5697] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.256887  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:46.257803  1709 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:46.257997  5424 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:46.258744  5424 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:46.261070  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 72881.5us
W20260709 13:00:46.264765  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.265089  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 71426.9us
I20260709 13:00:46.269747  4938 consensus_queue.cc:1059] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:46.270900  1599 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:46.271564  4938 raft_consensus.cc:3055] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:46.272039  5237 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:46.272410  4938 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:46.265763  1701 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 4.
W20260709 13:00:46.284703  5418 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:00:46.217267  5385 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:46.285377  5393 raft_consensus.cc:3055] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:46.286581  5424 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:46.297537  1456 catalog_manager.cc:5697] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:46.298985  5407 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:46.301328  1703 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:46.295327  1598 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:46.272500  5237 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.314599  1629 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:46.316412  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:46.318887  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:46.324061  1631 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:46.303817  5393 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:46.322165  5237 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:46.357200  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 65657.4us
I20260709 13:00:46.357060  5004 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:46.362569  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:46.364650  5004 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.366591  5004 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:46.366811  5298 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:46.377388  1456 catalog_manager.cc:5697] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.379215  5298 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:46.381614  5191 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:46.389264  5421 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:00:46.398535  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:46.399391  2327 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:00:46.402256  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:46.406210  2325 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:46.412747  2328 raft_consensus.cc:1217] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Deduplicated request from leader. Original: 5.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 13:00:46.413272  2328 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:46.414212  5383 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:46.432654  5369 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:00:46.434661  5393 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:46.435954  5393 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:46.436735  5413 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:46.441154  1632 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
W20260709 13:00:46.438853  5428 consensus_queue.cc:1175] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6b9e73092f6146639bf310a3d18cfe37" responder_term: 7 status { last_received { term: 7 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: [6.7-6.7]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:00:46.447090  1526 connection.cc:256] RPC call timeout handler was delayed by -3.5531846989999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:00:46.411885  1456 catalog_manager.cc:5697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 3 to 6, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:46.457386  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 100611us
I20260709 13:00:46.459689  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:46.462229  1701 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:46.467317  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.471597  5359 raft_consensus.cc:3055] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:46.472148  5359 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:46.473408  5359 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:46.474790  5359 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:46.478628  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:46.482059  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:46.482828  1703 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:46.484205  5427 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:46.485524  5385 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:46.488632  5426 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:46.490417  5191 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:46.490937  5191 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:46.492993  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:46.493767  1701 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:46.441625  5372 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:00:46.494534  5004 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:46.496562  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:46.497855  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 65731.1us
I20260709 13:00:46.500322  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:46.452778  1456 catalog_manager.cc:5697] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 5 to 6, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:46.508016  2327 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:46.510805  1700 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:46.518136  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.514632  1598 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:46.527231  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:46.533392  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 94885.8us
I20260709 13:00:46.534387  1701 raft_consensus.cc:1240] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:46.530303  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:46.537952  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:46.521677  5004 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:46.539273  1557 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:46.515618  5397 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:46.533226  5372 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:46.530750  5052 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.551301  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:46.450217  4938 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:46.564975  1456 catalog_manager.cc:5697] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 5, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.567674  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:46.568358  1701 raft_consensus.cc:2376] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9. Re-sending same reply.
I20260709 13:00:46.569345  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:46.570082  1701 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:46.542543  5313 raft_consensus.cc:2764] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:46.583526  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:46.584842  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:46.585644  1703 raft_consensus.cc:2376] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10. Re-sending same reply.
I20260709 13:00:46.588208  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:46.593317  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:46.593729  1673 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:46.594225  1708 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:46.542501  5438 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:46.598909  1706 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.599712  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:46.600841  5404 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:46.603363  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:46.579650  5372 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:46.606001  5431 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:00:46.615507  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.616417  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 65727.3us
I20260709 13:00:47.965678  5453 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:46.437441  5413 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:46.634294  1700 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
W20260709 13:00:48.046468  1700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2394) took 1586 ms (client timeout 1531 ms). Trace:
W20260709 13:00:48.047060  1700 rpcz_store.cc:269] 0709 13:00:46.459507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.463245 (+  3738us) service_pool.cc:224] Handling call
0709 13:00:48.046328 (+1583083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.637530  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:46.648206  5030 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.073041  5030 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:48.075603  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 844) took 1679 ms. Trace:
I20260709 13:00:48.075753  5030 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:46.648187  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:46.663815  5372 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:48.076520  2324 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:46.665418  4938 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.665966  5397 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:46.596714  5052 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:48.080672  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2399) took 1489 ms (client timeout 1985 ms). Trace:
I20260709 13:00:46.635895  5438 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:48.087643  5438 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:46.668859  5237 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:48.089902  5237 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:46.906131  5407 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.090925  5407 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:46.967011  5191 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:48.093436  2324 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
W20260709 13:00:46.968809  5393 consensus_meta.cc:287] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.001s
I20260709 13:00:46.999918  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:47.099210  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.201349  5450 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.339378  1709 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
W20260709 13:00:47.405939  1708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.012s	sys 0.004s
I20260709 13:00:47.632243  5451 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.835634  5452 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:47.871974  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.907195  5383 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:48.099342  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.099515  1704 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260709 13:00:48.099733  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.099947  1704 pending_rounds.cc:85] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 6
I20260709 13:00:47.908958  1702 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.100231  1704 pending_rounds.cc:107] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:47.931007  5427 raft_consensus.cc:3055] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:48.103343  1675 connection.cc:256] RPC call timeout handler was delayed by -1.4185318309999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
I20260709 13:00:48.103633  5427 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:48.094271  5191 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:48.104619  5191 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:48.104735  5427 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:48.105144  5191 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:48.106102  5427 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.107470  5191 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:47.935334  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:47.975499  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.976236  5455 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:47.978000  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:47.979279  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:47.981019  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:48.108731  1707 raft_consensus.cc:2393] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 7: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:47.973927  5413 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:48.109000  1630 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:48.109145  1628 raft_consensus.cc:2368] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12.
I20260709 13:00:47.981426  1635 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:00:47.982378  1627 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:48.007525  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.009630  1706 consensus_meta.cc:287] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.372s	user 0.030s	sys 0.028s
I20260709 13:00:47.994365  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:48.110334  1706 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:48.110788  1629 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:47.968422  5453 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:48.022948  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:48.040009  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.111609  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:48.112138  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.049539  1703 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 13:00:48.051162  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:48.054464  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:48.032989  5456 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:48.063612  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 661) took 1498 ms. Trace:
I20260709 13:00:48.068367  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:48.114737  1700 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:48.115074  2328 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:48.070322  2288 leader_election.cc:336] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.688s (SENT)
I20260709 13:00:48.076121  2326 rpcz_store.cc:276] 0709 13:00:46.395866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.396023 (+   157us) service_pool.cc:224] Handling call
0709 13:00:46.404946 (+  8923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.971515 (+1566569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.971544 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.972192 (+   648us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:47.972236 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.075219 (+102983us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54005668d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:48.075269 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.075402 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3599741312}
I20260709 13:00:46.615126  5404 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:48.080286  1601 connection.cc:256] RPC call timeout handler was delayed by -3.4363374259999659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260709 13:00:48.084254  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.085433  5052 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:48.094025  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 844) took 1557 ms. Trace:
W20260709 13:00:48.117293  1601 connection.cc:256] RPC call timeout handler was delayed by -3.0628374259999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
I20260709 13:00:48.094570  2327 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:48.083287  1705 rpcz_store.cc:269] 0709 13:00:46.591415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.592429 (+  1014us) service_pool.cc:224] Handling call
0709 13:00:48.080576 (+1488147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.118376  2329 raft_consensus.cc:2393] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:00:48.098624  1708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.503s	user 0.013s	sys 0.004s
W20260709 13:00:47.914130  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.115726  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:48.100549  1704 raft_consensus.cc:2889] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:48.121141  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:48.121826  1628 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:48.122618  1630 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:48.101392  5451 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:48.139154  5451 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:48.139915  5451 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:48.101523  5452 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:48.141086  1601 connection.cc:256] RPC call timeout handler was delayed by -2.71203339799996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 13:00:48.141558  1601 connection.cc:256] RPC call timeout handler was delayed by -2.6355333980000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
I20260709 13:00:48.103109  5313 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:00:48.103734  1675 connection.cc:256] RPC call timeout handler was delayed by -1.3942318310000132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 13:00:48.110846  1706 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2397) took 1582 ms (client timeout 1613 ms). Trace:
W20260709 13:00:48.009713  1526 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.483s	user 0.033s	sys 0.034s
W20260709 13:00:48.300874  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.301275  1526 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.775s	user 0.034s	sys 0.034s
W20260709 13:00:48.301513  1675 connection.cc:256] RPC call timeout handler was delayed by -1.3890930769999841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 13:00:48.301728  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 1.8217e+06us
W20260709 13:00:48.302452  1675 leader_election.cc:336] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.563s (SENT)
W20260709 13:00:48.302575  1526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.112s (SENT) [suppressed 47 similar messages]
I20260709 13:00:48.303026  1675 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:48.097362  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2600) took 1637 ms. Trace:
I20260709 13:00:48.304633  1709 rpcz_store.cc:276] 0709 13:00:46.459806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.464705 (+  4899us) service_pool.cc:224] Handling call
0709 13:00:46.603159 (+138454us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5800011798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 13:00:48.097302 (+1494143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25785728}
I20260709 13:00:48.305948  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:48.306843  1709 raft_consensus.cc:2410] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:00:48.306746  5459 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:48.308033  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:48.124166  1631 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
W20260709 13:00:48.308606  1675 connection.cc:256] RPC call timeout handler was delayed by -1.333031831000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:00:48.309532  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:48.310513  1631 raft_consensus.cc:2368] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10.
I20260709 13:00:48.310134  5313 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:48.311404  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:48.312106  1631 raft_consensus.cc:2368] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10.
I20260709 13:00:48.125049  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:48.313998  1707 raft_consensus.cc:2393] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:48.314965  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:48.315580  1707 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:48.124295  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:48.124882  5455 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:48.125737  5456 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:48.128271  5453 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:48.129997  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 1.13e+06us
I20260709 13:00:48.122820  5393 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:48.120814  5404 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.116861  5237 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.381675  5237 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:48.383867  5237 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:48.111583  5450 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:48.093921  5407 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:48.142299  5457 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:48.142673  5452 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:46.567281  1456 catalog_manager.cc:5697] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.423789  1456 catalog_manager.cc:5697] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 4, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.425604  1456 catalog_manager.cc:5697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 3, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.427455  1456 catalog_manager.cc:5697] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.081853  5030 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.437973  5030 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:48.141906  1601 connection.cc:256] RPC call timeout handler was delayed by -2.4879333979999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 13:00:48.441138  1601 connection.cc:256] RPC call timeout handler was delayed by -2.3349333979999756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 13:00:48.441648  1601 connection.cc:256] RPC call timeout handler was delayed by -2.2998333979999757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
I20260709 13:00:48.117728  2324 rpcz_store.cc:276] 0709 13:00:46.536451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.536849 (+   398us) service_pool.cc:224] Handling call
0709 13:00:48.093936 (+1557087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.118017  5438 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:48.146728  1702 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
W20260709 13:00:48.453012  1702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2398) took 1911 ms (client timeout 2171 ms). Trace:
W20260709 13:00:48.453502  1702 rpcz_store.cc:269] 0709 13:00:46.541852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.596127 (+ 54275us) service_pool.cc:224] Handling call
0709 13:00:48.452925 (+1856798us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.114686  1701 rpcz_store.cc:276] 0709 13:00:46.565424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.593541 (+ 28117us) service_pool.cc:224] Handling call
0709 13:00:46.593874 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:46.594254 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.594282 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:46.594909 (+   627us) log.cc:844] Serialized 52 byte log entry
0709 13:00:47.910683 (+1315774us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:47.910741 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.910819 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.060601 (+149782us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003b36a0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed99fadbe 00007f0ed9a05930 00007f0ed9a058d8 00007f0ed9a05858 00007f0ed9a05813 00007f0ed9a04a9c 00007f0edf8f0626 00007f0edf8eadd8 00007f0ed9a417cb 00007f0ed9a442c0
0709 13:00:48.063207 (+  2606us) raft_consensus.cc:1685] finished
0709 13:00:48.063240 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.063512 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9031,"raft.queue_time_us":1836,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":2698,"spinlock_wait_cycles":2896436096,"thread_start_us":37651,"threads_started":1,"wal-append.queue_time_us":54040}
I20260709 13:00:48.157581  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:48.458714  1559 raft_consensus.cc:2410] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:00:48.148087  5454 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.165730  1557 raft_consensus.cc:1240] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:48.170054  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:48.149472  5460 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.173950  1555 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:48.463606  5460 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:48.175992  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 660) took 1610 ms. Trace:
I20260709 13:00:48.464757  1703 rpcz_store.cc:276] 0709 13:00:46.565187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.597541 (+ 32354us) service_pool.cc:224] Handling call
0709 13:00:48.049212 (+1451671us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:48.113071 (+ 63859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.175783 (+ 62712us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400265550. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:48.175928 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3336971008}
I20260709 13:00:48.465999  5460 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:48.177086  1553 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:48.467406  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:48.468041  1556 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:48.468240  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:48.469023  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:48.469313  2286 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:48.469575  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:48.178812  1700 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:48.150532  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:48.470304  1553 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:48.471165  1629 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:48.471662  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:48.472013  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:48.178325  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:48.472916  1705 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:48.214006  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:48.473237  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:48.215718  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:48.218015  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:48.474022  1557 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:00:48.150230  5464 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:48.224907  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 154675us
I20260709 13:00:48.474385  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:48.475153  1629 raft_consensus.cc:2368] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12.
I20260709 13:00:48.242213  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:48.476125  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:48.234036  5466 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.476918  5466 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:48.464452  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:48.477463  2288 leader_election.cc:336] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.705s (SENT)
I20260709 13:00:48.478155  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:48.479238  5466 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:48.473984  1552 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
W20260709 13:00:48.479395  2288 leader_election.cc:336] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.707s (SENT)
I20260709 13:00:48.472371  1553 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
W20260709 13:00:48.480113  2288 leader_election.cc:336] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.707s (SENT)
I20260709 13:00:48.248420  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 653) took 1715 ms. Trace:
I20260709 13:00:48.256289  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:48.274034  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 662) took 1708 ms. Trace:
I20260709 13:00:48.480890  5413 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:48.317255  1630 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
W20260709 13:00:48.309564  1675 leader_election.cc:336] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.585s (SENT)
W20260709 13:00:48.300618  1706 rpcz_store.cc:269] 0709 13:00:46.528351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.528689 (+   338us) service_pool.cc:224] Handling call
0709 13:00:48.110804 (+1582115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.482077  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:48.318276  5451 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:00:48.320428  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:48.322237  5456 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:48.323832  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:48.324425  5455 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:48.324849  1707 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:48.325553  1709 raft_consensus.cc:2393] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 7: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:48.325193  1673 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:48.489849  5030 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:48.490983  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 165966us
I20260709 13:00:48.492051  1673 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:48.325381  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:48.326036  5453 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.492988  5453 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:48.493685  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.493502  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:48.494441  1633 raft_consensus.cc:2368] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10.
I20260709 13:00:48.495448  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:48.496047  1633 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:48.496558  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.328065  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:48.329638  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:48.330766  2326 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:48.332722  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:48.333096  5465 consensus_queue.cc:1059] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:48.339547  5313 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:48.348423  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 75947.3us
I20260709 13:00:48.375646  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:48.117282  4938 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.390844  2328 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:49.100575  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 952) took 1033 ms. Trace:
I20260709 13:00:49.101152  2328 rpcz_store.cc:276] 0709 13:00:48.067577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.067748 (+   171us) service_pool.cc:224] Handling call
0709 13:00:49.100447 (+1032699us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.393260  5450 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:48.432780  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:48.422480  5457 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:49.102653  2327 raft_consensus.cc:2376] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8. Re-sending same reply.
I20260709 13:00:49.103876  4938 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:49.104902  5457 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:48.115116  5383 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:49.105921  5383 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:49.106662  4938 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:48.446727  5404 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:49.110621  5404 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:48.449481  1598 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:48.462297  5454 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:48.474660  5464 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:49.111900  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 662433us
I20260709 13:00:49.113762  5454 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:48.245707  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:49.114708  5475 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:48.482853  1630 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:48.480506  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:49.115605  5475 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:49.115713  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 724) took 1113 ms. Trace:
I20260709 13:00:48.467406  1703 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:00:49.116289  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 636070us
I20260709 13:00:49.116245  1630 rpcz_store.cc:276] 0709 13:00:48.002547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.481858 (+479311us) service_pool.cc:224] Handling call
0709 13:00:49.115635 (+633777us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:49.117058  2288 leader_election.cc:336] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.793s (SENT)
W20260709 13:00:49.118023  2288 leader_election.cc:336] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.796s (SENT)
I20260709 13:00:49.118383  2288 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:49.118463  1630 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:00:48.484004  2286 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:49.118963  1630 pending_rounds.cc:85] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 8
I20260709 13:00:48.480953  1701 raft_consensus.cc:1275] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:00:48.481189  1708 rpcz_store.cc:276] 0709 13:00:46.565669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.594814 (+ 29145us) service_pool.cc:224] Handling call
0709 13:00:46.595108 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.595322 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:46.595660 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 13:00:48.152299 (+1556639us) log.cc:844] Serialized 14 byte log entry
0709 13:00:48.273543 (+121244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:48.273628 (+    85us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:48.273701 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.273792 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.273950 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10283,"prepare.queue_time_us":33410,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":84,"raft.queue_time_us":12117,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":16191,"thread_start_us":1676907,"threads_started":3,"wal-append.queue_time_us":102514}
I20260709 13:00:49.119401  5313 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:49.119626  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2409) took 1166 ms. Trace:
I20260709 13:00:49.120071  5313 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:49.117002  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2413) took 1162 ms. Trace:
I20260709 13:00:48.486676  1675 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:49.120944  1703 rpcz_store.cc:276] 0709 13:00:47.954757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.466815 (+512058us) service_pool.cc:224] Handling call
0709 13:00:48.467063 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.116762 (+649699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.116949 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:48.488042  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 43923.4us
W20260709 13:00:49.121821  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 812157us
W20260709 13:00:49.122185  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 638122us
W20260709 13:00:49.122785  1675 leader_election.cc:336] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.602s (SENT)
I20260709 13:00:48.470238  5462 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:49.123315  1675 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:48.328792  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:48.498401  1632 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:00:48.406245  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 103668us
W20260709 13:00:48.671674  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.251073  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.680846  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:48.649458  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 122198us
I20260709 13:00:49.254973  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:48.469837  1556 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.264813  5457 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:49.265755  5457 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:00:48.744014  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 252027us
I20260709 13:00:49.270722  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:48.681443  5393 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:49.277349  5393 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:48.739954  5452 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:48.781329  1635 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:49.282725  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 722) took 1280 ms. Trace:
I20260709 13:00:49.283118  1635 rpcz_store.cc:276] 0709 13:00:48.002029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.475894 (+473865us) service_pool.cc:224] Handling call
0709 13:00:49.282658 (+806764us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.284547  1635 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:49.285262  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 709) took 1287 ms. Trace:
I20260709 13:00:49.285681  1635 rpcz_store.cc:276] 0709 13:00:47.997481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.283848 (+1286367us) service_pool.cc:224] Handling call
0709 13:00:49.284216 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.284905 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.285153 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.288048  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 713) took 1288 ms. Trace:
I20260709 13:00:48.784220  1633 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:48.731263  5460 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:00:49.289131  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 702) took 1306 ms. Trace:
I20260709 13:00:48.782364  5453 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:48.898753  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.087162  5237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.026s	sys 0.064s
I20260709 13:00:49.289636  1633 rpcz_store.cc:276] 0709 13:00:47.983178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.495125 (+511947us) service_pool.cc:224] Handling call
0709 13:00:49.289049 (+793924us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:49.290138  5237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.026s	sys 0.065s
I20260709 13:00:49.291448  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 714) took 1291 ms. Trace:
I20260709 13:00:49.113749  5464 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:48.212957  1626 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:49.292618  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 700) took 1310 ms. Trace:
I20260709 13:00:49.292984  1626 rpcz_store.cc:276] 0709 13:00:47.982611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.200184 (+217573us) service_pool.cc:224] Handling call
0709 13:00:48.212765 (+ 12581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.292335 (+1079570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.292514 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.115044  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 710) took 1116 ms. Trace:
I20260709 13:00:48.451767  5438 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:49.296849  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 725) took 1294 ms. Trace:
I20260709 13:00:49.297436  1629 rpcz_store.cc:276] 0709 13:00:48.002800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.510772 (+507972us) service_pool.cc:224] Handling call
0709 13:00:49.296746 (+785974us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.480720  1704 rpcz_store.cc:276] 0709 13:00:46.533474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.533777 (+   303us) service_pool.cc:224] Handling call
0709 13:00:46.541104 (+  7327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.122670 (+1581566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.248035 (+125365us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400396a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:48.248325 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3582738688}
W20260709 13:00:49.119861  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.295477  1626 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:49.296872  1634 rpcz_store.cc:276] 0709 13:00:47.998291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.245204 (+246913us) service_pool.cc:224] Handling call
0709 13:00:49.114948 (+869744us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.485981  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:49.123526  5462 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.299724  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 728) took 1296 ms. Trace:
I20260709 13:00:49.300005  5462 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.300163  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 723) took 1297 ms. Trace:
I20260709 13:00:49.300619  1627 rpcz_store.cc:276] 0709 13:00:48.002284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.481501 (+479217us) service_pool.cc:224] Handling call
0709 13:00:49.300105 (+818604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.409044   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:49.207136  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 732) took 1001 ms. Trace:
W20260709 13:00:49.301975  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.485395  1551 rpcz_store.cc:276] 0709 13:00:48.205737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.205896 (+   159us) service_pool.cc:224] Handling call
0709 13:00:48.207509 (+  1613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.205833 (+998324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.205854 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.205912 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:49.205945 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.206894 (+   949us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54001d6ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:49.206926 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.207057 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296491136}
W20260709 13:00:49.302747  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 53357.2us
I20260709 13:00:49.486971  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:49.487427  1526 connection.cc:256] RPC call timeout handler was delayed by -3.0970642240000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2922s for a response
I20260709 13:00:49.487673  1557 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:49.123333  1601 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:48.496986  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:49.127555  1630 pending_rounds.cc:107] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:00:49.168979  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 706) took 1184 ms. Trace:
I20260709 13:00:49.598224  5469 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:49.598341  1628 rpcz_store.cc:276] 0709 13:00:47.984333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.648771 (+664438us) service_pool.cc:224] Handling call
0709 13:00:48.649127 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.730940 (+ 81813us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:48.748177 (+ 17237us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.168041 (+419864us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.168586 (+   545us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.168658 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:49.168723 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.168771 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.168862 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9129,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":57707,"raft.queue_time_us":921,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":130,"thread_start_us":419080,"threads_started":1,"wal-append.queue_time_us":416207}
I20260709 13:00:49.313951  1560 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
W20260709 13:00:49.125841  1675 connection.cc:256] RPC call timeout handler was delayed by -1.2916318310000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 13:00:49.603813  1675 leader_election.cc:336] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.618s (SENT)
I20260709 13:00:49.604240  1675 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:49.145620  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08001428c0 after lost signal to thread 434
W20260709 13:00:49.611864  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08000e0e60 after lost signal to thread 1492
W20260709 13:00:49.613158  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08001ae160 after lost signal to thread 1584
W20260709 13:00:49.613422  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08001ae140 after lost signal to thread 1585
W20260709 13:00:49.614464  1730 debug-util.cc:398] Leaking SignalData structure 0x7b080022f0e0 after lost signal to thread 1659
W20260709 13:00:49.614730  1730 debug-util.cc:398] Leaking SignalData structure 0x7b080022f080 after lost signal to thread 1660
W20260709 13:00:49.615103  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.615760  1730 debug-util.cc:398] Leaking SignalData structure 0x7b0800352ea0 after lost signal to thread 1733
W20260709 13:00:49.186232  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 53770.8us
I20260709 13:00:49.618458  2286 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:49.125224  2288 leader_election.cc:336] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.816s (SENT)
W20260709 13:00:49.621064  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 495814us
W20260709 13:00:49.621604  2288 leader_election.cc:336] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.816s (SENT)
I20260709 13:00:49.622128  5313 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:49.621945  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:49.622525  5313 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.303264  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:49.625638  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:49.169354  2321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.007s	sys 0.002s
W20260709 13:00:49.630182  2321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.143s	user 0.010s	sys 0.002s
I20260709 13:00:49.127074  5404 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:49.633879  5404 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:49.634713  5404 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:49.635128  5404 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.635489  5404 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.126346  5383 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:49.318970  5438 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:49.123895  5450 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:49.643982  5450 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.644438  5450 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.303720  5460 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:49.125240  5458 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:49.125414  5475 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:49.342533  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.268268  5457 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 13:00:49.343681  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.687364  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.347862  1556 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:49.688053  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 2454) took 1457 ms. Trace:
I20260709 13:00:49.688401  1556 rpcz_store.cc:276] 0709 13:00:48.230261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.468769 (+238508us) service_pool.cc:224] Handling call
0709 13:00:49.687990 (+1219221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.690042  1556 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:00:49.690387  1556 pending_rounds.cc:85] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 9
I20260709 13:00:49.690627  1556 pending_rounds.cc:107] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:00:49.690869  1556 raft_consensus.cc:2889] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:49.410730  5473 raft_consensus.cc:3055] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:00:49.413435  1632 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 691) took 1436 ms (client timeout 1707 ms). Trace:
I20260709 13:00:48.462805  1456 catalog_manager.cc:5697] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 2 to 5, term changed from 2 to 4, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.694842  1456 catalog_manager.cc:5697] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:49.487794  1526 connection.cc:256] RPC call timeout handler was delayed by -2.6929642239999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3371s for a response
W20260709 13:00:49.696821  1526 connection.cc:256] RPC call timeout handler was delayed by -2.6730700379999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3131s for a response
W20260709 13:00:49.697288  1526 connection.cc:256] RPC call timeout handler was delayed by -2.2931252370000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 13:00:49.697655  1526 connection.cc:256] RPC call timeout handler was delayed by -2.2247252370000297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260709 13:00:49.698030  1526 connection.cc:256] RPC call timeout handler was delayed by -2.2247252370000297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260709 13:00:49.698338  1526 connection.cc:256] RPC call timeout handler was delayed by -1.9718252370000187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 13:00:49.698698  1526 connection.cc:256] RPC call timeout handler was delayed by -1.9718252370000187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 13:00:49.699096  1526 connection.cc:256] RPC call timeout handler was delayed by -1.9619252370000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 13:00:49.699450  1526 connection.cc:256] RPC call timeout handler was delayed by -1.9619252370000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 13:00:49.699810  1526 connection.cc:256] RPC call timeout handler was delayed by -1.9520252370000435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 13:00:49.700201  1526 connection.cc:256] RPC call timeout handler was delayed by -1.9520252370000435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
I20260709 13:00:49.488397  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:49.489146  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:49.704968  1553 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:49.302909  1598 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:49.495026  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 200961us
W20260709 13:00:49.709072  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.291815  1633 rpcz_store.cc:276] 0709 13:00:47.999706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.290459 (+1290753us) service_pool.cc:224] Handling call
0709 13:00:49.290797 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.290988 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.291016 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.291058 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:49.291092 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.291146 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.291358 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.531420  5427 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.534008  5462 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:49.710234  5427 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:49.711647  5462 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:49.288496  1635 rpcz_store.cc:276] 0709 13:00:47.999396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.286923 (+1287527us) service_pool.cc:224] Handling call
0709 13:00:49.287338 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.287612 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.287649 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.287705 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:49.287760 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.287832 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.287977 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.542176  5452 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:49.570331  5487 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:49.300215  1626 rpcz_store.cc:276] 0709 13:00:48.003749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.294431 (+1290682us) service_pool.cc:224] Handling call
0709 13:00:49.294864 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.299435 (+  4571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.299664 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.572976  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:49.713028  1632 rpcz_store.cc:269] 0709 13:00:47.977163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.217686 (+240523us) service_pool.cc:224] Handling call
0709 13:00:49.413171 (+1195485us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b54001b9c54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:49.413341 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54141312}
I20260709 13:00:49.578748  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 734) took 1372 ms. Trace:
I20260709 13:00:49.713086  5487 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:49.714268  5473 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:49.714140  1554 rpcz_store.cc:276] 0709 13:00:48.206468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.206783 (+   315us) service_pool.cc:224] Handling call
0709 13:00:48.208886 (+  2103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.576750 (+1367864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.576786 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.576832 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:49.576874 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.578472 (+  1598us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54001d83d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:49.578519 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.578653 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3144854272}
I20260709 13:00:49.579555  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:49.715756  1559 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:49.716162  5487 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:49.580840  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:49.716734  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.716943  1551 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:49.581275  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:49.718022  1552 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:00:49.586539  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:49.597564  1630 raft_consensus.cc:2889] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:49.601377  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:49.719900  2329 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
W20260709 13:00:49.602239  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 478987us
I20260709 13:00:49.720058  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 708) took 1722 ms. Trace:
W20260709 13:00:49.720821  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 417929us
I20260709 13:00:49.720858  1630 rpcz_store.cc:276] 0709 13:00:47.997205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.117531 (+1120326us) service_pool.cc:224] Handling call
0709 13:00:49.117955 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.719808 (+601853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.720001 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.120159  1701 rpcz_store.cc:276] 0709 13:00:47.953441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.480318 (+526877us) service_pool.cc:224] Handling call
0709 13:00:48.480617 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.119392 (+638775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.119577 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.726684  5372 consensus_queue.cc:1059] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:49.606065  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 737) took 1392 ms. Trace:
I20260709 13:00:49.619333  5453 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:49.620115  5469 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.757890  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.640168  2321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 849) took 1238 ms. Trace:
I20260709 13:00:49.624949  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:49.758991  1627 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:49.622921  5313 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.621948  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:49.651922  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:49.764011  2329 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:49.660444  1599 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:49.766669  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 106288us
I20260709 13:00:49.664706  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:49.668962  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:49.669837  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:49.675554  1523 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:49.769424  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 93951.9us
W20260709 13:00:49.769994  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 497413us
I20260709 13:00:49.619362  2286 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:49.713606  1557 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:49.574657  5464 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:49.720016  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.723265  4938 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:49.603081  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 715) took 1603 ms (client timeout 2121 ms). Trace:
I20260709 13:00:49.772477  5464 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:49.772778  1631 rpcz_store.cc:269] 0709 13:00:48.000001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.487876 (+487875us) service_pool.cc:224] Handling call
0709 13:00:49.603022 (+1115146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.728969  1456 catalog_manager.cc:5697] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 3 to 5, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.775049  5464 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:49.774657  1456 catalog_manager.cc:5697] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 1 to 6, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:49.700501  1526 connection.cc:256] RPC call timeout handler was delayed by -1.6956700380000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.42169999999999996s for a response
W20260709 13:00:49.777750  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 156142us
W20260709 13:00:49.778374  2288 leader_election.cc:336] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.865s (SENT)
I20260709 13:00:49.727771  1560 rpcz_store.cc:276] 0709 13:00:48.213346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.213563 (+   217us) service_pool.cc:224] Handling call
0709 13:00:49.605892 (+1392329us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b5400160154. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:49.605990 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1931920768}
I20260709 13:00:49.727902  1601 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:49.739705  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08003ebea0 after lost signal to thread 2353
W20260709 13:00:49.779296  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08003ba280 after lost signal to thread 2354
I20260709 13:00:49.779363  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:49.715622  5473 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:49.622882  1634 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:49.684095  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:49.785825  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 166504us
I20260709 13:00:49.786227  2325 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:00:49.776662  1456 catalog_manager.cc:5697] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:49.789810  2288 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:49.791891  2326 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:00:49.759824  2321 rpcz_store.cc:276] 0709 13:00:48.401841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.401999 (+   158us) service_pool.cc:224] Handling call
0709 13:00:48.402332 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.402565 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:48.487246 (+ 84681us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.639620 (+1152374us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.639681 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:49.639879 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.639961 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.640101 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86215,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":8673,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"thread_start_us":1221721,"threads_started":2,"wal-append.queue_time_us":678734}
I20260709 13:00:49.791622  1456 catalog_manager.cc:5697] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:49.797758  1673 connection.cc:256] RPC call timeout handler was delayed by -3.00479545099995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 13:00:49.797521  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 193749us
I20260709 13:00:49.777679  5372 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:49.785851  5438 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:49.823659  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 45218.2us
W20260709 13:00:49.832895  1673 connection.cc:256] RPC call timeout handler was delayed by -2.5983301530000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 13:00:49.833362  1673 connection.cc:256] RPC call timeout handler was delayed by -2.4768301529999803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:00:49.833652  1673 connection.cc:256] RPC call timeout handler was delayed by -2.4156301529999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 13:00:49.833917  1673 connection.cc:256] RPC call timeout handler was delayed by -2.3517301530000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260709 13:00:49.834184  1673 connection.cc:256] RPC call timeout handler was delayed by -2.15069545099999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26080000000000003s for a response
W20260709 13:00:49.834596  1673 connection.cc:256] RPC call timeout handler was delayed by -1.92053654099999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 13:00:49.834882  1673 connection.cc:256] RPC call timeout handler was delayed by -1.6542301530000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25680000000000003s for a response
W20260709 13:00:49.835168  1673 connection.cc:256] RPC call timeout handler was delayed by -1.5430555099999879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 13:00:49.835431  1673 connection.cc:256] RPC call timeout handler was delayed by -1.5421555099999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260709 13:00:49.837126  1523 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:49.791481  5427 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:49.777033  5470 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:00:49.763440  5453 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:49.765427  5469 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:49.815174  5484 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:49.851403  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 64839.2us
I20260709 13:00:49.829069  5473 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:49.854382  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:49.845638  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:49.846675  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:49.847872  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 119565us
W20260709 13:00:49.839586  2288 leader_election.cc:336] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.896s (SENT)
I20260709 13:00:49.849682  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:49.851485  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:49.799145  5462 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:49.855691  1705 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:49.861110  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:49.861202  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:49.861902  1702 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:49.856750  1701 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:49.855042  1709 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:49.838867  5458 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.839402  5372 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.816498  5237 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:49.871731  2288 leader_election.cc:336] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.896s (SENT)
I20260709 13:00:49.841230  5452 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.864198  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:49.877138  5372 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.949245  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:49.871492  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 103996us
I20260709 13:00:49.875653  1523 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:49.853152  5484 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.952508  1707 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:49.854893  5383 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:49.854636  5438 raft_consensus.cc:697] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:49.966740  5438 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:49.967978  1673 leader_election.cc:336] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.633s (SENT)
I20260709 13:00:49.847198  5464 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
W20260709 13:00:49.969901  1673 leader_election.cc:336] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.847s (SENT)
W20260709 13:00:49.970484  1673 leader_election.cc:336] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.848s (SENT)
W20260709 13:00:49.988183  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 108073us
I20260709 13:00:49.955356  5484 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.961776  5455 raft_consensus.cc:3055] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:49.999631  5455 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:50.002522  5313 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:50.004897  5313 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:50.005581  5313 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:50.022107  5453 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:49.961745  5485 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:00:50.025763  5455 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:50.028069  5455 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.955219  5383 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:49.954370  5452 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:49.972043  5462 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:50.037760  5494 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:00:50.057881  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 229970us
I20260709 13:00:50.053552  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:50.016377  5393 consensus_meta.cc:287] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.003s
W20260709 13:00:50.058454  1675 connection.cc:256] RPC call timeout handler was delayed by -1.2514436550000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 13:00:50.060298  1675 connection.cc:256] RPC call timeout handler was delayed by -1.2493318310000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 13:00:50.064224  1675 connection.cc:256] RPC call timeout handler was delayed by -1.2081923650000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 13:00:50.064767  1675 connection.cc:256] RPC call timeout handler was delayed by -1.1955930769999554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:00:50.065459  1675 connection.cc:256] RPC call timeout handler was delayed by -1.1803436550000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 13:00:50.065914  1675 connection.cc:256] RPC call timeout handler was delayed by -1.1503318310000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260709 13:00:50.066660  1675 connection.cc:256] RPC call timeout handler was delayed by -1.1242318310000314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
W20260709 13:00:50.067516  1675 connection.cc:256] RPC call timeout handler was delayed by -1.1001930769999717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 13:00:50.069026  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 224778us
W20260709 13:00:50.069214  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 215101us
I20260709 13:00:50.056360  5383 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.087280  2286 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:50.098830  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 227075us
W20260709 13:00:50.105376  2288 leader_election.cc:336] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.900s (SENT)
I20260709 13:00:50.105813  2288 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:50.108511  1707 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
W20260709 13:00:50.114980  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.062049  5393 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.069344  5475 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:49.994369  5458 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:50.126528  5464 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:50.145565  2288 leader_election.cc:336] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.908s (SENT)
W20260709 13:00:50.146561  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 180324us
W20260709 13:00:50.148077  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.127404  5313 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.143978  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.147557  1599 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.142454  5475 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:50.153345  5458 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:50.153945  5393 consensus_queue.cc:1059] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:50.149096  5497 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:50.146626  5464 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.149503  1703 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
W20260709 13:00:50.156181  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.158654  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 287117us
W20260709 13:00:50.159195  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 164306us
W20260709 13:00:50.166204  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.146920  5499 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.160041  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:50.161485  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49480.9us
I20260709 13:00:50.156772  5313 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:50.163367  5460 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:50.164386  5438 raft_consensus.cc:2764] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:00:50.180436  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:50.181056  5450 consensus_meta.cc:287] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.002s
I20260709 13:00:50.180456  5460 raft_consensus.cc:697] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:50.169133  5464 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:50.185936  2288 leader_election.cc:336] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.978s (SENT)
W20260709 13:00:50.187880  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.187316  1552 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.161825  5503 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:50.184486  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:50.209738  1557 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:50.210299  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.162642  5453 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:00:50.212169  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:50.177232  5313 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.206692  2288 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:50.167474  5497 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:50.218585  5475 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:50.222617  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.187261  5470 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:50.226068  1675 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:50.228191  1552 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
W20260709 13:00:50.225740  5404 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.002s
W20260709 13:00:50.239420  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 49902.2us
I20260709 13:00:50.242908  5505 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.238104  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:50.249634  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.175698  5499 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:50.255468  1557 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:50.205183  5450 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:50.260094  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:50.261948  5502 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:50.244798  5487 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.276753  5462 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:50.279721  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 119830us
W20260709 13:00:50.281035  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.282374  5452 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:50.290575  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:50.292606  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 107384us
W20260709 13:00:50.293529  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 88476.7us
I20260709 13:00:50.217624  5497 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:50.313879  5438 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.286751  5499 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:50.296821  5487 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:50.253983  5404 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:50.360136  2325 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:50.361943  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:50.362520  5404 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:50.316399  5460 consensus_queue.cc:237] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:50.367515  5484 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:50.368373  5487 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.368839  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:50.370229  1601 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:50.372133  1601 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:50.372834  5516 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:50.373775  5516 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:50.326171  5450 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:50.326507  5469 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:50.326746  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 105315us
I20260709 13:00:50.332957  5383 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:50.334913  5427 raft_consensus.cc:3055] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:50.335188  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 75342.8us
I20260709 13:00:50.402724  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:50.335691  5372 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:50.359514  1581 debug-util.cc:398] Leaking SignalData structure 0x7b08000ebc60 after lost signal to thread 434
I20260709 13:00:50.389249  2286 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.407341  2286 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:50.407445  1581 debug-util.cc:398] Leaking SignalData structure 0x7b0800361220 after lost signal to thread 1492
W20260709 13:00:50.404783  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 218892us
W20260709 13:00:50.409248  1581 debug-util.cc:398] Leaking SignalData structure 0x7b08000ebf60 after lost signal to thread 1584
W20260709 13:00:50.409770  1581 debug-util.cc:398] Leaking SignalData structure 0x7b08000be720 after lost signal to thread 1585
W20260709 13:00:50.410938  1581 debug-util.cc:398] Leaking SignalData structure 0x7b0800261480 after lost signal to thread 1659
W20260709 13:00:50.412865  1581 debug-util.cc:398] Leaking SignalData structure 0x7b0800394480 after lost signal to thread 1660
I20260709 13:00:50.413112  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:50.414328  1581 debug-util.cc:398] Leaking SignalData structure 0x7b08000d7020 after lost signal to thread 1733
W20260709 13:00:50.416004  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.409868  2288 leader_election.cc:336] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.058s (SENT)
I20260709 13:00:50.417251  5521 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:50.417902  5521 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:50.418891  5521 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:50.424207  5438 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.425922  5498 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:50.426604  5383 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:50.426723  5498 raft_consensus.cc:697] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:50.427551  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:50.428162  1557 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.390118  5502 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:50.430691  5484 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:50.431751  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:50.442072  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:50.442389  1552 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.434109  5464 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:50.439018  1581 debug-util.cc:398] Leaking SignalData structure 0x7b0800389a60 after lost signal to thread 2353
W20260709 13:00:50.476928  1581 debug-util.cc:398] Leaking SignalData structure 0x7b08002ab420 after lost signal to thread 2354
I20260709 13:00:50.439128  2288 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:50.427734  5498 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:50.445044  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 72966.3us
I20260709 13:00:50.445924  5469 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:50.447165  5516 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:50.403486  5427 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:50.449739  1675 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:50.450652  5502 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:50.486219  5427 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:50.487527  5487 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:50.456979  5372 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:50.468914  5313 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:50.443921  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.489653  2321 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:50.489658  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 45844.7us
I20260709 13:00:50.490749  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:50.492188  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 87723.4us
I20260709 13:00:50.481410  1557 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:50.488090  5427 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.492890  5491 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:50.494441  5383 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:50.525171  5383 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:50.529373  5383 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.530784  5464 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:50.506634  5520 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.118s	user 0.000s	sys 0.002s
W20260709 13:00:50.532208  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 122835us
I20260709 13:00:50.495781  5485 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.496083  5313 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:50.496913  5452 consensus_queue.cc:1059] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:50.496929  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:50.455862  1552 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
W20260709 13:00:50.540747  2288 leader_election.cc:336] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.115s (SENT)
I20260709 13:00:50.499787  1601 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:50.504707  2321 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:50.509457  2286 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:50.509948  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.505928  5487 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:50.511884  5516 raft_consensus.cc:697] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:50.521667  5503 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.552907  5516 consensus_queue.cc:237] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:50.557210  2288 leader_election.cc:336] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 2.115s (SENT)
I20260709 13:00:50.557740  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:50.522500  1675 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:50.473457  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 173841us
I20260709 13:00:50.562323  1599 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.537746  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:50.563583  2325 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:50.498399  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:50.544741  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48010.1us
I20260709 13:00:50.545255  5491 raft_consensus.cc:3055] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:50.545722  5313 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:50.546142  5438 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.539140  5485 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:50.550341  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 50584.6us
I20260709 13:00:50.550945  4938 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:50.566298  1555 raft_consensus.cc:2393] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:50.566771  2286 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.566951  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:50.566224  5491 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:50.568910  5313 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:50.575807  1599 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.569777  5485 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.567502  5503 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:50.570068  5452 raft_consensus.cc:2764] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 13:00:50.595029  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 71778.7us
I20260709 13:00:50.593746  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.576658  5450 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:50.583917  4938 raft_consensus.cc:697] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:50.600394  4938 consensus_queue.cc:237] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:50.594069  5519 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.601926  5519 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.602388  5519 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.585793  5475 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:50.605144  5475 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:50.605268  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:50.605695  5475 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.606719  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.607610  5512 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:50.608525  5512 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:50.609907  5512 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:50.612749  2325 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:00:50.612519  1675 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:50.614840  1523 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.615512  5473 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:50.620276  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 44541.2us
I20260709 13:00:50.621011  1599 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.622270  1707 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:50.623221  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:50.623888  1707 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:50.624214  1701 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.619787  5453 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:00:50.625756  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:50.627512  5487 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:50.624962  5473 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:50.628705  5473 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.629149  1709 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:50.629887  5372 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:50.630455  5372 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.630684  5514 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:50.630858  5372 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.617115  5237 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:00:50.632923  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:50.633589  1706 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:50.635164  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:50.635773  1703 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:50.637423  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:50.638556  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:50.639185  1702 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:50.640645  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:50.625232  1599 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.641235  1708 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.611253  5509 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.638896  5514 raft_consensus.cc:697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:50.638167  5491 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:50.643893  5514 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:50.644636  5491 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:50.645268  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.648849  1708 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:00:50.649165  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:50.589789  5438 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:00:50.638191  5455 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:50.653056  5455 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.661463  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:50.674991  1707 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:50.673005  1706 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:50.617237  5450 raft_consensus.cc:697] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:50.673697  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:50.678256  1709 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:50.653687  5455 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.653805  5496 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:50.684970  1675 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:50.685977  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 68562.6us
I20260709 13:00:50.686367  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:50.688787  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:50.689191  1706 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 3.
I20260709 13:00:50.690580  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:50.691792  5487 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:50.689201  1526 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:50.698793  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 139657us
I20260709 13:00:50.692790  5487 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:50.680822  5438 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:50.718485  5450 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:50.701491  5452 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.720602  5473 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:50.722862  5473 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:50.693557  5496 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:50.726791  2288 leader_election.cc:336] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.154s (SENT)
W20260709 13:00:50.737032  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.742085  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:50.743450  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 62230.6us
I20260709 13:00:50.746193  1703 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:50.729473  5438 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:50.747275  1706 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:00:50.748905  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 59860.6us
W20260709 13:00:50.749895  2288 leader_election.cc:336] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.177s (SENT)
I20260709 13:00:50.753777  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:50.732648  5496 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:50.762024  1556 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:50.763763  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:50.766317  1707 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:50.766113  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:50.764401  1556 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.769865  1703 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
W20260709 13:00:50.764266  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 149474us
I20260709 13:00:50.787952  1675 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:50.714851  5313 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:50.794413  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.795837  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.798050  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:50.801121  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 51270us
W20260709 13:00:50.803424  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.801512  5526 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:00:50.816939  1556 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
W20260709 13:00:50.818503  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.825554  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:50.827351  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:50.827962  1703 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.846520  1706 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:50.847067  1703 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:50.824178  5514 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:50.860843  2325 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:50.855662  5404 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:50.957564  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 86883us
I20260709 13:00:50.859985  5509 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:50.972788  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.973246  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 185376us
W20260709 13:00:50.973443  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.858137  5469 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.996384  1701 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:50.863822  5514 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:51.002130  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.040424  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.074836  1675 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:50.978500  5438 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.861490  5372 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:50.995656  5491 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:51.069442  5518 log.cc:927] Time spent T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:00:51.046072  5514 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.000707  5521 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:51.091593  1601 connection.cc:256] RPC call timeout handler was delayed by -3.5183271500000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:00:51.094463  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 248617us
I20260709 13:00:51.083233   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:51.003960  5503 consensus_queue.cc:1059] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
W20260709 13:00:51.132913  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.081885  5438 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:51.148398  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:51.149715  1628 raft_consensus.cc:2410] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:51.150451  1675 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:51.151446  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.006313  5469 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:51.152805  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 350087us
I20260709 13:00:51.157792  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:51.186723  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 59987.5us
I20260709 13:00:51.094188  5404 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:51.192958  1634 raft_consensus.cc:2368] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
W20260709 13:00:51.197853  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 72448.1us
I20260709 13:00:51.195909  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:51.196563  5427 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:51.089154  5533 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:00:51.094421  5491 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:51.146939  5438 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:51.210114  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 61266.5us
I20260709 13:00:51.211409  1631 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:51.192246  5505 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.202764  4938 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.224421  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:51.251209  1675 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:51.242277  5519 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.639s	user 0.013s	sys 0.000s
I20260709 13:00:51.234136  5502 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:51.247558  5485 consensus_meta.cc:287] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.656s	user 0.003s	sys 0.008s
W20260709 13:00:51.307009  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 55906.1us
I20260709 13:00:51.256237  5503 raft_consensus.cc:3055] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:00:51.355449  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 96614.2us
I20260709 13:00:51.237406  5498 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
W20260709 13:00:51.365005  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.368383  1675 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:51.239387  5505 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:51.385793  1601 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:51.375636  5540 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:00:51.353893  5487 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:51.375249  5462 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:00:51.396843  5475 consensus_meta.cc:287] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.791s	user 0.007s	sys 0.006s
I20260709 13:00:51.352506  5452 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:51.398782  5452 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.397706  5475 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:51.353790  5503 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:51.357182  5404 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:51.401983  5404 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:51.293256  5519 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:51.258426  4938 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:51.380518  5372 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:51.382063  5538 log.cc:927] Time spent T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:00:51.382778  5457 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:51.383188  5551 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:00:51.375233  5532 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
I20260709 13:00:51.293416  5502 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:51.392939  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 59477.4us
W20260709 13:00:51.384369  5544 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:00:51.383219  5533 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:51.419956  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.423050  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 198694us
W20260709 13:00:51.440270  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 54552.7us
I20260709 13:00:51.332032  5485 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:51.459142  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 82680.6us
W20260709 13:00:51.459023  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 90718.6us
I20260709 13:00:51.404570  5404 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:51.440071  5518 log.cc:927] Time spent T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:00:51.441326  5502 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.396569  5487 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:51.465639  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:51.475394  1675 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:51.437959  5457 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:51.471997  5383 consensus_meta.cc:287] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.942s	user 0.000s	sys 0.014s
I20260709 13:00:51.484642  1601 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:51.456554  5372 consensus_queue.cc:1059] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:00:51.496088  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:51.497674  1675 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:51.507407  5543 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 13:00:51.507614  5537 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:51.508198  5537 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:51.458702  5503 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:51.476409  5404 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:00:51.491590  5427 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:51.496503  5473 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:51.526131  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 89104.4us
W20260709 13:00:51.527719  5542 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:00:51.529532  5534 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:51.528548  5567 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:51.529106  5559 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:51.528803  5560 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:00:51.531731  5547 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.096s
W20260709 13:00:51.532207  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.514338  5537 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.491927  5383 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:51.550035  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.561477  5457 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:51.564715  5503 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:51.533383  5469 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:51.566294  5455 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.880s	user 0.012s	sys 0.000s
I20260709 13:00:51.566905  5455 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:51.524684  5491 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:51.571061  5455 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:51.573199  5487 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:51.573987  5509 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:51.577390  5509 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.552064  5470 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:51.580904  5470 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:51.581507  5470 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:51.583235  5541 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.493s	user 0.000s	sys 0.001s
W20260709 13:00:51.585659  5496 consensus_meta.cc:287] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.802s	user 0.010s	sys 0.000s
I20260709 13:00:51.586161  5496 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:51.587843  4938 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:51.588188  5496 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:51.589030  5554 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:00:51.551285  5427 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:51.594758  5383 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:51.595186  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 122488us
I20260709 13:00:51.596328  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:51.599362  5505 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:51.599004  5470 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:51.600812  5548 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:51.606179  5556 consensus_queue.cc:1059] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:00:51.606869  5509 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:51.607410  5556 raft_consensus.cc:3055] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:51.607822  5556 raft_consensus.cc:740] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:51.609325  5475 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:51.610102  5519 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:51.615727  5452 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:51.616111  5553 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:51.616528  5553 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:00:51.617801  5539 log.cc:927] Time spent T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Append to log took a long time: real 0.383s	user 0.000s	sys 0.002s
I20260709 13:00:51.617538  5553 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:51.618654  5509 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:51.618877  5553 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:51.575934  5485 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:51.622632  5470 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:51.623517  5485 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:00:51.624684  5536 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.549s	user 0.000s	sys 0.002s
I20260709 13:00:51.628749  5556 consensus_queue.cc:260] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:51.630450  5556 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:51.636372  5514 consensus_meta.cc:287] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.001s
I20260709 13:00:51.637043  5514 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:51.639232  5514 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:51.650282  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:51.522791  5473 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:51.657706  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:51.656694  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:51.663005  2320 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.658196  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:51.657347  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:51.660185  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:51.670476  2322 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:00:51.670905  2322 pending_rounds.cc:85] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 9
I20260709 13:00:51.671217  2322 pending_rounds.cc:107] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:00:51.671432  2322 raft_consensus.cc:2889] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:51.672849  5427 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.673394  5427 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:51.675365  5427 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:51.690675  5473 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:51.628062  5438 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:51.694726  5438 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:51.678514  5502 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:51.707700  5502 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:51.710677  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:51.711615  5464 consensus_queue.cc:1059] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:51.711706  5485 consensus_queue.cc:1059] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:51.712924  5237 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:51.713132  5509 raft_consensus.cc:3055] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:51.713518  5464 raft_consensus.cc:3055] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:51.713721  5509 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:51.713977  5464 raft_consensus.cc:740] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:51.714638  5509 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:51.714800  5464 consensus_queue.cc:260] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:51.715920  5464 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.715885  5509 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.712944  5485 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:51.733584  2320 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:51.737777  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:00:51.742801  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.756032  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 254560us
W20260709 13:00:51.760567  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.021s	sys 0.037s
W20260709 13:00:51.761096  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.021s	sys 0.037s
I20260709 13:00:51.763571  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:51.767992  1557 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:51.767810  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:51.758828  5502 raft_consensus.cc:2764] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:00:51.771431  1555 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:51.774147  1552 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:51.772014  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.777859  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.801028  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 63305.9us
I20260709 13:00:51.800870  2325 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
W20260709 13:00:51.803927  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 319342us
W20260709 13:00:51.806864  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 314867us
I20260709 13:00:51.774114  5372 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.824203  1599 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:51.825012  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 327356us
I20260709 13:00:51.829181  1557 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:51.817052  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:51.833468  2288 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:51.815351  5237 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.814990  5496 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.844745  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:51.845881  1557 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:51.845906  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 329512us
I20260709 13:00:51.816661  5553 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:00:51.809111  5537 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:51.856971  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:51.845641  1673 leader_election.cc:336] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.519s (SENT)
I20260709 13:00:51.857795  1556 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:51.858058  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:51.837868  5503 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:51.846096  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:51.853466  1705 raft_consensus.cc:1275] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:51.839780  5475 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:51.859468  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:51.862380  1598 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:51.822384  5372 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:51.861261  1700 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:51.857482  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:51.864614  1552 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:51.828667  5558 consensus_queue.cc:1059] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:00:51.873313  1709 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:51.869131  2322 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:51.869365  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:51.874805  1556 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.870882  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:51.875825  1700 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.871160  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:51.877045  1705 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:51.871369  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.872115  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:51.872617  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:51.878756  1702 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.872159  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:51.883442  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:51.884064  1703 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.885195  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:51.885802  1704 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.887404  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:51.887691  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:51.888298  2320 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:00:51.894268  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:51.894601  1700 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:51.894924  1555 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.897080  5450 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:51.897430  5313 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:51.861219  5503 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:51.907748  1704 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:51.905308  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:51.905612  5534 raft_consensus.cc:3055] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:51.905484  5571 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:00:51.905967  5550 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 13:00:51.906510  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48520us
I20260709 13:00:51.846340  5496 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:51.905805  5568 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:51.914497  5568 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:51.914876  5568 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:51.902544  2288 connection.cc:256] RPC call timeout handler was delayed by -1.8848443880000332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 13:00:51.915861  2288 connection.cc:256] RPC call timeout handler was delayed by -1.8569443879999881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 13:00:51.916563  2288 connection.cc:256] RPC call timeout handler was delayed by -1.7561443879999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
W20260709 13:00:51.920751  2288 connection.cc:256] RPC call timeout handler was delayed by -1.658944388000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 13:00:51.921012  1702 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:51.899428  5427 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:51.841084  5237 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:51.923622  5237 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:51.925427  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:51.912366  5534 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:51.927191  1555 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:51.928287  5534 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:51.930529  5372 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:51.931162  5579 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:51.934612  5550 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:51.935123  5537 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:51.935391  5571 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:51.891423  5452 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:00:51.935868  5568 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:51.937680  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44612.8us
W20260709 13:00:51.909086  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 63465.4us
I20260709 13:00:51.909216  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:51.931174  1557 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:51.934731  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:51.921273  2288 connection.cc:256] RPC call timeout handler was delayed by -1.6031443880000324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
W20260709 13:00:51.944917  2288 connection.cc:256] RPC call timeout handler was delayed by -1.5704867210000089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25720000000000004s for a response
W20260709 13:00:51.945549  2288 connection.cc:256] RPC call timeout handler was delayed by -1.5005443880000371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
I20260709 13:00:51.948691  5452 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:51.950646  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 119944us
I20260709 13:00:51.919775  1705 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:51.953861  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:51.961161  1556 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:51.956489  1703 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:51.905669  5556 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:51.910403  5503 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.964035  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:51.991508  1709 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.964700  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:51.905339  5475 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:51.971845  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:51.972553  1675 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:51.995680  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:51.963753  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:51.992223  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:51.992515  1704 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.993978  2326 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:51.997128  1702 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:51.997254  1703 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.996322  1706 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.996937  1631 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:00:51.998486  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:51.998569  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 60087.8us
I20260709 13:00:51.995328  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:52.002951  2288 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:52.005505  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.007885  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.010306  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.014197  1557 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:52.016161  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:51.972115  5556 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.017174  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.020936  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:52.022652  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:52.030712  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:52.031474  1702 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:52.032481  1704 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:51.999198  5550 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.999462  5452 raft_consensus.cc:2764] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:52.043959  1632 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:52.045689  1706 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:52.058579  1705 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
W20260709 13:00:52.064024  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 67194.9us
I20260709 13:00:52.065099  5475 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:52.066897  5546 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:52.067538  5546 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:52.068147  5546 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.029742  5556 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:52.073727  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 51179.5us
I20260709 13:00:52.076848  5537 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:51.995914  5460 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:00:52.064327  5576 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:00:52.085997  1701 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:52.087924  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:51.993778  5237 consensus_queue.cc:1059] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:00:52.033020  5484 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:52.065742  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:52.093207  1703 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:52.021961  5462 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:52.097834  1709 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:52.106698  1708 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:52.106971  1701 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:52.110776  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:52.113452  5460 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:52.113889  5455 raft_consensus.cc:3055] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:52.114442  5455 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:52.115355  5455 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:52.118786  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 62400.7us
I20260709 13:00:52.120163  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:52.058980  5464 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:52.126235  1675 leader_election.cc:400] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 13:00:52.126681  1675 leader_election.cc:403] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:52.128402  5577 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 13:00:52.131635  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.132850  4938 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:52.132663  5427 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:52.135090  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:52.138526  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 50674.2us
I20260709 13:00:52.158793  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.113945  5460 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:52.167549  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.168221  5568 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:52.169925  5496 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:52.137965  5533 consensus_queue.cc:1059] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:00:52.102116  5484 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:52.124662  5383 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.124449  5462 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:52.062927  5550 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:52.172502  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.106287  5452 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:52.180100  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.180475  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:52.121708  5455 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.183193  5534 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.187422  1629 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:52.192107  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.201834  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:52.169962  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:52.193099  1634 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:00:52.186987  1675 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:52.178956  1626 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
W20260709 13:00:52.204515  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.196907  1523 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:52.219540  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.226233  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.194036  5585 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:00:52.194260  5372 raft_consensus.cc:3055] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:52.186787  5575 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.236124  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:52.194432  5484 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.197184  5550 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:00:52.229452  5537 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:52.257292  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.261679  1555 raft_consensus.cc:2368] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9.
I20260709 13:00:52.258026  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.258790  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.262851  1627 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:52.232880  5577 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:52.261531  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.248607  2326 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:52.265596  1552 raft_consensus.cc:2393] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:52.266764  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.197080  5383 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:00:52.273061  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.274389  1552 raft_consensus.cc:2393] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:52.274151  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.273108  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.171392  5556 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:52.278118  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:52.239709  5372 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:52.278867  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.281435  1627 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.284442  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:52.193248  5460 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:52.264040  5537 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.302867  1551 raft_consensus.cc:2368] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 13:00:52.195463  5462 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:52.306193  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:52.315449  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.318177  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 198019us
I20260709 13:00:52.330734  1557 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 9. Ops: []
I20260709 13:00:52.331043  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:52.307024  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.332867  1552 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:52.332985  1558 raft_consensus.cc:2368] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7.
I20260709 13:00:52.333132  1628 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 11. Ops: []
I20260709 13:00:52.252532  5509 consensus_queue.cc:1059] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:00:52.334671  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.259191  5575 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:52.299414  5502 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.339632  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:52.329545  5537 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:52.344879  1598 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:52.333521  5313 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:52.348655  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.351949  1558 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:52.355310  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:52.355521  1599 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:52.355418  1634 raft_consensus.cc:2368] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7.
I20260709 13:00:52.355758  1627 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:52.363584  1552 raft_consensus.cc:2393] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:52.363901  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:52.347999  5237 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:52.369946  4938 raft_consensus.cc:3055] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:52.375136  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.376034  1558 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:52.380831  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:52.386334  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.409130  1552 raft_consensus.cc:2393] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:52.411931  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.412513  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:52.413192  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.413700  1557 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:52.414961  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.415874  1555 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:00:52.420624  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.422277  5595 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.422467  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 67063.7us
I20260709 13:00:52.422855  5595 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:52.423166  1599 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:52.424057  1599 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:52.424808  5496 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:52.425345  5496 raft_consensus.cc:697] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:52.426129  5496 consensus_queue.cc:237] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:52.428767  5558 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:52.361084  5372 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:52.438416  1599 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:52.439700  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:52.449026  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.458927  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:52.347379  5502 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:52.478693  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.482241  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.362397  5567 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:52.492941  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.487461  1553 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:52.354854  5596 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:52.497402  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 157841us
I20260709 13:00:52.495278  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.456449  5574 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:52.506091  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.507776  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.477319  5571 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.503057  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.502468  1558 raft_consensus.cc:2393] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:52.514335  1555 raft_consensus.cc:2368] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9.
I20260709 13:00:52.511590  1552 raft_consensus.cc:2368] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 13:00:52.517915  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.439690  5505 consensus_queue.cc:1059] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:00:52.531334  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.382267  4938 raft_consensus.cc:740] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:52.498030  5552 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.535774  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:52.537108  1555 raft_consensus.cc:2368] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9.
I20260709 13:00:52.501777  5383 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.486150  5503 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:52.546401  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.547120  5313 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:52.547708  5313 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.548009  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:52.549623  5584 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:00:52.550437  1631 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:52.559571  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:52.573506  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.576611  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.574007  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:52.513487  5596 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:52.586171  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.596096  1557 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:52.528993  5574 raft_consensus.cc:697] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:52.491319  5567 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.601073  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:52.613543  2324 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:52.619526  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:52.623322  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:52.578269  5464 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.628153  2321 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 8: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:52.629091  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.637619  1552 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:52.642445  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:52.647469  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:52.648625  1557 raft_consensus.cc:2393] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 5: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:52.619658  5567 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.611349  5556 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:52.577817  5383 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:52.621743  5595 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:52.674080  1555 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:52.670516  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:52.669575  2324 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:00:52.670269  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:52.671605  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.679514  1634 raft_consensus.cc:2393] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:52.650907  4938 consensus_queue.cc:260] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:52.688373  5502 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:52.697371  5469 raft_consensus.cc:3055] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:52.697860  5469 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:52.698691  5469 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:52.700110  5469 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:52.694262  4938 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.702766  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:52.694473  5606 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:00:52.708688  1553 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:52.709421  5452 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:52.709959  5452 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:52.712693  5452 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:52.658805  5575 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:52.719547  1675 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:52.720816  1598 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:52.723433  1552 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:52.724141  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.685379  5601 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:00:52.724335  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.728521  1675 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:52.748564  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.750514  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:52.750842  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:52.751060  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:52.751523  1700 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:00:52.751725  1705 raft_consensus.cc:2393] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 8: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:52.751806  1704 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:00:52.752368  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:52.753296  1709 raft_consensus.cc:2393] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 8: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:52.754652  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:52.754899  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:52.756279  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:52.749032  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 306847us
I20260709 13:00:52.759416  1601 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:52.627370  5596 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:52.760543  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:52.761003  2324 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:52.762286  1553 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:52.763957  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:52.764762  1553 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:00:52.765064  1553 pending_rounds.cc:85] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 4
I20260709 13:00:52.765290  1553 pending_rounds.cc:107] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:00:52.765444  1553 raft_consensus.cc:2889] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.768573  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.769390  1556 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:52.771330  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:52.773658  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:52.767982  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:52.779593  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:52.780561  1705 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:52.781941  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.774556  1707 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:00:52.780603  1709 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:52.788244  1702 raft_consensus.cc:1240] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:00:52.790598  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.754256  5534 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.001s
I20260709 13:00:52.791213  1708 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:52.794560  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:52.798092  1702 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:52.732502  5452 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:52.795439  1704 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:52.796769  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:52.733187  5595 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:52.799692  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:52.805449  1703 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.807551  1552 raft_consensus.cc:1275] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 13:00:52.813552  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 84127.2us
I20260709 13:00:52.813879  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:52.814723  1707 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:00:52.816773  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:52.817358  1633 raft_consensus.cc:2410] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:52.817456  1707 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.808476  1552 pending_rounds.cc:85] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 4
I20260709 13:00:52.819487  1552 pending_rounds.cc:107] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:00:52.819999  1552 raft_consensus.cc:2889] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.794986  5552 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:00:52.825317  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:52.829248  1708 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.825181  1702 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:52.830349  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:52.830957  1706 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.825364  1705 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:00:52.757681  5453 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:52.757547  5608 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:52.838486  1704 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:52.795322  5427 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:52.795233  5464 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:52.799834  5452 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:52.825351  5593 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.439s	user 0.000s	sys 0.003s
I20260709 13:00:52.816054  5604 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:52.892048  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.897205  1703 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:52.920413  1708 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:00:52.939769  1707 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:00:52.940852  1704 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:52.832286  5595 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:52.952093  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:52.846169  5427 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:52.954223  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 194975us
I20260709 13:00:52.969851  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:52.969628  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:52.827023  5560 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:00:52.968284  5427 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.966907  1706 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:52.833069  5577 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.130s
W20260709 13:00:52.980698  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 231453us
I20260709 13:00:52.943539  5607 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:53.000578  1635 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:52.886511  5503 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:52.881839  5568 consensus_queue.cc:1059] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:00:52.983752  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 776) took 1080 ms. Trace:
I20260709 13:00:52.979460  1526 leader_election.cc:400] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7.
I20260709 13:00:52.895817  5452 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:52.978945  5502 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.995146  1703 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:52.997026  5505 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.996153  1601 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:52.998886  5595 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:52.925346  2324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:00:53.035061  2324 raft_consensus.cc:606] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.035715  2324 raft_consensus.cc:614] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:52.753517  5574 consensus_queue.cc:237] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:52.894989  5457 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
W20260709 13:00:53.044870  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48796.2us
I20260709 13:00:52.845273  5453 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:53.030997  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 56455.1us
I20260709 13:00:53.041242  1635 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:00:53.000540  5566 raft_consensus.cc:3055] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:53.081219  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:53.082160  1706 raft_consensus.cc:2410] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:53.082830  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:53.016731  1560 rpcz_store.cc:276] 0709 13:00:51.903531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.903901 (+   370us) service_pool.cc:224] Handling call
0709 13:00:51.917318 (+ 13417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:51.939230 (+ 21912us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:52.238815 (+299585us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.363439 (+124624us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.368540 (+  5101us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.368718 (+   178us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:52.368760 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.368844 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:52.983530 (+614686us) raft_consensus.cc:1685] finished
0709 13:00:52.983552 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.983691 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31485,"prepare.queue_time_us":89822,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":44101,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":47240,"thread_start_us":330425,"threads_started":2,"wal-append.queue_time_us":249758}
I20260709 13:00:53.057544  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:53.087662  1703 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:52.944321  5464 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:53.091039  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:53.101296  1635 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:53.106485  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44751.8us
W20260709 13:00:53.047325  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 211822us
W20260709 13:00:53.109954  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 158898us
W20260709 13:00:53.111351  1673 leader_election.cc:336] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.654s (SENT)
W20260709 13:00:53.112224  1673 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.659s (SENT)
I20260709 13:00:53.112725  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.080715  5573 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:53.118430  1673 leader_election.cc:336] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.722s (SENT)
I20260709 13:00:53.122430  1673 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.041016  5607 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:53.084360  5566 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:53.101163  5577 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:53.120992  5537 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.005s
I20260709 13:00:53.141283  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:53.143205  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 60475.4us
I20260709 13:00:53.144011  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:53.137216  1635 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:53.145573  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:53.146783  2320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.022s	sys 0.017s
W20260709 13:00:53.147189  2320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.022s	sys 0.017s
I20260709 13:00:53.157452  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.114212  5469 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:00:53.188022  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.136018  5616 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.158414  5608 raft_consensus.cc:697] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:53.139673  5577 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:00:53.173750  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.147058  5573 raft_consensus.cc:697] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:53.222532  2324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:00:53.225147  2324 raft_consensus.cc:606] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.188884  5502 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:53.230281  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 86323.7us
I20260709 13:00:53.271919  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:53.274255  2324 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:53.285914  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 169207us
I20260709 13:00:53.292078  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:53.292881  1706 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:00:53.290482  5616 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:53.335692  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.339068  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:53.366158  5628 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:53.147785  5537 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.269349  5502 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:53.367290  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:53.372571  5624 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.372929  1704 raft_consensus.cc:1275] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:53.379608  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:53.373603  5629 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:00:53.378026  2324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:00:53.375957  1706 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:53.382104  2324 raft_consensus.cc:606] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:53.382521  2324 raft_consensus.cc:614] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:53.386683  5614 log.cc:927] Time spent T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:00:53.387742  5603 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:53.390278  5502 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:53.391005  5573 consensus_queue.cc:237] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:53.393533  5611 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.369354  5627 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.395787  1553 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:53.295885  5579 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:00:53.402596  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2184) took 1216 ms. Trace:
I20260709 13:00:53.370007  5616 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.268237  5566 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.409615  1630 rpcz_store.cc:276] 0709 13:00:52.185761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.958061 (+772300us) service_pool.cc:224] Handling call
0709 13:00:52.958556 (+   495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.981523 (+ 22967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.981552 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.991104 (+  9552us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.148892 (+157788us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:53.190749 (+ 41857us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.288872 (+ 98123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.288961 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.402373 (+113412us) raft_consensus.cc:1685] finished
0709 13:00:53.402394 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.402534 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":172443,"prepare.queue_time_us":74521,"prepare.run_cpu_time_us":8522,"prepare.run_wall_time_us":35959,"raft.queue_time_us":176862,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":26370,"thread_start_us":57894,"threads_started":1,"wal-append.queue_time_us":248662}
W20260709 13:00:53.395355  5484 consensus_meta.cc:287] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.130s	user 0.011s	sys 0.003s
I20260709 13:00:53.419822  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:53.402959  4938 consensus_meta.cc:287] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.701s	user 0.010s	sys 0.000s
I20260709 13:00:53.268826  5608 consensus_queue.cc:237] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:53.394937  5621 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.398335  5453 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:53.407977  5464 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:53.439599  2324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:00:53.441915  2324 raft_consensus.cc:606] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.442425  2324 raft_consensus.cc:614] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:53.231853  5607 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:53.418469  5611 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:53.333053  5577 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:53.455228  5620 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:00:53.444859  5313 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.897s	user 0.015s	sys 0.000s
I20260709 13:00:53.446030  5566 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:53.468642  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.472479  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 311361us
I20260709 13:00:53.473591  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.480489  1673 leader_election.cc:400] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 4 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 4. Current term is 5.
I20260709 13:00:53.433815  5484 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.482101  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.454954  5427 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:53.499169  5546 consensus_meta.cc:287] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.399s	user 0.009s	sys 0.006s
I20260709 13:00:53.499697  5546 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.500834  2326 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:53.501827  5630 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:00:53.501961  5546 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:53.474509  5628 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:00:53.478196  5624 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.506052  2322 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:53.482381  5627 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.458345  5621 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.468066  5611 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.521920  1708 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:53.523562  2288 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.527652  1631 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:00:53.536759  5641 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:53.537238  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 55654.1us
I20260709 13:00:53.589444  1673 leader_election.cc:400] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9.
I20260709 13:00:53.591475  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.593801  5641 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:53.538743  5568 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:53.543342  5603 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.474611  5313 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.594714  5568 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.595161  5568 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:53.510279  5631 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.596380  5313 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:53.597390  1599 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:53.597580  5574 consensus_queue.cc:1059] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:53.598435  5574 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:53.598773  5574 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.598917  5505 raft_consensus.cc:3055] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:53.547501  5484 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:53.599422  5505 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:53.600544  5631 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:53.550962  5455 consensus_meta.cc:287] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.326s	user 0.022s	sys 0.001s
I20260709 13:00:53.601256  5631 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.602376  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:53.603443  5455 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.606546  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:53.606997  5631 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:53.597594  1673 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.607836  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:53.609030  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:53.610903  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.613502  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:53.552500  5611 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:53.558687  5567 consensus_meta.cc:287] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.885s	user 0.009s	sys 0.003s
I20260709 13:00:53.560364  5427 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:53.522779  5627 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:53.564121  1701 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:00:53.564951  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.566011  5537 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:53.572182  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:53.573128  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:53.578588  2329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:00:53.581866  1630 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:53.625515  2329 raft_consensus.cc:606] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.625928  2329 raft_consensus.cc:614] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:53.626001  1673 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.624984  2324 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:53.599180  5574 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.613629  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:53.551296  5626 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:53.616322  1626 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:00:53.618976  1599 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.640347  1708 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:53.631027  2320 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:53.634721  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:53.642571  2328 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:53.657449  2329 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:53.619621  5641 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:53.664711  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:53.617587  5631 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.653927  5628 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.648851  5516 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.634766  5611 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:53.670629   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:53.638356  5455 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.675302   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:53.676563  5552 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:53.677186  5552 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:53.677704  5552 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:53.681730  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:53.617486  5568 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.662215  5575 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:53.712688  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:53.714053  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 375026us
I20260709 13:00:53.662218  4938 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:53.646113  5496 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:00:53.715152  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:53.714886  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 191386us
I20260709 13:00:53.670312  5427 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:53.621095  5567 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.681763  5611 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:53.726359  2288 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.600531  5505 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:53.726357  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:53.728114  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.734289  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:53.709380  5383 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:53.737452  2320 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:53.736383  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:53.740264  2325 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:53.745013  1629 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:53.747404  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 82886.6us
I20260709 13:00:53.752236  2324 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:00:53.713797  5516 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:00:53.732126  5611 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.732443  5566 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:53.746714  5452 consensus_meta.cc:287] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.665s	user 0.006s	sys 0.006s
I20260709 13:00:53.687598  5610 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:00:53.722391  5575 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.724340  4938 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.730067  5427 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.732226  5484 consensus_queue.cc:1059] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:00:53.771843  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2182) took 1586 ms. Trace:
I20260709 13:00:53.773701  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:53.770076  5627 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:00:53.791582  5567 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:53.791736  5514 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.792846  5642 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:53.794083  4938 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:53.794883  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:53.795698  2324 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:53.796847  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:53.744501  5453 consensus_queue.cc:1175] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" responder_term: 9 status { last_received { term: 8 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:53.765420  5505 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:53.804814  5649 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:00:53.808537  5372 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.765152  5383 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:53.809589  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:53.809826  5383 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:53.810333  5383 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.811097  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:53.811885  5616 consensus_queue.cc:1059] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:53.812777  5502 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:53.813360  5566 raft_consensus.cc:3055] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:53.813735  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2612) took 1261 ms. Trace:
I20260709 13:00:53.814113  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:53.815464  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2615) took 1261 ms. Trace:
I20260709 13:00:53.815871  1630 rpcz_store.cc:276] 0709 13:00:52.553572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.455281 (+901709us) service_pool.cc:224] Handling call
0709 13:00:53.455721 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.625251 (+169530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.815205 (+189954us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b5400125a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:53.815399 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289500032}
I20260709 13:00:53.788353  1634 rpcz_store.cc:276] 0709 13:00:52.185118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.755859 (+570741us) service_pool.cc:224] Handling call
0709 13:00:52.770427 (+ 14568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.796870 (+ 26443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.796899 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.799097 (+  2198us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.117859 (+318762us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:53.143274 (+ 25415us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.155021 (+ 11747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.155103 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.771648 (+616545us) raft_consensus.cc:1685] finished
0709 13:00:53.771668 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.771787 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120674,"prepare.queue_time_us":22808,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":168138,"raft.run_cpu_time_us":468,"raft.run_wall_time_us":32822,"thread_start_us":223358,"threads_started":1,"wal-append.queue_time_us":613978}
I20260709 13:00:53.814131  1631 rpcz_store.cc:276] 0709 13:00:52.552107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.702507 (+150400us) service_pool.cc:224] Handling call
0709 13:00:53.813562 (+1111055us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b54000d98d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:53.813676 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1686349696}
I20260709 13:00:53.819823  1631 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:53.820683  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2616) took 1266 ms. Trace:
I20260709 13:00:53.822357  5579 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:53.822937  5579 raft_consensus.cc:697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:53.823803  5579 consensus_queue.cc:237] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:53.827613  5577 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.828119  5654 consensus_queue.cc:1059] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 13:00:53.829048  5648 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:00:53.812950  5603 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:53.830475  5484 raft_consensus.cc:3055] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:53.813759  5566 raft_consensus.cc:740] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:53.831112  5642 raft_consensus.cc:697] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:53.833220  5427 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:53.833539  5383 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.833973  5652 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:00:53.835839  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 875) took 1168 ms. Trace:
I20260709 13:00:53.821051  1631 rpcz_store.cc:276] 0709 13:00:52.554000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.819186 (+1265186us) service_pool.cc:224] Handling call
0709 13:00:53.819575 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.820308 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.820610 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:53.839946  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:53.840885  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:53.849435  1634 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:00:53.851220  1634 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:53.843230  1706 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:53.845964  2326 rpcz_store.cc:276] 0709 13:00:52.667160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.667364 (+   204us) service_pool.cc:224] Handling call
0709 13:00:52.684384 (+ 17020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.501240 (+816856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.835608 (+334368us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b5400791b54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:53.835781 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1876998528}
I20260709 13:00:53.854540  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:53.791647  5575 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:53.772660  5452 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:53.866034  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 737) took 1846 ms. Trace:
I20260709 13:00:53.866591  1628 rpcz_store.cc:276] 0709 13:00:52.019360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.019523 (+   163us) service_pool.cc:224] Handling call
0709 13:00:52.019908 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.334487 (+314579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.865734 (+1531247us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54000f4bd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:53.865960 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719809920}
I20260709 13:00:53.786814  5537 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:00:53.813387  5502 raft_consensus.cc:697] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:53.812789  5616 consensus_queue.cc:1059] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:00:53.844478  5484 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:53.862406  5603 raft_consensus.cc:697] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:53.890271  1700 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:53.887429  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:00:53.900487  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 167786us
I20260709 13:00:53.904170  1558 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:53.888432  5575 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.914091  2288 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:53.917241  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:53.918450  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:53.921351  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:53.924665  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.906530  5568 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:53.910383  5606 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.942888  5537 raft_consensus.cc:3055] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:53.901584  5566 consensus_queue.cc:260] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:53.967497  5537 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:53.974022  5537 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:53.975610  5537 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.907337  5545 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:00:53.915859  5575 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.983477  1627 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:53.922001  5502 consensus_queue.cc:237] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:53.985654  5372 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.987434  5663 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:53.987641  5372 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:53.988067  5663 raft_consensus.cc:697] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:53.923198  5484 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.931571  5642 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:53.997125  5598 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.091s
W20260709 13:00:54.006304  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 192225us
I20260709 13:00:54.007494  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:54.010515  1628 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:53.985090  5610 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.030212  5616 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:54.029918  5610 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:54.014569  5484 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:54.019788  5612 consensus_queue.cc:1059] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 13:00:54.020598  5662 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:00:54.030803  5616 raft_consensus.cc:697] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:54.033918  5616 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:53.965451  5606 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.032166  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:54.038445  5606 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:54.040694  2323 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:54.039062  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:54.005254  5566 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:54.047266  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:54.011538  5452 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:54.071683  5674 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:54.072479  5674 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:54.073462  5674 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:54.076083  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 152105us
I20260709 13:00:54.079772  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:53.980341  5603 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:53.988996  5663 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.080561  1558 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
W20260709 13:00:54.093901  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2606) took 1751 ms (client timeout 1549 ms). Trace:
W20260709 13:00:54.094601  1627 rpcz_store.cc:269] 0709 13:00:52.342706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.363587 (+ 20881us) service_pool.cc:224] Handling call
0709 13:00:54.093650 (+1730063us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54002d6c54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:54.093796 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3707523968}
I20260709 13:00:54.075757  5460 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:54.085680  5464 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:54.086973  5502 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:54.112670  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 743) took 1074 ms. Trace:
W20260709 13:00:54.118070  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 196220us
W20260709 13:00:54.129698  5558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.700s	user 0.010s	sys 0.008s
I20260709 13:00:54.109884  5464 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.111771  5502 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:54.163774  5464 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.163848  5502 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:54.167917  5638 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.730s	user 0.005s	sys 0.000s
I20260709 13:00:54.113538  5612 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:54.188140  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64886.6us
I20260709 13:00:54.188720  5598 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:54.189450  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:54.189896  5596 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:54.224613  5552 consensus_meta.cc:287] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.004s
W20260709 13:00:54.238452  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.239447  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.239889  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.240379  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.241834  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 195740us
I20260709 13:00:54.250607  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:54.257441  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:54.250756  5575 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:54.254179  5676 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.295761  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 888) took 2080 ms. Trace:
I20260709 13:00:54.296391  2322 rpcz_store.cc:276] 0709 13:00:52.215678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.215868 (+   190us) service_pool.cc:224] Handling call
0709 13:00:52.241498 (+ 25630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.511054 (+1269556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.295407 (+784353us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400763754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:54.295671 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2907237120}
W20260709 13:00:54.297529  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.233806  5612 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.233691  5598 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.277865  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:54.277918  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:54.281133  1557 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
W20260709 13:00:54.247747  5558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.702s	user 0.011s	sys 0.009s
W20260709 13:00:54.285523  5574 consensus_meta.cc:287] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.003s
I20260709 13:00:54.242074  5552 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.310412  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:54.310269  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:54.320971  5643 log.cc:927] Time spent T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.577s	user 0.001s	sys 0.001s
I20260709 13:00:54.321939  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:54.322268  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2614) took 1566 ms. Trace:
I20260709 13:00:54.328846  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:54.325552  1554 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:54.326200  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 788) took 1343 ms. Trace:
I20260709 13:00:54.329250  1700 rpcz_store.cc:276] 0709 13:00:52.756206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.756418 (+   212us) service_pool.cc:224] Handling call
0709 13:00:52.756694 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.890846 (+1134152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.322033 (+431187us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002f1a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:54.322208 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2606205824}
I20260709 13:00:54.330173  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:54.327468  1556 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:54.329763  1555 rpcz_store.cc:276] 0709 13:00:52.982706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.983059 (+   353us) service_pool.cc:224] Handling call
0709 13:00:52.997074 (+ 14015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.084777 (+ 87703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.084817 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:53.084882 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:53.084917 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.325984 (+1241067us) spinlock_profiling.cc:243] Waited 87.5 ms on lock 0x7b54001d83d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:54.326030 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.326143 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201185152}
I20260709 13:00:54.338565  5552 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:54.339774  5621 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:54.340778  1555 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:54.287781  5502 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.341912  1629 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:54.343343  1560 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:54.338672  5598 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:54.324357  5558 raft_consensus.cc:697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:54.345775  5682 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:00:54.361064  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:54.300630  5676 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:54.341032  5612 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:54.365219  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2619) took 1569 ms. Trace:
I20260709 13:00:54.365633  1709 rpcz_store.cc:276] 0709 13:00:52.796356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.796473 (+   117us) service_pool.cc:224] Handling call
0709 13:00:54.365040 (+1568567us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b54003ebcd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:54.365163 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1966302976}
I20260709 13:00:54.332175  5574 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:54.367107  5464 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:54.113044  1630 rpcz_store.cc:276] 0709 13:00:53.037974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.847283 (+809309us) service_pool.cc:224] Handling call
0709 13:00:53.847717 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.860910 (+ 13193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.860942 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.861427 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.938680 (+ 77253us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:54.108526 (+169846us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.108829 (+   303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.108905 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.108933 (+    28us) raft_consensus.cc:1685] finished
0709 13:00:54.108939 (+     6us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.112565 (+  3626us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16149,"raft.queue_time_us":15709,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":7967,"thread_start_us":216402,"threads_started":2,"wal-append.queue_time_us":135483}
I20260709 13:00:54.368258  5574 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:54.368748  1627 raft_consensus.cc:2368] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7.
I20260709 13:00:54.370046  5502 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:54.370644  5462 raft_consensus.cc:3055] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:54.371038  5462 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:54.371415  5676 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:54.372967  1552 raft_consensus.cc:2368] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 10.
W20260709 13:00:54.374884  5611 consensus_meta.cc:287] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.000s
I20260709 13:00:54.375705  1559 raft_consensus.cc:1275] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:54.376816  1551 raft_consensus.cc:1240] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:00:54.331372  5579 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:00:54.410444  1701 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:54.444810  1552 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:54.375330  5611 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.371838  5462 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.440613  5674 raft_consensus.cc:3055] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:54.458065  1626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2605) took 2179 ms (client timeout 1939 ms). Trace:
W20260709 13:00:54.458689  1626 rpcz_store.cc:269] 0709 13:00:52.278565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.380417 (+101852us) service_pool.cc:224] Handling call
0709 13:00:54.457835 (+2077418us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001bc454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:54.457970 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2812215680}
I20260709 13:00:54.461263  1708 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:54.456632  5674 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:00:54.460912  5654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.012s	sys 0.009s
W20260709 13:00:54.463958  5607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.029s	sys 0.038s
I20260709 13:00:54.472251  5464 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:54.455618  5558 consensus_queue.cc:237] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:54.469705  5372 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:54.486945  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 774270us
W20260709 13:00:54.488543  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.491981  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:54.489779  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:54.508390  1709 raft_consensus.cc:2393] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:54.492275  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:54.509473  1700 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:54.492774  1707 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:54.497291  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:54.491564  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:00:54.472370  5607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.029s	sys 0.039s
I20260709 13:00:54.530665  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:54.531561  1705 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:54.536514  1672 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:54.539247  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:54.542120  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:54.542725  1709 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:54.544144  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2614) took 1991 ms. Trace:
I20260709 13:00:54.548501  1635 rpcz_store.cc:276] 0709 13:00:52.553225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.145348 (+592123us) service_pool.cc:224] Handling call
0709 13:00:53.146283 (+   935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.155360 (+  9077us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:53.393286 (+237926us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b18003a3fc0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6998522 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:00:54.041097 (+647811us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b18003a3fc0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0edd47d3c7 00007f0ed9a8f9a7 00007f0ed9a9f0bf
0709 13:00:54.041296 (+   199us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.246349 (+205053us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.246777 (+   428us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.247223 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.247394 (+   171us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:54.249159 (+  1765us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.250143 (+   984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.250236 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.543909 (+293673us) raft_consensus.cc:1685] finished
0709 13:00:54.543935 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.544083 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69444,"prepare.queue_time_us":214164,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":143717,"raft.run_cpu_time_us":428,"raft.run_wall_time_us":50603,"spinlock_wait_cycles":25493504,"thread_start_us":273015,"threads_started":3,"wal-append.queue_time_us":202479}
I20260709 13:00:54.556103  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:54.490556  5628 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.559903  1709 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:54.561383  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:54.562318  1709 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:00:54.488510  5647 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:54.492894  5627 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.606210  5627 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:54.607709  5681 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.328s	user 0.002s	sys 0.000s
I20260709 13:00:54.608995  5647 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:54.609505  5464 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:54.611289  5647 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:54.611855  5647 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:54.613389  5452 raft_consensus.cc:3055] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:54.613785  5452 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:54.614794  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2185) took 2428 ms. Trace:
I20260709 13:00:54.614976  5452 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.615309  5607 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:54.616336  5607 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.488662  5577 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.588093  1707 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:54.547662  5624 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:54.589427  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:54.535380  5427 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.590909  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:54.595139  1703 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:54.623379  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:54.472904  5654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.013s	sys 0.010s
W20260709 13:00:54.617094  5690 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:00:54.624046  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:54.627321  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:54.627761  1703 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:54.628123  1631 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:00:54.600044  5693 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:00:54.605307  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.567368  1700 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:00:54.618939  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:54.630116  1627 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:54.513710  5608 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.617794  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:54.622094  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:54.624529  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:54.624876  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:54.635255  1707 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:54.543119  5674 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.629099  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:54.636343  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:54.636978  1704 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:54.630415  2288 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:54.638818  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:54.626827  1705 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:54.616888  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:54.639734  1628 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:54.631309  1631 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:54.615204  1633 rpcz_store.cc:276] 0709 13:00:52.186116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.981894 (+795778us) service_pool.cc:224] Handling call
0709 13:00:53.023780 (+ 41886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.090426 (+ 66646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.090467 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.113886 (+ 23419us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.224507 (+110621us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:53.334101 (+109594us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.344040 (+  9939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.503916 (+159876us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b18000770e0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:00:54.613657 (+1109741us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b18000770e0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69662a6 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419
0709 13:00:54.614516 (+   859us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x7b54000e7254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:54.614560 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.614597 (+    37us) raft_consensus.cc:1685] finished
0709 13:00:54.614612 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.614736 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100252,"prepare.queue_time_us":72675,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":67524,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":24560,"spinlock_wait_cycles":188135424,"thread_start_us":50546,"threads_started":1,"wal-append.queue_time_us":316680,"wal-append.run_cpu_time_us":2893,"wal-append.run_wall_time_us":1100321}
I20260709 13:00:54.542752  5641 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.656836  5641 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:54.658633  1673 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.681s (SENT) [suppressed 21 similar messages]
I20260709 13:00:54.553622  5631 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:54.664973  5560 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:54.667049  5560 consensus_queue.cc:1059] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:54.668440  5568 raft_consensus.cc:993] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: : Instructing follower e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 13:00:54.669107  5484 raft_consensus.cc:1081] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Signalling peer e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 13:00:54.632300  5427 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:54.671429  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 689) took 1033 ms. Trace:
I20260709 13:00:54.671787  5641 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:54.672524  5641 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:54.672870  5427 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:54.673072  5641 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:54.671826  1708 rpcz_store.cc:276] 0709 13:00:53.638318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.832827 (+194509us) service_pool.cc:224] Handling call
0709 13:00:53.833150 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.461758 (+628608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.671172 (+209414us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b54002530d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:54.671368 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1443895040}
I20260709 13:00:54.675272  1707 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:54.641906  1627 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:00:54.678076  1558 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:54.616551  5452 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:54.643603  5674 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:54.644762  5521 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:54.689273  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:54.647248  5383 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:54.650604  5694 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:54.608505  5627 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:54.650719  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:54.654057  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 691) took 1015 ms. Trace:
I20260709 13:00:54.654660  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:54.656159  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:54.678997  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:54.697816  1701 rpcz_store.cc:276] 0709 13:00:53.638930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.654506 (+ 15576us) service_pool.cc:224] Handling call
0709 13:00:54.653896 (+999390us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b5400397e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:54.653999 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1455809792}
I20260709 13:00:54.643615  1703 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:54.699079  1555 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:54.676559  1601 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:54.682873  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:54.610092  5464 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.689971  1554 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:00:54.635492  5664 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:54.704005  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47913.8us
I20260709 13:00:54.704105  1601 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:54.693076  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:54.694078  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:54.706069  1552 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
W20260709 13:00:54.683650  5460 consensus_meta.cc:287] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
W20260709 13:00:54.695533  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.702634  1555 raft_consensus.cc:3055] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:54.709789  1555 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:54.705160  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:54.711510  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.711988  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.713423  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2186) took 1966 ms. Trace:
I20260709 13:00:54.713814  1629 rpcz_store.cc:276] 0709 13:00:52.747158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.834803 (+1087645us) service_pool.cc:224] Handling call
0709 13:00:53.835111 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.345881 (+510770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.713176 (+367295us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b5400247a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:54.713364 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164947712}
I20260709 13:00:54.714781  5552 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:54.715214  5552 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.715553  5552 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.715761  5464 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:54.621197  5577 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.620967  5628 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:54.705338  1559 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:54.730491  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:54.732132  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:54.734257  2321 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:54.737463  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:54.680704  5608 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.739966  5568 raft_consensus.cc:3055] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:54.740429  5568 raft_consensus.cc:740] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:54.741314  5568 consensus_queue.cc:260] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.742583  5568 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.722146  5517 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:54.718627  5469 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:54.743971  4938 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.744119   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:54.744464  4938 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:54.747782  1632 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:54.710933  1555 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:54.748852  1555 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:54.724838  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:54.725764  5641 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:54.726585  5621 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:54.718103  5610 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:54.710565  5521 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:54.719213  1558 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:54.762220  1554 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:54.692750  5558 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.692495  5475 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.765532  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.762475  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 57383.6us
W20260709 13:00:54.766757  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 228735us
I20260709 13:00:54.770056  5450 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:54.783339  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:54.772449  5628 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:54.772780  5654 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:54.761281  5464 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.760433  5611 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:54.759826  5517 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.762054  5603 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.776407  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:54.728521  5684 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:54.805133  1558 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:54.777307  1552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33810
I20260709 13:00:54.808097  1552 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.809784  1552 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:54.811654  1551 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:00:54.814546  1632 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2173) took 2667 ms (client timeout 2245 ms). Trace:
W20260709 13:00:54.815125  1632 rpcz_store.cc:269] 0709 13:00:52.136892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.137099 (+   207us) service_pool.cc:224] Handling call
0709 13:00:54.803606 (+2666507us) spinlock_profiling.cc:243] Waited 2.53 s on lock 0x7b5400205b54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:54.803689 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5827489536}
I20260709 13:00:54.784720  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:00:54.785223  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:54.787212  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:54.788182  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:54.818395  1526 leader_election.cc:400] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7.
I20260709 13:00:54.823220  1526 leader_election.cc:403] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:54.785301  1675 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:54.800300  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 75519.2us
W20260709 13:00:54.829269  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44068.7us
I20260709 13:00:54.822691  1555 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:00:54.790146  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:54.831400  1555 pending_rounds.cc:85] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 4
I20260709 13:00:54.832023  1555 pending_rounds.cc:107] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:00:54.833420  1555 raft_consensus.cc:2889] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:54.782807  5469 raft_consensus.cc:697] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:54.866175  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:54.813030  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:54.865773  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:54.760490  5505 consensus_queue.cc:1059] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:00:54.791015  5627 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:54.875910  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 57728us
I20260709 13:00:54.859968  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:54.812319  5372 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:54.807272  5509 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:54.871361  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:54.888334  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:54.888515  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 229868us
W20260709 13:00:54.986560  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 259122us
I20260709 13:00:54.874723  5611 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:54.808096  5464 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:54.877173  5632 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:00:55.041268  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.881654  5516 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:00:54.874909  5695 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:54.859133  5684 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.043174  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:55.046000  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:54.890307  5372 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:55.057900  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.042863  1552 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.071229  1552 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:54.873942  5566 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.073055  5566 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.984658  5641 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:55.077246  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:54.937654  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 107427us
I20260709 13:00:55.064231  1703 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:54.881846  5579 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7.
I20260709 13:00:54.995941  5611 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.811124  5517 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:55.156370  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 73147.4us
I20260709 13:00:55.002965  5577 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:55.158598  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 81423.6us
I20260709 13:00:54.859287  5450 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:55.062224  5654 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.788040  5475 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:55.165232  1675 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:54.787175  5558 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:54.858306  5603 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:54.904338  5509 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.078898  5372 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.162222  5611 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:55.156939  5621 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:55.075681  5701 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.146854  5695 raft_consensus.cc:697] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:55.062552  5624 raft_consensus.cc:697] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:55.204236  5624 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:54.992790  5521 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.162045  5641 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.211287  5641 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:55.174306  5505 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:00:55.174664  5596 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:00:55.215732  5509 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:55.067821  5469 consensus_queue.cc:237] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:55.221249  5695 consensus_queue.cc:237] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:55.166433  5452 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:00:55.224084  5701 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:55.226425  5452 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.226958  5452 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:55.227156  5701 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:55.174645  5628 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:55.230310  5628 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.164109  5574 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:55.242363  1673 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.533s (SENT)
I20260709 13:00:55.243193  1673 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:55.175416  5698 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:00:55.197939  5697 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 13:00:55.246192  1708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.033s	sys 0.061s
W20260709 13:00:55.258309  1708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.033s	sys 0.061s
W20260709 13:00:55.238647  5552 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.002s
I20260709 13:00:55.176294  5577 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
W20260709 13:00:55.270572  1705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.043s	sys 0.131s
I20260709 13:00:55.241360  5505 raft_consensus.cc:3055] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:55.238479  5509 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.274371  1705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.043s	sys 0.131s
I20260709 13:00:55.243626  5701 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:55.176836  5654 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:55.283932  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 400538us
W20260709 13:00:55.284523  1701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.011s	sys 0.014s
W20260709 13:00:55.297837  1701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.012s	sys 0.014s
I20260709 13:00:55.299616  1673 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:55.304387  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:55.240479  5450 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:55.297415  5587 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.027s	sys 0.018s
I20260709 13:00:55.315718  1627 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:55.316406  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 144087us
I20260709 13:00:55.276273  5505 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:55.275956  5705 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:55.289767  1553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.011s	sys 0.027s
I20260709 13:00:55.310684  5684 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:55.356986  1553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.011s	sys 0.028s
I20260709 13:00:55.276607  5698 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:55.338903  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:55.334709  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:55.354449  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:55.357931  5698 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:55.359319  5684 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:55.273782  5552 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:55.328058  5587 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.028s	sys 0.018s
I20260709 13:00:55.438820  5611 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:55.447160  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:55.442531  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:55.449316  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:55.509816  1559 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.374439  5558 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:55.381532  5603 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:55.442061  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:55.516010  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:55.516252  1554 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
I20260709 13:00:55.366771  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2120) took 1083 ms. Trace:
I20260709 13:00:55.517226  1560 rpcz_store.cc:276] 0709 13:00:54.307245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.315086 (+  7841us) service_pool.cc:224] Handling call
0709 13:00:55.366564 (+1051478us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b5400026f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:55.366697 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32253184}
I20260709 13:00:55.518187  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:55.379664  5654 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:55.361254  5684 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:00:55.299336  5566 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:55.535248  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.377631  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:55.536082  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.396973  5545 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:55.536656  5545 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.538880  5545 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:55.538991  5600 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.404812  5631 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.745s	user 0.008s	sys 0.003s
I20260709 13:00:55.540028  5631 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:55.539692  5600 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.387413  1700 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:55.544052  1700 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:55.544420  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:55.545284  1635 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:55.299597  5701 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.549238  5701 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:55.285252  5509 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:55.551929  5509 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:55.432366  5608 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:55.559746  2288 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.008s	sys 0.044s
I20260709 13:00:55.370182  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:55.560379  1632 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:55.560776  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46929.8us
I20260709 13:00:55.561738  1601 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:55.392565  5628 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:55.423791  5607 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:55.352734  5452 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:55.371225  5705 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:55.373308  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:55.374224  1629 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13. Ops: [10.8-12.9]
W20260709 13:00:55.429225  5514 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:00:55.401363  5475 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:55.517113  5546 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:55.416138  4938 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:55.356038  5577 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:55.472198  1704 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.015s	sys 0.021s
I20260709 13:00:55.443641  5462 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:55.510891  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.476375  5699 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.482s	user 0.001s	sys 0.000s
I20260709 13:00:55.514408  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:55.519011  2323 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 7: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:55.624766  1627 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:00:55.626423  4938 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:55.524716  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:55.535998  2321 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:00:55.372718  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:55.380815  5464 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:55.372120  5704 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 13:00:55.562700  2288 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.008s	sys 0.045s
W20260709 13:00:55.633931  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 648137us
I20260709 13:00:55.564531  1675 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:55.635977  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 71536.4us
I20260709 13:00:55.637310  1675 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:55.574640  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:55.478677  5610 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:55.510425  5496 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.587561  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.039s	sys 0.008s
I20260709 13:00:55.591320  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:55.695031  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.043s	sys 0.008s
I20260709 13:00:55.595160  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:55.595630  1632 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:55.400259  5552 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:55.643533  5596 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:00:55.518606  5504 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.698500  5504 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.608354  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:55.700870  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:55.628279  4938 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:55.633509  5608 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.642979  5647 raft_consensus.cc:2764] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:00:55.589366  5684 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:55.638443  1635 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:00:55.621891  1703 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:55.612355  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:55.610720  5577 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:55.594923  5607 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.592213  5705 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:00:55.609923  1704 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.015s	sys 0.021s
I20260709 13:00:55.633240  5631 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:55.628540  1634 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:00:55.709553  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:55.373340  5505 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.676111  5628 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:55.624402  5546 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:55.738121  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 125850us
I20260709 13:00:55.716166  1672 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:55.767916  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 51885.4us
I20260709 13:00:55.768160  1557 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:55.741065  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:55.742926  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.743609  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:55.756085  2328 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:55.766067  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:55.771854  2328 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:00:55.771556  1706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.029s	sys 0.035s
I20260709 13:00:55.772609  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:55.781677  1557 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:55.733856  5616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.696s	user 0.025s	sys 0.030s
W20260709 13:00:55.782322  5616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.745s	user 0.026s	sys 0.030s
I20260709 13:00:55.784157  1558 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:55.785140  5723 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:55.672122  5610 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.772972  2328 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:55.781476  1706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.029s	sys 0.035s
I20260709 13:00:55.788275  1554 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:55.813014  2328 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.646888  5372 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.753623  5558 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:55.741081  5684 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.813130  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2482) took 1205 ms. Trace:
I20260709 13:00:55.788465  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:55.765072  5575 raft_consensus.cc:3055] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:55.792263  5469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.016s	sys 0.034s
I20260709 13:00:55.676867  5496 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.754354  5600 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:55.811681  1599 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:55.766669  5628 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.756474  5705 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.882649  1631 raft_consensus.cc:1240] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:55.792503  5723 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.716598  5521 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:00:55.769702  5464 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:55.787842  5383 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:55.815933  5708 consensus_queue.cc:1059] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:00:55.857435  1703 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
W20260709 13:00:55.871745  5469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.016s	sys 0.034s
I20260709 13:00:55.873102  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:55.877641  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 66030.6us
I20260709 13:00:55.859717  5611 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:00:55.815747  5505 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.867851  5575 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:55.786746  5427 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:55.845441  5558 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.871068  5684 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:55.770159  5631 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.891746  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:55.925112  1703 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.718840  5608 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:55.899407  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:55.860795  5504 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:55.767815  5607 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:55.870260  5623 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:55.849895  5460 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:00:55.921636  1554 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:55.844928  5632 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:00:55.892422  5723 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:55.972532  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.973150  2328 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
W20260709 13:00:56.008705  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.978643  5712 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:00:55.921967  5558 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.906430  5383 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:55.879439  5577 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:55.905076  5464 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:56.039083  1702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.018s	sys 0.030s
W20260709 13:00:56.045181  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.049348  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.050028  1702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.018s	sys 0.031s
W20260709 13:00:56.038787  5624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.010s	sys 0.036s
W20260709 13:00:56.066584  1705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.027s	sys 0.025s
W20260709 13:00:56.103317  1705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.027s	sys 0.025s
W20260709 13:00:56.030174  5568 consensus_meta.cc:287] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.287s	user 0.015s	sys 0.002s
I20260709 13:00:56.071592  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2458) took 3230 ms. Trace:
W20260709 13:00:56.053296  5713 log.cc:927] Time spent T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
I20260709 13:00:56.102403  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2484) took 1494 ms. Trace:
I20260709 13:00:56.112643  1701 rpcz_store.cc:276] 0709 13:00:54.607973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.699437 (+ 91464us) service_pool.cc:224] Handling call
0709 13:00:54.699866 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.700699 (+   833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.700730 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.701168 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.298508 (+597340us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:55.298571 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.298666 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.102155 (+803489us) raft_consensus.cc:1685] finished
0709 13:00:56.102178 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.102340 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12600,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":527763,"threads_started":1,"wal-append.queue_time_us":881370}
W20260709 13:00:56.102188  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.012s	sys 0.046s
W20260709 13:00:56.114177  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.013s	sys 0.046s
W20260709 13:00:56.114892  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 815229us
W20260709 13:00:56.064313  5450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.017s	sys 0.032s
I20260709 13:00:56.001579  5623 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:56.103259  5624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.011s	sys 0.037s
W20260709 13:00:56.067777  5517 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.894s	user 0.012s	sys 0.000s
I20260709 13:00:56.127353  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:56.128089  1701 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:00:56.103899  5645 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:56.133111  5645 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.136274  5623 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:56.140877  5546 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:56.145105  5383 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:56.146442  5610 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:56.149062  5496 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:56.153880  5711 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
W20260709 13:00:56.118690  5450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.017s	sys 0.032s
I20260709 13:00:56.167181  5611 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:56.167544  5464 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:56.169127  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.169432  1708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.020s	sys 0.032s
W20260709 13:00:56.179591  1708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.020s	sys 0.033s
W20260709 13:00:56.181452  1559 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.000s
I20260709 13:00:56.181933  1559 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:00:56.089594  5608 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:56.210978  1523 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:56.213521  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:56.214151  1556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.014s	sys 0.037s
W20260709 13:00:56.214896  1556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.014s	sys 0.037s
I20260709 13:00:56.197822  2329 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:56.198594  1703 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:00:56.205128  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:55.892635  5628 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:56.224644  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.209924  5702 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:56.218390  5695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.021s	sys 0.030s
W20260709 13:00:56.217669  5698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.008s	sys 0.044s
I20260709 13:00:56.222290  5452 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:00:56.341534  1700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.027s	sys 0.025s
W20260709 13:00:56.342144  1700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.028s	sys 0.025s
I20260709 13:00:56.343269  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2495) took 1561 ms. Trace:
I20260709 13:00:56.343830  1700 rpcz_store.cc:276] 0709 13:00:54.781636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.545921 (+764285us) service_pool.cc:224] Handling call
0709 13:00:55.546203 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.546435 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:55.546828 (+   393us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.342799 (+795971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.342874 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:56.342935 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.343029 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.343198 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":195,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"thread_start_us":795557,"threads_started":1}
I20260709 13:00:56.373064  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:56.374406  1700 raft_consensus.cc:2410] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:00:56.375280  5719 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:00:56.375532  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:56.386426  5631 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:56.278676  5695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.021s	sys 0.030s
W20260709 13:00:56.421366  2286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.016s	sys 0.016s
W20260709 13:00:56.422559  2286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.016s	sys 0.016s
I20260709 13:00:56.424692  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2499) took 1636 ms. Trace:
I20260709 13:00:56.425428  1700 rpcz_store.cc:276] 0709 13:00:54.788495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.423230 (+1634735us) service_pool.cc:224] Handling call
0709 13:00:56.423813 (+   583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.424067 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.424097 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.424154 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:56.424219 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.424290 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.424625 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:56.422962  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 787875us
I20260709 13:00:56.452399  1700 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:00:56.425259  5462 consensus_meta.cc:287] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.780s	user 0.003s	sys 0.008s
I20260709 13:00:56.180648  5611 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.173452  5517 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.222498  5383 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:56.234063  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:56.278973  5698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.008s	sys 0.044s
I20260709 13:00:56.228824  5724 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:56.467442  2325 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
W20260709 13:00:56.466022  5604 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.011s	sys 0.025s
I20260709 13:00:56.365411  5452 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:56.473778  5604 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.011s	sys 0.025s
W20260709 13:00:56.491995  2327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.036s	sys 0.062s
I20260709 13:00:56.221385  5608 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.504841  4938 raft_consensus.cc:3055] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:56.518512  4938 raft_consensus.cc:740] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:56.471484  5623 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.485402  5383 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:00:56.232563  1551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.024s	sys 0.052s
I20260709 13:00:56.256745  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:56.654891  1703 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
W20260709 13:00:56.600383  1553 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.091s	user 0.019s	sys 0.018s
W20260709 13:00:56.493847  2288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.006s	sys 0.042s
W20260709 13:00:56.656842  1553 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.020s	sys 0.018s
W20260709 13:00:56.657275  2288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.008s	sys 0.044s
I20260709 13:00:56.658547  5604 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:56.658769  5645 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:56.659646  5604 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:56.660851  1707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.289s	user 0.000s	sys 0.008s
W20260709 13:00:56.661419  1707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.329s	user 0.000s	sys 0.008s
I20260709 13:00:56.663341  5604 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:56.664342  1626 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.007s	sys 0.011s
W20260709 13:00:56.258239  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 392269us
I20260709 13:00:56.494532  2322 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:00:56.665166  1705 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.003s
W20260709 13:00:56.665741  1705 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.000s	sys 0.003s
W20260709 13:00:56.671474  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.673452  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.603045  1704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.004s	sys 0.038s
I20260709 13:00:56.515873  5608 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.605334  4938 consensus_queue.cc:260] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:56.606583  5611 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:56.485623  5617 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.010s	sys 0.083s
I20260709 13:00:56.608064  5654 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.609460  5676 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:56.529520  5684 consensus_meta.cc:287] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.000s
W20260709 13:00:56.684139  5617 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.010s	sys 0.088s
I20260709 13:00:56.684835  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:56.684932  5684 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:56.685690  5654 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.611932  5452 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:56.495013  5462 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.118s
W20260709 13:00:56.688819  1555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.189s	user 0.013s	sys 0.013s
W20260709 13:00:56.689299  1555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.240s	user 0.014s	sys 0.013s
I20260709 13:00:56.690292  5654 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:56.567612  5705 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.672s	user 0.005s	sys 0.004s
I20260709 13:00:56.690815  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2536) took 1250 ms. Trace:
W20260709 13:00:56.561272  5722 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.223s	user 0.004s	sys 0.005s
W20260709 13:00:56.550910  5723 consensus_meta.cc:287] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.009s
I20260709 13:00:56.694276  5723 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.490557  5724 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:56.650053  1551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.204s	user 0.027s	sys 0.052s
I20260709 13:00:56.691715  5705 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.698746  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2535) took 1258 ms. Trace:
I20260709 13:00:56.653491  5716 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:56.512217  2327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.036s	sys 0.063s
W20260709 13:00:56.664839  1626 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.008s	sys 0.011s
I20260709 13:00:56.455720  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2500) took 1660 ms. Trace:
I20260709 13:00:56.328109  5702 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:56.528024  5623 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.782519  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 921) took 1216 ms. Trace:
I20260709 13:00:56.691416  1555 rpcz_store.cc:276] 0709 13:00:55.440694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.446098 (+  5404us) service_pool.cc:224] Handling call
0709 13:00:55.447687 (+  1589us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.448096 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.448134 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.448603 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.690091 (+1241488us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:56.690199 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.690329 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.690416 (+    87us) raft_consensus.cc:1685] finished
0709 13:00:56.690429 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.690649 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32120,"raft.queue_time_us":2793,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":6864,"thread_start_us":1240673,"threads_started":1,"wal-append.queue_time_us":1108808}
W20260709 13:00:56.687052  1704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.005s	sys 0.039s
I20260709 13:00:56.466594  1701 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:56.664368  5739 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:56.531883  5546 consensus_queue.cc:1059] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.152s
I20260709 13:00:56.785801  5641 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:56.785724  5739 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.786906  5641 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.789238  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2502) took 1158 ms. Trace:
I20260709 13:00:56.789608  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 698) took 2255 ms. Trace:
I20260709 13:00:56.790058  1705 rpcz_store.cc:276] 0709 13:00:54.533887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.640155 (+106268us) service_pool.cc:224] Handling call
0709 13:00:54.641057 (+   902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.290758 (+649701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.290810 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.292307 (+  1497us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.103812 (+811505us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:56.666374 (+562562us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.737520 (+ 71146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.742142 (+  4622us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.781756 (+ 39614us) raft_consensus.cc:1685] finished
0709 13:00:56.782546 (+   790us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.789527 (+  6981us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16455,"prepare.queue_time_us":20755,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":88914,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":14562,"thread_start_us":1991576,"threads_started":3,"wal-append.queue_time_us":1220192}
I20260709 13:00:56.796228  5702 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:56.798435  5372 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:56.799916  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:56.802417  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:56.783113  2327 rpcz_store.cc:276] 0709 13:00:55.566215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.566799 (+   584us) service_pool.cc:224] Handling call
0709 13:00:55.567242 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.567938 (+   696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.567993 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.589737 (+ 21744us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.781791 (+1192054us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:56.781902 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.782013 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.782085 (+    72us) raft_consensus.cc:1685] finished
0709 13:00:56.782100 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.782334 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14526,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6718,"thread_start_us":1038921,"threads_started":1,"wal-append.queue_time_us":922512}
I20260709 13:00:56.730151  1703 raft_consensus.cc:1240] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:56.691428  5676 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:56.734170  1556 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.009s	sys 0.031s
I20260709 13:00:56.744475  1700 rpcz_store.cc:276] 0709 13:00:54.795174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.427367 (+1632193us) service_pool.cc:224] Handling call
0709 13:00:56.431208 (+  3841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.453119 (+ 21911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.455641 (+  2522us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:56.746744  5383 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.819625  5676 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:56.821655  5534 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.699165  1551 rpcz_store.cc:276] 0709 13:00:55.440362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.444235 (+  3873us) service_pool.cc:224] Handling call
0709 13:00:55.444570 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.444969 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.445033 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.445578 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.698240 (+1252662us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:56.698330 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.698444 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.698489 (+    45us) raft_consensus.cc:1685] finished
0709 13:00:56.698504 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.698680 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":360,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":1252019,"threads_started":1,"wal-append.queue_time_us":1082833}
W20260709 13:00:56.749655  1526 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.381s	user 0.003s	sys 0.012s
I20260709 13:00:56.822669  5534 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
W20260709 13:00:56.823414  1526 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.479s	user 0.004s	sys 0.012s
I20260709 13:00:56.789778  1701 rpcz_store.cc:276] 0709 13:00:55.630418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.221713 (+591295us) service_pool.cc:224] Handling call
0709 13:00:56.788963 (+567250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:56.823963  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 1.47951e+06us
W20260709 13:00:56.825279  2325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 914) took 2096 ms (client timeout 2290 ms). Trace:
I20260709 13:00:56.825909  1701 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:56.826565  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2503) took 1195 ms. Trace:
W20260709 13:00:56.750083  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 242697us
I20260709 13:00:56.751688  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 922) took 1185 ms. Trace:
I20260709 13:00:56.826906  1701 rpcz_store.cc:276] 0709 13:00:55.630709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.824831 (+1194122us) service_pool.cc:224] Handling call
0709 13:00:56.825378 (+   547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.826317 (+   939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.826514 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:56.827296  2326 rpcz_store.cc:276] 0709 13:00:55.566592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.566761 (+   169us) service_pool.cc:224] Handling call
0709 13:00:55.592347 (+ 25586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.816461 (+224114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.816501 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:55.816547 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:55.816576 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.751145 (+934569us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54005d16d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:56.751237 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.751458 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514909440}
W20260709 13:00:56.760879  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.756323  5716 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:56.834733  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:56.835484  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:56.836220  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 704) took 1770 ms. Trace:
I20260709 13:00:56.836884  5716 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:56.764789  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:56.837433  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:56.762881  5607 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:56.838366  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.773625  5684 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:56.770164  1557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.006s	sys 0.004s
W20260709 13:00:56.839205  1557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.006s	sys 0.004s
I20260709 13:00:56.839375  5739 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:56.774228  5505 consensus_meta.cc:287] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.862s	user 0.014s	sys 0.006s
I20260709 13:00:55.855892  1706 rpcz_store.cc:276] 0709 13:00:54.607489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.677806 (+ 70317us) service_pool.cc:224] Handling call
0709 13:00:54.678143 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.678394 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:55.082309 (+403915us) log.cc:844] Serialized 14 byte log entry
0709 13:00:55.812835 (+730526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:55.812880 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:55.812942 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.812996 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.813083 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59372,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":1223,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":33764,"thread_start_us":1120378,"threads_started":2}
I20260709 13:00:56.842818  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2505) took 1201 ms. Trace:
I20260709 13:00:56.779573  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:56.814440  4938 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:56.815901  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:56.816843  1556 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.010s	sys 0.032s
I20260709 13:00:56.816893  5546 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:56.857682  1633 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:56.857834  5546 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:56.859597  5546 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.819155  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 706) took 1732 ms. Trace:
I20260709 13:00:56.862211  1700 rpcz_store.cc:276] 0709 13:00:55.087105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.817678 (+1730573us) service_pool.cc:224] Handling call
0709 13:00:56.818265 (+   587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.818724 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.818754 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.818816 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:56.818860 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.818936 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.819065 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:56.864243  1700 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:56.857714  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2533) took 1418 ms. Trace:
I20260709 13:00:56.865286  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:56.865883  1559 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:56.865574  1556 rpcz_store.cc:276] 0709 13:00:55.439550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.439722 (+   172us) service_pool.cc:224] Handling call
0709 13:00:55.440161 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.440539 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.440576 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.441043 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.215386 (+774343us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:56.856749 (+641363us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.857242 (+   493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.857376 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.857457 (+    81us) raft_consensus.cc:1685] finished
0709 13:00:56.857473 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.857660 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":340457,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":12341,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":247,"thread_start_us":1406381,"threads_started":2,"wal-append.queue_time_us":1101029}
I20260709 13:00:56.789307  5608 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:56.832437  1555 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:56.869172  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:56.870713  5750 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.182s	user 0.002s	sys 0.002s
I20260709 13:00:56.833763  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:56.868036  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:56.872102  1556 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:00:56.834420  5464 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:56.873618  5464 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:56.875845  5464 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:56.836678  1703 rpcz_store.cc:276] 0709 13:00:55.065705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.656172 (+1590467us) service_pool.cc:224] Handling call
0709 13:00:56.722669 (+ 66497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.829427 (+106758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.836141 (+  6714us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:56.877436  5723 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:56.879763  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2506) took 1236 ms. Trace:
I20260709 13:00:56.768365  5577 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:56.756227  5517 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:56.822960  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 818) took 1037 ms. Trace:
I20260709 13:00:56.881590  1558 rpcz_store.cc:276] 0709 13:00:55.785348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.797511 (+ 12163us) service_pool.cc:224] Handling call
0709 13:00:55.797956 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.114657 (+316701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.114687 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.114729 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:56.114758 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.822415 (+707657us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54000b7cd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:56.822499 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.822781 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":727771520}
I20260709 13:00:56.883117  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:56.885636  5546 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.846776  5534 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:00:56.890182  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:56.891961  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:56.884423  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:56.848322  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2504) took 1217 ms. Trace:
I20260709 13:00:56.847620  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 705) took 1781 ms. Trace:
I20260709 13:00:56.893460  1705 rpcz_store.cc:276] 0709 13:00:55.086613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.806389 (+1719776us) service_pool.cc:224] Handling call
0709 13:00:56.840445 (+ 34056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.840859 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.840889 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.840962 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:56.847297 (+  6335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.847375 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.847514 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:56.741214  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:56.851034  1706 rpcz_store.cc:276] 0709 13:00:55.641699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.841416 (+1199717us) service_pool.cc:224] Handling call
0709 13:00:56.841944 (+   528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.842323 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.842352 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.842422 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:56.842461 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.842533 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.842647 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:56.857189  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:56.866927  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:56.870553  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:56.832439  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:56.872321  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:56.805078  5740 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:56.880256  1700 rpcz_store.cc:276] 0709 13:00:55.643379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.863359 (+1219980us) service_pool.cc:224] Handling call
0709 13:00:56.863876 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.879481 (+ 15605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.879699 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:56.838044  1635 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.847591  5372 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:56.825755  2325 rpcz_store.cc:269] 0709 13:00:54.729139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.737143 (+  8004us) service_pool.cc:224] Handling call
0709 13:00:56.824865 (+2087722us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54004551d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:56.825066 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3976485632}
I20260709 13:00:56.893064  1701 rpcz_store.cc:276] 0709 13:00:55.631003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.828443 (+1197440us) service_pool.cc:224] Handling call
0709 13:00:56.828893 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.847782 (+ 18889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.847823 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.847887 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:56.847919 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.847976 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.848153 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:56.908494  1551 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:56.909305  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:56.909646  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:56.910318  1551 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.911267  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:56.912925  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 702) took 2324 ms. Trace:
I20260709 13:00:56.913373  1707 rpcz_store.cc:276] 0709 13:00:54.588377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.686060 (+ 97683us) service_pool.cc:224] Handling call
0709 13:00:54.686474 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.692067 (+  5593us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:55.168895 (+476828us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.662197 (+1493302us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.663353 (+  1156us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.663582 (+   229us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:56.663979 (+   397us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.681451 (+ 17472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.705263 (+ 23812us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.869621 (+164358us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:56.901969 (+ 32348us) raft_consensus.cc:1685] finished
0709 13:00:56.901997 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.912849 (+ 10852us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56757,"prepare.queue_time_us":60653,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":8183,"raft.queue_time_us":87604,"raft.run_cpu_time_us":626,"raft.run_wall_time_us":15502,"spinlock_wait_cycles":148455040,"thread_start_us":1778396,"threads_started":2,"wal-append.queue_time_us":1388520}
W20260709 13:00:56.916038  1709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2480) took 2308 ms (client timeout 1615 ms). Trace:
I20260709 13:00:56.916873  5716 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:56.917480  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:56.918259  5676 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:56.919060  5676 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:56.919427  5676 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:00:56.916473  1709 rpcz_store.cc:269] 0709 13:00:54.606984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.624662 (+ 17678us) service_pool.cc:224] Handling call
0709 13:00:56.915646 (+2290984us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b54002567d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:56.915845 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4931940096}
I20260709 13:00:56.920665  5676 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:56.922420  5676 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:56.902460  5372 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:56.939323  1556 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:00:56.942319  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:56.943213  1554 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
W20260709 13:00:56.943791  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 260567us
W20260709 13:00:56.945578  1552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.004s	sys 0.005s
I20260709 13:00:56.944304  5575 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.952561  5575 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:56.955673  5628 consensus_meta.cc:287] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.725s	user 0.012s	sys 0.000s
I20260709 13:00:56.955912  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:56.959270  1598 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:56.965176  5534 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:56.965663  5534 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:56.966060  5534 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:56.970505  5545 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:56.941658  5372 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:56.949622  5505 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:56.972627  5739 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:56.973327  5505 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.974421  5739 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.974988  5739 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.975677  5505 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:56.976787  1552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.005s	sys 0.006s
I20260709 13:00:56.977823  5739 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:56.978000  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2543) took 1076 ms. Trace:
I20260709 13:00:56.976841  5545 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.978895  5545 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:56.945226  5716 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:56.981160  5545 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:56.984889  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:56.963835  5723 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:56.987684  1558 raft_consensus.cc:2393] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:00:56.988101  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 50399.6us
W20260709 13:00:56.992688  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 135416us
I20260709 13:00:56.993924  1551 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:00:56.995687  1635 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:00:56.997277  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2528) took 2316 ms. Trace:
I20260709 13:00:56.998878  5464 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:56.997761  1553 rpcz_store.cc:276] 0709 13:00:54.678511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.679632 (+  1121us) service_pool.cc:224] Handling call
0709 13:00:54.679984 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.680290 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.680314 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.680741 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.471649 (+790908us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:56.657496 (+1185847us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.932233 (+274737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.937198 (+  4965us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.941655 (+  4457us) raft_consensus.cc:1685] finished
0709 13:00:56.941671 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.995288 (+ 53617us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1073008,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":499,"raft.queue_time_us":5886,"raft.run_cpu_time_us":423,"raft.run_wall_time_us":23515,"thread_start_us":1860820,"threads_started":3,"wal-append.queue_time_us":881691,"wal-append.run_cpu_time_us":1850,"wal-append.run_wall_time_us":1023234}
I20260709 13:00:56.907627  5740 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.002763  1700 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:56.992424  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:56.978451  1552 rpcz_store.cc:276] 0709 13:00:55.901391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.901630 (+   239us) service_pool.cc:224] Handling call
0709 13:00:55.925320 (+ 23690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.925742 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.925782 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.926345 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.977559 (+1051214us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:56.977617 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.977698 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.977744 (+    46us) raft_consensus.cc:1685] finished
0709 13:00:56.977755 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.977945 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1766,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":21325,"thread_start_us":947985,"threads_started":1,"wal-append.queue_time_us":841196}
I20260709 13:00:57.007545  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:57.010629  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2638) took 1142 ms. Trace:
I20260709 13:00:57.011052  1700 rpcz_store.cc:276] 0709 13:00:55.863622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.904966 (+1041344us) service_pool.cc:224] Handling call
0709 13:00:56.986457 (+ 81491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.003300 (+ 16843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.006087 (+  2787us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:56.784842   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:57.012643  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:57.068682  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:57.069878  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 98223.5us
I20260709 13:00:57.071288  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:56.949308  5450 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.022812  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2202) took 1510 ms. Trace:
I20260709 13:00:57.020182  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 700) took 2465 ms. Trace:
I20260709 13:00:57.077435  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:57.082283  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.083851  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:57.084762  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 78382us
I20260709 13:00:56.987886  5628 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:57.088886  1553 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:00:57.089181  2327 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:57.061580  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:57.015475  5753 log.cc:927] Time spent T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
I20260709 13:00:57.026163  5623 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:57.090932  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:57.169394  1558 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:57.091714  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:57.092633  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:57.093628  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 918) took 1730 ms. Trace:
I20260709 13:00:57.094015  5740 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.107153  5641 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:57.111166  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 413103us
I20260709 13:00:57.112314  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.114254  1635 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:57.115346  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.120163  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2636) took 1257 ms. Trace:
I20260709 13:00:57.124687  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2513) took 1239 ms. Trace:
I20260709 13:00:57.126227  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:57.127359  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:57.128057  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2510) took 1364 ms. Trace:
I20260709 13:00:57.129436  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:57.130537  5624 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.146390  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 754) took 2281 ms. Trace:
I20260709 13:00:57.154348  5705 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:56.104524  1702 rpcz_store.cc:276] 0709 13:00:52.841605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.841737 (+   132us) service_pool.cc:224] Handling call
0709 13:00:52.842101 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:54.720151 (+1878050us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b18003cfe20. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a7dbfb 00007f0ed9a8864b
0709 13:00:54.720269 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.720293 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:54.760978 (+ 40685us) log.cc:844] Serialized 52 byte log entry
0709 13:00:55.261028 (+500050us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:55.294823 (+ 33795us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.064678 (+769855us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.065118 (+   440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.065302 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.071310 (+  6008us) raft_consensus.cc:1685] finished
0709 13:00:56.071327 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.071491 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33372,"prepare.queue_time_us":48369,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":217533,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":66209,"spinlock_wait_cycles":11119488,"thread_start_us":1323415,"threads_started":3,"wal-append.queue_time_us":713435}
I20260709 13:00:57.185488  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:57.186311  2323 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.186348  5624 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.057129  5723 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.189289  5624 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.158100  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:57.160141  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.190893  5723 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.156832  2286 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:57.191601  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:57.164162  1553 pending_rounds.cc:85] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 7
I20260709 13:00:57.192790  1553 pending_rounds.cc:107] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 8.8
W20260709 13:00:57.160167  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 98897.3us
I20260709 13:00:57.193114  1553 raft_consensus.cc:2889] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:57.193847  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:57.033463  5596 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:57.195217  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:57.196364  5596 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:57.196930  5596 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:57.197639  5628 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:57.171101  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:57.199229  5724 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:57.176827  1706 rpcz_store.cc:276] 0709 13:00:55.862762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.905953 (+1043191us) service_pool.cc:224] Handling call
0709 13:00:56.988479 (+ 82526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.119508 (+131029us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:57.119557 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.119680 (+   123us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:57.119733 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.119823 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.120057 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1521,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":146}
I20260709 13:00:57.099220  5372 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:57.201216  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 72087.8us
I20260709 13:00:57.202127  1675 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:57.203534  5372 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.179363  1631 rpcz_store.cc:276] 0709 13:00:54.864465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.864653 (+   188us) service_pool.cc:224] Handling call
0709 13:00:54.886151 (+ 21498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.883319 (+997168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.145882 (+1262563us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b54000e6d54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:57.146180 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2290870144}
I20260709 13:00:57.176915  1709 rpcz_store.cc:276] 0709 13:00:55.885155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.920463 (+1035308us) service_pool.cc:224] Handling call
0709 13:00:56.921007 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.124159 (+203152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.124191 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.124368 (+   177us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:57.124407 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.124475 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.124627 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":206817,"raft.queue_time_us":202759,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":257}
I20260709 13:00:57.188757  2325 raft_consensus.cc:2376] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6. Re-sending same reply.
I20260709 13:00:57.189350  2326 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:57.206468  1672 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:57.206912  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:57.207604  5624 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:57.207988  2286 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:00:57.156009  2329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 887) took 2368 ms (client timeout 1949 ms). Trace:
I20260709 13:00:57.193816  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:57.208652  2329 rpcz_store.cc:269] 0709 13:00:54.787817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.787957 (+   140us) service_pool.cc:224] Handling call
0709 13:00:57.155621 (+2367664us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400529254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:00:57.155798 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2985807616}
I20260709 13:00:57.210008  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:57.208094  5624 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:57.170091  2322 rpcz_store.cc:276] 0709 13:00:55.362921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.363067 (+   146us) service_pool.cc:224] Handling call
0709 13:00:55.377267 (+ 14200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.665678 (+1288411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.093126 (+427448us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400829e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:57.093427 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2568640384}
I20260709 13:00:57.192885  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:57.080984  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2512) took 1196 ms. Trace:
I20260709 13:00:57.216251  1707 rpcz_store.cc:276] 0709 13:00:55.884784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.915836 (+1031052us) service_pool.cc:224] Handling call
0709 13:00:56.916309 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.933414 (+ 17105us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.933442 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.986761 (+ 53319us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.067240 (+ 80479us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:57.067283 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.067348 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.080663 (+ 13315us) raft_consensus.cc:1685] finished
0709 13:00:57.080705 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.080902 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":33045,"threads_started":1,"wal-append.queue_time_us":33453}
I20260709 13:00:57.217873  1551 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.183646  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 697) took 2666 ms. Trace:
I20260709 13:00:57.226065  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:57.081393  1626 rpcz_store.cc:276] 0709 13:00:55.512642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.518878 (+  6236us) service_pool.cc:224] Handling call
0709 13:00:55.592766 (+ 73888us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.756836 (+1164070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.756885 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.757758 (+   873us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.941783 (+184025us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:57.022191 (+ 80408us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b180039ebc0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69662a6 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a00733 00007f0ed9a85dbf 00007f0ed9a8483e
0709 13:00:57.022247 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.022400 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.022461 (+    61us) raft_consensus.cc:1685] finished
0709 13:00:57.022475 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.022731 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32631,"raft.queue_time_us":36113,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":10543,"spinlock_wait_cycles":15067648,"thread_start_us":1274360,"threads_started":2,"wal-append.queue_time_us":181417}
I20260709 13:00:57.177894  1703 rpcz_store.cc:276] 0709 13:00:55.764263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.876723 (+1112460us) service_pool.cc:224] Handling call
0709 13:00:56.877164 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.877928 (+   764us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:56.878783 (+   855us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.127672 (+248889us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.127730 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:57.127801 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.127872 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.128000 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63433,"prepare.queue_time_us":223,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":65977,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"thread_start_us":182257,"threads_started":1}
I20260709 13:00:57.225696  1633 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:00:57.238813  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.220034  5464 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.256892  2323 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:00:57.257294  5742 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:57.257982  5742 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:57.258606  5742 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:57.220127  5624 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.261983  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.263939  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.264776  1627 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:57.265125  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.265347  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:57.236056  5534 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.266916  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.268884  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.269407  5534 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.270282  1632 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 10: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:00:57.270870  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 61013.2us
I20260709 13:00:57.272620  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:57.245656  1631 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:00:57.243674  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:57.274245  2321 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 7: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:57.253307  5608 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.253823  5623 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:57.219859  5383 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:57.278704  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.220144  1704 rpcz_store.cc:276] 0709 13:00:54.516999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.637619 (+120620us) service_pool.cc:224] Handling call
0709 13:00:54.637935 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.681605 (+ 43670us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:54.777106 (+ 95501us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b18004828c0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0edd47d3c7 00007f0ed9a8f9a7 00007f0ed9a9f0bf 00007f0ed9a9f038
0709 13:00:55.740757 (+963651us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.118435 (+1377678us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.119107 (+   672us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.119348 (+   241us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:57.119638 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.119940 (+   302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.176202 (+ 56262us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b5400396f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:57.176253 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.176292 (+    39us) raft_consensus.cc:1685] finished
0709 13:00:57.176305 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.183574 (+  7269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":338252,"prepare.queue_time_us":60411,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":340132,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":11045,"spinlock_wait_cycles":128259200,"thread_start_us":1958574,"threads_started":2,"wal-append.queue_time_us":783375}
W20260709 13:00:57.279894  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.237020  5724 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:57.276674  5623 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.280861  5464 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:57.292762  5628 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:57.313069  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.314867  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 897) took 1034 ms. Trace:
I20260709 13:00:57.312191  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.301326  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:57.286919  5604 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:57.338248  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:57.339046  2326 raft_consensus.cc:2376] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10. Re-sending same reply.
I20260709 13:00:57.329578  2328 rpcz_store.cc:276] 0709 13:00:56.279940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.280122 (+   182us) service_pool.cc:224] Handling call
0709 13:00:56.280544 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.280835 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.280871 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.363656 (+ 82785us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.933618 (+569962us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:56.945717 (+ 12099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.986249 (+ 40532us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.314274 (+328025us) raft_consensus.cc:1685] finished
0709 13:00:57.314315 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.314569 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":270628,"threads_started":1,"wal-append.queue_time_us":390640}
I20260709 13:00:57.293365  5724 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:57.163748  1708 rpcz_store.cc:276] 0709 13:00:54.555184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.675735 (+120551us) service_pool.cc:224] Handling call
0709 13:00:54.676098 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.727955 (+ 51857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.727985 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.728428 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.258952 (+530524us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:55.281786 (+ 22834us) log.cc:844] Serialized 14 byte log entry
0709 13:00:55.532826 (+251040us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b48001701d8. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ede9aeaa1 00007f0ede9a5b37 00007f0ede9a59ca 00007f0edea9d26f 00007f0edea9cf37 00007f0edeab155c 00007f0edeab1508 00007f0edeab1488 00007f0edeab1443 00007f0edeab06ec 00007f0edd9daa96
0709 13:00:56.180660 (+647834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.019467 (+838807us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b540012cfd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:57.019560 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.019661 (+   101us) raft_consensus.cc:1685] finished
0709 13:00:57.019682 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.019964 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34799,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":97779,"raft.run_cpu_time_us":4701,"raft.run_wall_time_us":796165,"spinlock_wait_cycles":142202496,"thread_start_us":1428617,"threads_started":2,"wal-append.queue_time_us":906977,"wal-append.run_cpu_time_us":11709,"wal-append.run_wall_time_us":1513221}
I20260709 13:00:57.344945  5628 raft_consensus.cc:697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:57.316459  5596 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:57.352995  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.337901  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:57.320778  5383 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:57.364804  5608 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:57.368208  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 72586.6us
I20260709 13:00:57.330617  5623 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:57.332857  5464 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:57.383942  1551 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:00:57.386099  5383 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.387619  5596 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:57.388862  5628 consensus_queue.cc:237] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.389515  4938 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:57.391752  5521 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:57.393162  5616 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:57.393772  5616 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:57.394503  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.396975  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 124504us
I20260709 13:00:57.374378  5724 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.396410  5534 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:57.406046  1629 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
W20260709 13:00:57.406977  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.411064  1598 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:57.397729  5464 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:57.412927  4938 consensus_queue.cc:1059] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:57.406203  5534 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.408423  5616 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.422179  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:00:57.383383  5558 consensus_meta.cc:287] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.133s	user 0.014s	sys 0.009s
I20260709 13:00:57.443547  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.436095  5534 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.417713  5450 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:00:57.468035  1631 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:57.423992  5604 consensus_queue.cc:1059] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:00:57.461925  5596 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:57.474140  5729 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:57.475924  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.476053  5729 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:57.477051  1708 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:00:57.478441  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:57.478821  5729 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:57.479403  1630 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.463320  5641 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:57.485262  5641 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.485767  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.487534  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.489324  1627 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:57.489933  1634 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:57.491425  1628 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:57.495532  5427 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:57.497013  5604 raft_consensus.cc:3055] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:57.496671  5427 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:57.497596  5604 raft_consensus.cc:740] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:57.498858  5604 consensus_queue.cc:260] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.499460  5427 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:57.474351  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 45539.6us
I20260709 13:00:57.472774  5577 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:57.509548  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.510169  1627 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:00:57.512215  5596 raft_consensus.cc:697] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:57.513235  5596 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.519713  5608 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.504733  5450 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.523234  5450 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:57.524955  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.525681  5607 raft_consensus.cc:3055] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:57.509258  5577 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:57.526094  5607 raft_consensus.cc:740] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:57.532706  1634 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:57.533301  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:57.528270  5577 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:57.537304  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:57.539811  4938 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.540647  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:57.539819  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.463477  5558 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.543529  4938 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.534020  2321 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:00:57.552153  1630 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:00:57.554703  1626 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:57.504838  5641 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.495483  5624 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.564858  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:57.537413  5716 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:57.574730  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:57.527274  5607 consensus_queue.cc:260] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:57.580487  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 117927us
I20260709 13:00:57.581247  1672 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:57.587056  4938 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.594959  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.601383  1632 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:57.602315  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.603605  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:57.609894  1707 raft_consensus.cc:2376] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8. Re-sending same reply.
I20260709 13:00:57.616750  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:57.617305  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.617530  2320 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:57.617987  1702 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:57.606263  5577 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:57.620270  5759 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:57.621402  5759 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:57.580308  1454 catalog_manager.cc:5697] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 2 to 5, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 5 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:57.626055  1675 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:57.627422  1675 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:57.627893  5705 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:57.628811  5729 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:57.629081  5676 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:57.629257  5729 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.629693  5729 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:57.629658  5676 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.631151  5759 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:57.632031  5676 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.632901  5627 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.620182  5577 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:57.633517  5577 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.628491  5705 raft_consensus.cc:697] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:57.638120  5705 consensus_queue.cc:237] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:00:57.642151  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:57.643765  1704 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:00:57.642795  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 72102.9us
I20260709 13:00:57.641602  1706 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:00:57.628458  1675 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:57.646790  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.607744  5604 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:57.656819  1708 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 8: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:57.615006  5575 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.663285  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.666585  1700 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:57.668375  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:57.602151  5716 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.676937  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:57.690979  1706 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.671602  5641 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:57.633441  5627 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.702077  1601 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:57.697363  1599 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:57.704141  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.702059  1709 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.687902  5607 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:57.712186  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 83841.2us
I20260709 13:00:57.713776  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:57.721714  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 50487.9us
I20260709 13:00:57.722640  5723 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:57.726138  5723 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.726514  5723 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:57.728751  5427 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:57.735553  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 88259.6us
I20260709 13:00:57.744359  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:57.744834  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.745695  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.745867  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.747116  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:57.747535  5616 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:57.748065  5616 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.748807  5383 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:57.749410  5383 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.745947  5558 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.751286  1707 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:00:57.752756  5676 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:57.753396  5676 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.748513  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:57.699152  5575 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.758450  5575 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.759500  1704 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:57.705224  5641 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:57.760514  5641 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.765040  5427 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:57.748840  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:57.724493  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:57.769470  5427 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:57.769399  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44975.3us
I20260709 13:00:57.770427  5772 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:57.772903  4938 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:57.773204  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:57.773846  4938 raft_consensus.cc:697] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:57.774916  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:57.775115  4938 consensus_queue.cc:237] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:57.775987  5521 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:57.776345  5521 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:57.776981  5521 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.777062  5560 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:57.781692  1702 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:00:57.769106  1673 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:57.787307  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:57.788866  1709 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
W20260709 13:00:57.790737  5768 log.cc:927] Time spent T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:00:57.774998  5504 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:57.793337  5504 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:57.794438  5504 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.795993  5575 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:57.795746  5723 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:57.809429  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:57.806460  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:57.806470  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2511) took 2032 ms. Trace:
I20260709 13:00:57.817608  1705 rpcz_store.cc:276] 0709 13:00:55.768357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.894658 (+1126301us) service_pool.cc:224] Handling call
0709 13:00:56.942566 (+ 47908us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.124906 (+182340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.124944 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.125615 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.449638 (+324023us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:57.449679 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.449748 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.796899 (+347151us) raft_consensus.cc:1685] finished
0709 13:00:57.796917 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.800796 (+  3879us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181733,"raft.queue_time_us":183449,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":152,"thread_start_us":323578,"threads_started":1,"wal-append.queue_time_us":451243}
I20260709 13:00:57.812700  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.831264  1708 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:00:57.826517  5611 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:57.850725  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 72523us
I20260709 13:00:57.857615  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:57.857811  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:57.822759  5779 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:57.808154  5464 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.859635  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:57.861982  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 89379.4us
I20260709 13:00:57.809634  5724 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:57.858851  2325 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:57.867825  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.868846  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.851187  5611 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.874145  1708 raft_consensus.cc:2410] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:57.876461  1705 raft_consensus.cc:2410] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:57.870146  5608 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.874895  5575 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:57.881899  1559 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:57.848073  5577 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.878931  5575 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.879029  5624 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.887504  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:57.889173  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.899360  1701 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:00:57.875146  5611 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:57.901345  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 132338us
I20260709 13:00:57.903780  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:57.912859  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 187239us
W20260709 13:00:57.902253  5742 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.643s	user 0.013s	sys 0.001s
I20260709 13:00:57.890934  5575 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.924145  1701 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:57.925522  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.878953  5608 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.932435  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.933145  1705 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:57.890772  5729 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:57.907021  5771 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:57.941831  1700 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:57.942068  1673 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:57.944403  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:57.955185  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:57.958413  1701 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:00:57.961030  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.001137  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:58.011749  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:57.923233  5742 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:57.973564  5780 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:00:58.029656  5575 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:58.032263  5575 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.973204  5705 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:58.028012  5521 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:58.027127  5534 consensus_meta.cc:287] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.001s
I20260709 13:00:58.027940  5383 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:58.001080  5624 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:58.053045  5521 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:58.017767  5771 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:58.053318  5624 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:58.054248  5608 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:58.007683  5740 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:58.056084  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 114083us
W20260709 13:00:58.034893  5773 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.532s	user 0.002s	sys 0.000s
I20260709 13:00:58.035728  5611 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:58.039520  5641 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:58.041874  5577 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:58.064620  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 832) took 1037 ms. Trace:
I20260709 13:00:58.065619  1454 catalog_manager.cc:5697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.066756  5534 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:57.971501  5627 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:58.067389  1454 catalog_manager.cc:5697] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 6 to 7, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 7 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:58.068369  1635 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:58.069140  2323 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:58.070253  5742 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:57.988402  5676 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:58.042577  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.046912  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:58.073204  1704 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:58.047914  5623 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.649s	user 0.011s	sys 0.000s
I20260709 13:00:58.074672  5623 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:58.021926  5558 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:58.065070  1556 rpcz_store.cc:276] 0709 13:00:57.027383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.077521 (+ 50138us) service_pool.cc:224] Handling call
0709 13:00:57.177306 (+ 99785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.275581 (+ 98275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.275617 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.304626 (+ 29009us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.475326 (+170700us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:57.475371 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.475441 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.033945 (+558504us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:58.064245 (+ 30300us) raft_consensus.cc:1685] finished
0709 13:00:58.064267 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.064520 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8589,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":21613,"spinlock_wait_cycles":5471488,"thread_start_us":68061,"threads_started":1,"wal-append.queue_time_us":104177}
W20260709 13:00:57.993522  5778 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 13:00:58.044656  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.076089  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.076278  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:58.076967  5729 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:58.087118  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:00:58.089279  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 77655.3us
I20260709 13:00:58.056372  5624 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:57.987511  5716 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:58.101876  5611 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:58.104846  5724 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:00:58.106853  5781 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.267s	user 0.000s	sys 0.002s
I20260709 13:00:58.108271  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.108975  5464 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:58.109611  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:58.110484  5616 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:58.070295  5534 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:58.113006  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:58.113451  1631 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:58.114784  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:58.116375  1630 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:58.117621  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:58.118523  1634 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:58.119158  5623 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:58.119413  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:58.081423  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 111670us
I20260709 13:00:58.120850  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:58.122116  5779 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:58.123577  5779 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:58.125070  1708 raft_consensus.cc:2393] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:58.096668  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:58.125644  2325 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:00:58.097446  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:58.126029  5676 consensus_queue.cc:1059] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:58.082911  5558 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.108860  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:58.127534  5558 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.128741  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.128965  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.124804  5716 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:58.129721  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.098078  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:58.130519  5716 raft_consensus.cc:3055] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:58.001410  5723 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:58.130931  5716 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:58.131911  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.131809  5716 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:58.127104  5759 raft_consensus.cc:3055] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:58.050429  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 98379.2us
I20260709 13:00:58.144119  1706 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:58.133570  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.158681  2328 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:00:58.162240  1707 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:58.169713  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.169299  1454 catalog_manager.cc:5697] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:58.173921  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.176837  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.177819  2328 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:58.174649  1556 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:58.180334  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.182032  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.183280  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.180334  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.184508  1557 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.186345  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.186615  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.188138  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:58.189522  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.191916  1629 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 10: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:58.147094  5759 raft_consensus.cc:740] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:58.193557  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:58.195557  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.195555  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.193028  1556 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:00:58.198741  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.199277  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.201236  1551 raft_consensus.cc:2393] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:58.202531  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.204078  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:58.204089  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:58.205163  2320 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 10: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:58.206122  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.208366  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.204885  2324 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:00:58.191777  5617 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.212647  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.213613  1560 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:58.216874  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.176607  5534 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:00:58.214571  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.220687  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.216902  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.217123  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:00:58.212359  5628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.002s	sys 0.023s
I20260709 13:00:58.210626  5716 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:58.221457  1555 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:00:58.233821  5552 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.234977  2320 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:58.236361  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.236835  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.237053  1552 raft_consensus.cc:2376] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9. Re-sending same reply.
I20260709 13:00:58.237994  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.238502  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.239571  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.241381  5786 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:58.219991  5617 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:58.248937  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.250149  5617 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:58.250536  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:58.240074  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:00:58.252851  5790 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:00:58.256310  5759 consensus_queue.cc:260] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:58.257570  5759 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.260372  5641 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:58.263983  1557 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
W20260709 13:00:58.265141  5785 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.248s	user 0.002s	sys 0.000s
W20260709 13:00:58.273078  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.278988  5616 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:58.280694  5616 consensus_queue.cc:1059] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:58.281487  5616 consensus_queue.cc:1243] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:58.274500  1672 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:58.256496  1601 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:58.285048  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 68235.1us
I20260709 13:00:58.298586  1557 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:00:58.299077  1557 pending_rounds.cc:85] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 7
I20260709 13:00:58.299340  1557 pending_rounds.cc:107] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:00:58.299618  1557 raft_consensus.cc:2889] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:58.300034  1557 pending_rounds.cc:107] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:00:58.300531  1557 raft_consensus.cc:2889] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:58.228099  5628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.002s	sys 0.024s
I20260709 13:00:58.302803  1556 raft_consensus.cc:2393] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 10: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:58.305296  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:58.307979  1672 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:00:58.317790  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 937) took 1028 ms. Trace:
I20260709 13:00:58.312485  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.318490  2323 rpcz_store.cc:276] 0709 13:00:57.289419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.289600 (+   181us) service_pool.cc:224] Handling call
0709 13:00:57.295166 (+  5566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.069548 (+774382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.317560 (+248012us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b5400535a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:00:58.317730 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1779334912}
W20260709 13:00:58.323257  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 66821.4us
I20260709 13:00:58.333329  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:58.299664  5771 raft_consensus.cc:3055] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:58.332376  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:58.301549  5624 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:58.338063  2327 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:58.340673  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.336603  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:58.324332  5786 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:58.346572  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:58.336210  5705 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:58.357882  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.358381  1601 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.360214  1560 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:00:58.311002  5504 consensus_queue.cc:1059] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:00:58.339613  5771 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:58.361151  4938 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.345135  5617 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:58.365110  1557 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:58.340199  5624 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.349655  5505 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:58.352039  5786 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.371831  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.383340  1599 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.352885  5740 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:00:58.373744  5624 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.377708  5505 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:58.404762  5795 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:00:58.399506  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.369982  5705 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:58.411693  1557 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:58.388835  5786 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.422668  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:58.426339  1700 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.426632  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:58.429147  1704 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.430152  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.411913  5596 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:58.417121  5505 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.433120  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.444764  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.442135  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:00:58.446664  1557 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:00:58.446949  5788 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
W20260709 13:00:58.449026  5794 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:00:58.450549  1599 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:58.451484  5617 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:58.452085  1599 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:00:58.452216  5617 raft_consensus.cc:697] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:58.452417  5740 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:58.453505  5617 consensus_queue.cc:237] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:58.461547  4938 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:58.462239  4938 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.462723  4938 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.465520  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:58.467465  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:58.432729  5575 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.491950  5558 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:58.514115  1700 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:00:58.464752  5607 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:58.545120  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:58.562095  1551 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:58.573460  1554 raft_consensus.cc:2410] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260709 13:00:58.436774  5771 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:58.546018  5505 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:58.591195  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 227095us
I20260709 13:00:58.550362  5383 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:00:58.611168  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 59077.2us
I20260709 13:00:58.622326  4938 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:58.573879  5705 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:58.642436  4938 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:58.644156  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49153.6us
I20260709 13:00:58.663942  2288 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.681806  1601 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:58.683390  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:58.684669  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.686228  5742 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.687172  5742 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:58.687616  5742 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.688062  5742 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.689388  5450 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:58.681731  5505 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:58.720950  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 208162us
W20260709 13:00:58.720376  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 77862us
W20260709 13:00:58.730353  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48637.9us
I20260709 13:00:58.727751  5641 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:58.718084  5558 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:58.735354  2322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:00:58.736248  2322 raft_consensus.cc:606] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.737707  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:58.738293  2328 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:00:58.742244  5808 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:00:58.734820  5811 log.cc:927] Time spent T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:58.732622  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:58.750888  2321 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:58.755996  1558 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:00:58.756933  1601 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.757606  1704 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:00:58.763187  2328 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:00:58.767030  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:58.768970  5819 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:58.785809  5819 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:00:58.786279  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.787096  5819 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:58.789726  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:58.790282  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:58.791815  5534 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:58.792564  5534 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:58.792142  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:58.794390  1700 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.791828  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:58.736171  5812 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.799553  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:58.800321  1626 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
W20260709 13:00:58.801082  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47663.5us
I20260709 13:00:58.801280  1703 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 7: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:58.802160  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:58.803848  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:58.814669  1628 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:58.815447  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:58.808722  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:58.816421  1626 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.816550  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:00:58.812918  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.818500  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:58.819370  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:58.819808  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:58.807027  1631 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 7: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:58.821647  1635 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:58.822180  1709 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:00:58.803611  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 119089us
I20260709 13:00:58.825769  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:58.781136  5607 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:58.734875  5641 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:58.828850  1707 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:58.837638  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:58.841012  1709 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.839200  1701 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:58.798899  5552 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:58.831130  5450 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:58.784060  5723 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:58.803083  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:58.813139  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 173966us
I20260709 13:00:58.827457  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:58.833340  2288 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.842636  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:58.820252  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:58.878155  1601 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.875154  1700 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:58.803589  5788 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.070s
W20260709 13:00:58.895084  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 62249.2us
W20260709 13:00:58.891072  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 88058.6us
I20260709 13:00:58.897897  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:58.899562  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:58.900444  5616 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:58.900826  5464 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:58.901204  5616 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:58.901718  5616 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:58.902130  5616 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.902848  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:58.903719  5825 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:58.905164  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:58.905948  5825 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:58.906343  5825 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:58.906687  5825 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.847784  5607 raft_consensus.cc:697] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:58.880947  5552 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:58.909420  5607 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:58.909600  5552 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:58.910705  5616 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:58.913615  5534 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:58.835762  5820 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:58.913941  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:58.915304  5816 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.305s	user 0.005s	sys 0.000s
I20260709 13:00:58.915199  2288 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.917322  5641 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:58.917595  5829 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:58.918897  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:58.920233  5450 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:58.920749  5450 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.920902  5829 consensus_queue.cc:1059] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:58.921343  5450 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:58.921881  5624 consensus_meta.cc:287] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.500s	user 0.004s	sys 0.006s
I20260709 13:00:58.922334  5829 raft_consensus.cc:3055] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:58.922300  5624 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:58.923610  1705 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 11: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:58.920760  2288 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:58.922796  5829 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:58.924880  5741 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:58.924808  5814 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:58.925340  5829 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:58.926569  5829 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:58.933770  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 55823.1us
I20260709 13:00:58.936347  1709 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:00:58.936961  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:58.938055  5464 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.938694  5786 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:58.939607  5807 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:58.940783  5814 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:58.941147  5814 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:58.943014  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:58.880713  5723 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:58.890532  5383 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.942039  5814 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:58.956693  5814 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:58.924516  5624 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:58.961329  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47474.1us
I20260709 13:00:58.961650  5786 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:58.962491  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:58.963325  5809 raft_consensus.cc:2764] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:00:58.995733  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 60899.8us
I20260709 13:00:58.999495  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:58.966432  5779 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.009675  2328 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:59.010581  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 217412us
I20260709 13:00:58.931872  5810 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
W20260709 13:00:59.010368  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 54913.7us
I20260709 13:00:58.995018  5616 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:59.011245  1675 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:59.017396  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.995397  5830 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:59.027544  1675 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:00:59.114205  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 110341us
I20260709 13:00:59.119128  5641 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:00:59.121600  5558 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:00:59.124310  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 98634.5us
I20260709 13:00:59.126258  1633 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:59.127701  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 100235us
I20260709 13:00:59.133490  1675 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:59.133911  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 170195us
I20260709 13:00:59.135739  1454 catalog_manager.cc:5697] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.139554  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:59.113809  5624 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:59.148674  1454 catalog_manager.cc:5697] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 5 to 7, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 7 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:59.158015  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:59.136133  5627 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:59.151126  1454 catalog_manager.cc:5697] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 4 to 7, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.148332  5624 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:59.173744  5624 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.148057  5641 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:59.128190  5819 consensus_queue.cc:1059] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:00:59.178632  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:59.174961  5741 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:00:59.163313  5628 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:59.187716  5676 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:59.187749  5827 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:00:59.187781  1454 catalog_manager.cc:5697] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 3 to 6, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:59.198000  5815 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:00:59.198287  1454 catalog_manager.cc:5697] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.200487  1454 catalog_manager.cc:5697] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 5 to 12, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.202514  1454 catalog_manager.cc:5697] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 5 to 6, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.187857  5818 consensus_queue.cc:1059] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.180s
I20260709 13:00:59.191457  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:59.204906  5817 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.204807  1454 catalog_manager.cc:5697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.205482  5817 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:59.206719  1454 catalog_manager.cc:5697] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.207839  5817 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:59.208637  1454 catalog_manager.cc:5697] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 7 to 9, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:59.210270  1454 catalog_manager.cc:5697] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 4 to 5, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:59.214540  1454 catalog_manager.cc:5697] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 5 to 6, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:59.221433  1454 catalog_manager.cc:5697] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.226122  5828 consensus_queue.cc:1059] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:00:59.229326  5834 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:00:59.228910  1454 catalog_manager.cc:5697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 4 to 6, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:59.229965  5628 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:59.232982  5628 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.172871  5742 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:59.236094  5742 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:59.231173  5810 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:59.188568  5616 consensus_queue.cc:1059] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:00:59.236864  5810 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:59.237803  5810 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:59.241731  5836 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:59.244364  5628 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:59.194191  5825 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:59.247475  5825 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:00:59.213255  5833 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:00:59.248445  1454 catalog_manager.cc:5697] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 4 to 8, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:00:59.252187  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:59.264796  1554 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:59.265185  1552 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:59.267061  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 127570us
I20260709 13:00:59.267127  1626 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:00:59.268966  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:59.270267  1709 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:00:59.269965  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:59.127859  5723 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:59.274966  1709 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:59.277973  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:59.279093  2322 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:59.276690  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:59.169519  5383 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:00:59.190478  5627 raft_consensus.cc:697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:59.283875  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:00:59.284307  1708 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 10: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:00:59.284806  1702 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 8: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:59.295874  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:59.297377  1705 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.281165  5676 raft_consensus.cc:3055] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:59.298079  5628 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:59.298422  5676 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:59.317206  1553 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:59.317536  5825 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:59.317945  5676 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:59.318811  1456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41160 (request call id 297) took 25691 ms (client timeout 15000 ms). Trace:
I20260709 13:00:59.319427  5676 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.187808  5777 consensus_queue.cc:1059] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.294s
I20260709 13:00:59.328063  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:59.328949  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.314960  1454 catalog_manager.cc:5697] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.329041  1703 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 11: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:00:59.332908  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:59.336971  2322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:00:59.327195  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:59.274129  5843 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:59.381103  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:00:59.348966  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:59.382261  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:00:59.389433  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:00:59.389209  1454 catalog_manager.cc:5697] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 6 to 8, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:59.383337  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 46598.3us
I20260709 13:00:59.390007  1558 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:59.433163  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 52314.5us
W20260709 13:00:59.429508  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 95534.2us
I20260709 13:00:59.450184  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:59.433300  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 84477.2us
I20260709 13:00:59.451761  1675 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:59.458695  5771 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.463414  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:59.469144  5812 raft_consensus.cc:3055] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:59.469646  5812 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:59.380847  5450 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:59.392516  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 236369us
I20260709 13:00:59.451577  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:59.316741  5705 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.117s
W20260709 13:00:59.444028  5829 consensus_meta.cc:287] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.517s	user 0.013s	sys 0.000s
I20260709 13:00:59.336676  5742 consensus_queue.cc:1059] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:00:59.383790  5628 consensus_queue.cc:1059] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 13:00:59.490527  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:59.488969  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.479199  5819 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:59.508203  1708 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:00:59.488709  5575 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:59.535588  1558 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
W20260709 13:00:59.538920  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.443333  5627 consensus_queue.cc:237] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:59.545619  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.519850  5560 raft_consensus.cc:3055] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:59.548941  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:59.560628  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:59.562903  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:59.563650  1626 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:59.564383  2321 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:00:59.564742  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 113031us
I20260709 13:00:59.566181  1626 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:59.530215  5819 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:59.566597  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:59.520097  5741 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:00:59.565804  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 102467us
I20260709 13:00:59.560371  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:59.572490  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:59.540609  5846 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:59.536504  5850 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:59.576232  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:59.546844  5628 consensus_queue.cc:1243] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer 8106dfc0bda54df0ae10ba13c28ccc18 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:59.576853  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:00:59.581667  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.581761  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:59.581995  2320 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:59.559923  5560 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:59.584147  1632 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:00:59.586519  1629 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:00:59.558422  5575 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:59.591074  5854 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:59.591593  5854 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:59.566267  5641 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:59.597247  1673 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:59.623422  5787 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.623904  5844 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:00:59.624236  5787 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:59.625108  5779 consensus_meta.cc:287] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.000s
I20260709 13:00:59.625608  5779 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:59.626379  1559 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:59.627178  5787 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:00:59.629194  5849 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
W20260709 13:00:59.639401  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 46008.1us
I20260709 13:00:59.640232  1673 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:59.641722  5819 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:59.642419  5850 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:59.645100  5859 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:59.531509  5812 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:59.629204  5450 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:59.671487  5624 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:59.673426  1634 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:59.648021  5846 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:59.685339  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 103028us
I20260709 13:00:59.636437  5853 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.689499  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:00:59.687430  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 205450us
W20260709 13:00:59.319257  1456 rpcz_store.cc:269] 0709 13:00:33.627484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.650337 (+ 22853us) service_pool.cc:224] Handling call
0709 13:00:59.318568 (+25668231us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:50.532741 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:50.533444 (+   703us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:50.533572 (+   128us) write_op.cc:435] Acquired schema lock
0709 13:00:50.533592 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:50.544766 (+ 11174us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:50.545089 (+   323us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:50.545126 (+    37us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:00:50.546800 (+  1674us) tablet.cc:701] Row locks acquired
0709 13:00:50.559844 (+ 13044us) write_op.cc:260] PREPARE: finished
0709 13:00:50.584290 (+ 24446us) write_op.cc:270] Start()
0709 13:00:50.616237 (+ 31947us) write_op.cc:276] Timestamp: P: 1783602050572331 usec, L: 0
0709 13:00:50.625296 (+  9059us) op_driver.cc:348] REPLICATION: starting
0709 13:00:50.723368 (+ 98072us) log.cc:844] Serialized 7546 byte log entry
0709 13:00:51.931460 (+1208092us) op_driver.cc:464] REPLICATION: finished
0709 13:00:52.052660 (+121200us) write_op.cc:301] APPLY: starting
0709 13:00:52.052757 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:53.571443 (+1518686us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:53.571561 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:54.354399 (+782838us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:54.464460 (+110061us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:00:54.469251 (+  4791us) write_op.cc:312] APPLY: finished
0709 13:00:54.612830 (+143579us) log.cc:844] Serialized 172 byte log entry
0709 13:00:54.774806 (+161976us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed697b0ac 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b
0709 13:00:55.593660 (+818854us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:55.626730 (+ 33070us) write_op.cc:454] Released schema lock
0709 13:00:55.673908 (+ 47178us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:55.769473 (+ 95565us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:55.775099 (+  5626us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2064362,"reported_tablets":44,"spinlock_wait_cycles":10496,"child_traces":[["op",{"apply.queue_time_us":120841,"apply.run_cpu_time_us":95152,"apply.run_wall_time_us":3659641,"cfile_cache_hit":74,"cfile_cache_hit_bytes":77219,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":2,"lbm_read_time_us":134444,"lbm_reads_gt_100_ms":1,"lbm_reads_lt_1ms":11,"num_ops":19,"prepare.queue_time_us":218924,"prepare.run_cpu_time_us":54116,"prepare.run_wall_time_us":494461,"raft.queue_time_us":261872,"raft.run_cpu_time_us":42165,"raft.run_wall_time_us":161101,"replication_time_us":1274816,"spinlock_wait_cycles":18343168,"thread_start_us":1512207,"threads_started":5,"wal-append.queue_time_us":1386443,"wal-append.run_cpu_time_us":25794,"wal-append.run_wall_time_us":3241778}]]}
I20260709 13:00:59.693594  2288 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:59.594158  5845 consensus_queue.cc:1059] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.268s
I20260709 13:00:59.691284  5812 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.698891  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:00:59.713690  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 73538.9us
I20260709 13:00:59.698568  5846 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:00:59.715405  1673 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:59.699954  5809 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:59.726636  5809 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:59.724982  5847 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:59.704798  5624 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:59.727694  5809 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:59.730266  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:00:59.712152  5854 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:59.708420  5575 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:59.729107  5861 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:59.741291  5759 raft_consensus.cc:3055] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:59.761075  5759 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:00:59.762434  5759 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:59.742323  5604 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:59.743682  1705 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:59.754889  5866 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:59.757233  5846 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:59.696499  5853 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:59.790565  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 75216.2us
I20260709 13:00:59.793781  1673 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:59.796994  5864 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:59.795487  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:59.801293  5862 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:59.810905  5862 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:59.814260  5862 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:00:59.765126  5866 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:59.765004  5604 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:59.801201  1601 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:00:59.791692  5759 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.765718  5850 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:59.809835  1673 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:59.790275  5847 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:00:59.837739  1705 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:59.838716  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:00:59.821563  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 224908us
I20260709 13:00:59.839437  1700 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:00:59.791399  5830 raft_consensus.cc:3055] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:59.845078  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:59.847188  1708 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:59.817783  5864 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:59.853295  1702 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:59.855031  5863 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:59.856877  1704 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 13:00:59.821502  5866 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.855655  5624 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:59.842177  5854 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:59.869050  5847 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:00:59.870652  5842 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.549s	user 0.003s	sys 0.000s
I20260709 13:00:59.863603  5740 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:00:59.878252  5853 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:59.873466  1703 raft_consensus.cc:3055] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:59.862253  5863 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.855082  5604 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:59.849989  5830 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:00:59.880460  1703 raft_consensus.cc:740] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:00:59.885812  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50524.8us
I20260709 13:00:59.894017  1673 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:59.887765  1703 consensus_queue.cc:260] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:59.895980  1703 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.909874  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2533) took 1106 ms. Trace:
I20260709 13:00:59.910490  1706 rpcz_store.cc:276] 0709 13:00:58.786857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.803726 (+ 16869us) service_pool.cc:224] Handling call
0709 13:00:58.819247 (+ 15521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.819465 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.819499 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.843780 (+ 24281us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.032810 (+189030us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:59.032865 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.032987 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.849083 (+816096us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:59.881115 (+ 32032us) raft_consensus.cc:1685] finished
0709 13:00:59.881136 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.893158 (+ 12022us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15409536,"thread_start_us":138486,"threads_started":1,"wal-append.queue_time_us":294624}
I20260709 13:00:59.905243  5853 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:59.915210  1634 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:59.880330  5854 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:00:59.885442  5863 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.921114  4938 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:00:59.926172  1601 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:00:59.927958  5821 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 13:00:59.931236  5824 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.797s	user 0.000s	sys 0.004s
I20260709 13:00:59.934226  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2580) took 1472 ms. Trace:
I20260709 13:00:59.941987  5830 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:00:59.943684  5830 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:59.944670  5817 consensus_queue.cc:1175] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" responder_term: 6 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: [5.4-5.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:59.946568  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1017) took 1645 ms. Trace:
W20260709 13:00:59.908780  5623 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.226s	user 0.013s	sys 0.019s
W20260709 13:00:59.949600  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 60997.2us
I20260709 13:00:59.934979  1551 rpcz_store.cc:276] 0709 13:00:58.462290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.563153 (+100863us) service_pool.cc:224] Handling call
0709 13:00:58.563611 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.581082 (+ 17471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.581122 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.589257 (+  8135us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.715591 (+126334us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:58.715631 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.715718 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.889286 (+1173568us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:00:59.933700 (+ 44414us) raft_consensus.cc:1685] finished
0709 13:00:59.933738 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.934121 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1709,"raft.queue_time_us":17189,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4991,"spinlock_wait_cycles":13035392,"thread_start_us":81952,"threads_started":1,"wal-append.queue_time_us":399293}
I20260709 13:00:59.951491  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:00:59.909346  5864 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:59.926750  5854 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.914553  5604 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.961293  5777 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:59.963757  5534 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:00:59.918733  5853 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:00:59.954162  5623 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.273s	user 0.013s	sys 0.020s
I20260709 13:00:59.984522  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:00:59.947570  2325 rpcz_store.cc:276] 0709 13:00:58.301180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.301305 (+   125us) service_pool.cc:224] Handling call
0709 13:00:58.313396 (+ 12091us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.354570 (+ 41174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.354617 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.368434 (+ 13817us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.587943 (+219509us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:58.587987 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.588060 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.941751 (+1353691us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b24002e1048. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed681e9c4 00007f0ed681cacb 00007f0ed69d7dc9 00007f0ed69d7a55 00007f0ed69d6fb0 00007f0ed964d488 00007f0ed964dbe8 00007f0ed9625398 00007f0ed962076a 00007f0ed961fbb6
0709 13:00:59.946074 (+  4323us) raft_consensus.cc:1685] finished
0709 13:00:59.946104 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.946487 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32731,"raft.queue_time_us":31350,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":7982,"spinlock_wait_cycles":134280960,"thread_start_us":165335,"threads_started":1,"wal-append.queue_time_us":308052}
I20260709 13:00:59.974108  5832 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.974004  5817 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:00:59.974512  5534 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:00:59.980938  5676 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.982052  5853 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:00:59.958968  5560 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.016527  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:00.016953  1627 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:00.017168  5560 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.017406  5676 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.018132  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:00.019932  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:59.985140  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:00.004347  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.020198  5676 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:00:59.970165  5777 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.022418  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:00.030623  1675 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:00.031875  1635 raft_consensus.cc:2393] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:00.021818  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:00:59.987565  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:00.035372  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:00.027781  5534 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:00.044090  5875 log.cc:927] Time spent T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Append to log took a long time: real 0.207s	user 0.003s	sys 0.000s
I20260709 13:01:00.048712  5817 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:00.055976  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 66529.4us
I20260709 13:01:00.063431  1635 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:01:00.070778  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:00:59.983669  5864 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:00.077008  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 125622us
I20260709 13:01:00.079107  1626 raft_consensus.cc:1217] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Deduplicated request from leader. Original: 4.3->[5.4-5.4]   Dedup: 5.4->[]
W20260709 13:01:00.079485  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.104063  1626 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:00.042248  5777 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.038232  5857 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:00.083153  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:00.111189  5740 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.112627  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.031104  5832 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:00.099907  5850 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.123075  1675 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:00.129318  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 48433.1us
I20260709 13:01:00.126024  5504 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.137271  5504 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.142272  5504 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:00.148382  5855 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:00.149564  5855 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:00.150715  5855 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:00.151129  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:00.152218  1700 raft_consensus.cc:2393] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 13: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:00.157847  5860 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:00.158525  5860 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:01:00.162537  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.010s	sys 0.022s
I20260709 13:01:00.128376  5740 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:00.167713  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 64587.1us
I20260709 13:01:00.175880  1703 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:01:00.184038  1675 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.042s (SENT) [suppressed 20 similar messages]
I20260709 13:01:00.187376  1599 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:00.198103  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.116001  5866 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:00.167511  5791 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.204842  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.010s	sys 0.023s
W20260709 13:01:00.185427  5628 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:01:00.205686  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 1.01414e+06us
I20260709 13:01:00.205628  4938 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.209954  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:00.211218  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:00.160166  5860 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:00.164253  5863 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:00.221267  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.229385  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 45366.1us
I20260709 13:01:00.213178  5855 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.246248  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:00.218043  5825 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.259265  1628 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 9: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:00.208765  5791 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.267536  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:00.245349  5860 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:00.268692  5741 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.021s	sys 0.005s
I20260709 13:01:00.278842  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:00.263227  5676 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:00.284550  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.266115  5853 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 13:01:00.282435  5741 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.022s	sys 0.006s
I20260709 13:01:00.289276  5825 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:00.320196  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 46754.9us
I20260709 13:01:00.321070  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:00.326984  1673 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:00.309101  5623 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:00.311655  5855 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:00.339615  5623 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.325817  5832 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:00.355877  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:00.356717  5521 raft_consensus.cc:3055] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:00.357184  5521 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:00.357432  5623 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:00.357864  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:00.358446  5740 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:00.358084  5521 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.358788  5846 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.338936  5859 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.359289  5864 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.326327  5676 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:00.360559  5676 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:00.360579  1673 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:00.358441  1445 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6325e0281aa547efa677c29cabdf5de4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8106dfc0bda54df0ae10ba13c28ccc18 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:00.361743  5859 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:00.361662  5676 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.362914  5676 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.363056  1673 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:00.363997  5859 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:00.325891  5505 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:00.365294  2328 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:00.365082  5505 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.367301  5505 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:00.368880  5846 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:00.369962  5879 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:01:00.368294  5777 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:00.335351  5857 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:00.374773  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 107279us
I20260709 13:01:00.376493  1526 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:00.381273  1626 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:01:00.376780  5881 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:01:00.383455  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:00.385002  1627 raft_consensus.cc:2368] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:00.374092  5857 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:00.370507  5854 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:00.377878  5853 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.385263  5863 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:00.389382  5857 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.382572  5825 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:01:00.399257  1704 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:00.419275  1706 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:00.422487  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:00.424809  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:00.425681  5604 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:00.400575  5892 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.427354  5843 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:00.427670  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:00.428273  1705 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.427981  5843 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:00.400933  5825 consensus_queue.cc:1243] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer 8106dfc0bda54df0ae10ba13c28ccc18 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:00.438242  1599 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:00.437040  5817 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:00.447799  5891 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:01:00.459791  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.457383  5893 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.464705  5893 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:00.466188  5843 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:00.427389  5892 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:00.468771  5892 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:00.469319  5892 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:00.449755  5817 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:00.472352  5817 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:00.473276  5817 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:00.466812  5893 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:00.469839  5892 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.477389  1705 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:00.485642  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:00.466822  5843 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.487504  1551 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:00.489439  5843 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.489464  5854 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:00.491684  5843 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:00.492817  5604 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:00.493420  5604 raft_consensus.cc:697] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:00.493818  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:00.494305  5604 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.498471  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:00.499799  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:00.499294  1558 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:00.501217  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:00.500538  1551 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:00.503574  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:00.505118  5853 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:00.502523  5847 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.506976  5847 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.510455  1555 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:00.511360  1553 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:01:00.511752  1553 pending_rounds.cc:85] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 6
I20260709 13:01:00.511974  1553 pending_rounds.cc:107] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:01:00.512233  1553 raft_consensus.cc:2889] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:00.513002  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:00.513514  1554 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:00.485590  5893 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:00.515996  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:00.517737  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:00.516702  1554 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:00.518298  1551 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:00.524719  5814 raft_consensus.cc:3055] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:00.525332  5814 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:00.526484  5814 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.527840  5814 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.517664  5809 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:00.529011  5809 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:00.529584  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2229) took 1728 ms (client timeout 2042 ms). Trace:
W20260709 13:01:00.530185  1630 rpcz_store.cc:269] 0709 13:00:58.801243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.801356 (+   113us) service_pool.cc:224] Handling call
0709 13:01:00.529366 (+1728010us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400247a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:00.529500 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2951169280}
I20260709 13:01:00.531533  5809 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:00.531889  5866 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:00.533062  5847 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:00.535211  5900 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:00.538729  5676 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:00.539525  5676 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:00.541075  5676 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:00.542665  5676 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.545831  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:00.546522  2326 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:00.548091  2325 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: [7.10-7.10]
I20260709 13:01:00.554004  1709 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:00.560005  1598 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:00.560163  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44997.5us
I20260709 13:01:00.558379  5866 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.561476  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:00.561362  5866 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.562333  1700 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 10: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:00.563751  5607 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:00.564209  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:00.564852  2328 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:00.566694  5791 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:00.567009  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:00.569003  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:00.569655  1627 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:01:00.569782  5829 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:00.570259  5829 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.570900  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:00.571187  5898 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:00.571554  2326 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:00.571925  5898 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.573834  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:00.573072  2329 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:01:00.574110  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.574913  1709 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
W20260709 13:01:00.577991  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.579089  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:00.573544  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:00.536052  5900 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.501307  5894 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:00.587219  1708 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:00.578703  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:00.590065  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:00.590870  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:00.593395  1702 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:00.593282  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:00.592392  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:00.591001  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:00.595739  1708 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:00.588449  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:00.570937  5899 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:00.515290  5777 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:00.572552  5829 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:00.564235  5607 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.606559  1701 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:00.615965  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:00.608842  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:00.616670  1552 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:01:00.620667  1523 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:00.621855  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:00.622485  1555 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.622602  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:00.624320  5822 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:00.625053  4938 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:00.626392  5575 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:00.629799  1551 raft_consensus.cc:2410] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
W20260709 13:01:00.630656  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 129560us
I20260709 13:01:00.631129  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:00.631449  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:00.631726  1708 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.633297  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:00.635493  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:00.635396  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:00.636861  1558 raft_consensus.cc:2410] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:01:00.638185  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:00.605933  5791 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:00.556883  5893 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:00.584604  5505 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:01:00.649473  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:00.650169  1553 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:00.651345  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:00.652088  1552 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:01:00.598352  5899 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.636220  5829 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.600432  5627 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:01:00.668562  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:00.659659  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.661928  1702 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:00.618980  5607 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.608891  5628 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:01:00.595796  5894 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:00.637145  5843 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:00.654408  5853 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.656723  5898 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.650285  5791 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:00.679281  5899 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:00.681819  5901 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:00.659116  5892 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:00.682658  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:00.683349  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:00.689859  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:00.691068  5810 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.695587  1701 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:01:00.697886  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:00.718164  1675 leader_election.cc:400] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:00.718569  1675 leader_election.cc:403] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:01:00.726192  2324 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: [7.10-7.10]
I20260709 13:01:00.730435  2325 raft_consensus.cc:2393] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:00.674362  5505 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.735841  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:00.768174  2288 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:00.676436  5843 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.718957  5791 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:00.846727  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 122031us
I20260709 13:01:00.849622  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:00.673563  5829 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:00.738425  5855 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.875705  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:00.890520  1701 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:00.786412  5901 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.812211  5843 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.815740  5847 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:00.810406  5809 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:00.924989  5809 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.925652  5809 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.891274  5372 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.915689  5861 raft_consensus.cc:3055] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:00.920419  1553 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:00.718284  5857 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:00.923565  1706 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:00.921342  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:00.934077  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 295957us
I20260709 13:01:00.853905  5894 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:00.847481  5742 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 13:01:00.855717  5822 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:01:00.905696  5847 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:01:00.967540  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.934031  5861 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:00.972865  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:00.969051  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:00.977371  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:00.979837  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:00.968797  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:00.991943  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.929857  5372 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:00.907908  5901 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:01.043984  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:00.974282  5847 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:01.050541  5900 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:01.094120  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 178832us
W20260709 13:01:01.203321  5904 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
W20260709 13:01:01.204119  5906 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
W20260709 13:01:01.355401  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.430154  1708 consensus_meta.cc:287] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.798s	user 0.010s	sys 0.003s
I20260709 13:01:00.968416  5911 consensus_queue.cc:1059] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.282s
I20260709 13:01:01.430238  5676 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:01.430761  5607 consensus_meta.cc:287] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.014s
I20260709 13:01:01.449587  2286 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:01.431507  5850 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:01.478663  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.432215  5829 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:01.204329  2327 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.000s	sys 0.022s
W20260709 13:01:01.495800  2327 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.003s	sys 0.025s
W20260709 13:01:01.440550  5898 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.709s	user 0.007s	sys 0.003s
W20260709 13:01:01.204730  5759 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.006s	sys 0.032s
W20260709 13:01:01.435223  5809 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.004s
I20260709 13:01:01.435498  5864 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:01.436688  5810 consensus_meta.cc:287] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.720s	user 0.012s	sys 0.023s
I20260709 13:01:01.437714  5857 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:01.438002  1555 consensus_meta.cc:287] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.003s
W20260709 13:01:01.439977  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.955610  5894 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:01:01.460084  1708 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:01.463150  1554 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:01:01.467195  1557 raft_consensus.cc:1275] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 4. (term mismatch)
I20260709 13:01:01.588737  1557 pending_rounds.cc:85] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 3
I20260709 13:01:01.588992  1557 pending_rounds.cc:107] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 13:01:01.589303  1557 raft_consensus.cc:2889] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.475302  1629 raft_consensus.cc:1275] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
W20260709 13:01:01.533797  5759 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.006s	sys 0.039s
W20260709 13:01:01.490788  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.483261  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:01.434589  5627 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.598814  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:01.575423  5864 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.600518  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:01.602341  5864 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:01.603206  1629 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:01.476670  5676 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
W20260709 13:01:01.605391  5791 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.715s	user 0.012s	sys 0.000s
I20260709 13:01:01.605581  5676 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:01.605857  5791 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.442022  5901 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:01.608261  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.598865  5627 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.510922  5850 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:01.611042  5627 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:01.611739  5850 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:01.507853  5893 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:01.469575  5521 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:01.517374  1627 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:01.528771  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:01.528779  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:01.530344  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:01.532665  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:01.440958  5372 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:01.443439  5628 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:01.534353  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:01.530520  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:01.543447  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 67839.2us
W20260709 13:01:01.545702  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 96187.7us
I20260709 13:01:01.620656  1628 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:01.621120  2286 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:01.443234  5853 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.714s	user 0.012s	sys 0.000s
I20260709 13:01:01.443539  5823 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:01.575649  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 56496.4us
I20260709 13:01:01.627015  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:01.578486  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:01.577440  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:01.587368  2322 raft_consensus.cc:606] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:01.628865  2322 raft_consensus.cc:614] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:01.588176  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:01.484928  2287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.004s	sys 0.027s
I20260709 13:01:01.588415  1554 pending_rounds.cc:85] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 5
I20260709 13:01:01.588992  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:01.464552  5723 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:01.578065  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:01.497205  5607 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.534210  5898 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.618438  1626 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:01:01.614401  1631 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:01.619086  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:01.622797  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:01.642397  1703 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:01:01.624028  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:01.624490  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:01.647755  1628 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:01:01.535374  5705 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:01.630620  2287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.005s	sys 0.027s
I20260709 13:01:01.617583  5919 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.630779  1554 pending_rounds.cc:107] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:01:01.661006  1554 raft_consensus.cc:2889] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.636526  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:01.661330  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:01.653492  5628 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:01.662077  2321 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:01.663146  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:01.629662  5604 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.664151  5922 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.664623  1708 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:01:01.664870  1557 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:01:01.617735  5829 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:01.665558  5829 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:01.664336  5604 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.666122  5829 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.647440  5821 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:01:01.666860  2323 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:01:01.667204  2323 pending_rounds.cc:85] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 8
I20260709 13:01:01.667419  2323 pending_rounds.cc:107] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:01:01.667644  2323 raft_consensus.cc:2889] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.651836  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:01.654170  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 930) took 1084 ms. Trace:
I20260709 13:01:01.630702  1559 raft_consensus.cc:2410] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:01.633289  5853 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.663235  5607 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:01.579766  1555 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
W20260709 13:01:01.663930  5843 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.728s	user 0.012s	sys 0.000s
I20260709 13:01:01.670154  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:01.669463  2327 rpcz_store.cc:276] 0709 13:01:00.570142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.573153 (+  3011us) service_pool.cc:224] Handling call
0709 13:01:00.598146 (+ 24993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.598370 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:01.496473 (+898103us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.653810 (+157337us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.653867 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:01.653916 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.653995 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.654111 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17813,"prepare.queue_time_us":1000957,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":26071,"thread_start_us":1034298,"threads_started":2}
I20260709 13:01:01.621057  5901 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:01.671252  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50248.9us
I20260709 13:01:01.677910  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:01.638427  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:01.678134  2286 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:01.673995  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:01.681159  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:01.681890  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 2608) took 1062 ms. Trace:
W20260709 13:01:01.682531  1445 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6325e0281aa547efa677c29cabdf5de4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8106dfc0bda54df0ae10ba13c28ccc18 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:01.682294  1555 rpcz_store.cc:276] 0709 13:01:00.611355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.621537 (+ 10182us) service_pool.cc:224] Handling call
0709 13:01:01.673940 (+1052403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36736}
I20260709 13:01:01.554508  5809 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.663657  5628 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:01.628878  5899 consensus_queue.cc:1059] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:01:01.685607  5918 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:01.675132  5886 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.687964  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:01.689591  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:01.690214  1556 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.691205  5861 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.692941  5628 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:01.693311  5814 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:01.693866  5855 consensus_meta.cc:287] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.799s	user 0.011s	sys 0.001s
I20260709 13:01:01.693688  5628 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.675434  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:01.680518  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:01.694286  5855 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:01.627104  5823 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.697806  2286 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:01.673027  5848 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:01.675477  5898 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.731340  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:01.736753  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 77444.3us
I20260709 13:01:01.740988  1555 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:01:01.699463  5676 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:01.735617  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 55193.3us
I20260709 13:01:01.716041  5627 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:01.746620  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:01.693722  5814 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:01.702046  5861 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:01.727208  5847 consensus_meta.cc:287] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.000s
I20260709 13:01:01.696331  5924 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:01.743459  1627 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:01:01.659507  5705 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:01.700702  5850 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:01.700817  5857 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:01.695971  5907 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:01.776264  2286 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:01.753471  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:01.778043  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:01.730417  5742 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:01.695080  5901 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:01.742429  5892 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:01.765908  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:01.696609  5843 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:01.771672  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 67610.6us
I20260709 13:01:01.752905  5676 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.749295  5791 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:01.790421  1523 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:01.740119  5923 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:01:01.830195  1556 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
W20260709 13:01:01.793172  5925 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.129s	user 0.001s	sys 0.001s
I20260709 13:01:01.756747  5627 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.758505  5853 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:01.759950  5814 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.806190  5742 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:01.808180  5892 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.802018  5759 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:01.802847  5917 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:01:01.804715  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 119350us
I20260709 13:01:01.811033  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:01.676246  5922 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.815722  1704 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:01.790838  5938 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:01.837231  5911 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:01.837517  5923 consensus_queue.cc:1243] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:01.819638  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:01.776502  5850 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.825381  5521 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.826974  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:01.832885  1601 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:01.870604  2323 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:01.775686  5924 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.743362  5848 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.833444  5777 consensus_queue.cc:1059] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:01.834424  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 735) took 1440 ms. Trace:
I20260709 13:01:01.828572  5918 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:01.836408  5928 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:01.836561  1599 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:01.915643  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 79126.6us
I20260709 13:01:01.799896  5898 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.839834  1558 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:01.798882  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:01.848013  5863 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:01.809345  5907 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:01.817219  5676 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:01.771790  5847 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.675199  5919 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.934631  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 933) took 1024 ms. Trace:
I20260709 13:01:01.795735  5857 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:01.806034  5628 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:01.952188  5628 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:01.952502  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:01.955442  5919 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:01.838909  5853 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.956832  5853 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.839232  5627 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.872443  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:01.807632  5856 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:01:01.854463  5892 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.850462  5742 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.874104  1706 rpcz_store.cc:276] 0709 13:01:00.394408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.420238 (+ 25830us) service_pool.cc:224] Handling call
0709 13:01:00.420546 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.934117 (+513571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.834174 (+900057us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54003eb7d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:01.834345 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156220160}
I20260709 13:01:01.918105  1601 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:01.984016  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 66028.1us
I20260709 13:01:01.985370  1601 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:01.916728  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:01.986552  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 69973.6us
W20260709 13:01:01.922569  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 103497us
W20260709 13:01:01.873098  5927 log.cc:927] Time spent T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:01:01.930665  5911 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.869736  5938 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.873168  5521 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.923749  5641 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:01.921084  5918 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:01.920888  5786 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.915201  5864 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.945277  5823 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:01.944990  5934 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.950996  5850 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:01.959954  5676 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:01.935084  5926 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:01.997570  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:01.932675  5788 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:02.017342  5828 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:01.926411  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 127625us
I20260709 13:01:02.018165  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:02.091265  1559 raft_consensus.cc:2410] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:02.092015  1555 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:01:01.935117  2324 rpcz_store.cc:276] 0709 13:01:00.909908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.911838 (+  1930us) service_pool.cc:224] Handling call
0709 13:01:00.912189 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:00.994437 (+ 82248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.441074 (+446637us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.442068 (+   994us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.527587 (+ 85519us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:01.527641 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.527731 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.792486 (+264755us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:01.931943 (+139457us) raft_consensus.cc:1685] finished
0709 13:01:01.931968 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.934563 (+  2595us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":552,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"spinlock_wait_cycles":120158592,"thread_start_us":139934,"threads_started":2,"wal-append.queue_time_us":175493}
I20260709 13:01:02.027949  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:02.030213  5938 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.096745  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.030491  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:01.980964  5628 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:02.059489  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 187078us
I20260709 13:01:01.935320  5817 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:01:02.004936  5886 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:02.089265  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.091794  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:01:02.093247  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 65408.6us
I20260709 13:01:02.110663  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:02.022311  5822 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:02.093748  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:02.114092  1555 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:02.028472  5821 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:02.095546  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:02.044262  5759 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:02.097651  1628 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:01:02.104069  1552 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260709 13:01:02.116176  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:02.113711  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2583) took 1408 ms. Trace:
I20260709 13:01:02.053015  5596 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:01:02.135978  5901 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:02.136937  5901 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:02.137722  5901 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:02.138237  5901 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.140231  5901 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.128113  1701 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:02.130419  1704 rpcz_store.cc:276] 0709 13:01:00.694948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.733783 (+ 38835us) service_pool.cc:224] Handling call
0709 13:01:02.102779 (+1368996us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b540012bbd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:02.102888 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956243328}
I20260709 13:01:02.125286  1629 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.151476  5607 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:02.152454  5607 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.152946  5607 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.153956  5628 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.154508  5628 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:02.154943  5628 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.157637  1629 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:02.161286  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2617) took 1199 ms. Trace:
I20260709 13:01:02.161880  1551 rpcz_store.cc:276] 0709 13:01:00.961591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.043642 (+ 82051us) service_pool.cc:224] Handling call
0709 13:01:01.078825 (+ 35183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.442422 (+363597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.442448 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.442868 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.501661 (+ 58793us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:01.501804 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.502159 (+   355us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.161012 (+658853us) raft_consensus.cc:1685] finished
0709 13:01:02.161040 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.161209 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2659,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":156,"thread_start_us":1680,"threads_started":1,"wal-append.queue_time_us":240216}
I20260709 13:01:02.126070  5886 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.192799  5936 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:02.193791  5628 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.193740  5936 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.198488  5848 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:02.198536  5786 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:02.117760  5705 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:02.118202  5843 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.086340  5864 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:02.091257  5641 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.134618  5898 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:02.216490  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2178) took 1166 ms. Trace:
W20260709 13:01:02.277972  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 161862us
I20260709 13:01:02.278091  1553 rpcz_store.cc:276] 0709 13:01:01.050063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.450364 (+400301us) service_pool.cc:224] Handling call
0709 13:01:01.450746 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.451009 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.451040 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.451576 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.651728 (+200152us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:01.664634 (+ 12906us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.673001 (+  8367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.673077 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.216185 (+543108us) raft_consensus.cc:1685] finished
0709 13:01:02.216214 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.216402 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10316,"prepare.queue_time_us":13339,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":8433,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":20909,"thread_start_us":199797,"threads_started":1,"wal-append.queue_time_us":307138}
I20260709 13:01:02.281095  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:02.281762  1559 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
W20260709 13:01:02.252239  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 48930.1us
I20260709 13:01:02.220638  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:02.154949  5607 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.289438  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:02.290175  1704 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:02.089929  5934 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:02.304863  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:02.199970  5919 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:02.213533  5628 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:02.283306  5898 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.211735  5822 raft_consensus.cc:697] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:02.214775  5922 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:02.140704  5759 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.323944  5822 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.317111  5628 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.322018  5788 raft_consensus.cc:697] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:02.327365  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:02.331936  2327 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.000s
I20260709 13:01:02.205211  5938 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.311812  5919 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.332403  2327 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:02.365545  5942 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:02.366523  5886 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:02.127218  5907 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.321434  5898 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:02.375110  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:02.379895  2323 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:02.311192  5623 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:01:02.382261  5596 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:02.382907  5596 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:02.383504  5943 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:01:02.383903  5596 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.388054  5900 raft_consensus.cc:3055] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:02.388552  5900 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:02.389129  5950 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:02.375444  5857 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:02.389425  5900 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:02.390591  5900 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:02.391116  5641 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.363454  5919 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.362799  5847 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:02.409575  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 298940us
I20260709 13:01:02.413303  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.414367  1629 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 9: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:02.416612  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.404976  5857 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:02.442471  5676 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.440238  5786 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.442660  5857 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:02.451756  1702 raft_consensus.cc:1240] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:02.447515  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:02.453055  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:02.454674  1703 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:01:02.402793  5911 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.461663  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:02.462576  5944 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.172s
I20260709 13:01:02.459213  5786 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:02.464237  5952 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:01:02.465277  5945 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:02.466014  5945 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:02.421736  5936 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:02.422894  5950 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:02.477617  1706 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:02.478713  1700 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:01:02.490970  1700 pending_rounds.cc:85] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 7
I20260709 13:01:02.491245  1700 pending_rounds.cc:107] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:01:02.491740  1700 raft_consensus.cc:2889] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:02.493196  5627 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.004s
I20260709 13:01:02.499878  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:02.473371  5940 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:01:02.497913  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.456074  5676 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:02.499835  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 198246us
I20260709 13:01:02.457598  5850 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.467797  5575 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.510174  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.474920  5791 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.506906  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.507807  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.471227  5864 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:02.508630  5956 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:02.509266  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.513564  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:02.512283  1631 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:01:02.514671  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 212676us
I20260709 13:01:02.509451  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:02.516444  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:02.517269  1675 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:02.527694  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.528086  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.505446  5843 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:02.536984  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:02.537731  1700 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:02.538548  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:02.541658  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.542307  1629 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:01:02.514590  5893 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:02.546370  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:02.548147  1601 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:02.550186  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:02.551306  1675 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:02.552707  1700 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:01:02.552817  5641 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:02.472100  5911 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:02.512336  5949 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.504712  5627 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.553854  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:02.556010  5953 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.530354  5864 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:02.557592  5954 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:01:02.547480  5944 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:01:02.513252  5850 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:02.560065  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:02.581090  1705 raft_consensus.cc:2368] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14.
I20260709 13:01:02.558293  5934 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:02.522616  5791 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.561316  5938 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:02.566074  5962 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:02.527675  5847 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:02.566864  5953 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.448532  5788 consensus_queue.cc:237] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:02.561203  5628 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.514768  5575 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:02.543313  5956 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.583384  5960 consensus_queue.cc:1059] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:01:02.599011  5945 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:02.605325  5947 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:02.605872  5947 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.613948  5950 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:02.614555  5723 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.969s	user 0.012s	sys 0.000s
I20260709 13:01:02.615736  1635 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:02.615796  5857 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:02.570248  5949 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:02.582376  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:02.545141  5843 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.559373  5893 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:02.632725  5949 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:02.626163  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 983) took 1933 ms. Trace:
I20260709 13:01:02.606200  5947 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.565027  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:02.639163  5843 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:02.642269  5742 consensus_meta.cc:287] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.000s
W20260709 13:01:02.644018  5814 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.781s	user 0.007s	sys 0.003s
I20260709 13:01:02.633922  2329 rpcz_store.cc:276] 0709 13:01:00.692460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.692654 (+   194us) service_pool.cc:224] Handling call
0709 13:01:00.692979 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:00.693178 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.693205 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:00.693683 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:01:00.971436 (+277753us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:00.971473 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.971538 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.614680 (+1643142us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b24002e0f28. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed681e9c4 00007f0ed681cacb 00007f0ed69d7dc9 00007f0ed69d7a55 00007f0ed69d6fb0 00007f0ed964d488 00007f0ed964dbe8 00007f0ed9625398 00007f0ed962076a 00007f0ed961fbb6
0709 13:01:02.616093 (+  1413us) raft_consensus.cc:1685] finished
0709 13:01:02.616114 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.626063 (+  9949us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32393472,"thread_start_us":277408,"threads_started":1,"wal-append.queue_time_us":906399}
I20260709 13:01:02.624176  5607 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.594658  5962 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:02.590796  5817 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:01:02.635070  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 52936.9us
W20260709 13:01:02.627645  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 59043.8us
W20260709 13:01:02.653179  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 88237.5us
I20260709 13:01:02.644775  5866 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.646029  5949 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:02.656104  5860 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.668018  5627 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.642778  5742 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.655278  5962 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:02.680320  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.646456  5814 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.666388  5953 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.687175  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.685247  1630 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:01:02.666949  5949 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.686529  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.656315  5607 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:02.680930  5829 consensus_meta.cc:287] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.014s	user 0.012s	sys 0.001s
I20260709 13:01:02.663340  5822 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:01:02.691035  1634 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:01:02.693024  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.693497  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2626) took 1006 ms. Trace:
I20260709 13:01:02.694340  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2180) took 1168 ms. Trace:
I20260709 13:01:02.697000  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.728772  1554 rpcz_store.cc:276] 0709 13:01:01.687450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.699068 (+ 11618us) service_pool.cc:224] Handling call
0709 13:01:01.699310 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.756387 (+ 57077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.756431 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.756486 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:01.756534 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.693279 (+936745us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b5400027954. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:02.693325 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.693442 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130676992}
I20260709 13:01:02.729739  1557 rpcz_store.cc:276] 0709 13:01:01.525923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.600213 (+ 74290us) service_pool.cc:224] Handling call
0709 13:01:02.694188 (+1093975us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b540017edd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:02.694287 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145937280}
I20260709 13:01:02.680320  5866 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:02.685845  5853 consensus_meta.cc:287] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.000s
I20260709 13:01:02.721305  5949 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:02.751495  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:02.755152  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 63580.6us
I20260709 13:01:02.736354  5814 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:02.753835  5641 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:02.757954  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:02.761741  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:02.762169  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:02.767673  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:02.738389  5829 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.770704  2328 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:02.758208  5911 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:02.748251  5866 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.748798  5853 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.774308  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:02.753317  5843 consensus_queue.cc:1059] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:01:02.760807  5627 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:02.783107  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:02.784406  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:02.766103  5894 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:02.787344  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:02.788017  1557 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:01:02.785120  1709 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:01:02.786749  5627 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:02.789525  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 123534us
I20260709 13:01:02.796124  1555 raft_consensus.cc:2368] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10.
I20260709 13:01:02.796378  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:02.779731  5850 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:02.805594  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33322 (request call id 11) took 3484 ms. Trace:
I20260709 13:01:02.806078  2322 rpcz_store.cc:276] 0709 13:00:59.314676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.314958 (+   282us) service_pool.cc:224] Handling call
0709 13:01:02.798565 (+3483607us) spinlock_profiling.cc:243] Waited 2.25 s on lock 0x7b540076fcd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a7f853 00007f0edea4d60a 00007f0ed7fd37d4 00007f0ed7fd3762 00007f0ed7fd3691 00007f0ed7fd360c 00007f0ed7fd28c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:02.798673 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5173390208}
I20260709 13:01:02.814399  5923 raft_consensus.cc:3055] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:02.815069  5923 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:02.821491  2328 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:02.786808  5894 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.828785  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.828986  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.831704  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:02.832468  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.834115  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:02.835696  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.835619  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.799723  5505 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:02.837575  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:02.839124  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.840932  5866 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.845204  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.847091  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.850097  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.851068  1633 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 10: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:02.847796  5947 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:02.830143  5894 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.816056  5923 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.831997  5791 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.867411  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:02.869280  5956 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.907899  1707 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:02.832544  5627 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:02.925699  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:02.924247  2286 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:02.926649  1702 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:02.848412  5949 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:02.948951  5898 consensus_meta.cc:287] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.007s
I20260709 13:01:02.919090  5814 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:02.952153  2326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4ce544917f545499da64014539a4ff2"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:02.961954  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:02.929291  5923 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.967895  2326 raft_consensus.cc:606] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:02.926937  5860 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:02.944986  5892 consensus_meta.cc:287] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.921s	user 0.011s	sys 0.003s
I20260709 13:01:02.946125  5970 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:02.926493  5919 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:02.946592  5829 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:02.978523  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:02.988085  5947 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:02.989688  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:02.991370  1702 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:02.999298  5786 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:03.005990  1675 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:02.975673  5970 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.011826  1675 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:03.014245  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.015695  1557 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:03.016731  5866 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:03.016901  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.017261  5866 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:03.017568  1557 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:03.017729  5866 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:03.018587  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.019239  1557 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
W20260709 13:01:03.021955  5909 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.952s	user 0.004s	sys 0.000s
I20260709 13:01:03.022545  5853 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:02.978207  5892 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:03.020182  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:03.028266  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 799) took 1398 ms (client timeout 1788 ms). Trace:
I20260709 13:01:02.969017  5898 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:03.028952  1627 rpcz_store.cc:269] 0709 13:01:01.629842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.631304 (+  1462us) service_pool.cc:224] Handling call
0709 13:01:03.024559 (+1393255us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b5400125a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:03.028103 (+  3544us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170199296}
I20260709 13:01:03.038125  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2631) took 1047 ms. Trace:
I20260709 13:01:03.038628  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:02.970551  5814 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.025234  5962 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:03.045542  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:03.008553  5627 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:03.052662  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:03.041980  1556 rpcz_store.cc:276] 0709 13:01:01.990584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.990831 (+   247us) service_pool.cc:224] Handling call
0709 13:01:01.991229 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.991492 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:02.030928 (+ 39436us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.027572 (+996644us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b180007f120. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6912c0a 00007f0ee0052219 00007f0ed699aa40 00007f0ed69954e4 00007f0ed6995455 00007f0edd47d3c7 00007f0ed9a8f9a7 00007f0ed9a9f0bf 00007f0ed9a9f038
0709 13:01:03.037596 (+ 10024us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.037785 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.037849 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:03.037891 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.037954 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.038064 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":948060,"prepare.queue_time_us":1058426,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":4037,"raft.queue_time_us":2715,"spinlock_wait_cycles":41577088}
I20260709 13:01:03.005326  5854 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.066941  5854 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:03.070173  5854 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:03.027922  5970 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:03.073432  1445 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6325e0281aa547efa677c29cabdf5de4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8106dfc0bda54df0ae10ba13c28ccc18 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:03.081676  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:03.028136  1557 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 5.
I20260709 13:01:03.007460  5860 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:03.051667  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 63364.3us
I20260709 13:01:03.054176  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:03.085281  1556 raft_consensus.cc:2368] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14.
I20260709 13:01:03.037232  5955 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:03.055272  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:03.086357  1704 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:03.058094  5814 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:03.059607  1708 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:03.084484  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:03.042912  2326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:03.089718  2326 raft_consensus.cc:606] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:03.090965  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.091766  1556 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:01:03.092363  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:03.093093  1628 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:03.094353  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.097180  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.098250  1553 raft_consensus.cc:2393] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:03.096324  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.299678  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:03.300433  1557 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:03.300534  4938 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:03.301035  4938 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.319526  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.324100  2288 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:03.096935  5505 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:03.328461  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.330574  1553 raft_consensus.cc:2410] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:01:03.111168  5892 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:03.076725  5627 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:03.301826  5372 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:03.303206  5853 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:03.303391  5907 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:03.448447  1557 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:03.427698  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.429868  5847 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:03.328419  5814 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:03.389345  5990 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:03.431741  5853 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.342484  5953 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:03.508477  4938 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:03.435189  5742 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:03.438424  5866 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.341575  5505 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:03.460260  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:03.512116  1557 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:03.465533  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2173) took 2515 ms. Trace:
I20260709 13:01:03.513197  1558 rpcz_store.cc:276] 0709 13:01:00.950407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.950574 (+   167us) service_pool.cc:224] Handling call
0709 13:01:00.950970 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.922228 (+971258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.465311 (+1543083us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b54001aa9d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:03.465478 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2043572992}
I20260709 13:01:03.471968  1702 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:01:03.088934  5860 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.511938  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:03.451826  5978 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.508s	user 0.000s	sys 0.002s
I20260709 13:01:03.465518  5847 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.518627  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.521241  1558 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:03.453913  5962 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:03.501643  5990 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.503185  5892 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:03.507467  5949 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:03.535885  1557 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:03.557973  1553 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11. Ops: [10.4-10.4]
I20260709 13:01:03.466100  5907 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.458621  5372 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.522866  5847 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:03.502485  5814 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.529134  5919 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:03.515277  5953 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.590410  5953 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:03.563004  5892 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:03.594273  5907 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:03.596402  1628 consensus_meta.cc:287] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.001s
I20260709 13:01:03.596838  1628 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:03.600517  5898 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:03.570585  5962 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.601882  5962 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:03.610069  5894 consensus_meta.cc:287] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.691s	user 0.010s	sys 0.000s
I20260709 13:01:03.610567  5894 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:03.581758  1556 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:01:03.619755  5860 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:03.622440  5990 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:03.624466  5866 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:03.637905  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2664) took 2089 ms (client timeout 1866 ms). Trace:
W20260709 13:01:03.638460  1635 rpcz_store.cc:269] 0709 13:01:01.548405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.594043 (+ 45638us) service_pool.cc:224] Handling call
0709 13:01:03.637626 (+2043583us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000f4bd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:03.637807 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336647552}
I20260709 13:01:03.645254  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2590) took 1193 ms. Trace:
I20260709 13:01:03.636157  5607 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:03.645819  1703 rpcz_store.cc:276] 0709 13:01:02.452155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.455474 (+  3319us) service_pool.cc:224] Handling call
0709 13:01:02.474171 (+ 18697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.474442 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.474479 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.490948 (+ 16469us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.751866 (+260918us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:02.751937 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.752074 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.644975 (+892901us) raft_consensus.cc:1685] finished
0709 13:01:03.645001 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.645175 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58752,"thread_start_us":233365,"threads_started":1,"wal-append.queue_time_us":295475}
I20260709 13:01:03.649421  5814 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:03.576506  5985 log.cc:927] Time spent T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.536s	user 0.001s	sys 0.000s
I20260709 13:01:03.719336  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.596247  5372 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:03.723528  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 881) took 1654 ms. Trace:
I20260709 13:01:03.724022  1552 rpcz_store.cc:276] 0709 13:01:02.068914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.069082 (+   168us) service_pool.cc:224] Handling call
0709 13:01:02.069462 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:02.133509 (+ 64047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.723172 (+1589663us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b5400027454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:03.723451 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78935424}
I20260709 13:01:03.729390  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:03.730544  1553 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:03.709002  5898 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:03.723862  5962 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:03.726298  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 333261us
I20260709 13:01:03.734978  5892 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:03.756978  5627 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:03.758050  1635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 13:01:03.758802  1635 raft_consensus.cc:606] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:03.768709  2326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:03.769371  2326 raft_consensus.cc:606] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:03.769721  2326 raft_consensus.cc:614] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:03.778676  5918 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:03.779589  5853 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:03.744998  5993 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:03.783339  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 459213us
I20260709 13:01:03.786155  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2681) took 1123 ms. Trace:
I20260709 13:01:03.781633  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 887) took 1454 ms. Trace:
I20260709 13:01:03.788655  1555 rpcz_store.cc:276] 0709 13:01:02.326966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.327111 (+   145us) service_pool.cc:224] Handling call
0709 13:01:03.772495 (+1445384us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54001d83d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:03.781582 (+  9087us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076099328}
I20260709 13:01:03.746500  5372 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:03.781142   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:03.786751  1701 rpcz_store.cc:276] 0709 13:01:02.662475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.809577 (+147102us) service_pool.cc:224] Handling call
0709 13:01:02.809905 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.810383 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.810413 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.810920 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.908678 (+ 97758us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:02.908729 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.908794 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.783903 (+875109us) raft_consensus.cc:1685] finished
0709 13:01:03.783933 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.784095 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":97372,"threads_started":1,"wal-append.queue_time_us":161881}
I20260709 13:01:03.741899  5898 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:03.780329  5832 raft_consensus.cc:3055] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:03.745221  5894 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:03.795264  5809 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:03.803836  5962 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:03.804792  5832 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:03.807785  5907 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:03.797789  5372 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.809543  5892 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:03.823966  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 179290us
I20260709 13:01:03.813836  5853 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:03.796178  5993 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.818259  5894 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:03.829114  5604 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:03.829957  5627 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:03.823241  5962 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.826659  5907 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.859575  1553 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:01:03.829766  5892 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:03.866444  5372 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:03.831557  5894 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.830816  5853 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:03.874795  2286 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:03.889230  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:03.891932  5931 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 2.049s	user 0.008s	sys 0.003s
I20260709 13:01:03.900940  5924 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:03.901876  5810 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:03.902631  5810 raft_consensus.cc:993] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: : Instructing follower e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 13:01:03.903398  2286 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:03.905006  5893 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:03.905069  5810 raft_consensus.cc:1081] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Signalling peer e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 13:01:03.861793  5627 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.906575  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2177) took 2920 ms. Trace:
I20260709 13:01:03.908165  5627 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:03.908900  5908 raft_consensus.cc:3055] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:03.909214  5534 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:03.909217  5627 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.909930  5534 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.910034  5627 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.904309  5952 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:03.912807  5627 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:03.886788  5923 consensus_meta.cc:287] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.913s	user 0.011s	sys 0.001s
I20260709 13:01:03.913129  5505 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:01:03.906991  1560 rpcz_store.cc:276] 0709 13:01:00.986144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.446788 (+460644us) service_pool.cc:224] Handling call
0709 13:01:01.447577 (+   789us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.607759 (+160182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.607791 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.608232 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.673426 (+ 65194us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:01.673462 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.906190 (+2232728us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400026f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:03.906242 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.906289 (+    47us) raft_consensus.cc:1685] finished
0709 13:01:03.906301 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.906516 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5173,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":8521,"spinlock_wait_cycles":367383424,"thread_start_us":64650,"threads_started":1,"wal-append.queue_time_us":165541,"wal-append.run_cpu_time_us":1754,"wal-append.run_wall_time_us":1060540}
I20260709 13:01:03.905035  2286 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:03.909359  5908 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:03.922029  2286 leader_election.cc:400] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14.
I20260709 13:01:03.922437  2286 leader_election.cc:403] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:01:03.923409  2286 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:03.924220  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:03.927167  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2589) took 1475 ms. Trace:
I20260709 13:01:03.953812  1705 rpcz_store.cc:276] 0709 13:01:02.451835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.458946 (+  7111us) service_pool.cc:224] Handling call
0709 13:01:03.926915 (+1467969us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54003d9fd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:03.927095 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272696064}
I20260709 13:01:03.928144  1709 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:03.929672  5372 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:03.925621  5995 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:03.931360  5898 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:03.932878  5907 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:03.925864  5829 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14.
I20260709 13:01:03.933797  5908 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:03.935658  5853 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:03.936934  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.937136  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 991) took 2266 ms. Trace:
I20260709 13:01:03.968248  1560 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:03.912374  5534 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:03.971819  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.846622  5832 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:03.939175  5993 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:03.940564  5962 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:03.941345  5923 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:03.943368  5971 raft_consensus.cc:3055] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:03.945353  5521 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:03.948331  2323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 994) took 1996 ms (client timeout 1942 ms). Trace:
W20260709 13:01:03.993703  2323 rpcz_store.cc:269] 0709 13:01:01.952084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.952253 (+   169us) service_pool.cc:224] Handling call
0709 13:01:03.948110 (+1995857us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400078d54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:03.948260 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980906368}
I20260709 13:01:03.949474  1708 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:03.958289  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:03.995211  1553 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:01:03.995544  5962 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:03.995636  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:03.959316  1673 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:03.996294  5962 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:03.961391  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:03.998353  1673 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:03.996577  1705 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:03.969439  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:03.967355  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:03.968116  2328 rpcz_store.cc:276] 0709 13:01:01.670319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.676369 (+  6050us) service_pool.cc:224] Handling call
0709 13:01:03.936939 (+2260570us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54004f3b54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:03.937078 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2488353152}
I20260709 13:01:03.970323  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:03.970902  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:03.938081  5970 consensus_meta.cc:287] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.866s	user 0.005s	sys 0.006s
I20260709 13:01:03.972514  1551 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:01:04.003253  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:03.965008  5951 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:03.973748  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:03.974115  5832 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.007326  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.008085  5641 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:03.974386  5908 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:03.966094  5995 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.973628  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:03.980199  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:04.015040  1630 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:04.012995  6001 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:01:03.991559  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:04.002104  1635 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:03.998751  1628 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:04.004558  1673 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:04.017544  1705 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:03.966827  2286 leader_election.cc:400] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10.
I20260709 13:01:04.014463  1631 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:04.018298  2286 leader_election.cc:403] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:03.983301  6003 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:01:04.018841  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:03.994115  5971 raft_consensus.cc:740] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:04.017799  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:03.998960  5955 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:04.019356  5854 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:04.021935  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 55260.9us
I20260709 13:01:04.015955  5995 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:03.999006  5962 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:04.023496  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.023929  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.033265  1630 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:01:04.033397  1628 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:04.034150  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.034356  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.000169  5960 raft_consensus.cc:3055] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:04.021754  1631 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:03.969772  5952 consensus_queue.cc:1059] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:01:04.025482  1673 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:03.967399  5372 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.027101  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.045490  1700 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:04.026160  5521 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.029968  5641 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:03.967558  5847 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.006068  5923 raft_consensus.cc:697] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:04.031530  2286 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:04.036303  5960 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:04.020890  5892 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:04.005712  5970 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.049995  5952 consensus_queue.cc:1243] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:04.074697  5924 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:04.074944  5984 log.cc:927] Time spent T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 1.243s	user 0.016s	sys 0.009s
I20260709 13:01:04.051088  1673 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:04.015878  5951 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:04.057792  1635 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
W20260709 13:01:04.098289  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.081684  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50278us
I20260709 13:01:04.086721  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:04.103551  1673 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:04.104274  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.108028  2323 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:04.106076  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.104408  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.109115  1705 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:04.106201  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.108381  1633 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:01:04.110666  5955 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:04.111159  1700 raft_consensus.cc:1240] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:04.107070  5854 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:04.112226  5854 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:04.111106  5955 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:04.114152  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:04.098984  6001 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:04.118165  1551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4ce544917f545499da64014539a4ff2"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33810
I20260709 13:01:04.118839  1551 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:04.119186  1551 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:04.119241  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:04.125289  5521 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10.
I20260709 13:01:04.112658  5854 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.100961  5952 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.074126  5847 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:04.108336  5894 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:04.127475  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:04.116539  2323 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:04.128993  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:04.137434  2320 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:01:04.137609  5759 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:04.130007  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:04.139635  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2271) took 1310 ms. Trace:
I20260709 13:01:04.141592  2328 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:04.141592  1700 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:04.117676  5955 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.072790  5962 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.087821  5924 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:04.097007  5907 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:04.106781  5829 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:04.137836  1707 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:04.143162  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:04.155474  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2188) took 1170 ms. Trace:
I20260709 13:01:04.050361  5641 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:04.155853  1556 rpcz_store.cc:276] 0709 13:01:02.985595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.319193 (+333598us) service_pool.cc:224] Handling call
0709 13:01:04.155300 (+836107us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b5400160154. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:04.155416 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600948480}
I20260709 13:01:04.140286  1629 rpcz_store.cc:276] 0709 13:01:02.829592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.841748 (+ 12156us) service_pool.cc:224] Handling call
0709 13:01:02.844380 (+  2632us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.856449 (+ 12069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.856526 (+    77us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.857460 (+   934us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.973837 (+116377us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:03.015463 (+ 41626us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.032783 (+ 17320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.938315 (+905532us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b180025f9c0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:01:03.940205 (+  1890us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b180025f9c0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:01:04.044841 (+104636us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b180025f9c0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69662a6 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419
0709 13:01:04.139177 (+ 94336us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5400204754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:04.139235 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.139299 (+    64us) raft_consensus.cc:1685] finished
0709 13:01:04.139327 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.139545 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41367,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":36,"raft.queue_time_us":17430,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":216,"spinlock_wait_cycles":99964544,"thread_start_us":115927,"threads_started":1,"wal-append.queue_time_us":155812}
I20260709 13:01:04.149993  1673 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:04.159157  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:04.130381  1551 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.131211  5627 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:04.151648  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.162927  2320 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:04.153587  1598 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:04.161489  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.164188  2328 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:01:04.166150  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.166759  1703 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:01:04.169912  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.154843  5962 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:04.165202  5907 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.181645  5962 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:04.173098  5866 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:04.150898  5705 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:04.184211  5575 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:04.193627  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:04.198561  1556 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.199692  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.200050  5990 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:04.200695  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.201090  5742 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:04.201721  5742 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.200721  5990 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.204044  5990 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:04.169252  5829 raft_consensus.cc:697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:04.205614  5829 consensus_queue.cc:237] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.196609  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2596) took 1658 ms. Trace:
I20260709 13:01:04.208788  1559 raft_consensus.cc:1240] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:04.117838  5971 consensus_queue.cc:260] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:04.184312  5995 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.186095  5946 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:04.210050  1558 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:04.239821  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.241048  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:04.216768  1552 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260709 13:01:04.231402  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:04.243052  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.235741  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2609) took 1282 ms. Trace:
I20260709 13:01:04.249536  1553 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:04.165802  5942 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:04.249657  1709 rpcz_store.cc:276] 0709 13:01:02.953339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.953528 (+   189us) service_pool.cc:224] Handling call
0709 13:01:03.927831 (+974303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.955000 (+ 27169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.235520 (+280520us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54003d9fd0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:04.235664 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197245184}
I20260709 13:01:04.161739  5641 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:04.232333  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.255474  1629 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:04.218395  1706 rpcz_store.cc:276] 0709 13:01:02.537726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.589432 (+ 51706us) service_pool.cc:224] Handling call
0709 13:01:02.607307 (+ 17875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.867142 (+1259835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.867175 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.867215 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:03.867252 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.196320 (+329068us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400253fd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:04.196380 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.196519 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2896586624}
I20260709 13:01:04.241415  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.155058  5924 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.232023  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.166189  1673 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:04.208202  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:04.277835  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.279886  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.280535  1706 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:04.281576  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:04.283423  1627 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:04.288457  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:04.289312  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.268406  6006 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:01:04.187803  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 70935.8us
I20260709 13:01:04.134303  5951 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.162590  5627 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:04.279565  5850 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.238853  5894 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:04.142347  5952 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.259802  5892 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:04.190553  5372 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:04.265007  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:04.265419  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.311765  1707 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:04.266232  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.266973  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.312927  1704 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:04.265057  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.216282  5759 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.270429  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:04.313719  1598 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:04.316701  1557 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:04.303646  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.270421  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:04.276342  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 110208us
I20260709 13:01:04.185778  5970 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:04.291893  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 50915.6us
I20260709 13:01:04.269057  5971 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.254556  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:04.325405  1556 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:04.152552  5960 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:04.301635  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.295080  1601 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:04.217684  5962 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.168278  5923 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.252079  1551 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:04.306902  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:04.204087  5742 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:04.339740  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.340832  1554 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:04.312441  1702 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:04.344841  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.345454  1702 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:04.347360  5948 raft_consensus.cc:993] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 13:01:04.318651  1673 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:04.322072  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.323422  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:04.356453  2320 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.303413  5853 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:04.304023  5627 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:04.320727  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:04.360826  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:04.361083  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.362118  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:04.363350  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:04.332058  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.333931  4938 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:04.334398  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:04.336136  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.364701  2327 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:04.334556  1598 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:04.303642  5854 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:04.338634  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.340889  1560 raft_consensus.cc:2410] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:01:04.343570  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:04.348824  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.368863  1705 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:04.314203  1700 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:04.349289  5907 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:04.307861  5898 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:04.374135  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:04.317615  1709 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:01:04.374882  1626 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:04.310185  5705 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:04.350816  2326 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:04.351862  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:04.352047  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:04.353245  2286 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:04.320996  5901 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:04.358774  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.256531  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:04.364210  2329 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:04.333204  5723 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:04.381395  2328 raft_consensus.cc:2368] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10.
I20260709 13:01:04.367250  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.381865  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.382373  1633 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:04.370893  2324 raft_consensus.cc:2368] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9.
I20260709 13:01:04.321550  5892 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:04.369554  1601 leader_election.cc:400] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14.
I20260709 13:01:04.356994  5960 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.316995  5894 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
W20260709 13:01:04.378911  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 44415.9us
I20260709 13:01:04.385982  4938 raft_consensus.cc:697] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:04.324862  5759 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.370545  5893 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:04.393206  2286 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:04.370389  5939 raft_consensus.cc:2764] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:01:04.391707  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:04.374810  5908 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:04.354662  5866 consensus_queue.cc:1059] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:01:04.354667  5962 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:04.401381  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:04.373821  5907 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:04.396225  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.394620  1601 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:04.408319  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.401888  1598 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:04.378273  5787 raft_consensus.cc:1081] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 13:01:04.403124  1557 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:04.403764  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.395449  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.386523  5830 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:04.401304  5938 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:04.410959  5830 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:04.381009  5952 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:04.387502  5723 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.407490  4938 consensus_queue.cc:237] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:04.417349  1558 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:04.412232  1556 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:04.425119  1626 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:04.426949  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.427619  1559 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:04.445542  1552 raft_consensus.cc:2393] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 13: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:01:04.445848  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 51293.2us
I20260709 13:01:04.446013  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.390684  5901 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:04.446696  1601 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:04.448024  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:04.396234  5990 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:04.464963  1556 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:04.380757  5898 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:04.457023  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.468895  2324 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:04.472147  2288 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:04.388007  5705 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.407220  5907 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:04.423693  5830 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.448733  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.474982  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:04.401749  5832 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:01:04.395665  5893 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:04.479288  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 77459.7us
W20260709 13:01:04.496419  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49805.2us
I20260709 13:01:04.497076  1598 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:04.411506  5822 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:01:04.420392  5938 raft_consensus.cc:697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:04.425798  5723 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:04.413025  5908 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:04.484881  1627 raft_consensus.cc:2410] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 9 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
W20260709 13:01:04.485880  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 122574us
I20260709 13:01:04.482108  5907 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.399853  5742 consensus_queue.cc:1059] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
W20260709 13:01:04.547994  6008 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:04.548198  5742 consensus_queue.cc:1243] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:04.504735  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.548796  5819 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:04.505609  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:04.549252  5819 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:01:04.549660  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44153.9us
I20260709 13:01:04.419696  5372 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:01:04.541424  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:04.465893  5866 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:04.541513  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 222932us
I20260709 13:01:04.467499  5521 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:01:04.482254  5970 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:04.483106  5505 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:04.545429  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 48430.9us
I20260709 13:01:04.502978  5982 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:04.546427  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48375.5us
W20260709 13:01:04.547700  6011 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:01:04.547330  5948 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:04.554057  1707 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:01:04.558981  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:04.559547  2320 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:04.559885  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:04.467763  5990 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:04.502349  5893 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.497843  5853 raft_consensus.cc:697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:04.506973  5810 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:04.577750  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:04.635334  2324 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 10: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:01:04.582285  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.549679  5819 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:04.618206  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 58405.7us
I20260709 13:01:04.637213  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:04.580310  5505 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:04.566198  5848 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:04.642802  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:04.620806  5990 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:04.640127  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.642998  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:04.638792  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 43567.5us
W20260709 13:01:04.646818  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 84959.3us
I20260709 13:01:04.655382  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:04.584079  5982 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:04.669360  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:04.679119  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:04.680048  2320 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:04.640239  5505 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.642071  5848 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:04.694459  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 117855us
I20260709 13:01:04.671881  5575 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:04.696672  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:04.668876  5854 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:04.673481  5982 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.693394  5939 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:04.707863  6023 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:04.708771  6023 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:04.713306  6012 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:01:04.713485  5854 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:04.714126  5854 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:04.714689  5854 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.675978  5908 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.700434  5759 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:04.725453  5853 consensus_queue.cc:237] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:04.673233  5938 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.688632  5894 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:04.730589  5505 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.731763  6016 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:04.694542  5848 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.764784  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.773762  1700 raft_consensus.cc:2393] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 7: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:04.769073  1702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 13:01:04.775430  1702 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:04.775908  1702 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.780197  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:04.731750  6007 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
W20260709 13:01:04.753053  5955 consensus_meta.cc:287] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.002s
I20260709 13:01:04.731549  6013 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:04.794598  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.738508  6023 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:04.731776  6015 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:04.731853  5892 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:04.751585  5942 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:04.812541  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 175459us
I20260709 13:01:04.813079  5854 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.816998  5505 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:04.793128  5955 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:04.819638  5955 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:04.820938  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:04.824776  5705 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:04.731738  6017 consensus_queue.cc:1059] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.126s
I20260709 13:01:04.765432  5924 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:04.829557  5627 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:04.830765  5924 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:04.831589  1705 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:04.832005  5627 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:04.833563  5534 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:04.834154  5534 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:04.835247  5534 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.836156  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.836822  5962 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:04.836921  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.837296  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.837754  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:04.838104  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.838389  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.839284  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.796073  6013 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:04.840386  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.840993  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.841282  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:04.841879  6017 raft_consensus.cc:3055] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:04.842271  6017 raft_consensus.cc:740] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:04.843146  6017 consensus_queue.cc:260] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:04.846387  5936 raft_consensus.cc:3055] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:04.847069  5936 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:01:04.848088  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.850559  5854 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:04.825389  5898 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:04.840991  2325 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:04.799342  6025 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:04.856148  6025 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:04.848414  5936 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.856564  6025 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.857302  5936 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:04.859002  5847 raft_consensus.cc:3055] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:04.859745  5847 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:04.864290  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:04.868506  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:04.870860  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 57456.7us
I20260709 13:01:04.871620  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:04.871738  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:04.872479  2323 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 10: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:04.874053  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:04.875847  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:01:04.865442  5850 consensus_meta.cc:287] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.002s
I20260709 13:01:04.879307  5850 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:04.866765  5901 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:04.881260  5819 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.882812  5995 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:04.883471  5819 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:04.841228  6013 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.884768  6013 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:04.896482  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 217668us
I20260709 13:01:04.898221  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:04.901556  1632 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:01:04.889830  5847 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.907464  5847 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:04.909060  5901 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:04.844496  6017 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:04.903430  1675 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:04.918629  2329 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:04.936553  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:04.938778  2328 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:04.940904  2327 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:04.941277  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.941721  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.940470  1598 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:04.934190  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:04.910898  6021 log.cc:927] Time spent T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:01:04.935751  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:04.854282  5907 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.904661  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:04.899106  1702 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:04.943224  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.885633  5962 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:01:04.937821  5854 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.937996  5850 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:04.933894  5938 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:05.005288  1702 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:05.006687  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:04.955756  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:04.985450  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 80905.5us
I20260709 13:01:04.947858  5705 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:04.983855  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:04.963668  1523 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:04.986152  1701 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
W20260709 13:01:04.948777  5641 consensus_meta.cc:287] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.002s
W20260709 13:01:05.014211  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 50697us
I20260709 13:01:05.008495  1707 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:05.030123  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:05.030710  1523 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.031868  1523 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:04.974694  5901 consensus_queue.cc:1059] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:01:05.014405  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:05.015151  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:05.006106  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 47396.2us
I20260709 13:01:05.033588  5898 raft_consensus.cc:3055] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:05.034179  5898 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:05.035183  5898 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.035691  1672 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.036520  5898 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:05.032819  6027 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:05.037703  5952 raft_consensus.cc:993] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: : Instructing follower e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 13:01:05.037721  5955 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:05.038293  5952 raft_consensus.cc:1081] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Signalling peer e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 13:01:05.032235  5908 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:04.945622  5924 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.012383  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:05.029731  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:05.032994  5901 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:05.041705  5901 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:05.042702  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:05.043466  1523 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.045782  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:05.046514  2323 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.987680  5914 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:05.005003  6015 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:05.042135  5901 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:05.012230  5850 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:05.059043  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:05.059584  1523 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:04.948071  6014 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:05.098850  1552 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:05.089979  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:05.012988  6028 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.092240  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.092536  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:05.107949  1556 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.095404   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:05.097154  1559 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:05.097795  1558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33810
I20260709 13:01:05.106024  2323 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
W20260709 13:01:05.112603  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 76999.7us
W20260709 13:01:05.047886  5971 consensus_meta.cc:287] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.720s	user 0.009s	sys 0.003s
I20260709 13:01:05.103186  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:05.105984  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:05.114147  1672 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.114279  1704 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:01:05.114517  1707 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:05.115307  1704 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:05.117038  1672 leader_election.cc:400] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10.
I20260709 13:01:05.117592  1672 leader_election.cc:403] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:05.118002  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:05.124648  1556 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:05.068410  5908 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:05.129027  1560 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:05.131597  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.132833  1704 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:05.093621  5901 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.068843  5705 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:05.013422  5938 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.135104  2286 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:05.089709  5850 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.150491  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:05.151604  1704 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.139366  1672 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:05.091248  5892 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:05.156908  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.069083  5924 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:05.090643  6023 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:05.071015  6027 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:05.106931  5894 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:05.013370  5854 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.148777  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:05.132920  5853 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:05.110567  5914 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:05.144160  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.154314  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:05.068709  5641 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.142923  5627 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.222949  5627 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.223369  5907 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:05.223464  5627 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.223932  5705 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.10, Last appended by leader: 10, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:05.225807  5960 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.828s	user 0.010s	sys 0.000s
I20260709 13:01:05.186178  1672 leader_election.cc:400] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9.
I20260709 13:01:05.196099  1704 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:05.228654  1672 leader_election.cc:403] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:05.229506  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:05.230854  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:05.198197  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 44175.1us
I20260709 13:01:05.231739  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.143585  6015 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.150734  5596 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:05.205086  5957 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:05.152771  5962 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:05.099695  6016 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
W20260709 13:01:05.214380  6032 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 13:01:05.217427  6034 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:01:05.110059  6014 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.220814  6041 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:05.199630  6023 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:05.221698  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.241169  6015 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:05.234911  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 49030.5us
I20260709 13:01:05.272406  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:05.278666  1672 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.240085  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.182096  6024 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.145480  5970 consensus_queue.cc:1059] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:01:05.231902  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.208417  5829 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:05.295855  5830 consensus_meta.cc:287] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.798s	user 0.005s	sys 0.005s
I20260709 13:01:05.296905  5970 raft_consensus.cc:3055] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:05.296996  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 65187.7us
I20260709 13:01:05.297595  5970 raft_consensus.cc:740] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:05.298950  5970 consensus_queue.cc:260] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.188362  6027 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.300196  6027 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:05.300467  5829 raft_consensus.cc:697] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:05.301918  5829 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.302819  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:05.304754  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:05.305814  5641 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:05.305940  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:05.180857  5971 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.307197  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:05.306958  5971 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.308251  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:05.309659  5971 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:05.228041  5908 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:05.310268  5908 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.310801  5908 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:05.262677  1706 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 8: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:05.313015  5914 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.314509  5854 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:05.240796  6037 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.316888  6037 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:05.319478  6037 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:05.296382  5830 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.244971  5995 consensus_queue.cc:1059] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:01:05.203320  5948 consensus_queue.cc:1059] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:01:05.263762  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 128740us
I20260709 13:01:05.245100  6013 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9.
I20260709 13:01:05.328677  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:05.117020  6028 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.265429  5962 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:05.269613  5723 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.706s	user 0.010s	sys 0.003s
I20260709 13:01:05.287976  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:05.288733  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:05.247272  5596 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.289534  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:05.289883  1633 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:05.289749  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:05.290762  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:05.293659  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:05.294956  6031 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:01:05.299274  5936 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:05.299417  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.299741  2320 raft_consensus.cc:2410] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:01:05.309804  1700 raft_consensus.cc:1240] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:05.323524  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:05.243916  1709 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
W20260709 13:01:05.377882  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 78540.1us
I20260709 13:01:05.280970  6015 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.325769  6016 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:05.243851  5907 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.378762  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:05.381367  1628 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:05.270829  1599 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:01:05.390635  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 119891us
I20260709 13:01:05.326066  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:05.379881  5723 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.385722  6014 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:05.386256  6025 consensus_meta.cc:287] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 13:01:05.392093  2326 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:05.392416  1708 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:05.349399  5962 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:05.383668  6030 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:01:05.399967  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:05.400944  1701 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:05.410737  5828 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.418963  5828 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:05.416308  6049 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.421885  6049 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.389369  5812 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.427451  1599 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:05.387142  6016 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:05.401050  5893 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.744s	user 0.011s	sys 0.000s
W20260709 13:01:05.429989  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.393420  5995 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:05.436170  2288 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.549s (SENT) [suppressed 8 similar messages]
I20260709 13:01:05.403584  5372 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.421178  5828 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:05.453536  1708 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:05.440733  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:05.432621  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:05.439465  5812 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:05.456159  5828 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:05.457676  2326 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:05.443979  5372 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:05.458094  6043 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:05.458757  5372 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.461876  5596 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:05.462502  5908 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:05.463323  5830 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:05.437817  5788 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:05.415343  5892 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.468948  5892 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:05.434470  5848 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.001s
I20260709 13:01:05.473766  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:05.424240  6049 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:05.441184  6016 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.485556  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.458034  5812 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:05.491169  6028 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:05.498332  5627 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.411777  6025 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:05.501751  1554 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:05.515168  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:05.516816  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 60375.5us
I20260709 13:01:05.433774  5791 consensus_queue.cc:1059] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:01:05.520566  1599 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:05.500379  5990 consensus_meta.cc:287] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.826s	user 0.009s	sys 0.000s
W20260709 13:01:05.501365  5982 consensus_meta.cc:287] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.755s	user 0.011s	sys 0.000s
I20260709 13:01:05.544376  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:05.551079  1552 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:05.545033  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:05.546068  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:05.547374  1555 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:01:05.553565  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:05.480651  5938 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:05.443598  5893 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.557761  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:05.500454  6024 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10.
I20260709 13:01:05.560715  1633 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:01:05.538836  5847 consensus_meta.cc:287] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.631s	user 0.005s	sys 0.007s
I20260709 13:01:05.554656  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:05.504443  6049 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:05.556358  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.558848  1627 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:05.558557  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:05.559167  1631 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:05.500875  5924 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:05.556879  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:05.562171  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:05.585263  1551 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:05.585868  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:05.586762  1626 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:05.595764  5372 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:05.602383  5372 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:01:05.518337  5898 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:05.565366  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:05.538972  6050 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:05.567090  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 130540us
I20260709 13:01:05.479259  5848 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.565164  5627 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:05.566677  6049 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:05.568605  5946 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:05.603545  5372 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:05.614243  5822 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:05.616096  5575 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:05.617690  5957 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:05.558089  5759 consensus_queue.cc:1059] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:01:05.619879  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 63609.1us
I20260709 13:01:05.626915  1704 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:05.548915  5990 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.592258  5830 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:05.720561  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.707368  6049 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.723491  1626 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:05.562027  5982 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.629671  5898 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:05.606873  5960 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:01:05.721530  5575 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:05.730472  6048 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:01:05.726311  6056 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.769121  2329 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
W20260709 13:01:05.777688  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 175993us
I20260709 13:01:05.782256  5848 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:05.786309  5990 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:05.791074  5901 consensus_meta.cc:287] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.000s
I20260709 13:01:05.792218  6025 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:05.796682  5723 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:05.798060  5893 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:05.800364  5850 consensus_meta.cc:287] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.621s	user 0.007s	sys 0.003s
I20260709 13:01:05.805990  5907 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:05.803709  6044 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.370s	user 0.004s	sys 0.000s
W20260709 13:01:05.827867  6041 consensus_meta.cc:287] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.000s
I20260709 13:01:05.828605  6041 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:05.816457  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 214717us
W20260709 13:01:05.867084  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 51636.2us
W20260709 13:01:05.818710  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 99291.8us
I20260709 13:01:05.881537  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.883425  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:05.884972  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:05.896454  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 66436.7us
I20260709 13:01:05.897324  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:06.063208  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.068038  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 170771us
I20260709 13:01:06.069380  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:06.070093  1632 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:06.070644  1632 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:06.076982  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:06.077899  1555 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:01:06.078593  1554 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:01:06.079092  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:06.079756  1555 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:06.080077  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:06.080698  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:06.080957  1554 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:06.081868  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:06.082571  1554 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:01:06.083302  1554 pending_rounds.cc:85] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 3
I20260709 13:01:06.083649  1554 pending_rounds.cc:107] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:01:06.084005  1554 raft_consensus.cc:2889] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:05.809957  5901 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.088110  1627 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:05.859089  5982 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:06.101492  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:06.102433  5960 consensus_queue.cc:1059] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:06.103036  1631 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:06.103605  5960 raft_consensus.cc:3055] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:06.104014  5960 raft_consensus.cc:740] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:06.104908  5960 consensus_queue.cc:260] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.105993  5908 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:06.106170  5960 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:06.106765  5908 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:06.093545  5723 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:06.109206  6036 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.723s	user 0.000s	sys 0.015s
I20260709 13:01:06.108340  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 762) took 1125 ms. Trace:
I20260709 13:01:06.110953  1702 rpcz_store.cc:276] 0709 13:01:04.983393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.015779 (+ 32386us) service_pool.cc:224] Handling call
0709 13:01:05.031932 (+ 16153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.101954 (+ 70022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.102051 (+    97us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.111445 (+  9394us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.243305 (+131860us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:05.243379 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.243512 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.803060 (+559548us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:06.099957 (+296897us) raft_consensus.cc:1685] finished
0709 13:01:06.099988 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.108267 (+  8279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24448,"raft.queue_time_us":30583,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10714,"spinlock_wait_cycles":122162944,"thread_start_us":62997,"threads_started":1,"wal-append.queue_time_us":236376}
I20260709 13:01:06.114094  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:06.118721  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:06.118492  6049 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.119659  1629 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:06.091535  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:06.121340  1626 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.823930  5850 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.126628  5850 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:06.127426  1700 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:06.130390  1700 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:06.130800  5993 raft_consensus.cc:3055] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:06.131325  5993 raft_consensus.cc:740] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:06.131883  1700 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:06.071463  1632 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.133255  1632 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:05.916539  5907 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:05.922053  5893 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:06.139251  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:06.149411  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:05.806671  6056 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:05.915709  5898 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:06.144207  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2639) took 1038 ms. Trace:
W20260709 13:01:06.158247  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 260896us
I20260709 13:01:06.158555  1707 rpcz_store.cc:276] 0709 13:01:05.105702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.135867 (+ 30165us) service_pool.cc:224] Handling call
0709 13:01:05.136166 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.288014 (+151848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.288049 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:05.288095 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:05.288125 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.143847 (+855722us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400396554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:06.143934 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.144125 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348739456}
I20260709 13:01:06.160775  1707 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:06.160552  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:06.153066  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:06.161583  1631 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:06.062469  5990 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:06.165210  1700 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:06.168964  1626 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:06.171576  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 769) took 1053 ms. Trace:
I20260709 13:01:06.172169  1558 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:06.171996  1708 rpcz_store.cc:276] 0709 13:01:05.118527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.249621 (+131094us) service_pool.cc:224] Handling call
0709 13:01:06.171392 (+921771us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400397954. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:06.171516 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261335808}
I20260709 13:01:06.172643  1558 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.173763  1702 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:01:06.157135  5823 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.015s	sys 0.055s
I20260709 13:01:06.210057  1700 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:06.060539  5947 consensus_queue.cc:1059] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
W20260709 13:01:06.222494  1553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 2651) took 1969 ms (client timeout 1683 ms). Trace:
W20260709 13:01:06.223289  1553 rpcz_store.cc:269] 0709 13:01:04.253012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.253321 (+   309us) service_pool.cc:224] Handling call
0709 13:01:06.222286 (+1968965us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b54002206d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:06.222424 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1650893696}
I20260709 13:01:06.230130  2320 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:06.230334  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:06.230894  2328 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.231670  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:06.232534  2321 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:06.061731  6015 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:06.216112  5823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.015s	sys 0.055s
I20260709 13:01:06.132139  5993 consensus_queue.cc:260] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.204492  5759 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:06.238236  6027 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.889s	user 0.009s	sys 0.003s
W20260709 13:01:06.243731  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.251590  2328 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
W20260709 13:01:06.291718  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.253958  1558 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.258425  6049 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:06.209369  5893 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:06.295568  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:06.287537  1632 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:06.288964  2321 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:01:06.296466  2328 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.205972  5907 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.077s
W20260709 13:01:06.293089  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 220465us
I20260709 13:01:06.202423  5990 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.298446  1560 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:06.291218  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 130733us
I20260709 13:01:06.283227  5534 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:06.310410  2321 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:06.306146  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:06.315348  1629 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:06.337497  1629 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:06.338738  1633 raft_consensus.cc:3055] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:06.339218  1633 raft_consensus.cc:740] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:06.341094  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:06.337491  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:06.347384  5990 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:06.309778  5830 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:06.348758  1626 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:06.348869  5830 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:06.350299  5901 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:06.294641  6027 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.351825  1555 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:06.353367  6027 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:06.342732  5993 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:06.354192  5575 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.582s	user 0.006s	sys 0.005s
I20260709 13:01:06.355926  2321 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:06.306814  5823 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:06.363318  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:06.373214  1632 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:06.376044  2328 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:06.377844  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:06.354990  5575 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.340943  5893 raft_consensus.cc:697] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:06.345645  6063 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:06.359423  5823 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.381172  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:06.386282  1626 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:06.362197  5901 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:06.382529  1706 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2702) took 2118 ms (client timeout 1834 ms). Trace:
W20260709 13:01:06.391317  1706 rpcz_store.cc:269] 0709 13:01:04.264168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.281312 (+ 17144us) service_pool.cc:224] Handling call
0709 13:01:06.382238 (+2100926us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b54003ec1d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:06.382438 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2248309504}
I20260709 13:01:06.383404  1705 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:06.380056  5990 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:06.394536  1598 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:06.389276  2328 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:01:06.395542  1598 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:06.381997  6027 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:06.398926  5947 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:06.398500  5901 raft_consensus.cc:697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:06.401372  5596 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:06.387001  6063 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.399178  6065 consensus_queue.cc:1059] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:01:06.427682  6068 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:01:06.428346  6015 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:06.432134  6042 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 1.034s	user 0.002s	sys 0.000s
W20260709 13:01:06.438679  6016 consensus_meta.cc:287] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.922s	user 0.007s	sys 0.007s
I20260709 13:01:06.441538  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:06.403103  5948 consensus_queue.cc:1059] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:01:06.450791  5575 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:06.407519  6027 raft_consensus.cc:697] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:06.397944  5990 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.456028  6063 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:06.457293  6043 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:06.415136  5947 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:06.417522  6067 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.410389  5777 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:01:06.415655  5893 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:06.466130  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 1.18739e+06us
W20260709 13:01:06.467516  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 1.18036e+06us
I20260709 13:01:06.508730  1672 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:06.494912  6065 consensus_queue.cc:1243] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:06.469494  5955 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:06.511379  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.421241  6056 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:06.522758  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:06.526541  1707 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.521530  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:06.498917  5962 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.070s	user 0.010s	sys 0.002s
I20260709 13:01:06.527626  1700 raft_consensus.cc:2393] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:06.520268  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:06.528210  1704 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:01:06.529119  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.529035  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:06.530352  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:06.528605  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:06.523316  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:06.535017  1708 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.503393  5947 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.537673  1672 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:06.532277  1700 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:06.544625  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:06.545403  1700 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:06.546464  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:06.534149  1675 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:06.498034  5742 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:01:06.549319  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:06.549896  1706 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.542003  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:06.473220  6016 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.550359  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:06.550629  1704 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:06.552246  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 49231.3us
I20260709 13:01:06.554435  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:06.559121  1708 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:06.560165  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:06.501727  5596 raft_consensus.cc:697] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:06.562506  6074 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:01:06.563633  1708 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:06.572958  1557 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:06.574376  1707 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:06.572739  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 767) took 1499 ms. Trace:
W20260709 13:01:06.578866  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44783.2us
I20260709 13:01:06.577930  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:06.551373  5705 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.549216  5641 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:06.580528  1704 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:06.579703  1675 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:06.609200  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:06.502761  6043 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.612411  6043 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:06.614548  5627 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:06.615242  5627 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.615742  5627 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.618793  6013 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:06.619606  6013 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:06.586720  5641 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.621168  5982 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.620872  6013 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.621802  5982 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.623631  5641 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:06.623850  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 764) took 1610 ms (client timeout 1641 ms). Trace:
W20260709 13:01:06.624228  1701 rpcz_store.cc:269] 0709 13:01:05.013916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.014937 (+  1021us) service_pool.cc:224] Handling call
0709 13:01:06.623675 (+1608738us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400265a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:06.623790 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490661760}
I20260709 13:01:06.583843  5955 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:06.625296  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:06.625453  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 69899.2us
I20260709 13:01:06.626463  2288 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:06.582437  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 79761.2us
I20260709 13:01:06.568305  6024 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:06.578403  1703 rpcz_store.cc:276] 0709 13:01:05.073170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.102233 (+ 29063us) service_pool.cc:224] Handling call
0709 13:01:05.109350 (+  7117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.109556 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:05.132934 (+ 23378us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.268440 (+135506us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.431387 (+1162947us) spinlock_profiling.cc:243] Waited 92.3 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:06.459221 (+ 27834us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b180020dfa0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6912c0a 00007f0ee0052219 00007f0ed699aa40 00007f0ed69954e4 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a8f716 00007f0ed9aa0287 00007f0ed9aa0208
0709 13:01:06.506573 (+ 47352us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.538997 (+ 32424us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.572274 (+ 33277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.572330 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:06.572381 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.572448 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.572572 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1248281,"prepare.queue_time_us":74339,"prepare.run_cpu_time_us":154,"prepare.run_wall_time_us":2880,"raft.queue_time_us":1292917,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":9471,"spinlock_wait_cycles":219893888,"thread_start_us":181374,"threads_started":2,"wal-append.queue_time_us":195971}
I20260709 13:01:06.584978  1707 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:06.586005  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 48418.3us
W20260709 13:01:06.627507  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.587455  6014 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.563921  6026 consensus_queue.cc:1059] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:01:06.558069  6078 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:01:06.563484  5850 consensus_queue.cc:1059] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:01:06.515141  5901 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.537525  5962 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.637822  5962 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:06.601405  1706 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:06.591409  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:06.509109  6067 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.587116  5596 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.587476  5705 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.598274  6081 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:06.585647  6037 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.591010  5990 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:06.603844  5892 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:06.586947  1708 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:06.626696  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:06.628808  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:06.543030  6056 consensus_queue.cc:1059] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:01:06.585501  5924 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:06.662999  5924 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.663470  5924 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.629572  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:06.655611  6017 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.664959  1703 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:06.665002  6017 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.666477  1703 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:06.645802  6024 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:06.631275  5955 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.598511  5823 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:06.584363  6027 consensus_queue.cc:237] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:06.633410  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 145808us
I20260709 13:01:06.678391  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:06.679215  1559 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:06.683539  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:06.687716  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:06.674590  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 45849.8us
I20260709 13:01:06.690182  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:06.692030  1672 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:06.642781  6026 raft_consensus.cc:3055] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:06.645910  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:06.648648  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:06.713742  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:06.714511  1707 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:06.649600  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:01:06.651600  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 146573us
I20260709 13:01:06.657069  6016 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:06.630923  6043 consensus_queue.cc:1059] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:01:06.660144  1701 raft_consensus.cc:2376] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9. Re-sending same reply.
I20260709 13:01:06.661713  1708 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:06.645448  5982 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:06.608924  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:06.679062  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:06.699564  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:06.723300  1552 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:01:06.724172  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:06.725039  1559 raft_consensus.cc:2368] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10.
I20260709 13:01:06.700341  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:06.684376  1703 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:06.706424  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:06.673187  5990 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.708287  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:06.695837  5854 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.693850  5641 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:06.659770  6037 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:06.641544  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50188.6us
I20260709 13:01:06.674278  6086 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:06.700059  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:06.754927  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 54956.7us
I20260709 13:01:06.755239  1673 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:06.719452  6026 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:06.712049  5627 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:06.728178  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 78662.4us
I20260709 13:01:06.728902  1700 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 8: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:06.743633  1601 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:06.683308  6024 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:06.732862  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:06.772403  6041 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.772955  1673 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:06.773797  6045 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:06.774111  2325 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:06.733825  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:06.735493  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:06.747378  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:06.735572  1707 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:01:06.775331  2327 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:06.772181  6024 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.776463  2326 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 11. (index mismatch)
I20260709 13:01:06.749245  2324 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:06.719569  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:06.779001  1553 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:06.774273  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:06.757664  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:06.758512  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:06.780928  2328 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:01:06.769448  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:06.781468  1672 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:06.770900  1599 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:06.774288  5641 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:06.782446  2322 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.783133  5819 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:06.783723  5819 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.784466  5819 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.783672  5641 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.789147  6045 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:06.789896  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46395.4us
I20260709 13:01:06.790934  6013 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:06.791436  6013 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.792125  6013 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.791321  6041 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:06.794267  6041 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:06.797591  5942 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:06.797736  5993 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:06.798038  5942 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:06.798240  5993 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.798925  5993 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.799659  1673 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:06.799541  5942 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.800922  6041 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:06.801576  5942 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.722548  6017 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:06.721652  6067 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:06.805630  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:06.806746  6091 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:06.752110  5850 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:06.814316  2322 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
W20260709 13:01:06.814440  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 43644.5us
I20260709 13:01:06.736967  5990 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.751094  6016 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.815631  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.769129  5866 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:06.736265  6080 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:06.802767  6084 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:01:06.769928  5892 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.821699  1599 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:06.817277  5901 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:06.738983  6023 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:06.728156  5823 consensus_queue.cc:1059] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:01:06.829780  5854 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:06.808568  5861 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:01:06.769132  5893 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:01:06.831686  5947 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.849257  1672 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:06.837643  6080 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.807322  6064 consensus_queue.cc:1059] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:01:06.853010  1672 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:06.837815  6016 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.847241  5982 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.849231  5901 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:06.827111  6091 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.842792  5866 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.846737  5819 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.864405  5627 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:06.855196  6023 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:06.866256  5955 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:06.876930  5819 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:06.867903  5947 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:06.847929  6041 consensus_queue.cc:1059] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:01:06.878525  6041 raft_consensus.cc:3055] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:06.878974  6041 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:06.865713  5990 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:06.880123  6081 raft_consensus.cc:3055] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:06.880622  6081 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:01:06.873306  6088 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:01:06.881513  6081 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.854156  6080 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.883011  6081 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.877558  6051 consensus_queue.cc:1059] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:06.884421  6023 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:06.886166  6023 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:06.845460  6026 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.887283  6026 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.889125  6024 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:06.880156  6041 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.890184  6041 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.857167  6096 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:06.860786  5641 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:06.894309  2329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 1050) took 1958 ms (client timeout 1834 ms). Trace:
W20260709 13:01:06.897677  2329 rpcz_store.cc:269] 0709 13:01:04.935518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.935777 (+   259us) service_pool.cc:224] Handling call
0709 13:01:06.893998 (+1958221us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54006446d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:06.894128 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449364864}
I20260709 13:01:06.899590  5641 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:01:06.892541  6039 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 1.543s	user 0.005s	sys 0.000s
I20260709 13:01:06.900910  6016 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:06.894752  6037 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:06.893908  5901 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:06.903426  6082 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:01:06.903740  5641 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.902361  6080 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.912014  5866 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:06.913950  5705 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:06.906394  6091 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:06.915503  5924 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:06.903260  6013 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.917294  5894 raft_consensus.cc:3055] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:06.909286  6086 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:06.919785  6050 raft_consensus.cc:3055] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:06.922253  5894 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:06.926390  6050 raft_consensus.cc:740] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:06.893106  6096 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.927433  5892 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:06.928054  5894 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.926252  5924 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:06.928393  6050 consensus_queue.cc:260] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.932667  6050 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.937613  6096 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:06.938151  6013 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:06.926214  6080 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:06.938956  6086 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:06.939733  6023 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:07.011116  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.010582  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 163067us
W20260709 13:01:07.014647  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 222338us
I20260709 13:01:07.016034  1599 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:07.018888  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:07.019949  1601 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:07.034258  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:07.041599  1700 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:07.045745  1700 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:07.046878  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:07.047325  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:07.047690  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:07.047969  1703 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:07.049440  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:07.051085  1701 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 11: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:07.028694  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:07.052798  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:07.054041  1706 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 10: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:07.055784  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:07.068761  5853 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.070230  5853 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.073510  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:07.074491  5894 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.075599  5892 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.923499  5850 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:07.077525  6041 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:07.077095  5892 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.077178  6013 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.079483  6013 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.081285  5901 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:07.086763  5908 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:07.087635  5908 raft_consensus.cc:697] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:07.088807  5819 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:07.089425  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.092990  5822 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:07.095304  5534 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:07.097697  5823 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:07.098456  5823 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:07.103286  6023 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:07.081929  5901 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.117539  5908 consensus_queue.cc:237] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:07.120262  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.120810  6013 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:07.121857  5853 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:07.122897  5892 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:07.125731  1626 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:07.129029  1632 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:07.135651  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:07.138761  1632 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 11. (index mismatch)
W20260709 13:01:07.139251  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 288220us
I20260709 13:01:07.141608  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.144022  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.145186  1632 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:07.148620  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.149004  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.149180  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.149780  1629 raft_consensus.cc:2393] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 9: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:07.115727  5901 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:07.154721  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.162808  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.163810  1635 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:01:07.154727  6081 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.169431  6081 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:07.176011  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 93570.2us
I20260709 13:01:07.177364  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:07.178885  1706 raft_consensus.cc:2410] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:07.172362  6081 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:07.181385  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.191414  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:07.196738  1627 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.196882  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2285) took 2551 ms. Trace:
I20260709 13:01:07.197741  1628 rpcz_store.cc:276] 0709 13:01:04.642978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.644005 (+  1027us) service_pool.cc:224] Handling call
0709 13:01:04.644279 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.389859 (+745580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.191334 (+1801475us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54001bbf54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:07.194653 (+  3319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694337920}
I20260709 13:01:07.208563  1627 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
W20260709 13:01:07.210026  1709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 759) took 2266 ms (client timeout 1549 ms). Trace:
I20260709 13:01:07.212894  5993 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:07.214389  1709 rpcz_store.cc:269] 0709 13:01:04.943023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.943264 (+   241us) service_pool.cc:224] Handling call
0709 13:01:07.209580 (+2266316us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400255dd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:07.209809 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475049344}
I20260709 13:01:07.216885  5993 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:07.217262  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:07.218333  1706 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:07.219334  5830 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.222890  5951 raft_consensus.cc:3055] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:07.238394  5951 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:07.239940  5951 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.241113  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.241479  5951 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:07.243376  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:07.243654  6055 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.636s	user 0.000s	sys 0.004s
I20260709 13:01:07.244206  1626 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:07.245532  6058 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:07.246270  6079 raft_consensus.cc:3055] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:07.246630  1558 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:07.247471  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:33810 (request call id 917) took 2150 ms. Trace:
I20260709 13:01:07.100353  5823 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.247984  1558 rpcz_store.cc:276] 0709 13:01:05.097466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.097633 (+   167us) service_pool.cc:224] Handling call
0709 13:01:07.168818 (+2071185us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400160154. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a7ca3d 00007f0edea4ccd0 00007f0ed7fd1254 00007f0ed7fd11e2 00007f0ed7fd1111 00007f0ed7fd108c 00007f0ed7fd0342 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:07.247297 (+ 78479us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2442956544}
I20260709 13:01:07.223474  5901 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.225001  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.225955  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.228274  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:07.229425  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:07.230522  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.234022  5976 raft_consensus.cc:3055] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:07.236032  1560 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:07.262586  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60036 (request call id 89) took 2748 ms. Trace:
I20260709 13:01:07.231873  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:07.240376  1673 leader_election.cc:400] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10.
I20260709 13:01:07.266475  1673 leader_election.cc:403] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:01:07.265342  1634 rpcz_store.cc:276] 0709 13:01:04.453258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.453409 (+   151us) service_pool.cc:224] Handling call
0709 13:01:07.201424 (+2748015us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b54001b9c54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a8b735 00007f0ed9a839fa 00007f0edea4b4c9 00007f0ed7fc7c54 00007f0ed7fc7be2 00007f0ed7fc7b11 00007f0ed7fc7a8c 00007f0ed7fc6d42 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:07.201859 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2178478464}
I20260709 13:01:07.246160  6058 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:07.275305  1553 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:07.257443  6079 raft_consensus.cc:740] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:07.287009  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.296001  1559 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.297576  6058 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.299476  6058 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.265507  5976 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:07.270778  5894 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.312227  5894 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.314256  1707 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:07.314949  5894 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:07.316778  1552 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.324326  6013 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.324851  5641 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.325243  6013 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.329221  6079 consensus_queue.cc:260] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.331138  6079 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.331358  6013 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:07.336841  5521 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:07.337675  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:07.338325  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:07.338918  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:07.339116  2324 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:07.339874  1634 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:07.341537  5951 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:07.342569  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.342306  5976 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.345072  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:07.345737  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2708) took 2015 ms. Trace:
I20260709 13:01:07.346153  2328 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.346267  1702 rpcz_store.cc:276] 0709 13:01:05.330445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.115954 (+785509us) service_pool.cc:224] Handling call
0709 13:01:06.173504 (+ 57550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.174417 (+   913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.345207 (+1170790us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b5400397950. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:07.345497 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131123456}
I20260709 13:01:07.347579  1633 consensus_queue.cc:260] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.314069  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:07.348991  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 760) took 2403 ms. Trace:
I20260709 13:01:07.349375  1705 rpcz_store.cc:276] 0709 13:01:04.945372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.949070 (+  3698us) service_pool.cc:224] Handling call
0709 13:01:06.383162 (+1434092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.392574 (+  9412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.348507 (+955933us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54003ec1d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:07.348790 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3296876288}
I20260709 13:01:07.351876  5596 raft_consensus.cc:3055] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:07.352458  5596 raft_consensus.cc:740] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:07.333958  1445 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6325e0281aa547efa677c29cabdf5de4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8106dfc0bda54df0ae10ba13c28ccc18 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:07.338481  2326 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:07.354053  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:07.353943  5596 consensus_queue.cc:260] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.355134  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:07.355631  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:07.355829  2326 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:07.314013  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2672) took 1237 ms. Trace:
I20260709 13:01:07.356097  5847 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:07.356154  5372 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:07.357338  5372 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.359663  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:07.356374  1551 rpcz_store.cc:276] 0709 13:01:06.076008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.084284 (+  8276us) service_pool.cc:224] Handling call
0709 13:01:06.084553 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.168080 (+ 83527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.168137 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.168204 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:06.168261 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.313456 (+1145195us) spinlock_profiling.cc:243] Waited 83.1 ms on lock 0x7b54001d88d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:07.313522 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.313813 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191168896}
I20260709 13:01:07.359807  5372 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:07.362818  6014 raft_consensus.cc:3055] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:07.363355  6014 raft_consensus.cc:740] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:07.363948  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:07.365485  6056 raft_consensus.cc:3055] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:07.365881  5723 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.364576  6014 consensus_queue.cc:260] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:07.368287  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:07.369555  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:07.370172  6014 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.370561  2322 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:01:07.365932  6056 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:07.342419  5951 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.369618  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:07.335901  1559 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:07.353946  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:07.374271  1553 raft_consensus.cc:2393] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:07.376827  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:07.377085  1558 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:07.380715  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:07.381789  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 2685) took 1301 ms. Trace:
I20260709 13:01:07.378260  1633 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:07.382287  1555 rpcz_store.cc:276] 0709 13:01:06.080415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.081628 (+  1213us) service_pool.cc:224] Handling call
0709 13:01:07.381325 (+1299697us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54001c84d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:07.381560 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618833280}
I20260709 13:01:07.384024  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:06.299202   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:07.382102  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:07.355645  5596 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:07.345039  5976 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:07.394677  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:07.395231  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:07.394523  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:07.398759  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:07.402019  1702 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 5.
I20260709 13:01:07.351786  6026 consensus_queue.cc:1059] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:01:07.398924  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:07.405862  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:07.409003  1554 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 10: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:07.409993  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:07.410265  6026 raft_consensus.cc:3055] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:07.410703  6026 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:07.411911  6026 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.413887  1701 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:07.415876  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:07.410724  1554 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:07.418928  5641 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10.
I20260709 13:01:07.427285  5951 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:07.449848  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:07.437304  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:07.417774  6026 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.419459  6056 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.454128  6056 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:07.424791  1558 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.442849  1705 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:07.436931  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:07.438831  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.462369  1675 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:07.425125  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 185052us
I20260709 13:01:07.463408  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:07.464713  6013 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:07.465549  6013 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:07.467387  6104 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:07.406477  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:07.469135  6076 raft_consensus.cc:3055] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:07.469220  1551 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:07.469805  6076 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:07.471587  1634 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 10: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:07.471105  6076 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:07.472808  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.421538  1672 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:01:07.474514  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 53045us
W20260709 13:01:07.472818  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.475350  1672 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:07.452339  5372 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:07.477034  5372 raft_consensus.cc:3055] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:07.477224  1635 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:07.477475  5372 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:07.478404  5924 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:07.452615  6078 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:07.478960  5924 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.478495  5372 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.479509  5924 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.481238  5830 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:07.478988  6014 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:07.433573  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:07.479370  6078 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.487743  5901 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:07.488554  1554 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:01:07.428730  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 74956.1us
I20260709 13:01:07.491091  2288 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:07.493175  5810 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.493563  5970 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:07.495236  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:07.495564  5810 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.462661  1552 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
W20260709 13:01:07.496862  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.479287  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.498395  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:07.478946  1707 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:07.501979  2324 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:01:07.441727  1709 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:07.488008  6078 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:07.435519  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2673) took 1359 ms. Trace:
I20260709 13:01:07.507251  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:07.509994  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:07.514865  1559 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:07.516086  2325 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:07.496101  5810 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.518720  5810 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:07.521133  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.524830  5848 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:07.525187  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2684) took 1445 ms. Trace:
I20260709 13:01:07.525977  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:07.530682  1599 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:07.531250  5372 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.513512  1557 rpcz_store.cc:276] 0709 13:01:06.076309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.076462 (+   153us) service_pool.cc:224] Handling call
0709 13:01:06.091472 (+ 15010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.573399 (+481927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.435055 (+861656us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b5400028354. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:07.435337 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106791808}
W20260709 13:01:07.539363  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44196.3us
I20260709 13:01:07.506873  1555 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:07.540833  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:07.540921  1558 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:07.533099  5971 consensus_queue.cc:1059] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:07.538414  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.545570  2328 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:07.546264  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:07.556665  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.561973  2327 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:07.572989  2328 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:07.549104  5894 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:07.570170  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:07.549613  5521 raft_consensus.cc:2764] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:01:07.577896  1633 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:07.575079  1675 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:07.557873  5908 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:07.579432  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:07.580518  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:07.586684  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:07.586936  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.547499  5901 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 13:01:07.587913  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47755.6us
I20260709 13:01:07.587361  1630 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:01:07.568022  6079 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:07.583685  5894 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.593050  1709 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:07.594696  1705 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:07.592336  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:07.597013  1702 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:07.598133  5812 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:01:07.577698  6086 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:07.600773  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 824) took 1280 ms. Trace:
I20260709 13:01:07.601282  1633 rpcz_store.cc:276] 0709 13:01:06.314254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.314352 (+    98us) service_pool.cc:224] Handling call
0709 13:01:06.338606 (+ 24254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.346520 (+1007914us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b4c00369080. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed7d51a20 00007f0ed7d62a29 00007f0ed7d28644 00007f0ed7d4ff2d 00007f0ed7d4fb93 00007f0ed9a8018b 00007f0ed9a80cb5 00007f0ed9a7bf30 00007f0ed9a7d7de 00007f0ed9a87b49 00007f0ed9a88416
0709 13:01:07.582447 (+235927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.594727 (+ 12280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4711680}
I20260709 13:01:07.602353  5641 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:07.602985  5641 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.603392  5641 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.603916  1626 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:07.609957  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.610684  1630 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:07.525621  1556 rpcz_store.cc:276] 0709 13:01:06.080048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.083522 (+  3474us) service_pool.cc:224] Handling call
0709 13:01:06.083822 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:06.210852 (+127030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.210898 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:06.211681 (+   783us) log.cc:844] Serialized 52 byte log entry
0709 13:01:06.391490 (+179809us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:06.403463 (+ 11973us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.406364 (+  2901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.622862 (+216498us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b4800290358. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ede9aeaa1 00007f0ede9a5b37 00007f0ede9a59ca 00007f0edea9d26f 00007f0edea9cf37 00007f0edeab155c 00007f0edeab1508 00007f0edeab1488 00007f0edeab1443 00007f0edeab06ec 00007f0edd9daa96
0709 13:01:07.523571 (+900709us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b1800220300. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69662a6 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419
0709 13:01:07.524635 (+  1064us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54000569d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:07.524684 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.524763 (+    79us) raft_consensus.cc:1685] finished
0709 13:01:07.524776 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.525015 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4956,"prepare.queue_time_us":13011,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":38522,"raft.run_cpu_time_us":2938,"raft.run_wall_time_us":212324,"spinlock_wait_cycles":287058304,"thread_start_us":97912,"threads_started":1,"wal-append.queue_time_us":130861,"wal-append.run_cpu_time_us":3177,"wal-append.run_wall_time_us":1122956}
I20260709 13:01:07.618233  5924 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.621959  1675 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:07.623493  1675 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:07.625694  6041 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:07.626425  6041 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:07.626773  6041 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:07.627122  6041 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.628685  5894 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:07.629133  5641 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.630359  1673 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:07.631723  5641 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:07.631830  1673 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:07.632751  6023 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:07.633136  6023 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.633459  6023 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:07.636983  6076 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.637456  2328 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:07.586447  5892 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:07.641172  5892 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.643599  5892 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:07.644219  5641 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:07.645382  5848 consensus_queue.cc:1059] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:07.646260  6026 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.651505  6078 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.586889  5908 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:07.644270  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 52855.1us
I20260709 13:01:07.659267  1675 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:07.660463  1709 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:07.577698  5759 consensus_queue.cc:1059] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:01:07.592448  5853 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.671109  5853 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.674026  1601 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:07.674564  5853 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:07.676549  5947 raft_consensus.cc:3055] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:07.677011  5947 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:07.677274  2329 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:07.677965  5947 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.678551  1630 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:07.679430  5947 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.684818  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.677284  2323 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:07.691071  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:01:07.693747  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 280213us
I20260709 13:01:07.662566  5908 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:07.700747  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.706684  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:07.690186  5976 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.698114  6013 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:07.665894  6026 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:07.718297  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 59124.6us
W20260709 13:01:07.719347  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 211552us
I20260709 13:01:07.720027  1635 raft_consensus.cc:2393] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 15: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:07.729869  5372 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.730086  1630 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:07.710696  5924 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:07.738634  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:07.744730  1675 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:07.704907  5830 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:01:07.761439  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:07.719446  6101 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.719769  5993 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.749544  5372 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:07.753062  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.712081  6086 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:01:07.743348  6013 raft_consensus.cc:697] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:07.717164  6014 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:07.783838  5372 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:07.757447  2325 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:07.758356  1673 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:07.767869  1601 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:07.768790  1672 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:07.755987  5641 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:07.742516  5823 consensus_queue.cc:1059] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:01:07.749732  6056 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:01:07.793730  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.794391  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 60866.8us
I20260709 13:01:07.772468  6101 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.782686  5970 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.746968  5976 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:07.770635  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 129920us
I20260709 13:01:07.791419  1702 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
W20260709 13:01:07.797384  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.790656  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:07.802222  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:07.772795  5759 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:07.825362  5759 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.827755  5759 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:07.828888  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:07.829598  6079 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:07.830082  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.831549  6101 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:07.832134  5957 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:07.832144  6058 consensus_queue.cc:1059] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:07.832978  5957 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.835276  5957 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:07.835922  6014 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.838263  6014 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:07.839805  5810 raft_consensus.cc:3055] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:07.840210  5810 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:01:07.841200  6117 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:01:07.843027  1700 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:07.843415  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:07.844615  2324 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 12: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:01:07.845009  2323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 1053) took 2524 ms (client timeout 1514 ms). Trace:
W20260709 13:01:07.845448  2323 rpcz_store.cc:269] 0709 13:01:05.320257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.323227 (+  2970us) service_pool.cc:224] Handling call
0709 13:01:07.844789 (+2521562us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b54006ffc54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:07.844919 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5228337024}
I20260709 13:01:07.849968  5853 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.850741  5853 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.819499  5641 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:07.857110  5641 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:07.822314  2327 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:07.858085  5641 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.858728  6041 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.821059  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:07.861318  1707 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:01:07.820691  5924 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:07.864809  5924 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.865217  5924 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:07.868177  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.868630  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:07.869318  1705 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:07.869387  2288 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:07.871579  6086 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:07.871991  6086 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.872357  1701 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:07.872356  6086 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:07.878971  1601 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:07.881224  5812 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:07.823892  6083 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.881915  5812 raft_consensus.cc:697] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:07.881981  6083 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.883083  5812 consensus_queue.cc:237] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.823998  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.885037  6013 consensus_queue.cc:237] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.841274  5810 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.823354  1633 raft_consensus.cc:3055] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:07.888833  1633 raft_consensus.cc:740] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:07.824265  5970 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.819586  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:07.889781  5892 raft_consensus.cc:3055] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:07.890074  2322 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.890268  5892 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:07.891000  5970 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:07.891374  5892 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.881003  6102 consensus_queue.cc:1059] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:07.892817  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.893040  6078 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:07.893610  1628 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
W20260709 13:01:07.894891  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.895067  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:07.895610  2323 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:07.889797  1633 consensus_queue.cc:260] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.896909  1633 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:07.899437  5372 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:07.899887  5372 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:07.900683  5372 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.900966  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.902278  5372 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:07.903803  5894 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.904727  6083 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:07.904731  5970 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:07.909757  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:07.909843  6026 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:07.911000  6083 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:07.912187  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:07.888346  1523 connection.cc:256] RPC call timeout handler was delayed by -1.419548103000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
I20260709 13:01:07.802522  5828 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:07.914158  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.917807  1599 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:07.828269  5759 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:07.918115  2328 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:07.920065  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:07.914541  2322 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:07.922556  2323 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:07.917043  5828 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:07.913614  5848 consensus_queue.cc:1175] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" responder_term: 9 status { last_received { term: 9 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 9 index: 8 } }
I20260709 13:01:07.924566  6078 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:07.925146  6078 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:07.925685  6078 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:07.925334  5759 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.927922  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:07.928277  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:07.861596  6041 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:07.933306  1700 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:07.932565  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:07.924801  5828 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.941951  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:07.943866  5372 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:07.945153  1633 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:07.948741  5861 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:07.956398  1701 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:07.938417  5892 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:07.962445  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50402.3us
I20260709 13:01:07.955858  5861 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:07.975317  5372 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:07.975415  1523 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:07.979383  5861 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.980279  6121 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:07.984745  5372 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:07.988727  5960 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:01:07.989073  6122 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:07.990633  5976 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:07.992838  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:07.995196  6086 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:07.929492  5830 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:08.000906  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:07.937953  6023 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:08.008513  5848 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:07.964072  6120 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:08.011850  6078 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.015336  5892 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:08.021145  5759 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:07.992367  5894 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:08.020001  5908 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.999519  5853 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:08.028012  5848 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.981011  6121 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:07.989892  6122 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:08.040045  5759 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:08.050107  5759 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.051509  6121 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:08.044502  5848 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:08.052359  5759 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:08.046938  5853 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:08.045783  5894 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:08.037284  5924 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:08.039198  5892 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:08.037771  6120 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.166576  2328 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:08.166640  6023 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:08.168360  6120 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:08.175776  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 437995us
I20260709 13:01:08.172183  6086 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:08.178993  5924 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:08.185089  5908 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:08.188351  5810 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.162245  6083 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:08.192235  5828 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:08.192549  6078 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:08.195747  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 357374us
I20260709 13:01:08.132169  5894 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:08.219512  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.220042  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:08.221048  2327 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 12: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:01:08.222208  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 45568.9us
I20260709 13:01:08.175316  5976 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:01:08.221626  6102 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:08.237903  1675 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:08.234544  5892 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:08.247367  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.277480  1556 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:01:08.278918  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:08.282778  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47546.1us
I20260709 13:01:08.265355  5892 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.266956  5641 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:08.270143  6083 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.288614  1555 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:08.270494  6122 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:08.292081  1675 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:08.297730  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:08.298367  5892 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.302232  1675 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:08.297083  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 47251us
I20260709 13:01:08.308533  1672 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:08.310441  5894 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:08.312110  5892 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:08.309788  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 349054us
I20260709 13:01:08.318310  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:08.319609  6127 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.320087  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:08.321627  6127 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:08.323906  6131 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:08.330328  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:08.333025  5828 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:08.323415  6127 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:08.337489  6023 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:08.342780  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.343098  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:08.356308  5894 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:08.356422  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:08.335307  6013 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:08.309427  6122 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:08.363972  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 56414.2us
I20260709 13:01:08.368206  6041 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:08.368780  5924 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.369805  2322 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:08.371526  1523 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:08.357179  5894 raft_consensus.cc:697] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:08.375625  2323 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:08.361351  6131 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:01:08.300953  6083 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.382315  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:08.383113  6041 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:08.376132  6120 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:08.384323  6041 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.385643  6083 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:08.387493  6079 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:08.390906  5848 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.393280  2326 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:08.393359  6120 raft_consensus.cc:697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:08.395208  6120 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.382588  5894 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.407088  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:08.408905  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:08.409664  1558 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:01:08.409425  6130 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:08.411208  5641 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:08.412441  6125 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:08.412850  6125 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:08.413684  6125 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.414964  6125 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.417610  5848 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:08.404531  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.383273  1559 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:08.423504  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:08.424216  1631 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:08.424851  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.425064  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.426219  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:08.427021  1635 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:08.428130  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:08.431056  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:08.433276  1707 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:08.435171  1626 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 11. (term mismatch)
I20260709 13:01:08.372068  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:08.438392  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 66513.9us
W20260709 13:01:08.438690  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 74757.7us
I20260709 13:01:08.445676  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:08.435571  1626 pending_rounds.cc:85] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 10
I20260709 13:01:08.458089  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:08.459128  1702 raft_consensus.cc:2368] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
I20260709 13:01:08.457294  1626 pending_rounds.cc:107] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 13:01:08.462311  1626 raft_consensus.cc:2889] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:08.463619  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:08.464258  1632 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.462414  1701 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
W20260709 13:01:08.467410  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.463676  1526 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:08.428192  6083 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.469986  1627 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:08.457299  6138 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:08.475919  1630 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:08.427887  6143 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:08.479650  1601 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:08.483822  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:08.484745  1626 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:08.484944  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:08.486850  1601 leader_election.cc:400] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
I20260709 13:01:08.487243  1601 leader_election.cc:403] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:08.489295  1701 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:08.457546  6130 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.498245  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.511474  1705 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 8: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:08.511245  6130 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:08.513752  6130 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:08.498615  5823 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:08.516353  5823 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:08.517645  5823 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.522444  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:08.523180  1629 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:01:08.498518  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:08.524899  1701 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:08.501401  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:08.501426  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.509008  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.475208  6127 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.524245  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:08.526227  1703 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
W20260709 13:01:08.544891  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 43923.7us
I20260709 13:01:08.487440  6023 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.552013  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.496634  6078 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:08.477062  5908 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:01:08.561466  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.466593  6013 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:01:08.571230  1633 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:01:08.575124  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:08.592612  1627 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:08.491489  6014 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:01:08.576630  2328 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:01:08.541916  6143 raft_consensus.cc:697] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:08.497678  6083 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:08.561097  6078 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.582934  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.583593  1703 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:08.600658  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:08.601955  1558 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:08.594561  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:08.603544  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:08.621886  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.647131  1631 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:08.566330  6102 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:01:08.573315  5924 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:01:08.588469  6058 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.654979  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.650908  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:08.655571  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:08.654685  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 192667us
I20260709 13:01:08.565939  6023 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.658931  1703 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:08.659228  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:08.652143  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:08.659857  1627 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:08.660193  1631 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:08.661204  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:08.662186  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.662557  1631 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:08.607266  6078 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:08.559800  6127 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:08.654843  6105 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:01:08.666188  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 187493us
I20260709 13:01:08.666409  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:08.657938  1557 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:08.643610  6138 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:08.656373  1555 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:08.667178  1631 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:08.669415  1705 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:08.670550  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.672138  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:08.673101  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:08.674453  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:08.677706  1627 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 11: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:08.679337  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.680125  1707 raft_consensus.cc:2393] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 10: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:08.679840  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.688138  1635 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:08.667848  6138 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:08.680719  5853 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:08.693560  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.694036  1631 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:01:08.694126  1523 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:08.668056  6058 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:08.687227  6146 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.724838  6146 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.731071  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.724473  5908 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:08.733457  5908 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.734074  5908 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.691497  6013 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.715145  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:08.736889  1706 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:08.698527  5853 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:08.753561  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 48976.1us
I20260709 13:01:08.717187  1704 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 10. Ops: []
I20260709 13:01:08.717643  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.719056  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.719267  6083 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:08.719384  1458 catalog_manager.cc:5697] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
W20260709 13:01:08.722177  1454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57414 (request call id 191) took 22908 ms (client timeout 15000 ms). Trace:
I20260709 13:01:08.722898  6127 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:08.698509  6122 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:01:08.728259  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:08.741501  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:08.762095  1707 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 11: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:08.742336  1626 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:08.763116  1628 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:08.761574  2328 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:08.695785  5894 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:08.692929  6138 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:08.753489  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:08.767069  2326 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:08.765714  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:08.759572  1703 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:01:08.765192  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:08.767755  1553 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:08.726704  6023 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:08.756522  6014 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.757356  5853 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:08.782321  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 88306.8us
I20260709 13:01:08.754264  6146 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:08.761854  6102 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.782923  2288 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:08.757019  6129 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:08.735544  6013 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.788055  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:08.778340  5908 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:08.759057  1454 rpcz_store.cc:269] 0709 13:00:45.813583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.816998 (+  3415us) service_pool.cc:224] Handling call
0709 13:01:08.721934 (+22904936us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:59.793777 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:59.794827 (+  1050us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:59.794915 (+    88us) write_op.cc:435] Acquired schema lock
0709 13:00:59.794947 (+    32us) tablet.cc:662] Decoding operations
0709 13:00:59.797717 (+  2770us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:59.798812 (+  1095us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:59.800288 (+  1476us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:00:59.806731 (+  6443us) tablet.cc:701] Row locks acquired
0709 13:00:59.806784 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:00:59.806953 (+   169us) write_op.cc:270] Start()
0709 13:00:59.807115 (+   162us) write_op.cc:276] Timestamp: P: 1783602059806884 usec, L: 0
0709 13:00:59.807153 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:00:59.816409 (+  9256us) log.cc:844] Serialized 8323 byte log entry
0709 13:01:00.386724 (+570315us) op_driver.cc:464] REPLICATION: finished
0709 13:01:00.537015 (+150291us) write_op.cc:301] APPLY: starting
0709 13:01:00.537120 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:00.687503 (+150383us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:00.687589 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:01.938268 (+1250679us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:01.938890 (+   622us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:01:01.938967 (+    77us) write_op.cc:312] APPLY: finished
0709 13:01:01.939604 (+   637us) log.cc:844] Serialized 188 byte log entry
0709 13:01:02.089723 (+150119us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:02.107040 (+ 17317us) write_op.cc:454] Released schema lock
0709 13:01:02.141067 (+ 34027us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:02.917771 (+776704us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b180043f7e0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6998522 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:01:02.923494 (+  5723us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:02.925684 (+  2190us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1613701,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":147488,"apply.run_cpu_time_us":88710,"apply.run_wall_time_us":1614260,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91781,"num_ops":21,"prepare.queue_time_us":49111,"prepare.run_cpu_time_us":26100,"prepare.run_wall_time_us":43294,"raft.queue_time_us":235861,"raft.run_cpu_time_us":15477,"raft.run_wall_time_us":109695,"replication_time_us":569961,"spinlock_wait_cycles":23149440,"thread_start_us":420034,"threads_started":5,"wal-append.queue_time_us":226800,"wal-append.run_cpu_time_us":44112,"wal-append.run_wall_time_us":2773835}]]}
I20260709 13:01:08.798799  6043 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:08.736518  6143 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.804781  6078 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:08.805953  1700 raft_consensus.cc:2410] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:01:08.811359  1701 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:01:08.814541  1707 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:08.814653  1632 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:08.826675  1629 raft_consensus.cc:2368] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 8. Current term is 9.
I20260709 13:01:08.829133  6058 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:01:08.784369  6014 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:08.832804  5938 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:08.833421  5938 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:08.833550  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.833890  5938 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:08.834831  6014 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:08.827732  6129 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.839108  6129 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:08.827925  5861 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
I20260709 13:01:08.844836  6013 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:08.840623  6158 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:01:08.846215  6149 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.172s	user 0.002s	sys 0.000s
I20260709 13:01:08.848515  1706 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:01:08.827479  6086 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:01:08.836400  1458 catalog_manager.cc:5697] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:08.850061  2288 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:08.855755  1555 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
W20260709 13:01:08.857779  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 47993us
I20260709 13:01:08.858526  1523 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:08.807853  6102 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:08.860981  6043 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:08.878726  1523 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:08.862694  6125 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.863184  6078 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:08.864953  6122 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.887248  6146 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.889335  6164 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:08.891273  6164 raft_consensus.cc:697] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:08.892294  6164 consensus_queue.cc:237] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.895632  5641 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:08.896138  5641 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:08.896790  5372 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:08.897392  6102 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:08.884408  6043 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:08.899761  6043 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:08.903962  1523 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:08.906680  6122 raft_consensus.cc:2764] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Leader election decision vote started in defunct term 9: won
I20260709 13:01:08.906762  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:08.907618  1553 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:08.908030  1557 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:08.909981  1675 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:08.910976  1675 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:08.911769  1675 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:08.912676  1675 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:08.914011  1675 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:08.914763  6023 raft_consensus.cc:2764] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:01:08.915540  6023 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:08.886773  6125 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:08.885156  1458 catalog_manager.cc:5697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 2 to 5, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:08.929111  1553 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:08.917176  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.933670  6014 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:08.934222  6014 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.933856  6138 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:08.934602  6014 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.935199  6125 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:01:08.936005  6138 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:08.936910  6145 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:08.936975  6167 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:08.937631  6145 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:08.944193  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.953039  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:08.953845  1632 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:08.956717  1675 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:08.889189  6146 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:08.961778  1626 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:01:08.965484  1553 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 8. Current term is 10. Ops: []
I20260709 13:01:08.944489  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:08.974067  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:09.049156  1707 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:09.049078  1704 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:09.103183  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:09.104167  1632 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:09.105077  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:09.112071  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:09.116262  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:09.137319  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.138033  1553 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:01:09.141181  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:09.148934  1707 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:09.150672  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:09.151454  1704 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:09.150441  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:09.111790  5960 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.102183  6079 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.165578  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.150111  5970 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.140827  5812 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.102854  6167 raft_consensus.cc:697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:09.147126  5908 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:09.161366  6127 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.166358  6131 raft_consensus.cc:2764] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:09.169322  6120 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:09.194525  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.200224  6146 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:09.174857  6176 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:09.180512  6122 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:09.201026  6176 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.201200  6122 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:09.201627  6176 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.201717  6122 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.207921  6167 consensus_queue.cc:237] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:09.215204  6162 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:01:09.212224  6127 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.219026  6127 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:09.219283  1703 raft_consensus.cc:1275] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:09.222518  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.223500  1556 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:09.183871  5641 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.225073  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.225963  1559 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:09.226169  5641 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:09.233618  1552 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:09.237383  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.238336  1552 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:09.240302  1558 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:01:09.240953  1558 pending_rounds.cc:85] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 8
I20260709 13:01:09.241339  1558 pending_rounds.cc:107] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:01:09.195102  6145 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.243135  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:09.244728  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.187637  6079 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.152400  5853 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.241640  1558 raft_consensus.cc:2889] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:09.189662  6058 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:09.248852  1634 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 10: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:09.189211  6129 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:09.250398  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.256016  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:09.195891  5812 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.261526  5812 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:09.190150  5970 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.262428  6129 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.264117  5970 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:09.264683  6129 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:09.265050  1555 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:09.266060  5853 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:09.270167  6079 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:09.253592  6058 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.272632  6058 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:09.196218  5908 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.274736  5908 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:09.180707  5960 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:09.276986  6166 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.440s	user 0.004s	sys 0.007s
I20260709 13:01:09.281050  5960 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:09.256987  1559 raft_consensus.cc:2376] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11. Re-sending same reply.
I20260709 13:01:09.284673  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.305656  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.178380  6023 raft_consensus.cc:697] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:09.298113  1704 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:09.352478  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:09.357713  5372 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:09.358191  5372 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:09.358577  5372 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:09.360792  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.361676  1553 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 6.
I20260709 13:01:09.366019  6043 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.366659  6043 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.366827  6176 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.369661  6043 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:09.370893  6176 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:09.373107  6023 consensus_queue.cc:237] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.390311  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.391067  1553 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
W20260709 13:01:09.396972  1709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.006s	sys 0.004s
W20260709 13:01:09.397322  1709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.006s	sys 0.004s
I20260709 13:01:09.398111  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:09.399271  1559 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:09.359699  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 209310us
I20260709 13:01:09.401090  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:09.402437  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:09.408430  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:09.408699  2286 leader_election.cc:336] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.620s (SENT)
I20260709 13:01:09.410094  5372 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.347812  6122 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.415704  5372 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:09.417879  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.414465  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.409261  2286 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:09.415962  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 52128.5us
I20260709 13:01:09.395843  5641 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.413689  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.426644  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.426831  1558 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:09.427429  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:09.428251  1551 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:09.410558  6164 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:09.432508  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.425905  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:09.425980  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:09.439925  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.422070  6143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.019s	sys 0.007s
I20260709 13:01:09.452924  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:09.432080  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:09.457461  1707 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:09.457643  1560 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.423256  5892 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:09.420274  5960 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.459445  5908 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.460276  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:09.464869  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.465677  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.460318  5812 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:09.474202  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:09.432541  6043 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:09.480227  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.480422  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.483198  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.483855  5372 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.484387  5372 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.485805  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:09.458329  6143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.020s	sys 0.007s
I20260709 13:01:09.438068  6164 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:09.492462  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.488840  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:09.493139  1552 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:09.493417  1555 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:09.496834  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:09.506279  5372 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:09.500133  1626 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:01:09.475900  6129 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:09.509369  5372 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:09.474912  6125 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:09.439499  5641 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.479207  5812 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.515357  1599 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:09.513545  5372 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.479431  5892 raft_consensus.cc:697] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:09.582002  5892 consensus_queue.cc:237] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.582821  6143 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:09.583567  6143 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.494587  5960 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.585913  6143 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:09.587883  5960 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:09.508087  6086 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:01:09.546912  5938 consensus_meta.cc:287] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.000s
I20260709 13:01:09.695735  5938 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.697911  5938 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:09.531103  6129 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.700083  6129 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:09.550187  6014 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.002s
I20260709 13:01:09.700982  6014 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.702993  6014 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:09.551116  6122 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:09.551765  1560 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:09.496726  6164 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:09.704725  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:09.704850  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:09.705382  2324 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:09.705466  1560 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.707553  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:09.708214  2326 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
W20260709 13:01:09.521353  6174 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:01:09.553920  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.710508  1556 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:09.710563  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.711386  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.711621  1557 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:09.555938  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:09.487186  5908 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.713199  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:09.714008  2326 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:09.714869  5908 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:09.715160  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:09.715551  5908 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:09.561507  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 46288.8us
I20260709 13:01:09.718140  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:09.562501  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.718677  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:09.719022  1552 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 4.
I20260709 13:01:09.719202  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:09.719513  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:09.720055  1557 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:09.721472  6102 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:09.721571  5976 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:09.721957  6102 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.722090  5976 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:09.722373  6102 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.722563  5976 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:09.723284  1445 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6325e0281aa547efa677c29cabdf5de4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8106dfc0bda54df0ae10ba13c28ccc18 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:09.724910  1558 raft_consensus.cc:2410] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:09.726830  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.727545  1557 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:09.728015  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:09.713232  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 157351us
I20260709 13:01:09.729835  5976 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.730506  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:09.730981  6102 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.731899  6180 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:09.732319  6180 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.734768  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:09.735507  2326 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.737975  6180 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.740720  5976 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:09.741999  1673 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:09.742942  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:09.743708  2321 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.744167  6129 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:09.720203  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.745033  1552 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:01:09.746079  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.747255  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.747929  1552 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:09.750797  1626 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:09.563396  5861 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:09.752331  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:09.752903  5861 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.753211  1633 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 6.
I20260709 13:01:09.753444  5861 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.753651  2321 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:09.754730  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:09.755517  5960 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:09.756165  5960 raft_consensus.cc:697] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:09.757081  5960 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.566252  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 788) took 1014 ms. Trace:
I20260709 13:01:09.758487  1700 rpcz_store.cc:276] 0709 13:01:08.551605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.551736 (+   131us) service_pool.cc:224] Handling call
0709 13:01:09.565954 (+1014218us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54003d9fd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:09.566136 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570533632}
I20260709 13:01:09.569432  5971 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.569590  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2325) took 1103 ms. Trace:
I20260709 13:01:09.571173  1706 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:01:09.574497  6041 raft_consensus.cc:3055] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:09.600816  1559 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:01:09.763271  1599 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:09.604735  6125 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.604559  5812 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.610689  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 789) took 1058 ms. Trace:
I20260709 13:01:09.774825  1705 rpcz_store.cc:276] 0709 13:01:08.551938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.552083 (+   145us) service_pool.cc:224] Handling call
0709 13:01:08.565759 (+ 13676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.669937 (+104178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.606274 (+936337us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540012cfd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:09.610600 (+  4326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237774080}
I20260709 13:01:09.613575  5641 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:09.538086  6172 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:01:09.621313  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.623739  6043 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.633399  1675 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:09.807765  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 174462us
I20260709 13:01:09.634199  6184 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:09.637651  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:09.640036  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:09.824229  1705 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:09.642071  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:09.824874  1707 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:09.763322  1601 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:09.824265  1702 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
W20260709 13:01:09.826894  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 63657.4us
I20260709 13:01:09.646126  5372 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:09.828547  1601 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:09.829012  5372 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:09.829686  6185 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:09.654636  1672 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:01:09.681911  6178 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260709 13:01:09.833534  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 90232.3us
I20260709 13:01:09.684212  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:09.836900  1704 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 5.
W20260709 13:01:09.687456  6171 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.179s	user 0.000s	sys 0.004s
I20260709 13:01:09.712973  1560 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:09.761098  1628 rpcz_store.cc:276] 0709 13:01:08.466464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.466830 (+   366us) service_pool.cc:224] Handling call
0709 13:01:08.762874 (+296044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.765413 (+  2539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.569323 (+803910us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b5400247a50. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:09.569516 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636365056}
I20260709 13:01:09.688053  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2724) took 1207 ms. Trace:
I20260709 13:01:09.767158  1599 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:09.712512  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.837715  1629 rpcz_store.cc:276] 0709 13:01:08.480880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.523992 (+ 43112us) service_pool.cc:224] Handling call
0709 13:01:09.687828 (+1163836us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b5400246b54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:09.687967 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652891392}
I20260709 13:01:09.838414  1560 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:09.839243  1556 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:09.839169  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:09.840400  1673 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:09.771637  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:09.760092  5971 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:09.772487  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:09.772997  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:09.773491  6179 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:09.773744  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:09.859608  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:09.774012  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:09.776386  1551 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:09.766191  6041 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:09.783563  2326 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
W20260709 13:01:09.815572  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.816795  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 361922us
I20260709 13:01:09.871140  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:09.728405  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:09.836719  6086 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:09.842624  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:09.771024  1555 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:09.845546  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:09.844331  1701 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:09.876312  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 109228us
W20260709 13:01:09.857936  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 203381us
I20260709 13:01:09.774471  6125 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:09.777901  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:09.862582  1552 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:01:09.883630  1633 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.777292  6102 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:09.877877  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:09.878595  1708 raft_consensus.cc:2368] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:01:09.879172  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:09.881886  1709 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 5: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:09.882491  1672 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:09.933002  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 50624.7us
I20260709 13:01:09.883719  1552 pending_rounds.cc:85] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 5
I20260709 13:01:09.934912  1552 pending_rounds.cc:107] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:01:09.935223  1552 raft_consensus.cc:2889] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:09.865365  5971 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:09.874334  6176 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:09.844095  6043 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:09.943053  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 63960.5us
I20260709 13:01:09.823531  5938 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:09.895449  5823 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:09.859455  6179 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.874193  5894 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:09.874292  6023 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:09.899097  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46071.5us
I20260709 13:01:09.899195  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:09.901335  5901 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:09.947332  6086 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:09.953158  5901 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.955821  5901 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:09.901957  5976 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:09.856907  6078 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:09.890300  6041 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.857021  5641 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:09.995952  5641 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.996335  5641 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.944986  6102 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:10.001439  6102 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:09.947263  6179 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:09.950363  6198 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:01:09.945312  5861 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:10.009897  5976 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:10.011108  5976 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.012301  1626 raft_consensus.cc:2368] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12.
I20260709 13:01:09.949565  6023 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.944900  5970 consensus_queue.cc:1059] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:09.952418  6195 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:09.936287  6176 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:09.958281  5947 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:09.901858  1599 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:09.942596  6129 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:09.960628  6043 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:09.960850  2324 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
W20260709 13:01:09.961879  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.949479  5938 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:09.988116  1633 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:09.993196  6078 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.995136  6041 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.995494  5993 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:10.011693  5861 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:09.869174  6185 raft_consensus.cc:697] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:10.013512  5894 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:10.016764  6023 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:10.027285  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 125491us
I20260709 13:01:10.021771  6176 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.071115  5970 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.079857  1599 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:10.022447  6129 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.022616  5947 consensus_queue.cc:1243] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:01:10.022819  6195 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:10.030447  6078 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.089942  5372 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:10.058045  6058 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:10.086786  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:10.093326  2326 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:10.096138  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:10.081097  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 241966us
I20260709 13:01:10.090798  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:10.097506  2286 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:01:10.098069  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 227010us
I20260709 13:01:10.098199  2322 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:10.087477  6129 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.108424  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:10.117638  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:10.118114  2321 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:10.118526  2326 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:10.118496  2328 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:10.120631  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:10.121409  1555 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 4.
I20260709 13:01:10.122766  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:10.122205  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:10.116348  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:10.124022  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:10.124639  1552 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:10.125702  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:10.123878  5372 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:10.129330  2329 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 11: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:10.129922  1551 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:10.078773  5993 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.131837  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:10.092927  6058 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.146238  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:10.130983  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 178396us
I20260709 13:01:10.151583  2326 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:01:10.087109  5970 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.262115  1526 leader_election.cc:400] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
W20260709 13:01:10.214031  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 116580us
I20260709 13:01:10.278692  2286 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:10.259703  1598 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:10.262548  5372 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.268712  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:10.154090  2327 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 11: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:10.259109  2321 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:10.258701  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:10.279974  5372 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:10.218623  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 91693.7us
I20260709 13:01:10.268936  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:10.275648  1709 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:10.277419  1526 leader_election.cc:403] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:01:10.214510  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:10.282127  2328 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
W20260709 13:01:10.273754  6180 consensus_meta.cc:287] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.004s
I20260709 13:01:10.282984  2326 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:10.286271  1708 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:10.227008  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:10.150125  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:10.284710  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:10.217744  1551 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:10.126861  6198 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:10.294957  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.017s	sys 0.039s
W20260709 13:01:10.300806  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.017s	sys 0.039s
I20260709 13:01:10.117298  6102 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.133167  6177 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:10.226446  6164 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 13:01:10.129415  6167 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.304013  2286 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:10.128963  6126 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:10.258738  5924 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:10.335255  6125 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:10.282971  6043 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:10.263355  6207 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:01:10.335258  2329 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:10.334266  1601 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:10.341986   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:10.395135  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.397717  2328 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.284075  6058 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:10.133070  6185 consensus_queue.cc:237] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:10.345168  6201 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:10.303916  6180 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.434111  6176 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.354283  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:10.392134  6164 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:10.436534  6176 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:10.438059  6164 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:10.392068  6125 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.439374  6125 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.346454  6086 raft_consensus.cc:3055] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:10.440757  6086 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:10.441682  6086 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.442667  6086 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.443641  6023 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.357507  5372 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:10.358629  6205 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:01:10.364486  6202 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:01:10.391027  6209 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:01:10.215103  5812 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.464337  5812 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:10.367645  6206 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:10.465201  6206 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:10.465667  6206 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.370882  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:10.467674  1635 raft_consensus.cc:2368] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:01:10.469069  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:10.469841  1635 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:10.282552  6184 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:10.379604  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:10.383389  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 126479us
I20260709 13:01:10.470744  6184 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:10.471915  1627 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:10.368379  6215 raft_consensus.cc:2764] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:10.386795  2326 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:10.302136  6198 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:10.227761  6143 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.153s
I20260709 13:01:10.372347  6145 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:10.287967  6195 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.391945  1552 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
W20260709 13:01:10.413422  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 79320.6us
W20260709 13:01:10.414800  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 110840us
I20260709 13:01:10.506740  2286 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:10.415179  5894 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:10.415263  5993 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:10.417691  6212 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.134s	user 0.004s	sys 0.000s
I20260709 13:01:10.520576  1526 leader_election.cc:400] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 8. Current term is 9.
I20260709 13:01:10.520979  1526 leader_election.cc:403] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:10.423465  6078 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:10.385499  5908 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:10.424423  5901 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.389655  6177 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.394413  6167 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.427707  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:10.393373  6043 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.428773  5970 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:10.434574  6180 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:10.346066  6211 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.356902  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:10.581264  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:10.581576  1634 raft_consensus.cc:2393] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 10: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:10.581846  1702 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.526950  5812 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.447631  6179 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:10.436636  1553 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
W20260709 13:01:10.449621  6200 log.cc:927] Time spent T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:01:10.450263  1631 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
W20260709 13:01:10.598765  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 303776us
I20260709 13:01:10.460934  2328 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:10.469671  5641 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:10.473198  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:10.288264  5861 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:10.477943  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:10.480118  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:10.474406  6176 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:10.394059  5924 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:10.488097  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:10.492919  5853 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:10.494041  6125 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:10.509219  5372 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.510547  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:10.607156  5372 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:10.500599  1672 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:39387 timed out after 1.657s (SENT) [suppressed 14 similar messages]
I20260709 13:01:10.398358  5938 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:10.512028  1675 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:10.608779  1705 raft_consensus.cc:2368] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10.
I20260709 13:01:10.511822  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:10.515977  1708 raft_consensus.cc:1275] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:10.609692  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:10.610277  1599 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:10.523232  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:10.530771  1526 leader_election.cc:400] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:01:10.473695  5823 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:10.611846  1627 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.612026  5823 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.473265  6184 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:10.617736  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 89156.3us
I20260709 13:01:10.619436  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:10.620438  6180 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.621399  1627 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:10.544653  2286 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:10.631003  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:10.492081  6058 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.573391  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:10.521782  6145 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:10.543509  6014 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.074s	sys 0.110s
I20260709 13:01:10.579418  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:10.580268  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 295610us
I20260709 13:01:10.524999  6215 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:10.404713  6208 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:10.399235  6126 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.511524  6041 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:01:10.499255  6209 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:01:10.543469  5894 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 8. Current term is 9.
I20260709 13:01:10.603400  5812 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.580848  6164 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.617024  6184 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:10.500154  6198 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.625046  6167 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:10.625483  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:10.626873  1632 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:10.626629  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:10.577157  6043 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.628122  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:10.634372  1705 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:01:10.555423  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 405317us
I20260709 13:01:10.635519  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:10.635800  2324 raft_consensus.cc:2368] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:10.636472  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:10.548614  5908 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:10.639401  1704 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:10.694410  1629 raft_consensus.cc:2368] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10.
I20260709 13:01:10.640051  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:10.695766  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 55787.5us
I20260709 13:01:10.638062  6207 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:01:10.606457  5861 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.643925  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2242) took 1227 ms. Trace:
I20260709 13:01:10.713464  1553 rpcz_store.cc:276] 0709 13:01:09.416719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.417573 (+   854us) service_pool.cc:224] Handling call
0709 13:01:10.643758 (+1226185us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001d8dd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:10.643869 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340774144}
I20260709 13:01:10.607079  5960 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:10.656147  1559 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:10.656991  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:10.718026  1554 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.657891  1702 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:10.576418  5901 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.662696  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:10.639184  6014 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.078s	sys 0.110s
I20260709 13:01:10.659512  6215 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:10.722131  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:10.723089  1704 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 10: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:01:10.665118  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 120579us
I20260709 13:01:10.635957  6182 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:10.599932  6211 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.671170  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:10.685428  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:10.685707  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 59164.6us
I20260709 13:01:10.687963  1709 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:10.691562  1705 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:10.643242  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:10.635983  6176 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:10.687906  6184 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:10.715591  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:10.719342  1551 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:10.756631  1706 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.732052  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:10.695322  6143 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:10.759919  1559 raft_consensus.cc:1275] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:01:10.734840  2286 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:10.745683  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:10.760751  1553 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.746042  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:10.746757  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:10.714447  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:10.758538  1701 pending_rounds.cc:85] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 12
I20260709 13:01:10.716509  5861 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.710278  5970 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:10.767230  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:10.762178  1701 pending_rounds.cc:107] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:01:10.768010  1556 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.768337  1701 raft_consensus.cc:2889] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:10.761893  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 261300us
I20260709 13:01:10.678575  6164 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:10.764847  1627 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:10.722196  6215 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:10.779371  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:10.783216  1627 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:01:10.780472  2323 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:10.726711  5894 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:10.789629  1634 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:10.761165  6023 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:10.759325  6182 raft_consensus.cc:697] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:10.797672  2324 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:10.760151  6143 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.780196  5853 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:10.733551  6167 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
W20260709 13:01:10.798694  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 106279us
I20260709 13:01:10.762977  6219 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.802232  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:10.797776  1706 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:10.781575  6083 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.785409  6215 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:10.766834  6213 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:01:10.828389  1709 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
W20260709 13:01:10.840903  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 328878us
I20260709 13:01:10.842152  1675 leader_election.cc:400] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12.
I20260709 13:01:10.845329  1675 leader_election.cc:403] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:10.814811  6143 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.815270  6041 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.820286  5828 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.919303  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:10.915875  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 73919.1us
W20260709 13:01:10.921535  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 174854us
I20260709 13:01:10.905975  1553 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:10.822717  5970 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:10.923180  1526 leader_election.cc:400] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10.
I20260709 13:01:10.923576  1526 leader_election.cc:403] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:01:10.800457  5894 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:10.826043  5853 raft_consensus.cc:697] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:01:11.032099  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 297272us
I20260709 13:01:10.863962  5641 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
W20260709 13:01:10.974282  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 51193.7us
I20260709 13:01:11.038705  1627 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:11.030944  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.864694  6023 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.918107  6184 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:10.833530  6083 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:11.066818  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 243731us
I20260709 13:01:10.974107  5892 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.069115  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:10.967608  6125 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:11.015497  6211 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:10.925266  6177 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:11.052037  6145 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:10.851217  6219 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.062934  5970 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:11.059929  5924 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:10.924840  6041 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:10.970158  6231 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:11.065085  6023 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.114130  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:11.071904  6014 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12.
I20260709 13:01:11.142628  1634 raft_consensus.cc:1275] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:10.966107  5828 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.071138  5641 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.091634  6214 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.383s	user 0.000s	sys 0.001s
I20260709 13:01:11.071715  6126 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:11.050767  6227 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
W20260709 13:01:11.129423  6221 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:01:11.130366  5908 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:11.130832  6226 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
W20260709 13:01:11.131932  6224 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:01:11.132828  6222 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 13:01:11.141630  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 160091us
I20260709 13:01:11.145366  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:11.145593  5853 consensus_queue.cc:237] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.164494  6240 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:11.185535  6240 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.147185  5894 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.147354  5861 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.152065  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:11.187989  6240 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:11.188167  1633 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:11.189152  5828 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:11.189952  5861 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:11.191262  5894 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:11.191882  5894 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.193686  5908 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:11.194322  5894 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.194396  5908 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:11.197283  6220 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.380s	user 0.001s	sys 0.000s
I20260709 13:01:11.201648  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2337) took 1439 ms. Trace:
I20260709 13:01:11.202158  1632 rpcz_store.cc:276] 0709 13:01:09.762287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.762595 (+   308us) service_pool.cc:224] Handling call
0709 13:01:11.201417 (+1438822us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b5400205654. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:11.201578 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769079680}
I20260709 13:01:11.204804  6179 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.125936  6177 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:11.205750  6129 consensus_meta.cc:287] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.991s	user 0.011s	sys 0.001s
I20260709 13:01:11.205860  6177 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.206540  6177 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.206296  6129 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.207548  1705 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:11.163297  6176 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:11.123056  5970 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:11.166826  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:11.221720  1703 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 11: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:11.166920  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:11.222643  1704 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:11.169595  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:11.126477  6167 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:01:11.054723  6182 consensus_queue.cc:237] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.171660  6164 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.136471  6145 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:01:11.182981  6242 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:11.164870  5641 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.183948  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:11.238437  2328 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.216279  1554 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:11.217927  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:11.243412  1558 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.219718  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:11.220297  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:11.244050  2326 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:11.227180  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 148623us
W20260709 13:01:11.213181  6180 consensus_meta.cc:287] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.001s
I20260709 13:01:11.231249  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:11.233099  1526 leader_election.cc:400] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10.
I20260709 13:01:11.189999  6239 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:11.208539  6129 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:11.226107  5970 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.236250  6209 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:11.260244  1673 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:11.262667  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:11.267987  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:11.271011  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:11.272346  1559 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 10: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:11.273375  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:11.274098  2323 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:11.144043  6231 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.237147  6126 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.234082  5894 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:11.309322  2328 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:11.284408  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:11.265569  6180 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:11.325057  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:11.281090  6176 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:11.273689  6240 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:01:11.350934  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:11.306416  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:11.308787  1556 consensus_meta.cc:287] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.009s
I20260709 13:01:11.284832  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:11.353060  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:11.348760  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:11.354344  1555 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.302171  6232 raft_consensus.cc:476] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Not starting pre-election -- already a leader
W20260709 13:01:11.355400  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 332926us
I20260709 13:01:11.359813  1559 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
W20260709 13:01:11.360472  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.360913  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:11.356402  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 319110us
I20260709 13:01:11.340719  1672 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:11.325114  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:11.361681  1705 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:11.325937  2328 raft_consensus.cc:2368] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:11.263752  6227 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.362931  6227 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.363471  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:11.338964  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:11.348832  1558 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:11.364971  1557 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.352432  1556 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:11.316390  2326 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:11.364998  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:11.274945  6185 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:01:11.370677  2288 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:11.357403  1523 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:11.372326  1555 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 6.
I20260709 13:01:11.345194  6129 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:11.348315  6233 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.381523  1672 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:11.382081  5372 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:11.383029  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:11.381178  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:11.255422  6242 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.402500  1672 leader_election.cc:400] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:11.340045  5894 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.349711  5924 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:01:11.413546  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:11.337060  6126 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.405550  1672 leader_election.cc:403] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:11.410004  1557 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:11.379724  5901 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:11.425209  6238 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:01:11.427357  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:11.428670  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:11.429309  1628 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
W20260709 13:01:11.431841  6215 consensus_meta.cc:287] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.000s
I20260709 13:01:11.433732  6231 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:11.437548  6206 consensus_meta.cc:287] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.971s	user 0.013s	sys 0.000s
I20260709 13:01:11.438236  6206 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.448872  6219 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.408738  6041 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:11.415625  5823 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:11.454306  6251 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.455250  6251 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.460793  2321 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.412473  6023 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:11.378720  6195 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:01:11.414364  1632 raft_consensus.cc:2368] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:01:11.383888  6176 raft_consensus.cc:697] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:11.275444  6239 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.418335  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:11.391351  6207 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.423830  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:11.424206  6249 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:11.424644  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:11.425067  6242 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:11.414062  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:11.478116  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 107519us
W20260709 13:01:11.525470  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 179045us
I20260709 13:01:11.526516  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:11.526731  1523 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:11.499881  2325 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:11.479346  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:11.480540  2321 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:11.408704  6145 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:11.536413  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:11.393085  6129 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:11.488356  6102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.012s
I20260709 13:01:11.543345  1523 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:11.544971  1523 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:11.545851  1672 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:01:11.535636  6198 consensus_meta.cc:287] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.825s	user 0.009s	sys 0.003s
I20260709 13:01:11.552799  1631 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:01:11.554021  6225 log.cc:927] Time spent T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.454s	user 0.002s	sys 0.000s
W20260709 13:01:11.543334  6102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.008s	sys 0.013s
I20260709 13:01:11.529680  6249 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:11.563293  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:11.544050  6145 raft_consensus.cc:697] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:11.552066  6023 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:11.398216  6233 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.579113  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:11.537077  5901 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:01:11.582360  1523 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:11.546506  6232 raft_consensus.cc:2764] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:01:11.432451  6215 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.594952  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:11.558373  6207 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.604743  1599 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:11.543135  6208 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:11.636399  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:11.635208  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 86457.4us
I20260709 13:01:11.596820  1630 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:11.594687  5641 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:11.582821  6249 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.652436  2326 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.548959  6209 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:01:11.643826  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:11.669420  1599 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:11.611725  6102 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.616477  6164 raft_consensus.cc:2764] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:01:11.634042  6086 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:11.634858  6023 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.558187  6198 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:11.672873  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 58119.1us
I20260709 13:01:11.594638  5853 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:01:11.679903  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:11.658272  6267 raft_consensus.cc:2764] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:01:11.683768  1556 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:11.667358  6206 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:11.695528  2326 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:11.678952  6241 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:11.680125  6126 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:11.637463  6176 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.702481  2322 raft_consensus.cc:2393] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 7: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:11.683539  6023 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.686858  6086 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.704181  6261 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:11.736028  6261 raft_consensus.cc:697] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:11.736486  6043 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.025s	user 0.008s	sys 0.001s
I20260709 13:01:11.737259  6261 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.737324  6043 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.739394  2327 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:11.706734  6262 log.cc:927] Time spent T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:01:11.701773  6207 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:01:11.746304  6078 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:01:11.727200  5894 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:11.707044  6251 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.707468  5970 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.708454  6274 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.708936  6126 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:11.709188  6208 raft_consensus.cc:697] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:11.764895  6274 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.765866  6208 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.767244  6274 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:11.688822  6252 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.769024  6129 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:11.768908  6252 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.697135  6145 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.771291  6252 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.682861  6236 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:11.772617  5894 raft_consensus.cc:3055] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:11.773064  5894 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:01:11.773674  5892 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.000s
I20260709 13:01:11.774127  6083 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.774034  5894 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.774179  5892 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10.
W20260709 13:01:11.776080  6264 log.cc:927] Time spent T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:01:11.726002  6143 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.798s	user 0.013s	sys 0.000s
I20260709 13:01:11.733047  6086 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.734233  6206 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:11.666488  6232 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:01:11.690642  6218 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:11.755662  1601 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:11.757162  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:11.757629  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:11.808938  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 53340.1us
I20260709 13:01:11.809042  1704 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:01:11.758327  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:11.759650  1700 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:11.762106  6239 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:11.813058  6263 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:01:11.812938  6239 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:11.762359  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:11.814486  1556 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:11.814826  1702 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:01:11.727388  6241 raft_consensus.cc:697] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:11.731791  5853 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.778055  6267 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.786415  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:11.712957  6215 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:11.820667  1555 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:11.807380  2327 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:11.809190  6242 consensus_queue.cc:1059] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:01:11.811919  1707 raft_consensus.cc:2368] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:01:11.814935  1556 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:11.762575  6182 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:11.817653  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:11.823544  1558 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 11: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:11.821899  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:11.822763  6268 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:01:11.817374  6083 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:11.827240  6198 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.822402  1599 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:11.830161  5853 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.833242  6233 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.833479  5853 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.835115  1555 raft_consensus.cc:2410] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:01:11.835620  1556 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.848075  5970 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.846519  1556 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:11.842487  6177 consensus_meta.cc:287] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.000s
I20260709 13:01:11.840704  6129 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:11.853241  6177 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.854029  6129 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:11.855137  6129 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.856961  1708 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:11.840660  6180 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.858642  6177 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:11.861572  6241 consensus_queue.cc:237] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.872057  5908 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:11.818735  6218 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:11.796090  6143 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.838337  6102 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:11.846501  1601 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:11.834003  6267 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.869714  6227 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:11.837014  6206 consensus_queue.cc:1243] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer 8106dfc0bda54df0ae10ba13c28ccc18 log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:01:11.882643  1556 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:01:11.899816  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 53425.1us
I20260709 13:01:11.903461  1703 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:11.905047  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:11.909716  1559 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:01:11.914510  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:11.915818  1707 raft_consensus.cc:2410] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:11.897316  6129 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.917243  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:11.917755  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:11.900858  6102 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.919798  1700 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:01:11.905364  6182 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.932734  1598 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:11.907550  6232 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.946332  6232 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.947491  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:11.947814  5901 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:01:11.917822  5960 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:11.911963  6079 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:01:11.943471  1702 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:11.949079  5960 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.951516  5960 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.951007  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2734) took 1617 ms. Trace:
I20260709 13:01:11.954186  1630 rpcz_store.cc:276] 0709 13:01:10.333409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.333529 (+   120us) service_pool.cc:224] Handling call
0709 13:01:10.335494 (+  1965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:11.665636 (+1330142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.950772 (+285136us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002c7ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:11.950946 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2899924352}
I20260709 13:01:11.954763  6281 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:11.955194  6281 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:11.931559  6102 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:11.938722  1673 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:11.962793  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:11.964079  6079 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:11.962814  6145 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:01:11.965150  6232 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.967039  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:11.968418  6217 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:11.968888  6217 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:11.969317  6217 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.968912  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:11.972316  6267 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.982656  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:12.003249  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:12.016460  1705 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:11.978507  6267 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:12.000893  6232 consensus_queue.cc:1059] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:01:11.956024  6281 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.019176  6267 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:11.984527  6079 raft_consensus.cc:697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:12.021795  6267 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:11.984025  6176 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:12.022719  6176 raft_consensus.cc:697] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:12.022516  6079 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.008630  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:11.939604  5908 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:12.026839  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:12.029757  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 344974us
W20260709 13:01:12.027347  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 355205us
I20260709 13:01:11.947707  6143 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:12.023675  6176 consensus_queue.cc:237] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:12.028877  1601 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:11.965178  6145 raft_consensus.cc:3055] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:12.032290  2325 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:12.030644  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:11.984119  6043 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:12.037035  1703 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:12.040114  1601 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:12.041606  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:12.047950  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:12.055058  1700 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
W20260709 13:01:12.055577  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.055797  1700 pending_rounds.cc:85] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 10
I20260709 13:01:12.056325  1700 pending_rounds.cc:107] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:01:12.056656  1700 raft_consensus.cc:2889] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:12.058144  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:12.058771  1526 leader_election.cc:400] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:01:12.059806  1526 leader_election.cc:403] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:12.058823  1707 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:12.062983  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.063659  1630 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:12.065876  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:12.069450  6282 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:01:12.071062  6249 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.071633  6276 raft_consensus.cc:3055] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.071935  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.072180  6276 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:12.072713  1560 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:12.073551  6276 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.074723  6232 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:12.075237  6232 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:12.075733  6232 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:12.076519  6102 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:12.078922  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.057924  6209 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:01:12.053431  6280 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:12.079638  1631 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:12.080102  6280 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:12.080503  6280 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.081010  5823 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:12.081962  6218 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:12.083093  6276 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.042547  6266 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:01:12.084677  6239 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:12.038785  6145 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:12.085227  6239 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.047334  6279 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:12.085705  6239 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:12.038987  5908 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.089672  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:12.090929  5908 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:12.090605  6208 consensus_queue.cc:1059] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:01:12.091866  6208 consensus_queue.cc:1243] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:12.092355  6208 raft_consensus.cc:3055] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.092697  6208 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:12.063423  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:12.093318  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:12.093520  6208 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.094170  2325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:12.095147  2325 raft_consensus.cc:606] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:12.060489  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.095788  2325 raft_consensus.cc:614] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:12.092361  2327 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:12.100111  2288 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:12.103991  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:12.104875  1551 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:12.094501  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:12.107815  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 77314.9us
I20260709 13:01:12.108767  1523 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:12.110669  6266 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:12.111208  6266 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.111593  6266 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.112974  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:12.115736  6023 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.117022  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:12.118011  1707 raft_consensus.cc:2393] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 11: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:12.118969  5960 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.119906  1702 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:12.122124  5960 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:12.123505  2322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 1080) took 1858 ms (client timeout 1546 ms). Trace:
I20260709 13:01:12.125473  6217 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:12.128175  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 69515.8us
I20260709 13:01:12.130097  2329 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:12.127362  2325 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:12.094781  6208 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.130383  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:12.123989  2322 rpcz_store.cc:269] 0709 13:01:10.265113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.265301 (+   188us) service_pool.cc:224] Handling call
0709 13:01:12.123225 (+1857924us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400529254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:12.123388 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3259755904}
I20260709 13:01:12.140110  6294 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:01:12.149088  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:12.150038  1702 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:12.150992  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:12.140435  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:12.141456  5901 consensus_queue.cc:1059] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:12.153728  5901 raft_consensus.cc:3055] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:12.154356  5901 raft_consensus.cc:740] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:12.154539  6281 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:12.155267  5901 consensus_queue.cc:260] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:12.135179  6143 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 13:01:12.160140  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.145701  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2736) took 1516 ms. Trace:
I20260709 13:01:12.145782  1523 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:12.146485  6209 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.146791  2321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 1088) took 1675 ms. Trace:
I20260709 13:01:12.147118  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.148159  1709 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:01:12.142845  6289 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:01:12.172986  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:12.185403  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.163156  1551 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:01:12.163690  1675 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:12.190155  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.165577  2321 rpcz_store.cc:276] 0709 13:01:10.471842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.472908 (+  1066us) service_pool.cc:224] Handling call
0709 13:01:12.146608 (+1673700us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b5400548154. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:12.146729 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1974518528}
I20260709 13:01:12.162884  1552 rpcz_store.cc:276] 0709 13:01:10.629022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.663200 (+ 34178us) service_pool.cc:224] Handling call
0709 13:01:10.712040 (+ 48840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:10.798320 (+ 86280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.798353 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:10.819066 (+ 20713us) log.cc:844] Serialized 26 byte log entry
0709 13:01:11.150063 (+330997us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:11.360987 (+210924us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.369171 (+  8184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.143500 (+774329us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b1800457060. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69662a6 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419
0709 13:01:12.145410 (+  1910us) spinlock_profiling.cc:243] Waited 85.9 ms on lock 0x7b54000b81d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:12.145465 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.145506 (+    41us) raft_consensus.cc:1685] finished
0709 13:01:12.145517 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.145640 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7462,"prepare.queue_time_us":397579,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":7925,"raft.run_cpu_time_us":490,"raft.run_wall_time_us":22035,"spinlock_wait_cycles":212388992,"thread_start_us":374208,"threads_started":2,"wal-append.queue_time_us":353927}
I20260709 13:01:12.193063  1675 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:12.194546  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 48853.5us
I20260709 13:01:12.195837  1523 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:12.052030  6086 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.205623  1675 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:12.135754  6023 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:12.216889  1526 leader_election.cc:400] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:01:12.218971  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:12.225844  1675 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:12.229759  1702 raft_consensus.cc:2410] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:01:12.230005  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:12.229949  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:12.232471  2321 raft_consensus.cc:2376] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13. Re-sending same reply.
I20260709 13:01:12.233657  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:12.235651  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:12.231491  2325 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:12.164691  6284 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:12.245864  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:12.246344  1526 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:12.247927  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.192742  5901 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:12.165223  6197 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.237839  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:12.254086  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:12.254789  2324 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:12.260092  2327 raft_consensus.cc:2410] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:12.201193  6294 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.214355  6177 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.228946  5641 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:12.263311  2322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:12.263406  6284 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.199234  6232 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:12.229686  6242 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.256381  6266 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.240492  5892 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:12.268944  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:12.252696  5924 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:01:12.270516  6239 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:12.239636  6206 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:12.271662  6197 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:12.242570  6180 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.276468  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.279047  1675 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:12.242055  6240 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.298998  1675 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:12.281601  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:12.286782  2322 raft_consensus.cc:606] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:12.287173  1635 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:01:12.302261  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.305366  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:12.307065  2321 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:12.284641  5641 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:12.285293  5892 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.312129  2327 raft_consensus.cc:2393] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 15: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:12.314332  6270 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:12.318200  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:12.322664  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 76400.8us
I20260709 13:01:12.273727  6236 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:01:12.308825  6014 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:12.325408  1551 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 16. Current term is 17. Ops: [14.8-16.9]
I20260709 13:01:12.285609  6280 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:12.330852  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.311813  6227 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:12.357239  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.316947  5892 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.358693  1560 raft_consensus.cc:2393] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:12.359826  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.298734  6206 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.322949  6270 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.322403  5853 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:12.372153  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.362140  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:12.378237  6304 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:01:12.380887  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2733) took 2049 ms. Trace:
I20260709 13:01:12.385370  1633 rpcz_store.cc:276] 0709 13:01:10.333059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.333536 (+   477us) service_pool.cc:224] Handling call
0709 13:01:10.333880 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.188554 (+854674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.380514 (+1191960us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b5400246654. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:12.380804 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963939712}
I20260709 13:01:12.389772  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.393810  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:12.393922  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:12.394631  1632 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:12.395781  1557 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 6: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:01:12.396011  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.388862  6014 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:12.399885  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.400017  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.405224  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.402788  1633 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:01:12.415956  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:12.375144  5641 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:12.417122  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:12.417594  1632 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:01:12.418314  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.418553  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.419045  1633 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:12.419847  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.420306  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:12.420547  1632 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:12.421867  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.420622  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.423273  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.424556  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:12.425139  1633 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.426770  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:12.427923  1557 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:12.432803  1523 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:12.431764  6086 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:12.440894  6276 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:12.441404  6276 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.441756  6276 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.442860  6270 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:12.441771  6300 log.cc:927] Time spent T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:12.444825  6232 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:12.445315  6292 log.cc:927] Time spent T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:01:12.445453  6232 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:12.398089  5853 consensus_queue.cc:1059] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:01:12.446635  5853 raft_consensus.cc:3055] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.447023  5853 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:12.447769  6280 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:12.449668  1599 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:12.450628  6261 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:12.451176  6261 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.451552  6261 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:12.451495  1599 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:12.453226  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.453325  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.436182  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:12.456048  1526 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:12.457859  1633 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:12.458431  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2269) took 1189 ms. Trace:
I20260709 13:01:12.455936  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2747) took 1918 ms. Trace:
I20260709 13:01:12.465281  1634 rpcz_store.cc:276] 0709 13:01:10.537790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.801109 (+263319us) service_pool.cc:224] Handling call
0709 13:01:10.820742 (+ 19633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:11.143034 (+322292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.455754 (+1312720us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54002d7654. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:12.455890 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734000384}
I20260709 13:01:12.466737  1705 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:12.458776  1599 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:12.458813  1559 rpcz_store.cc:276] 0709 13:01:11.269496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.375917 (+106421us) service_pool.cc:224] Handling call
0709 13:01:11.376405 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.910323 (+533918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.458194 (+547871us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b54001f7054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:12.458377 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1225522048}
I20260709 13:01:12.469748  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.476704  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.447872  5853 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.456750  6270 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.468508  6252 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.471025  6176 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:12.495779  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:12.470773  6240 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:12.481331  6232 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:12.486923  6267 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:12.487852  6310 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:12.508641  2320 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:12.481068  6242 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:01:12.487411  6266 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:12.510807  1557 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:01:12.520628  5812 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:12.521487  6309 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:01:12.521739  6310 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.522349  6310 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.529266  2286 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:12.529997  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2728) took 1378 ms (client timeout 1794 ms). Trace:
I20260709 13:01:12.530299  6086 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:12.530463  1708 rpcz_store.cc:269] 0709 13:01:11.151187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.152556 (+  1369us) service_pool.cc:224] Handling call
0709 13:01:12.529763 (+1377207us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b540012c5d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:12.529909 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1455798016}
I20260709 13:01:12.530992  6086 raft_consensus.cc:697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:12.531991  6086 consensus_queue.cc:237] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.533373  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.534720  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.539875  1560 raft_consensus.cc:2410] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:12.533821  6310 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:12.542332  6299 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:01:12.542939  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.546810  2328 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:12.535631  2286 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:12.549598  6260 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.888s	user 0.000s	sys 0.003s
I20260709 13:01:12.574410  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2742) took 1381 ms. Trace:
I20260709 13:01:12.575528  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.502190  6270 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.514693  6176 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:12.511543  5853 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.578205  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.511281  6240 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.508409  6307 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:12.553885  6276 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.560406  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 1015) took 1081 ms. Trace:
I20260709 13:01:12.497049  6182 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:12.556413  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.570060  6242 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:01:12.571110  6306 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:01:12.570902  6310 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:12.550081  6267 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:12.574863  1553 rpcz_store.cc:276] 0709 13:01:11.217151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.217282 (+   131us) service_pool.cc:224] Handling call
0709 13:01:11.217624 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.217850 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.217880 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:11.231937 (+ 14057us) log.cc:844] Serialized 26 byte log entry
0709 13:01:11.418372 (+186435us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:11.418426 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.418517 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.548989 (+1130472us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:12.574088 (+ 25099us) raft_consensus.cc:1685] finished
0709 13:01:12.574110 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.574344 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3586816,"thread_start_us":144610,"threads_started":1,"wal-append.queue_time_us":347922}
I20260709 13:01:12.583319  1626 raft_consensus.cc:2368] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11.
I20260709 13:01:12.583138  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:12.577025  5892 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.616930  6281 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.594359  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.600533  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:12.637130  1555 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:12.602530  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:12.604955  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:12.607476  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:12.607259  6261 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:12.643553  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:12.644147  1627 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.645355  6261 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:12.613296  1552 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:01:12.615026  2323 rpcz_store.cc:276] 0709 13:01:11.478799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.534177 (+ 55378us) service_pool.cc:224] Handling call
0709 13:01:11.534552 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.673570 (+139018us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:11.690388 (+ 16818us) log.cc:844] Serialized 14 byte log entry
0709 13:01:12.030795 (+340407us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.031268 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:01:12.031415 (+   147us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:12.031435 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.031480 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.557297 (+525817us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b18002c00e0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:01:12.560095 (+  2798us) raft_consensus.cc:1685] finished
0709 13:01:12.560180 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.560317 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14817,"prepare.queue_time_us":16203,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":7473,"raft.queue_time_us":133797,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":10421,"spinlock_wait_cycles":8975744,"thread_start_us":436167,"threads_started":2,"wal-append.queue_time_us":339632}
I20260709 13:01:12.622857  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:12.625608  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:12.647493  1708 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:12.647658  5938 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:12.648221  5938 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.648687  5938 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.649175  6177 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.651211  6266 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:12.628940  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:12.653714  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:12.654443  1626 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.623740  6242 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:12.655522  6058 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:12.630656  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 47613.9us
I20260709 13:01:12.593847  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.632198  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.648568  2288 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:12.657001  6267 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:12.658392  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:12.657401  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.659621  6218 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:12.660017  6236 consensus_queue.cc:1059] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:12.660985  6236 raft_consensus.cc:3055] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.661363  6236 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:12.660151  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.628404  1559 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:12.663488  1633 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:12.664188  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:12.665812  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:12.668105  6291 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.391s	user 0.001s	sys 0.001s
I20260709 13:01:12.626235  6182 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.668229  6235 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:12.668915  6235 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:12.669324  6235 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.669556  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2748) took 1269 ms. Trace:
I20260709 13:01:12.666034  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:12.670495  6182 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:12.662199  6236 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:12.670531  1628 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.679358  6236 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.679639  6285 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:12.680447  6240 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:12.680557  6176 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:12.656414  6242 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:12.682201  6270 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:12.683015  6249 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:12.669922  1629 rpcz_store.cc:276] 0709 13:01:11.400017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.400193 (+   176us) service_pool.cc:224] Handling call
0709 13:01:11.420217 (+ 20024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.421913 (+  1696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.421962 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:11.949399 (+527437us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b2c000f1738. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2
0709 13:01:11.949826 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:01:12.058502 (+108676us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:12.058557 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.058878 (+   321us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.667179 (+608301us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:12.669344 (+  2165us) raft_consensus.cc:1685] finished
0709 13:01:12.669365 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.669498 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14016,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"spinlock_wait_cycles":142404224,"thread_start_us":107515,"threads_started":1,"wal-append.queue_time_us":248596}
I20260709 13:01:12.685846  1629 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:01:12.686980  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:12.687309  6305 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:01:12.689702  2288 leader_election.cc:400] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11.
I20260709 13:01:12.688097  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.697007  2288 leader_election.cc:403] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:12.693492  1633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 13:01:12.698477  1633 raft_consensus.cc:606] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:12.698637  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:12.698901  1633 raft_consensus.cc:614] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:12.700918  1556 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:12.700829  1629 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:12.705016  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 247216us
W20260709 13:01:12.722720  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 162174us
I20260709 13:01:12.671999  6218 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:12.733278  6043 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:12.670250  6239 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:12.682211  6242 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:12.740386  1629 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:12.740654  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.741294  1556 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:12.711015  6211 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.711285  6270 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:12.665486  6281 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.725211  6285 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:12.750231  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:12.751389  1554 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 10: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:12.753140  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:12.754201  1557 raft_consensus.cc:2368] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10.
I20260709 13:01:12.753170  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:12.761104  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.762410  1629 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:12.763175  1554 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:12.765355  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.765868  1554 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:12.773573  1554 raft_consensus.cc:1217] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 11.11->[13.12-13.12]   Dedup: 13.12->[]
I20260709 13:01:12.774435  1554 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:01:12.776434  1554 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:01:12.747545  1626 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:12.788746  1627 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:12.798918  1555 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:12.792663  1554 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:01:12.795186  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:12.742836  6043 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.801635  1628 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:12.802560  2288 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:12.812804  1554 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:12.817262  1627 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:01:12.817904  1554 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:12.821239  1554 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:12.827375  1554 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:12.761373  6285 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.850724  2327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:12.851408  2327 raft_consensus.cc:606] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:12.816990  6266 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:12.877574  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.902820  2327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:12.907593  6145 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 8.11, Last appended by leader: 11, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:12.915373  5892 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:12.918341  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.946816  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.949143  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.950979  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 1011) took 1626 ms. Trace:
I20260709 13:01:12.951602  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:12.951630  2325 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:12.884526  6266 raft_consensus.cc:697] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:12.956859  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.951792  2326 rpcz_store.cc:276] 0709 13:01:11.326874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.380913 (+ 54039us) service_pool.cc:224] Handling call
0709 13:01:12.909436 (+1528523us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b5400671e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:12.950922 (+ 41486us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598490880}
I20260709 13:01:12.957468  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:12.957814  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 997) took 2230 ms. Trace:
I20260709 13:01:12.958074  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:12.958307  1631 raft_consensus.cc:2393] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:12.959836  2326 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:12.962387  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:12.962989  2326 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.958287  2329 rpcz_store.cc:276] 0709 13:01:10.717549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.720926 (+  3377us) service_pool.cc:224] Handling call
0709 13:01:12.129905 (+1408979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.130604 (+   699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.924263 (+793659us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400529250. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:12.947848 (+ 23585us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3166550912}
I20260709 13:01:12.996733  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:12.999862  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:13.000933  1631 raft_consensus.cc:2376] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7. Re-sending same reply.
W20260709 13:01:13.004700  2286 leader_election.cc:336] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.640s (SENT)
W20260709 13:01:12.969089  6296 log.cc:927] Time spent T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.761s	user 0.006s	sys 0.004s
I20260709 13:01:13.009467  2286 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:12.954352  6218 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.013449  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:13.012188  1598 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:13.019357  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:13.020299  2329 raft_consensus.cc:2393] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:13.008744  6145 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.028168  6043 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:13.028005  5960 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:13.030428  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:13.031008  6211 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11.
I20260709 13:01:13.032245  6086 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.023170  5861 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.021595  6281 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:13.033249  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:13.033495  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:13.022058  6218 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.034329  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2761) took 1166 ms. Trace:
I20260709 13:01:13.010190  5894 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.041728  1701 raft_consensus.cc:3055] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:13.051338  6285 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:13.053597  6177 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:13.058753  1632 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
W20260709 13:01:13.082453  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.093182  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:13.041332  2326 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:13.063176  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:13.069219  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:13.069554  1560 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:01:13.076077  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.078320  1558 rpcz_store.cc:276] 0709 13:01:11.868235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.872706 (+  4471us) service_pool.cc:224] Handling call
0709 13:01:11.873148 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.873559 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.873597 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:11.874059 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:01:12.193123 (+319064us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:12.193162 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.193228 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.923553 (+730325us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:13.033981 (+110428us) raft_consensus.cc:1685] finished
0709 13:01:13.034003 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.034261 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":951,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8064,"spinlock_wait_cycles":13036928,"thread_start_us":289004,"threads_started":1,"wal-append.queue_time_us":311206}
I20260709 13:01:13.083088  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:13.078720  1701 raft_consensus.cc:740] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:13.069067  1703 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
W20260709 13:01:13.088289  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.089082  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1102) took 1119 ms. Trace:
I20260709 13:01:13.096442  1705 raft_consensus.cc:2410] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:13.102089  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:13.104136  2320 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:13.101192  2328 rpcz_store.cc:276] 0709 13:01:11.969572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.971071 (+  1499us) service_pool.cc:224] Handling call
0709 13:01:11.971416 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.566036 (+594620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.088849 (+522813us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b5400535a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:13.089026 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322341632}
I20260709 13:01:13.098976  1672 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:13.114696  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:13.115396  1708 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:13.116725  1599 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:13.121104  1700 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:13.121881  1675 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:13.068871  5908 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:13.071933  6102 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:13.124313  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.125933  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:13.126248  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:13.150557  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:13.123921  2328 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:13.105544  6207 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.011s	sys 0.020s
I20260709 13:01:13.132649  6177 consensus_queue.cc:1059] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:13.142683  6244 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:13.143129  6211 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.131995  6236 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.152657  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:13.158694  1631 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:01:13.153388  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:13.154381  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:13.094607  5641 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.157032  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:13.104802  6129 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:13.165330  2326 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:13.125442  6023 consensus_queue.cc:1059] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:01:13.175438  6206 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:13.177460  5938 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.528s	user 0.016s	sys 0.001s
I20260709 13:01:13.178292  5924 raft_consensus.cc:3055] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:13.178063  5938 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.180104  6218 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:13.181234  6129 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.068679  6266 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.183339  6129 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:13.185271  5641 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.187238  2327 raft_consensus.cc:606] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:13.149817  6285 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:13.124055  6240 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:13.154491  6279 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:13.153364  6207 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.011s	sys 0.020s
W20260709 13:01:13.153221  6282 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:13.169490  2320 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:13.178748  5924 raft_consensus.cc:740] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:13.187819  2327 raft_consensus.cc:614] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:13.187484  1705 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:13.167129  2323 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:13.114336  6249 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:13.192483  1633 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:01:13.115994  6235 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.194618  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:13.205400  1702 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:13.205917  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:13.199028  5924 consensus_queue.cc:260] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:13.199949  6249 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:13.160238  6211 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.202533  5938 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:13.190310  5853 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.004s
I20260709 13:01:13.198380  2322 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 11: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:13.207106  1631 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:13.153364  5908 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.232834  1553 raft_consensus.cc:2410] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:13.197089  6240 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:13.241267  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:13.242318  6332 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:13.242686  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:13.243944  6332 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:13.254235  1551 raft_consensus.cc:2410] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:13.249459  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:13.265708  1705 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:13.267207  1702 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
W20260709 13:01:13.268831  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 264115us
I20260709 13:01:13.271716  2286 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:13.252203  6232 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:13.276247  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:13.277230  1634 raft_consensus.cc:1240] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:13.282191  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2357) took 1089 ms. Trace:
I20260709 13:01:13.281903  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1100) took 1313 ms. Trace:
I20260709 13:01:13.320808  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:13.320561  1632 rpcz_store.cc:276] 0709 13:01:12.192625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.423053 (+230428us) service_pool.cc:224] Handling call
0709 13:01:13.281998 (+858945us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b5400247a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:13.282131 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1459569024}
I20260709 13:01:13.312363  2286 leader_election.cc:400] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10.
I20260709 13:01:13.327800  2286 leader_election.cc:403] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:01:13.320890  2324 rpcz_store.cc:276] 0709 13:01:11.968869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.972707 (+  3838us) service_pool.cc:224] Handling call
0709 13:01:11.973067 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.265201 (+292134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.281613 (+1016412us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b540052c454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:13.281818 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":638877056}
I20260709 13:01:13.332515  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2746) took 1266 ms. Trace:
I20260709 13:01:13.330565  5908 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:13.331231  1635 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:13.333149  1709 rpcz_store.cc:276] 0709 13:01:12.065670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.067067 (+  1397us) service_pool.cc:224] Handling call
0709 13:01:12.067437 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.166065 (+ 98628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.332259 (+1166194us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b5400266454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:13.332460 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184182144}
I20260709 13:01:13.342494  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:13.343204  1709 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:13.269695  5853 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:13.274427  5894 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.290757  6276 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:13.290303  6211 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:13.281391  6217 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:13.358596  2286 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:13.277500  5938 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:13.357203  2321 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.011s	sys 0.032s
I20260709 13:01:13.352957  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:13.359581  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 227912us
W20260709 13:01:13.360440  2321 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.011s	sys 0.033s
I20260709 13:01:13.361364  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:13.361666  2321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1102) took 1063 ms. Trace:
I20260709 13:01:13.334825  6242 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.341130  6207 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.337471  6270 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10.
I20260709 13:01:13.391235  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:13.433291  1709 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 6: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:13.387276  1675 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:13.434655  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47488.8us
I20260709 13:01:13.435637  1675 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:13.437373  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 78876.6us
I20260709 13:01:13.437649  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:13.438555  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:13.341886  6232 raft_consensus.cc:697] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:13.443362  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:13.341388  6218 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:01:13.393276  6129 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:13.358920  5894 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:13.392613  6236 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:01:13.444342  6217 consensus_queue.cc:1059] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 13:01:13.584934  6330 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.350s	user 0.002s	sys 0.000s
I20260709 13:01:13.496886  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:13.388084  6208 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.456336  6211 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:13.458947  6145 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:13.445641  6086 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:13.503535  6315 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:01:13.520819  1601 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:13.538489  6331 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:01:13.432468  6242 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:13.459220  6291 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:01:13.512204  6339 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.441332  6207 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:13.634861  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 193201us
I20260709 13:01:13.467249  6276 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:13.518522  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:13.678520  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 240924us
W20260709 13:01:13.643772  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 123038us
I20260709 13:01:13.646437  6211 raft_consensus.cc:697] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:13.473356  6218 consensus_queue.cc:1243] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:01:13.681413  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 162954us
I20260709 13:01:13.590960  5938 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.512266  6023 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:13.533298  6239 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 13:01:13.528438  6235 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:13.656508  5894 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:13.649917  6182 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:13.669267  6207 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:13.668733  1709 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.362389  2321 rpcz_store.cc:276] 0709 13:01:12.297925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.536903 (+238978us) service_pool.cc:224] Handling call
0709 13:01:12.537194 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.537592 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.537628 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.553594 (+ 15966us) log.cc:844] Serialized 26 byte log entry
0709 13:01:12.801760 (+248166us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:13.361017 (+559257us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.361329 (+   312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.361431 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.361474 (+    43us) raft_consensus.cc:1685] finished
0709 13:01:13.361496 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.361613 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103607,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":509,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":80,"thread_start_us":789269,"threads_started":2,"wal-append.queue_time_us":352753}
I20260709 13:01:13.670207  6266 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.650290  6164 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.670925  6242 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:13.672554  1701 consensus_queue.cc:260] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.679571  1675 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:13.529431  6249 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:13.388290  5853 raft_consensus.cc:697] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:13.686247  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:13.715880  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:13.677825  6217 raft_consensus.cc:3055] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:13.358282  6240 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.388758  6206 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.289s
I20260709 13:01:13.696188  6182 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:13.684823  6145 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:13.703962  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.704022  1675 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:13.706072  1701 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:13.687395  6310 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:13.537736  6232 consensus_queue.cc:237] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:13.711516  6197 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:13.705880  6164 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.712971  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 867) took 1235 ms. Trace:
I20260709 13:01:13.745231  1675 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:13.692704  6347 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.749179  1675 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:13.750826  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:13.751179  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.719636  6336 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:01:13.725509  1709 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:13.688486  6276 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:13.691537  5938 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.710490  6236 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:13.731429  1559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 962) took 1329 ms (client timeout 1574 ms). Trace:
I20260709 13:01:13.725057  6209 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.713266  6211 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.729890  6207 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:13.727617  6217 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:13.744488  1626 rpcz_store.cc:276] 0709 13:01:12.477722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.798132 (+320410us) service_pool.cc:224] Handling call
0709 13:01:13.282321 (+484189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.282685 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.282713 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.283155 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.513144 (+229989us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:13.513606 (+   462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.514625 (+  1019us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.670612 (+155987us) raft_consensus.cc:1685] finished
0709 13:01:13.670632 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.712659 (+ 42027us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b5400247a50. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:13.712903 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1054,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":1112196480,"thread_start_us":228092,"threads_started":1,"wal-append.queue_time_us":356197}
I20260709 13:01:13.704453  6266 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.755416  6347 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:13.814214  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 821) took 1117 ms. Trace:
I20260709 13:01:13.814649  1700 rpcz_store.cc:276] 0709 13:01:12.696615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.697649 (+  1034us) service_pool.cc:224] Handling call
0709 13:01:12.697995 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.124789 (+426794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.813984 (+689195us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b5400397954. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:13.814157 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972241792}
I20260709 13:01:13.756361  6176 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:13.830228  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:13.831161  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:13.831846  1560 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:13.832026  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:13.761206  6261 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:13.768934  6078 raft_consensus.cc:3055] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:13.771279  5641 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:13.776122  1672 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:01:13.842545  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 66389.7us
I20260709 13:01:13.798028  6249 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:13.781272  6341 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:13.783968  5924 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:13.786226  5894 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.786708  5908 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.752712  6177 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:13.788045  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2365) took 1403 ms. Trace:
I20260709 13:01:13.771188  1701 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 13:01:13.732093  6182 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.789017  2321 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:13.791208  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 823) took 1046 ms. Trace:
I20260709 13:01:13.830483  6332 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:13.795895  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 45071.6us
I20260709 13:01:13.836565  6078 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:13.887586  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:13.801189  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:13.803880  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:13.807389  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1095) took 1576 ms. Trace:
I20260709 13:01:13.807994  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 953) took 1408 ms. Trace:
I20260709 13:01:13.811226  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:13.840852  6207 raft_consensus.cc:697] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:13.819280  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:13.820006  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:13.888837  2325 rpcz_store.cc:276] 0709 13:01:12.231359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.246870 (+ 15511us) service_pool.cc:224] Handling call
0709 13:01:12.951405 (+704535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.954298 (+  2893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.807208 (+852910us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b5400671e50. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:13.807339 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1618989440}
I20260709 13:01:13.820206  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 951) took 1421 ms. Trace:
I20260709 13:01:13.756798  6350 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:13.832422  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:13.814523  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:13.853821  6348 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:13.896908  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 82459.5us
I20260709 13:01:13.898542  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:13.899822  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:13.830869  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:13.900213  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:13.900444  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:13.794485  6285 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:13.740899  6145 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:13.838924  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:13.907508  1700 raft_consensus.cc:2410] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:01:13.780730  6086 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:13.850075  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:13.850605  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:13.846477  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:13.805402  6236 raft_consensus.cc:697] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:13.852188  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:13.862816  1633 rpcz_store.cc:276] 0709 13:01:12.384987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.766304 (+381317us) service_pool.cc:224] Handling call
0709 13:01:12.766604 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.197359 (+430755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.787755 (+590396us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400204254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:13.787981 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978691328}
I20260709 13:01:13.831311  6242 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:13.795107  1559 rpcz_store.cc:269] 0709 13:01:12.401875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.469407 (+ 67532us) service_pool.cc:224] Handling call
0709 13:01:13.731249 (+1261842us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54001d7ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:13.731374 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362533632}
I20260709 13:01:13.913967  1626 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:13.841019  6310 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.835871  6261 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:13.843535  6209 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.796888  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:13.948079  1705 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:13.885102  6043 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.878187  1704 rpcz_store.cc:276] 0709 13:01:12.744948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.745082 (+   134us) service_pool.cc:224] Handling call
0709 13:01:12.745448 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.757327 (+ 11879us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:12.772824 (+ 15497us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.093084 (+320260us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.093568 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.093693 (+   125us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:13.093722 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.093786 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.790981 (+697195us) raft_consensus.cc:1685] finished
0709 13:01:13.791003 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.791152 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11400,"prepare.queue_time_us":38216,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":19258,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":21918,"thread_start_us":284584,"threads_started":1,"wal-append.queue_time_us":433486}
I20260709 13:01:13.819209  1673 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:13.888909  2329 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:13.888955  1553 rpcz_store.cc:276] 0709 13:01:12.399480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.631873 (+232393us) service_pool.cc:224] Handling call
0709 13:01:13.807797 (+1175924us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b540017e8d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:13.807940 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321596288}
I20260709 13:01:13.889120  2324 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:13.847484  6249 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:13.893906  1555 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:13.894381  1551 rpcz_store.cc:276] 0709 13:01:12.398940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.658154 (+259214us) service_pool.cc:224] Handling call
0709 13:01:13.820004 (+1161850us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b54000578d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:13.820152 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367887104}
I20260709 13:01:13.908787  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:13.911518  1630 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:01:13.959988  1445 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6325e0281aa547efa677c29cabdf5de4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8106dfc0bda54df0ae10ba13c28ccc18 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:13.940478  2320 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:13.850867  6129 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:01:13.887823  5892 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:13.956707  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 137566us
I20260709 13:01:13.907325  5823 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:13.866331  5894 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:13.835314  5853 consensus_queue.cc:237] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:13.963440  1629 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:13.879231  5908 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.904210  6350 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:13.967154  1704 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:13.893862  6332 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:13.943104  6348 raft_consensus.cc:697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:13.963804  6249 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:13.914280  6285 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:13.985918  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 153950us
I20260709 13:01:13.988924  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:13.965758  6197 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.989449  1555 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:13.965678  6023 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:14.003304  1551 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:13.970584  5823 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:13.948439  6242 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:13.888523  6217 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:13.963891  6232 consensus_queue.cc:1059] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:01:13.950345  6310 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:13.982709  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 161439us
I20260709 13:01:13.990881  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:13.977836  6350 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.972568  6078 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.030617  6310 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:14.033229  6285 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.034406  5908 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:14.035286  6351 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:01:14.035224  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:14.036818  5938 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.037359  1630 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:14.038403  1627 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:01:14.039191  6242 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:14.039855  5823 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.040982  6266 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:14.042830  5894 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.016901  6207 consensus_queue.cc:237] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.044132  1551 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:13.979671  5641 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:01:13.980031  6341 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:01:13.966048  5892 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:13.991312  1554 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:01:14.060909  1554 pending_rounds.cc:85] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 7
I20260709 13:01:14.061856  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:14.062196  6285 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:14.064592  1551 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:14.051244  1704 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:13.958240  6209 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:14.070593  1557 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:13.950111  6086 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:14.051690  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 78779.1us
I20260709 13:01:13.990144  6177 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:01:14.075567  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:14.076444  2324 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:14.076777  6358 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.008571  6023 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:14.012665  6276 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.063265  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:14.068302  1555 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:14.023357  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:14.008934  6043 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:14.083691  6347 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.078477  6164 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:14.056525  6218 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:01:14.084239  6348 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.080440  6217 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:14.087198  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.087548  1703 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:14.119325  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.009153  6197 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:14.052683  6270 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:14.093436  6361 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:14.093475  5938 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:14.077875  6352 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:14.079470  6023 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:14.062534  1554 pending_rounds.cc:107] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:01:14.089982  6043 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:14.140476  1554 raft_consensus.cc:2889] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:14.139705  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 114170us
I20260709 13:01:14.101017  6276 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:14.077353  6358 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:13.992436  6261 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.129834  1673 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:14.139488  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:14.154284  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:14.048504  6236 consensus_queue.cc:237] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:14.163308  1560 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:01:14.170266  1560 pending_rounds.cc:85] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 9
I20260709 13:01:14.170544  1560 pending_rounds.cc:107] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:01:14.170773  1560 raft_consensus.cc:2889] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:14.163686  1555 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:14.127059  6270 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:14.125252  6177 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:14.181010  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:14.152262  6043 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:14.164347  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 184077us
W20260709 13:01:14.204319  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 74575.5us
I20260709 13:01:14.146207  6240 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:01:14.178983  6145 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:14.193485  6261 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:14.194526  6341 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:14.211192  1558 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:14.216713  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:14.150225  5938 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.193176  5641 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.194780  6270 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:14.219254  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 57606.8us
I20260709 13:01:14.228930  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:14.229650  1629 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:14.163687  6276 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.233094  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2783) took 1138 ms. Trace:
I20260709 13:01:14.154660  6352 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:14.237308  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:14.239317  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:14.201205  6177 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:14.150085  6361 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.252753  6086 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:14.253793  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:14.258345  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:14.259250  1559 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:14.219971  6341 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:14.255782  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:14.261747  1552 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:14.264958  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:14.267961  1700 raft_consensus.cc:2368] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11.
W20260709 13:01:14.268795  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.264437  2286 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:14.271610  1553 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 13:01:14.276366  1556 pending_rounds.cc:85] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 9
I20260709 13:01:14.276861  1556 pending_rounds.cc:107] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:01:14.277486  1556 raft_consensus.cc:2889] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:14.236292  6209 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.279613  1675 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:14.282116  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:14.282238  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:14.281286  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:14.289250  2324 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:14.289400  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:14.290726  1560 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:14.291389  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:14.293352  2286 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:14.292953  1700 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:14.295598  2286 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:14.232244  5641 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:14.270217  6145 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.275425  6242 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:14.260432  6332 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.280217  6086 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:14.306416  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:14.274699  6341 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:14.316766  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.321754  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:14.297050  6209 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.299820  6218 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:14.335343  1702 raft_consensus.cc:2410] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 13 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:01:14.314518  6208 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:14.341830  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:14.316000  6310 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:14.350612  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:14.351691  1560 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:14.329566  6086 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:14.307482  6266 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:01:14.335144  6357 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.335282  6359 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.335829  6374 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:14.319384  6145 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:14.336362  6207 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:14.347774  6208 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.324945  6356 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:01:14.404696  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:14.331403  6079 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:01:14.407581  6357 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.412297  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:14.438498  2324 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:14.413012  6276 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:14.415338  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2763) took 1167 ms. Trace:
I20260709 13:01:14.439601  1709 rpcz_store.cc:276] 0709 13:01:13.247842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.443050 (+195208us) service_pool.cc:224] Handling call
0709 13:01:14.415090 (+972040us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54003ea8d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:14.415259 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515712384}
W20260709 13:01:14.440106  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 91531.5us
I20260709 13:01:14.325142  6242 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.362000  6086 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:14.343381  6209 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:14.450654  1709 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:01:14.453513  1709 pending_rounds.cc:85] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 8
I20260709 13:01:14.453806  1709 pending_rounds.cc:107] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:01:14.454046  1709 raft_consensus.cc:2889] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:14.454159  1560 raft_consensus.cc:2410] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 13 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:01:14.427027  6208 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:14.360917  6310 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:14.459508  1598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.435s	user 0.022s	sys 0.038s
W20260709 13:01:14.443249  6354 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.238s	user 0.000s	sys 0.002s
W20260709 13:01:14.469787  6367 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:01:14.470690  6375 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:01:14.485379  6366 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:01:14.430042  6197 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.431178  6358 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:14.536765  1598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.513s	user 0.025s	sys 0.041s
W20260709 13:01:14.544493  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 1.52032e+06us
I20260709 13:01:14.545179  1598 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:14.408360  5823 consensus_queue.cc:1059] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:01:14.428028  6207 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.540959  5641 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:14.505839  6362 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:01:14.407426  6359 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:14.557169  6371 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:01:14.613278  6242 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:14.564057  5938 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:14.619691  6182 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.732s	user 0.015s	sys 0.004s
I20260709 13:01:14.620904  6387 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:14.622109  6177 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:14.623234  6339 consensus_meta.cc:287] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.937s	user 0.010s	sys 0.003s
I20260709 13:01:14.623739  6339 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:14.625137  1707 raft_consensus.cc:2410] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:14.626256  6310 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:14.627620  6361 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:14.629076  6357 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:14.630515  6207 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:14.631494  5823 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:14.569764  6386 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:01:14.641521  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:14.568737  6197 consensus_queue.cc:1059] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:01:14.712981  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 258626us
I20260709 13:01:14.736624  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:14.737756  2324 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:14.739282  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:14.573693  6352 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.720537  5938 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:14.620289  6182 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.718407  6208 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.794384  6332 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.795097  6208 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.794967  6332 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:14.797423  6332 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.757215  6177 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:14.801198  6378 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:01:14.801087  6177 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:14.803093  6182 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:14.803229  6177 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:14.806236  6350 consensus_meta.cc:287] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.001s
I20260709 13:01:14.806746  6350 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:14.807950  1704 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:14.818406  6270 consensus_meta.cc:287] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.577s	user 0.003s	sys 0.006s
I20260709 13:01:14.818097  6341 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:14.816370  6249 consensus_meta.cc:287] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.809s	user 0.005s	sys 0.010s
I20260709 13:01:14.766856  6386 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:01:14.839789  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:14.843497  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 286143us
I20260709 13:01:14.845803  6197 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:01:14.857697  6340 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.267s	user 0.006s	sys 0.005s
I20260709 13:01:14.847114  1598 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:14.837387  6023 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.001s
W20260709 13:01:14.838868  6377 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.376s	user 0.002s	sys 0.000s
W20260709 13:01:14.840341  6043 consensus_meta.cc:287] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.003s
I20260709 13:01:14.769659  5938 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.837327  6359 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:14.879853  1598 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:14.889981  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 131751us
I20260709 13:01:14.835180  6270 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.873471  6145 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:14.895784  2323 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:14.873421  6197 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:14.893136  6079 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:14.900507  2324 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:14.901074  6341 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:14.931306  1599 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:14.913467  6391 raft_consensus.cc:3055] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:14.913846  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:14.915804  6393 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:01:14.917853  6385 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.374s	user 0.000s	sys 0.001s
I20260709 13:01:14.918999  6350 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:14.921288  6086 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.873361  6207 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:14.841253  6249 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.910715  6387 raft_consensus.cc:3055] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:14.888836  6209 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.879335  5971 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:01:14.933367  6261 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.003s
I20260709 13:01:14.937057  6270 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.938714  5938 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.884469  6043 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.876451  6023 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:14.975281  6023 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:14.941551  2329 raft_consensus.cc:2393] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:14.978091  1708 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:14.979390  1523 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:14.980914  1523 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:14.982286  1523 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:14.940912  6391 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:14.989612  1523 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:14.971118  6145 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:14.972569  6176 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:01:14.973208  1702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2762) took 1725 ms (client timeout 1507 ms). Trace:
W20260709 13:01:14.984786  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2792) took 1298 ms (client timeout 1559 ms). Trace:
W20260709 13:01:15.000306  1702 rpcz_store.cc:269] 0709 13:01:13.247533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.275125 (+ 27592us) service_pool.cc:224] Handling call
0709 13:01:14.972985 (+1697860us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540012c0d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:14.973133 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2328222592}
I20260709 13:01:14.957618  5861 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:14.951284  6339 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.990984  6357 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:14.990187  5908 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:14.993264  6043 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.993749  6209 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:14.995760  6086 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:15.005017  6310 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:14.960211  6079 raft_consensus.cc:697] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:15.005930  5861 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:14.963685  6207 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.957307  6387 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:15.012524  1585 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:44807 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:44807 timed out after 15.000s (SENT)
I20260709 13:01:15.012725  5938 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.034616  5938 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:15.036056  6365 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.879s	user 0.004s	sys 0.000s
I20260709 13:01:15.045312  5938 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:14.233773  1701 rpcz_store.cc:276] 0709 13:01:13.090147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.883433 (+793286us) service_pool.cc:224] Handling call
0709 13:01:13.883810 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.883989 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:14.161873 (+277884us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.228230 (+ 66357us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:14.228283 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:14.228326 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.228388 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.228542 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9387,"prepare.queue_time_us":282675,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":13012,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":10070,"thread_start_us":304599,"threads_started":2,"wal-append.queue_time_us":56244}
I20260709 13:01:15.051755  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:15.056552  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 53402us
I20260709 13:01:15.057439  2288 leader_election.cc:400] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11.
I20260709 13:01:15.060505  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:15.061955  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:15.065004  6281 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:15.065414  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:15.065716  6281 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:15.066766  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:15.067943  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:15.069159  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2289) took 1251 ms. Trace:
I20260709 13:01:15.069612  1557 rpcz_store.cc:276] 0709 13:01:13.817835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.817955 (+   120us) service_pool.cc:224] Handling call
0709 13:01:13.854299 (+ 36344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.070964 (+216665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.068918 (+997954us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400026f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:15.069095 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496548736}
I20260709 13:01:15.071622  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:15.072950  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:15.074595  1634 raft_consensus.cc:1240] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:15.076020  1634 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:01:15.012941  6357 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:15.082986  6357 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:15.087607  5892 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:15.088457  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:15.088914  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:15.089928  2328 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:15.090013  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:15.091511  2322 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:15.013698  6208 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:01:15.015154  5971 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:15.094897  5971 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:14.998494  6249 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:15.000422  1705 rpcz_store.cc:269] 0709 13:01:13.686535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.829968 (+143433us) service_pool.cc:224] Handling call
0709 13:01:14.984617 (+1154649us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400266454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:14.984732 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269332352}
I20260709 13:01:15.097873  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2381) took 1197 ms. Trace:
I20260709 13:01:14.950080  6341 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.015699  6209 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.098605  6341 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.006608  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.100068  1703 raft_consensus.cc:2410] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:15.100250  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.100991  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.101190  6341 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:15.007622  6364 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:15.101414  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:15.101760  6364 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:15.102213  6364 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.102594  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.103729  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.097750  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.099277  6209 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.105065  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.106411  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:15.009194  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.107646  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.108295  1702 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:15.011236  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:15.010067  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:15.109918  1630 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:01:15.111029  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 967) took 2532 ms. Trace:
I20260709 13:01:15.111409  1554 rpcz_store.cc:276] 0709 13:01:12.578880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.829004 (+250124us) service_pool.cc:224] Handling call
0709 13:01:13.820135 (+991131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.147914 (+327779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.109947 (+962033us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54000578d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:15.110820 (+   873us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b54000578d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:15.110938 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2666600576}
I20260709 13:01:15.113093  6364 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:15.113543  1707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2765) took 1790 ms (client timeout 2114 ms). Trace:
W20260709 13:01:15.114015  1707 rpcz_store.cc:269] 0709 13:01:13.323241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.475367 (+152126us) service_pool.cc:224] Handling call
0709 13:01:15.113336 (+1637969us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b5400398d54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:15.113483 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2295401728}
I20260709 13:01:15.115150  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.115391  6364 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:15.116856  1700 raft_consensus.cc:1240] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:15.022414  5861 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.120290  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2791) took 1442 ms. Trace:
I20260709 13:01:15.120833  1700 rpcz_store.cc:276] 0709 13:01:13.678279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.372831 (+694552us) service_pool.cc:224] Handling call
0709 13:01:15.116680 (+743849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.119296 (+  2616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.120050 (+   754us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b5400398d50. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:15.120220 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1709234560}
I20260709 13:01:15.122120  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.123587  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.117156  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.016031  6310 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:15.021133  6164 raft_consensus.cc:3055] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:15.125501  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.022379  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:15.126312  1700 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 6.
I20260709 13:01:15.018255  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2378) took 1119 ms. Trace:
I20260709 13:01:15.125355  1672 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:15.126816  1631 rpcz_store.cc:276] 0709 13:01:13.899084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.908440 (+  9356us) service_pool.cc:224] Handling call
0709 13:01:15.017962 (+1109522us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54000e7254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:15.018187 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452666240}
I20260709 13:01:15.125557  6164 raft_consensus.cc:740] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:15.025012  6391 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:15.021973  1628 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:15.022382  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:15.128849  6391 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:15.129010  1627 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:15.129262  6164 consensus_queue.cc:260] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:15.130391  6164 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:15.016780  6079 consensus_queue.cc:237] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.131883  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2755) took 1940 ms. Trace:
I20260709 13:01:15.132241  1708 rpcz_store.cc:276] 0709 13:01:13.191775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.968397 (+776622us) service_pool.cc:224] Handling call
0709 13:01:13.985185 (+ 16788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.978586 (+993401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.131644 (+153058us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b54003ec6d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:15.131824 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2282737920}
I20260709 13:01:15.134205  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2794) took 1348 ms. Trace:
I20260709 13:01:15.015429  6339 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.137646  6339 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:15.022641  6235 raft_consensus.cc:3055] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:15.138605  6235 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:15.139457  6235 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.029058  6078 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:15.141228  1703 raft_consensus.cc:2410] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:01:15.143198  1703 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:15.134541  1708 rpcz_store.cc:276] 0709 13:01:13.786216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.133369 (+1347153us) service_pool.cc:224] Handling call
0709 13:01:15.133690 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.133873 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.133900 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:15.133938 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:15.133970 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.134031 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.134138 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.080392  1632 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:15.140442  6235 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.116391  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:15.144557  1703 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:15.003619  1523 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:15.125372  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.173576  1702 raft_consensus.cc:2410] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 18 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:15.026942  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2790) took 1349 ms. Trace:
I20260709 13:01:15.179193  1704 rpcz_store.cc:276] 0709 13:01:13.677861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.150710 (+472849us) service_pool.cc:224] Handling call
0709 13:01:14.150936 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.808337 (+657401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.026680 (+218343us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54002f2954. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:15.026880 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1510429056}
I20260709 13:01:15.098322  1626 rpcz_store.cc:276] 0709 13:01:13.900095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.900221 (+   126us) service_pool.cc:224] Handling call
0709 13:01:15.097684 (+1197463us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b54001b9c54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:15.097818 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14761216}
W20260709 13:01:15.175417  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 250514us
I20260709 13:01:15.181478  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:15.181759  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:15.182160  1626 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:15.182349  1632 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:15.146657  1701 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
W20260709 13:01:15.159830  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.188326  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:15.164821  2322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:15.189394  2322 raft_consensus.cc:606] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:15.188428  1701 pending_rounds.cc:85] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 5
I20260709 13:01:15.191468  1701 pending_rounds.cc:107] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:01:15.190496  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:15.145711  1708 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:01:15.195917  1708 pending_rounds.cc:85] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 5
I20260709 13:01:15.126890  6310 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:15.192044  2322 raft_consensus.cc:614] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:15.194195  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:15.166088  1707 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:15.165198  6339 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.197225  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:15.027338  6207 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:15.153769  5971 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:15.204886  6359 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.196573  1701 raft_consensus.cc:2889] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.165042  1672 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:15.196161  1708 pending_rounds.cc:107] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:01:15.204064  2326 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:15.207821  1708 raft_consensus.cc:2889] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.208361  1672 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:01:15.209877  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 206287us
I20260709 13:01:15.210745  1705 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:15.212867  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:15.200692  6393 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:01:15.211575  6242 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:15.215584  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:15.214880   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:15.211966  6339 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.232877  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:15.200884  5960 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:01:15.220093  6393 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:15.219075  6207 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.218905  6242 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.028059  6387 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:15.227005  2322 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:15.233258  6364 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.265252  1702 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:15.235958  1554 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:01:15.236763  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:15.241160  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:15.266956  1553 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:15.267241  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:15.268515  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:15.221081  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:15.172138  1454 catalog_manager.cc:5697] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:15.227084  6145 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.209265  6359 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:15.222469  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 272660us
I20260709 13:01:15.258461  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:15.221343  6397 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:15.246488  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:15.290689  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:15.281667  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:15.293612  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:15.238570  6393 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:15.304719  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:15.305933  1707 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:15.230116  6182 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:01:15.256891  6242 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.299762  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:15.298902  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:15.233681  6208 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:01:15.245930  6347 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.308872  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:15.310766  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 62181.2us
I20260709 13:01:15.314254  1557 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:15.318743  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:15.322572  1555 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:15.326027  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:15.326984  1555 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:01:15.300274  6397 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:15.335433  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.304193  6363 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.337426  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:15.357002  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:15.359687  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:15.256234  6207 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.372470  1555 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:15.320751  6339 consensus_queue.cc:1059] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:01:15.367870  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:15.362579  1559 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:15.385946  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:15.374291  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:15.333925  6236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.010s	sys 0.022s
I20260709 13:01:15.388734  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:15.389530  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.390332  2286 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:15.391809  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:15.387773  1555 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.362703  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:15.335129  6387 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:15.280337  6364 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.287439  6145 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:15.431479  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 62109us
W20260709 13:01:15.429262  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 66665.1us
I20260709 13:01:15.458335  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:15.506352  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:15.499039  1555 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:15.386137  6043 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:15.372391  6397 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.514603  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:15.397750  6236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.011s	sys 0.023s
I20260709 13:01:15.322088  6270 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:01:15.507085  1559 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:15.535343  1554 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:15.550597  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:15.537616  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:15.375962  6209 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.334645  6347 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.501107  6358 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:15.374496  6129 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.169s
I20260709 13:01:15.430619  6164 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 13:01:15.507563  6023 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:15.533936  6043 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.507789  6176 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:15.566825  2324 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:15.615015  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 335400us
I20260709 13:01:15.542775  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:15.385181  6363 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:15.522269  6249 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:15.609651  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 326187us
I20260709 13:01:15.568234  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:15.550912  6240 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:15.620245  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 106865us
I20260709 13:01:15.626212  1555 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:15.431565  6393 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.610184  6206 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.611829  6043 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:15.612654  6369 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:15.676137  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 60060.5us
I20260709 13:01:15.621670  6208 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.628638  6358 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:15.688159  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:15.611577  6023 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:15.716194  6164 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:15.635651  6399 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:01:15.621150  6176 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.731173  1559 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:15.734464  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:15.642000  6240 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.712831  6359 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:15.729292  6401 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:01:15.726780  6164 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:15.728474  6402 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:01:15.634631  6249 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.717199  6339 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:15.716674  1526 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:15.692873  6369 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:15.720062  6393 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.730783  6236 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:15.700336  6208 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.719123  6391 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 13:01:15.755733  6235 consensus_meta.cc:287] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.000s
W20260709 13:01:15.802928  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.751866  6164 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:15.809616  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 93050.2us
I20260709 13:01:15.812255  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:15.815383  2326 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
W20260709 13:01:15.819280  6408 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 13:01:15.821028  6416 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:01:15.825847  6078 consensus_meta.cc:287] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.001s
I20260709 13:01:15.826200  6249 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:15.809480  5861 consensus_meta.cc:287] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.690s	user 0.012s	sys 0.001s
I20260709 13:01:15.827209  5861 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:15.827723  6422 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:15.828488  1634 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:15.828322  6422 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:15.829710  5861 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:15.831117  6398 log.cc:927] Time spent T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:01:15.833262  6405 log.cc:927] Time spent T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:01:15.834584  6208 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:15.837387  6240 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:15.837710  6023 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:15.838021  6240 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:15.838253  6023 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:15.838598  6240 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.838727  6023 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:15.751156  5960 consensus_queue.cc:1059] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:01:15.841348  5960 raft_consensus.cc:3055] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:15.841779  5960 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:15.842852  5960 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:15.844233  5960 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:15.845270  6209 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:15.849599  6176 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:15.849808  6369 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:15.850589  2324 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:15.806408  6236 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:15.855511  6409 log.cc:927] Time spent T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:01:15.809463  6207 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:15.856618  6359 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:15.858141  6363 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:15.858510  6400 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.305s	user 0.000s	sys 0.000s
I20260709 13:01:15.860626  6364 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:15.861173  6357 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.778s	user 0.010s	sys 0.003s
I20260709 13:01:15.861654  6357 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.813064  6145 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:15.866199  6357 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:15.867919  6236 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:15.841892  6422 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:15.765091  6339 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.868571  6334 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:15.869204  6334 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:15.870504  6339 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:15.878057  6023 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:15.880764  1556 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:15.883322  1556 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:01:15.871486  6240 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:15.887876  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:15.901113  6242 consensus_meta.cc:287] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.000s
I20260709 13:01:15.901865  6358 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.902166  6242 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:15.893113  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 831) took 1654 ms. Trace:
I20260709 13:01:15.845100  6347 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:15.902531  6358 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:15.892649  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 80471.7us
I20260709 13:01:15.891923  6086 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:15.906428  1700 rpcz_store.cc:276] 0709 13:01:14.239117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.138480 (+899363us) service_pool.cc:224] Handling call
0709 13:01:15.138823 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.139073 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:15.375140 (+236067us) log.cc:844] Serialized 14 byte log entry
0709 13:01:15.892241 (+517101us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b1800247360. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed962523a
0709 13:01:15.892467 (+   226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:15.892532 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:15.892618 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.892705 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.893034 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":502580,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":4044,"spinlock_wait_cycles":5632896,"thread_start_us":566170,"threads_started":2,"wal-append.queue_time_us":443789}
I20260709 13:01:15.870225  6334 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:15.906355  6404 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.159s	user 0.000s	sys 0.004s
I20260709 13:01:15.900472  2323 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:15.906605  6209 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.912254  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:15.916807  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.925186  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:15.925344  6352 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:15.922997  6334 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:15.912561  6393 consensus_queue.cc:1059] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:01:15.937649  6421 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:15.939563  6209 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:16.006162  2286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.006s	sys 0.010s
W20260709 13:01:16.006750  2286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.007s	sys 0.011s
I20260709 13:01:16.002417  2320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1120) took 1087 ms. Trace:
I20260709 13:01:15.981598  6352 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:16.008715  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 305836us
I20260709 13:01:15.951393  6347 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:01:15.958158  6078 consensus_queue.cc:1059] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:01:16.018179  1702 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:15.999114  6411 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:15.953066  6357 consensus_queue.cc:1059] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:01:16.007434  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 615613us
I20260709 13:01:16.021505  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:16.027498  1700 raft_consensus.cc:2410] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:01:16.013612  6352 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:16.031252  2286 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:16.030552  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 86389.1us
W20260709 13:01:16.032953  1675 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.771s (SENT) [suppressed 19 similar messages]
I20260709 13:01:16.011997  6240 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:16.014161  6249 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:16.040817  6249 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:16.043699  6249 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:16.045061  6428 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:16.008906  6421 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.018456  5861 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:16.008670  2320 rpcz_store.cc:276] 0709 13:01:14.915149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.926167 (+ 11018us) service_pool.cc:224] Handling call
0709 13:01:14.926507 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.926969 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.926996 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.931647 (+  4651us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.232793 (+301146us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:15.522163 (+289370us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.000242 (+478079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.000315 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.000357 (+    42us) raft_consensus.cc:1685] finished
0709 13:01:16.000373 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.002353 (+  1980us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31724,"prepare.queue_time_us":448311,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":3604,"raft.queue_time_us":48747,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":46856,"thread_start_us":1022984,"threads_started":3,"wal-append.queue_time_us":480025}
I20260709 13:01:16.029251  6339 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:16.012722  6043 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.060842  2286 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:16.037379  6358 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:16.069092  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:16.070122  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:16.074632  1707 raft_consensus.cc:2393] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 10: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:16.075066  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:16.077289  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.072980  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:16.081151  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:16.081853  1700 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:16.081874  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.065706  5892 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:16.083765  5892 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:16.086992  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.088704  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2774) took 2373 ms. Trace:
I20260709 13:01:16.090013  6043 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:16.089135  1709 rpcz_store.cc:276] 0709 13:01:13.715451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.455101 (+739650us) service_pool.cc:224] Handling call
0709 13:01:14.985246 (+530145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.989599 (+  4353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.989633 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.990918 (+  1285us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.296090 (+305172us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:15.296133 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.296200 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.885040 (+588840us) raft_consensus.cc:1685] finished
0709 13:01:15.885060 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.088438 (+203378us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b5400266450. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:16.088647 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3951,"raft.queue_time_us":4470,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":1217668864,"thread_start_us":304494,"threads_started":1,"wal-append.queue_time_us":523908}
I20260709 13:01:16.058563  6357 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:01:16.054266  6240 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.053814  6242 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:16.094017  6240 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:16.091797  6209 raft_consensus.cc:3055] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:16.107668  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:16.095487  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 44147.6us
I20260709 13:01:16.109028  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:16.099541  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.100875  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.111934  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:16.112658  1628 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:16.101934  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:16.102106  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:16.113737  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:16.102991  1672 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:16.115665  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.104379  1673 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:16.105123  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:16.105883  2325 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:16.028815  6411 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.120368  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:16.124653  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:16.124805  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 64036.7us
I20260709 13:01:16.125639  2286 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:16.061513  6428 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.163030  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:16.165992  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.166837  1629 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
W20260709 13:01:16.167006  6425 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:16.106833  6209 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:16.061142  6393 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:01:16.168151  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.169219  2325 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 13: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:16.169500  6433 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:16.169991  6433 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.170329  6433 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:16.175179  6352 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:16.065907  5861 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.177659  6164 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:16.178877  5861 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:16.179823  6164 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:16.096834  6249 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
W20260709 13:01:16.183290  6397 consensus_meta.cc:287] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.003s
I20260709 13:01:16.183727  6397 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.184779  1552 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:16.095131  6261 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:16.128538  6429 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.185519  6261 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.185868  6429 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:16.187610  6261 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:16.187799  6429 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:16.128201  6043 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:16.065568  6431 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.166054  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:16.189713  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 90866.5us
I20260709 13:01:16.189818  1559 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:16.196223  2325 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:16.196671  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:16.197018  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:16.199967  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:16.200722  1700 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:16.191452  6421 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:16.126679  6350 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:16.201771  6350 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:16.202198  6350 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:16.200978  6043 raft_consensus.cc:697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:16.203838  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:16.204672  1709 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
W20260709 13:01:16.209265  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 104973us
I20260709 13:01:16.209420  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.211573  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:16.215338  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:16.073325  6339 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.218686  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:16.215638  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 90066.6us
I20260709 13:01:16.221038  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:16.189256  6434 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.251195  5971 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.251770  6261 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:16.252997  6386 raft_consensus.cc:3055] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:16.253394  6386 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:16.254115  6339 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:16.254190  6386 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.255064  1633 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:16.255640  6386 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:16.256887  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:16.257472  1628 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:16.235121  6421 raft_consensus.cc:2764] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:16.262727  6411 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:16.262975  5892 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:16.263921  6352 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:16.235001  6435 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:16.265941  6435 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:16.266335  6435 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:16.191835  6428 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:16.270864  6428 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:16.270401  6043 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.238801   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:16.273341  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.237809  1454 catalog_manager.cc:5697] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:01:16.239933  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 129164us
I20260709 13:01:16.190335  6242 consensus_queue.cc:1059] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:01:16.251933  6430 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:16.279101  1556 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:16.279127  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:16.281057  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:16.284974  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:16.285626  1601 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:16.271354  6209 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:16.212651  6436 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:16.288672  1601 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:16.289563  1552 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:16.292548  1628 raft_consensus.cc:2410] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:16.294025  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:16.295526  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.214720  1673 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:16.294353  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 261398us
W20260709 13:01:16.296346  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 81704.4us
I20260709 13:01:16.297271  1601 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:16.296367  1627 raft_consensus.cc:2410] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:01:16.293680  2288 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:16.299335  1601 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:16.298712  1673 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:16.281854  6397 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:16.304934  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:16.306238  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:16.282028  6434 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.309190  1707 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:16.309511  1555 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:16.309557  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:16.310441  1700 raft_consensus.cc:2368] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10.
I20260709 13:01:16.303488  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:16.313185  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:16.314425  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:16.315534  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:16.313207  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:16.317414  1707 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:16.323585  1707 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:16.316720  1675 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:16.332016  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:16.334426  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:16.302474  6209 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:16.304322  6431 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:16.251780  5971 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:16.335425  2326 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 10: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:16.293089  6261 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:16.437270  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:16.450855  2323 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:16.450982  2321 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:16.333098  6270 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.339856  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:16.437731  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:16.292889  5861 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.145s
I20260709 13:01:16.334904  1675 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:16.412523  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 71274.9us
W20260709 13:01:16.373250  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.446849  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.381958  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.399364  6281 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.399660  6430 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.302326  6422 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:16.365082  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.301826  6079 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:16.304661  6411 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.339082  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:16.348552  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 70317.2us
W20260709 13:01:16.332834  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 92359us
I20260709 13:01:16.459156  6145 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:16.330300  6249 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.181s
I20260709 13:01:16.452958  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.454770  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:16.533222  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 195206us
I20260709 13:01:16.533840  1702 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 14: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:01:16.534394  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.438369  6206 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 13:01:16.457387  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.330400  6423 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.540534  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:16.541096  6444 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:01:16.541239  1626 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:16.542079  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:16.542601  1626 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:16.543495  5823 raft_consensus.cc:3055] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:16.543942  5823 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:16.338711  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:16.502732  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.545037  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:16.495936  1708 raft_consensus.cc:2410] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 13 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:01:16.308389  6391 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:16.503273  2320 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:16.505218  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.318456  6436 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.470052  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:16.330530  6339 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:16.513448  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.551698  1631 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:16.552547  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.515269  1627 raft_consensus.cc:1275] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:16.308425  6197 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.156s
W20260709 13:01:16.497989  6439 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:01:16.460053  6341 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.018s	sys 0.013s
I20260709 13:01:16.436887  6420 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:16.335402  6176 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:16.355625  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.457310  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.536404  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.537425  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.544926  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 983) took 1190 ms. Trace:
I20260709 13:01:16.553354  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:16.553921  2326 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:16.554631  1672 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:16.536732  6078 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:16.534112  6242 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.516345  6422 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.520974  6390 raft_consensus.cc:3055] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:16.615648  6413 consensus_queue.cc:1059] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:01:16.633419  6404 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:01:16.616326  6261 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:01:16.618315  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 80457.9us
I20260709 13:01:16.618810  6412 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:16.615720  5960 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:16.623997  1626 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:16.626418  1628 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:16.522015  6430 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.631057  1630 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:01:16.631721  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:16.661240  1601 leader_election.cc:400] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10.
W20260709 13:01:16.633011  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 72215.9us
I20260709 13:01:16.633590  1553 rpcz_store.cc:276] 0709 13:01:15.354788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.354952 (+   164us) service_pool.cc:224] Handling call
0709 13:01:15.355403 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.937240 (+581837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.937273 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:16.003871 (+ 66598us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.206469 (+202598us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:16.206530 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.258445 (+ 51915us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54001d6ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:16.258496 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.544649 (+286153us) raft_consensus.cc:1685] finished
0709 13:01:16.544669 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.544861 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41063,"raft.queue_time_us":42047,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":645517568,"thread_start_us":442401,"threads_started":2,"wal-append.queue_time_us":280908}
I20260709 13:01:16.611490  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:16.610635  6339 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:16.638796  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 84221.6us
W20260709 13:01:16.643705  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 308821us
I20260709 13:01:16.633649  6391 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:16.668978  1675 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:16.616164  2321 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:16.640959  6390 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:16.644436  5823 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.651854  6236 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:16.624933  6208 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:01:16.438232  6387 consensus_queue.cc:1059] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:01:16.665799  1601 leader_election.cc:403] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:16.640991  6422 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:16.672174  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:16.631086  6341 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.018s	sys 0.014s
I20260709 13:01:16.626549  6411 consensus_queue.cc:1059] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:01:16.683941  1675 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:16.690828  1454 catalog_manager.cc:5697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:16.630326  6436 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:16.671362  6339 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:16.701478  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 199470us
I20260709 13:01:16.705472  5823 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.679139  6236 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:16.716660  6236 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.731098  6086 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:16.734822  6390 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.746537  6435 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.748075  6434 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:16.726089  6420 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:16.748929  6393 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10.
I20260709 13:01:16.752183  1702 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:16.752905  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:16.753525  1709 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:16.735723  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 74633.8us
I20260709 13:01:16.757721  6391 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.758731  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:16.685413  6459 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:16.760721  6415 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.761482  6415 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:01:16.741669  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 57838.7us
I20260709 13:01:16.765448  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:16.767098  1675 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:16.767561  6424 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.773s	user 0.001s	sys 0.002s
I20260709 13:01:16.741946  6341 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.769546  6341 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:16.770814  6341 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:16.772099  6412 consensus_queue.cc:1059] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:16.773872  6387 raft_consensus.cc:3055] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:16.774399  6387 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:16.775446  6387 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:16.777997  6079 raft_consensus.cc:3055] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:16.778465  6079 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:16.779337  6079 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:16.781891  1601 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:16.784819  6393 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:16.746924  6390 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.790952  1672 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:16.792126  6176 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:16.792689  6176 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:16.793584  6176 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 8.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.794278  6145 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:16.794797  6145 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.797806  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:16.798347  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2296) took 1554 ms. Trace:
I20260709 13:01:16.809775  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:16.816738  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.821918  1675 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:16.798763  1560 rpcz_store.cc:276] 0709 13:01:15.243587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.243711 (+   124us) service_pool.cc:224] Handling call
0709 13:01:15.247282 (+  3571us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:15.505675 (+258393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.505710 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:15.506294 (+   584us) log.cc:844] Serialized 52 byte log entry
0709 13:01:15.763034 (+256740us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:15.763080 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.890839 (+127759us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54000b7cd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:15.890912 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.766910 (+875998us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:16.798133 (+ 31223us) raft_consensus.cc:1685] finished
0709 13:01:16.798156 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.798292 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":342,"raft.queue_time_us":998,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":19807,"spinlock_wait_cycles":611631232,"thread_start_us":208308,"threads_started":1,"wal-append.queue_time_us":383187}
I20260709 13:01:16.813712  6079 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.837791  1675 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:16.839784  1709 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:16.843192  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:16.745792  6023 raft_consensus.cc:3055] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:16.850652  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:16.856261  1703 raft_consensus.cc:2955] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:16.872865  6078 raft_consensus.cc:3055] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:16.873405  6078 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:16.875144  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:16.860817  6334 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:16.877967  6450 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:01:16.878484  6334 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:16.879971  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2297) took 1636 ms. Trace:
I20260709 13:01:16.880646  1551 rpcz_store.cc:276] 0709 13:01:15.244000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.244139 (+   139us) service_pool.cc:224] Handling call
0709 13:01:15.265237 (+ 21098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.275902 (+ 10665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.275945 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.641314 (+365369us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b18003dac80. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69662a6 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a
0709 13:01:16.172893 (+531579us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b2c00000658. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2
0709 13:01:16.203991 (+ 31098us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.334495 (+130504us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:16.334531 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.334597 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.879670 (+545073us) raft_consensus.cc:1685] finished
0709 13:01:16.879698 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.879896 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21597,"raft.queue_time_us":15087,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":14664,"spinlock_wait_cycles":27014784,"thread_start_us":84371,"threads_started":1,"wal-append.queue_time_us":298892}
I20260709 13:01:16.863642  6457 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:16.883920  6446 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:01:16.814658  6341 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:01:16.896456  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 58770.5us
I20260709 13:01:16.742427  6086 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.903548  1454 catalog_manager.cc:5697] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 7 to 10, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:16.905450  1675 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:16.834033  6235 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:16.852106  6430 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:16.852283  6023 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:16.925870  2288 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:16.928140  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:16.888113  6433 consensus_meta.cc:287] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.717s	user 0.008s	sys 0.004s
I20260709 13:01:16.836078  6422 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:16.932935  1551 raft_consensus.cc:2410] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:16.879688  6334 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:16.869419  6435 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:16.917490  6457 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:16.967149  1632 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
W20260709 13:01:16.970036  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.994566  1707 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:01:16.995967  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:16.874301  6078 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:16.958731  6431 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:17.021675  6448 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 13:01:16.997145  6435 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:17.055637  2327 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:16.971364  6457 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:17.062812  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.994077  5823 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:16.996434  6235 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.967300  6430 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
W20260709 13:01:17.072206  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 276353us
I20260709 13:01:17.081091  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:01:17.023267  6350 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.821s	user 0.012s	sys 0.000s
I20260709 13:01:17.083196  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:16.951954  6433 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.045629  6436 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:17.158875  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 250418us
I20260709 13:01:17.046411  6429 raft_consensus.cc:3055] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:17.038228  6414 raft_consensus.cc:3055] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:17.156925  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 73840us
I20260709 13:01:17.077582  6086 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:17.072731  6240 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:17.144721  6207 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.170403  6433 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:17.055774  6435 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:17.175231  6460 raft_consensus.cc:3055] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:17.230026  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1126) took 1131 ms. Trace:
I20260709 13:01:17.160971  6209 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:17.158198  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.072700  6457 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:17.198135  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:17.160650  6458 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:01:17.205989  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 249443us
I20260709 13:01:17.231408  2328 rpcz_store.cc:276] 0709 13:01:16.098977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.099238 (+   261us) service_pool.cc:224] Handling call
0709 13:01:16.099579 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.124707 (+ 25128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.124736 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:16.189277 (+ 64541us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.318858 (+129581us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:16.318898 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.318961 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.229737 (+910776us) raft_consensus.cc:1685] finished
0709 13:01:17.229762 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.229942 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24745,"raft.queue_time_us":28635,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":1658,"thread_start_us":117981,"threads_started":1,"wal-append.queue_time_us":334070}
I20260709 13:01:17.079919  5823 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.203392  6430 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:17.181219  6414 raft_consensus.cc:740] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:17.115563  6339 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.200984  6240 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:17.085487  6235 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.146709  6350 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.178507  6429 raft_consensus.cc:740] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:17.194511  6236 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.264545  2324 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:17.291347  2320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.002s	sys 0.021s
W20260709 13:01:17.429677  2320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.002s	sys 0.021s
I20260709 13:01:17.160631  1675 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:17.433647  6456 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:17.434898  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 274198us
I20260709 13:01:17.182399  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:17.058365  6023 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.270453  6209 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.438212  6209 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:17.439453  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 256964us
I20260709 13:01:17.287578  6240 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:17.441200  6397 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:17.441808  6397 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.442283  6397 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:17.335019  6386 consensus_meta.cc:287] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.049s	user 0.010s	sys 0.003s
I20260709 13:01:17.334699  6399 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:17.452329  6399 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.454401  2320 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:01:17.455983  6399 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:17.307953  6414 consensus_queue.cc:260] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.456161  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:17.457074  1634 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:17.457458  6357 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:17.191359  6425 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:01:17.317478  6429 consensus_queue.cc:260] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.458464  6414 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.284272  6430 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.462270  6430 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:17.307578  6435 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.463261  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:17.464332  6435 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.272853  6458 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.469578  6476 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:17.471537  6458 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:17.473011  6347 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.231855  6460 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:01:17.335268  6468 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
W20260709 13:01:17.336840  6469 log.cc:927] Time spent T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:01:17.401273  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.406615  1702 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:17.480213  6347 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.414410  1700 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:17.481199  6347 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.482534  5823 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:17.414820  6350 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:17.484724  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.484247  6347 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:17.484184  6207 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.487334  6207 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.489228  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:17.490478  2320 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.489264  6236 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:17.492728  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 287633us
I20260709 13:01:17.415231  6339 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:17.427711  6235 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:17.341504  6422 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:17.464949  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 524756us
I20260709 13:01:17.467252  1675 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:17.473572  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:17.478739  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:17.532469  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:17.548049  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 53947.6us
I20260709 13:01:17.551705  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:01:17.553419  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.555590  6396 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:17.558218  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 91138.8us
W20260709 13:01:17.559670  6079 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.732s	user 0.013s	sys 0.000s
I20260709 13:01:17.561239  6249 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:17.564163  6207 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:17.564764  6412 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:17.556070  6023 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:17.568600  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:17.475965  6460 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:17.580685  6145 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.785s	user 0.005s	sys 0.019s
I20260709 13:01:17.581486  1707 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:01:17.576723  6412 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:17.583351  1707 pending_rounds.cc:85] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 8
W20260709 13:01:17.587091  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 124289us
I20260709 13:01:17.593360  1632 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 10: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:17.594172  6412 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.596365  6412 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:17.603453  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 291515us
I20260709 13:01:17.606803  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:17.609064  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:17.610126  1701 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:01:17.611783  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:17.612848  1709 raft_consensus.cc:2393] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 8: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:17.614151  6357 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:17.614872  1675 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:17.574882  6249 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.617115  6249 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.621614  6396 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:17.622332  6396 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:17.622870  6396 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:17.625252  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:17.609894  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 58537.2us
I20260709 13:01:17.632783  6341 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:17.633342  6341 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:17.633797  1598 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:17.634812  6350 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:17.638146  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:17.641032  6415 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:17.642292  6415 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:17.643149  6415 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.633988  6341 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:17.648973  6459 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:17.649556  6459 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:17.649952  6459 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:17.652463  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:17.653590  1631 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:17.654575  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:17.657732  1552 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:17.659075  1553 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:17.659215  1559 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:17.661861  5938 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:17.662175  6387 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:17.663033  6078 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.664562  1707 pending_rounds.cc:107] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:01:17.665000  1707 raft_consensus.cc:2889] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:17.663709  6145 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.671444  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:17.672788  6145 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:17.675156  5971 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:17.677026  6415 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:17.678879  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:17.679793  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.679986  6207 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:17.681075  6207 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:17.682710  6429 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:17.687203  6461 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.658s	user 0.000s	sys 0.002s
W20260709 13:01:17.690747  6471 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.404s	user 0.001s	sys 0.000s
I20260709 13:01:17.662668  5938 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.701442  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1140) took 1382 ms. Trace:
I20260709 13:01:17.704282  5971 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:01:17.706102  2325 rpcz_store.cc:276] 0709 13:01:16.318996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.319307 (+   311us) service_pool.cc:224] Handling call
0709 13:01:16.319597 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.319931 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.319958 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:16.336106 (+ 16148us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.660679 (+324573us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:16.660723 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.660789 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.686335 (+1025546us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:17.696595 (+ 10260us) raft_consensus.cc:1685] finished
0709 13:01:17.696624 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.701242 (+  4618us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10842,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":62955,"spinlock_wait_cycles":60448128,"thread_start_us":154358,"threads_started":1,"wal-append.queue_time_us":481567}
W20260709 13:01:17.708003  6470 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.526s	user 0.005s	sys 0.000s
I20260709 13:01:17.385931   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:17.709721  6397 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:17.712881  6397 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:17.713742  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:17.714715  1707 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:01:17.715201  1601 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:17.724368  6457 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.725231  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 1053) took 1284 ms. Trace:
I20260709 13:01:17.725643  2327 rpcz_store.cc:276] 0709 13:01:16.440605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.440826 (+   221us) service_pool.cc:224] Handling call
0709 13:01:16.441138 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:17.056203 (+615065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.724762 (+668559us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b5400431f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:17.725066 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1402438400}
I20260709 13:01:17.727056  6457 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:17.730243  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:17.732815  1703 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
W20260709 13:01:17.734372  6465 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.687s	user 0.002s	sys 0.000s
I20260709 13:01:17.737654  1454 catalog_manager.cc:5697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.740707  2324 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:17.741382  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:17.742286  1454 catalog_manager.cc:5697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 5 to 6, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 6 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:01:17.744264  6466 log.cc:927] Time spent T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.695s	user 0.002s	sys 0.000s
I20260709 13:01:17.744884  6434 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:17.744982  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.736068  6357 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:17.745764  5938 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:17.721310  1557 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:01:17.744264  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:17.766304  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:17.780777  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 75421.9us
I20260709 13:01:17.732208  6209 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.784818  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:17.779093  6397 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:01:17.813824  6481 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.814430  1672 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:17.814599  6481 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:17.815236  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 56366.5us
I20260709 13:01:17.815654  6240 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.816368  6023 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:17.816722  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:17.817430  6023 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:17.818019  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 989) took 1201 ms. Trace:
I20260709 13:01:17.819199  6023 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.820067  1598 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:17.821317  6411 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:17.822384  6423 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:17.823006  6479 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:17.823325  6423 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.823990  6479 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:17.827011  6281 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.827791  6281 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.817876  6240 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:17.829818  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2785) took 1505 ms. Trace:
I20260709 13:01:17.830550  6393 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:17.828065  6261 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.837684  6209 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:17.859956  6436 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.860670  6436 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.862766  6270 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:17.863559  6270 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.863962  6270 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:17.804332  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2401) took 1437 ms (client timeout 1805 ms). Trace:
I20260709 13:01:17.845649  6208 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:17.866773  1454 catalog_manager.cc:5697] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:17.867632  6208 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.854892  2320 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:17.818527  1554 rpcz_store.cc:276] 0709 13:01:16.548239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.550366 (+  2127us) service_pool.cc:224] Handling call
0709 13:01:16.611364 (+ 60998us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.616541 (+  5177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.616571 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:16.617069 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.645463 (+ 28394us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:16.668053 (+ 22590us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.668254 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.668323 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.047314 (+378991us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b1800456ac0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:01:17.611777 (+564463us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b1800456ac0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6998522 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:01:17.733025 (+121248us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:17.749472 (+ 16447us) raft_consensus.cc:1685] finished
0709 13:01:17.749516 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.749715 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2761,"prepare.queue_time_us":22592,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":4449,"raft.queue_time_us":3613,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":9019,"spinlock_wait_cycles":68289408,"thread_start_us":26982,"threads_started":1,"wal-append.queue_time_us":65295}
I20260709 13:01:17.859702  6145 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.869344  1454 catalog_manager.cc:5697] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 5 to 8, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 8 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:17.871934  1560 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:01:17.834476  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 193059us
W20260709 13:01:17.876384  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 103753us
I20260709 13:01:17.844400  1705 rpcz_store.cc:276] 0709 13:01:16.323722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.323864 (+   142us) service_pool.cc:224] Handling call
0709 13:01:16.441241 (+117377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.526187 (+ 84946us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.526215 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:16.526653 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.696852 (+170199us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:16.696904 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.696993 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.742776 (+1045783us) spinlock_profiling.cc:243] Waited 7.48 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:17.829101 (+ 86325us) raft_consensus.cc:1685] finished
0709 13:01:17.829123 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.829523 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7938,"raft.queue_time_us":10103,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":41516,"spinlock_wait_cycles":17213312,"thread_start_us":146044,"threads_started":2,"wal-append.queue_time_us":347968}
W20260709 13:01:17.866866  1634 rpcz_store.cc:269] 0709 13:01:16.361886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.364675 (+  2789us) service_pool.cc:224] Handling call
0709 13:01:17.785172 (+1420497us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b54000f55d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:17.799145 (+ 13973us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2161559424}
I20260709 13:01:17.864323  6436 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:17.846630  6393 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:17.914855  6414 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:17.920128  1599 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:17.906112  6261 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.921831  1555 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:17.922019  1454 catalog_manager.cc:5697] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 6 to 9, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.932063  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:17.933084  1672 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:17.940138  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:17.850675  6459 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:17.885308  6145 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.930514  6393 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:17.948372  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:17.975477  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:17.976830  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 56800.9us
I20260709 13:01:17.970676  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:17.982925  6491 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:17.983425  6491 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:17.983570  2326 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:17.984493  6491 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.985499  6490 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:17.986032  6490 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:17.986514  6490 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:17.986683  6459 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:17.988848  6209 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:01:17.989255  6493 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:01:17.990499  6474 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.658s	user 0.000s	sys 0.003s
I20260709 13:01:17.990692  6145 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:17.991310  6492 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:17.992187  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2793) took 1183 ms. Trace:
I20260709 13:01:17.992576  1704 rpcz_store.cc:276] 0709 13:01:16.808567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.808699 (+   132us) service_pool.cc:224] Handling call
0709 13:01:16.808941 (+   242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.817142 (+  8201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.817187 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:16.830518 (+ 13331us) log.cc:844] Serialized 26 byte log entry
0709 13:01:17.016721 (+186203us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:17.016766 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.016850 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.638253 (+621403us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b48001701d8. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ede9aeaa1 00007f0ede9a5b37 00007f0ede9a59ca 00007f0edea9d26f 00007f0edea9cf37 00007f0edeab155c 00007f0edeab1508 00007f0edeab1488 00007f0edeab1443 00007f0edeab06ec 00007f0edd9daa96
0709 13:01:17.850039 (+211786us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:17.991789 (+141750us) raft_consensus.cc:1685] finished
0709 13:01:17.991815 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.992011 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7706,"raft.queue_time_us":8287,"raft.run_cpu_time_us":5090,"raft.run_wall_time_us":818379,"spinlock_wait_cycles":11289216,"thread_start_us":159011,"threads_started":1,"wal-append.queue_time_us":423132}
I20260709 13:01:17.994176  6208 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:17.994792  6208 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:18.000727  1458 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41156 (request call id 260) took 48821 ms (client timeout 15000 ms). Trace:
W20260709 13:01:18.002964  6242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.016s	sys 0.016s
W20260709 13:01:18.003324  6242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.092s	user 0.017s	sys 0.017s
W20260709 13:01:18.004384  6435 consensus_meta.cc:287] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.539s	user 0.013s	sys 0.002s
I20260709 13:01:17.953014  6240 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:18.006331  6240 raft_consensus.cc:697] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:18.007404  6240 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.008720  2322 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:17.978096  6479 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:01:17.937121  6396 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.014994  6396 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:18.002810  6481 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.022496  6423 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:17.943871  6249 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:18.001248  1458 rpcz_store.cc:269] 0709 13:00:29.078565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.078858 (+   293us) service_pool.cc:224] Handling call
0709 13:00:31.161269 (+2082411us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b540029f754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ef090 00007f0ed9a8df3a 00007f0edf8441cc 00007f0edf94237e 00007f0edde032a4 00007f0edde03232 00007f0edde03161 00007f0edde030dc 00007f0edde02392 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:17.885781 (+46724512us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:09.601308 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:09.602192 (+   884us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:09.602253 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:01:09.602285 (+    32us) tablet.cc:662] Decoding operations
0709 13:01:09.603162 (+   877us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:09.603292 (+   130us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:09.603342 (+    50us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:01:09.603921 (+   579us) tablet.cc:701] Row locks acquired
0709 13:01:09.603981 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:01:09.658935 (+ 54954us) write_op.cc:270] Start()
0709 13:01:09.659146 (+   211us) write_op.cc:276] Timestamp: P: 1783602069607795 usec, L: 0
0709 13:01:09.659210 (+    64us) op_driver.cc:348] REPLICATION: starting
0709 13:01:09.731402 (+ 72192us) log.cc:844] Serialized 1312 byte log entry
0709 13:01:10.279680 (+548278us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b540029f754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a80e28 00007f0edd4bb581 00007f0edd4bad58 00007f0edd4bf9f1 00007f0edd4bf9a9 00007f0edd4bf939 00007f0edd4bf901 00007f0edd4beb2d 000000000038f354 000000000038f199
0709 13:01:11.136807 (+857127us) op_driver.cc:464] REPLICATION: finished
0709 13:01:11.441976 (+305169us) write_op.cc:301] APPLY: starting
0709 13:01:11.442106 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:11.692253 (+250147us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:11.714586 (+ 22333us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:11.827226 (+112640us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:11.827663 (+   437us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:01:11.827725 (+    62us) write_op.cc:312] APPLY: finished
0709 13:01:11.828033 (+   308us) log.cc:844] Serialized 41 byte log entry
0709 13:01:11.828244 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:11.828398 (+   154us) write_op.cc:454] Released schema lock
0709 13:01:11.830973 (+  2575us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:11.931838 (+100865us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:11.941525 (+  9687us) write_op.cc:454] Released schema lock
0709 13:01:12.652908 (+711383us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b180033e200. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6998522 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
Metrics: {"mutex_wait_us":5059530,"reported_tablets":46,"spinlock_wait_cycles":1833080064,"child_traces":[["op",{"apply.queue_time_us":298877,"apply.run_cpu_time_us":10337,"apply.run_wall_time_us":459291,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16649,"num_ops":3,"prepare.queue_time_us":389397,"prepare.run_cpu_time_us":34090,"prepare.run_wall_time_us":697652,"raft.queue_time_us":796531,"raft.run_cpu_time_us":16851,"raft.run_wall_time_us":291365,"replication_time_us":1447400,"spinlock_wait_cycles":169862528,"thread_start_us":1156615,"threads_started":4,"wal-append.queue_time_us":1177688,"wal-append.run_cpu_time_us":20363,"wal-append.run_wall_time_us":2709177}]]}
I20260709 13:01:18.025748  6249 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:17.988430  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:18.030478  1526 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:18.031414  6397 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:18.032032  6397 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:18.032464  6397 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:18.023332  6261 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:17.976734  1454 catalog_manager.cc:5697] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.042936  6341 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:17.985605  6491 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:18.053458  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:18.056674  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.058684  6209 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:18.058979  6347 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:18.062475  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:18.064522  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 84766.8us
I20260709 13:01:18.046778  6397 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:18.043267  1454 catalog_manager.cc:5697] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:01:18.092553  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:18.074791  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 102504us
I20260709 13:01:18.087126  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:18.132608  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.139714  6347 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:18.072961  6207 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.085458  6460 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:18.105943  6341 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:18.163561  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:18.174652  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:18.178730  6397 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.140523  6347 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.186192  2328 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 13:01:18.186602  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 244746us
I20260709 13:01:18.170343  1454 catalog_manager.cc:5697] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.077770  6281 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.202941  1551 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:01:18.207818  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.217046  1672 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:18.136013  6270 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.232441  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:18.228171  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:18.225046  1454 catalog_manager.cc:5697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 6 to 7, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.239956  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:18.240240  1634 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:18.248829  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:18.236935  6207 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.251235  6347 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:18.253180  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:18.256340  1703 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:01:18.255215  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:18.175945  6393 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:18.223489  6240 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:18.232127  6414 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.272989  6086 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:18.275405  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:18.237111  6261 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:18.294780  2327 raft_consensus.cc:2368] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:18.232033  6397 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:18.291795  1701 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:18.276288  1627 raft_consensus.cc:2376] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10. Re-sending same reply.
W20260709 13:01:18.302855  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.257278  6281 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:18.309823  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 135254us
I20260709 13:01:18.294535  6414 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:18.326776  6281 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.309230  6397 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.296277  6261 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:18.329077  6397 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:18.313205  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:18.331202  1703 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 12: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:18.325042  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:18.332242  1704 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:18.327113  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:18.334275  6497 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.418s	user 0.006s	sys 0.000s
I20260709 13:01:18.334714  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:18.273628  6086 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:18.335390  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:18.296248  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:18.336319  1701 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 14: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:18.336771  2321 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:18.337235  6397 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:18.338495  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 232843us
I20260709 13:01:18.339877  6423 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.340445  6423 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.340481  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:18.342823  1702 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:18.342434  6490 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:18.322211  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:18.335510  6086 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:18.346516  6490 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.336383  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:18.353859  6499 log.cc:927] Time spent T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.348s	user 0.000s	sys 0.007s
I20260709 13:01:18.354009  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:18.355916  6207 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:18.356961  6207 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:18.357344  6207 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.357678  6207 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:18.360494  6270 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.368811  1454 catalog_manager.cc:5697] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 8 to 9, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 9 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:18.370769  1454 catalog_manager.cc:5697] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 6 to 14, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:18.373245  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:18.373740  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:18.374070  6393 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.374428  1626 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:18.376688  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:18.378382  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:18.380103  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:18.380671  6414 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.380764  1628 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.382550  6261 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.383240  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.384014  1553 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:18.385035  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:18.388216  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 48524.9us
I20260709 13:01:18.372646  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:18.398367  1634 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
W20260709 13:01:18.401933  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 183170us
I20260709 13:01:18.413241  1626 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:18.406144  1526 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:18.402870  1628 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:18.415277  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:18.401161  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.385046  6415 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:18.402338  1632 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:01:18.418972  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.329077  6281 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:18.432053  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:18.431942  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:18.434612  1700 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:18.442373  1552 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:18.442412  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.444756  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.447783  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.448710  1552 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:18.448922  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.449860  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.453768  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:18.426182  2326 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:18.455917  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:18.456889  2325 raft_consensus.cc:2393] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 11: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:18.439121  1559 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:18.461393  1627 raft_consensus.cc:2410] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:01:18.455104  1454 catalog_manager.cc:5697] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 2 to 9, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:18.433115  6397 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:18.467396  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:18.468767  5938 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:18.469336  6506 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.469801  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.471248  1672 leader_election.cc:400] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:18.471679  1672 leader_election.cc:403] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:01:18.423020  6415 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:18.403268  6270 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:01:18.478731  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:18.480466  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 48893us
I20260709 13:01:18.480909  2288 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:18.481621  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:18.488620  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:18.488950  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:18.488647  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.469424  5938 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.493558  6508 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:18.501749  6507 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:01:18.482089  6242 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.487079  6435 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:18.488236  6281 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:18.486891  6240 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:18.515220  2288 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:18.521903  2329 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:18.496683  6347 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:18.538538  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.542492  6145 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:18.544409  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:18.545542  1632 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
W20260709 13:01:18.546937  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.548509  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:18.555467  1560 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:01:18.523689  6281 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:18.524207  6240 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:18.543292  6423 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.539530  6508 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:18.576468  1628 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:18.586753  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:18.586689  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.590790  1701 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:18.518527  6242 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:18.575362  6281 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:18.584121  6508 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.603878  6508 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.605764  6491 consensus_queue.cc:1059] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:18.606645  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:18.606781  1601 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:18.607311  6491 raft_consensus.cc:3055] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:18.607586  6429 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:18.607749  6491 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:18.609089  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:18.608976  6491 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.609993  1704 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:18.610363  6491 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.611078  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:18.583730  6415 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.612418  6415 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.609902  6207 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:18.620767  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:18.621977  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:18.625080  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.627308  1634 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:18.623840  1601 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:18.641131  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:18.641446  1454 catalog_manager.cc:5697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 4 to 8, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:18.644275  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.648423  1627 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:01:18.639017  1626 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:01:18.652254  1552 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11. Ops: [9.8-10.9]
I20260709 13:01:18.654023  1628 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:18.598351  5938 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.626369  6423 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:18.672672  6387 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:18.673285  6387 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.657974  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:18.673686  6387 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:18.674368  6490 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.674798  6429 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:18.674937  6490 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:18.675573  6429 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:18.635697  6434 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:18.676944  1557 raft_consensus.cc:2368] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9.
I20260709 13:01:18.677547  6490 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.655733  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.663847  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:18.667212  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:18.667752  6391 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:01:18.668540  6197 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.661053  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.679767  1629 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:18.682364  1628 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:18.686756  1631 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:18.687716  1551 raft_consensus.cc:2393] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:18.672974  6423 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.676962  6434 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.660549  1454 catalog_manager.cc:5697] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 6 to 11, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:18.691099  1553 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:18.695647  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.695756  6434 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:18.708447  6086 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.692911  6197 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:18.711185  6197 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.711601  6423 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:18.696745  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:18.712924  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 54971.6us
W20260709 13:01:18.626843  6261 consensus_queue.cc:1175] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6b9e73092f6146639bf310a3d18cfe37" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 11 index: 9 } }
I20260709 13:01:18.688030  6490 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:18.711227  6086 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:18.724931  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:18.725481  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:18.732942  1703 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:18.723887  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.734829  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:18.734973  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:18.740288  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.736726  1707 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:18.741271  1704 raft_consensus.cc:2393] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 8: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:18.741948  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:18.736169  1706 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:18.680243  6429 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.739894  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:18.754575  1601 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:18.755558  6456 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.756103  6456 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:18.758477  6456 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:18.760878  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:18.763314  1701 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:18.751330  6145 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:18.766417  6504 log.cc:927] Time spent T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.175s	user 0.000s	sys 0.002s
I20260709 13:01:18.769263  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:18.767597  6334 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.769845  1707 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
W20260709 13:01:18.776100  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 58198us
I20260709 13:01:18.781839  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:18.782209  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.783361  6207 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.792552  6242 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:18.795023  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.779223  6197 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:18.803455  6514 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:01:18.796532  1551 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
W20260709 13:01:18.815080  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 130133us
I20260709 13:01:18.822832  1599 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:18.827826  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:18.829105  1599 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:18.830243  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 53390.2us
I20260709 13:01:18.813603  6197 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.842705  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:18.840953  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 183053us
I20260709 13:01:18.831938  1675 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:18.841256  1555 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:18.849035  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:18.850296  6145 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:18.850919  6145 raft_consensus.cc:697] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:18.851799  6145 consensus_queue.cc:237] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:18.840452  6414 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.855623  1675 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:18.856564  1675 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:18.857755  1675 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:18.856889  6522 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:18.859115  6341 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:18.860512  6456 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:18.860908  6456 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.861238  6456 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:18.865969  1675 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:18.778645  6334 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.876183  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:18.840536  6490 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.881857  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:18.882848  1629 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:18.890355  1703 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:01:18.846562  6197 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:18.841928  6436 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:18.892249  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:18.897292  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:18.899376  1632 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:18.901095  1552 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:18.902498  1631 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:18.908107  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:18.908459  6521 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:01:18.908794  1631 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:18.910478  6334 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.905798  6145 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:18.920801  6145 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.921186  6145 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:18.925313  6518 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:01:18.920235  6347 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:18.929162  6347 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:18.937863  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 997) took 1124 ms. Trace:
I20260709 13:01:18.938336  1556 rpcz_store.cc:276] 0709 13:01:17.813860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.817328 (+  3468us) service_pool.cc:224] Handling call
0709 13:01:18.079969 (+262641us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 13:01:18.080294 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:18.090547 (+ 10253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:18.090588 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:18.105876 (+ 15288us) log.cc:844] Serialized 26 byte log entry
0709 13:01:18.487772 (+381896us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:18.487816 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.489877 (+  2061us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.937417 (+447540us) raft_consensus.cc:1685] finished
0709 13:01:18.937445 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.937690 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10282,"raft.queue_time_us":787,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":44408,"spinlock_wait_cycles":54366464,"thread_start_us":319897,"threads_started":1,"wal-append.queue_time_us":506665}
I20260709 13:01:18.941016  6506 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.947568  6414 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.899783  6434 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.004717  6434 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:18.954339  1632 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:18.959874  6281 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:18.961318  6435 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
W20260709 13:01:19.007170  6460 consensus_meta.cc:287] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.832s	user 0.011s	sys 0.001s
I20260709 13:01:18.961910  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:18.963006  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.964423  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:19.015393  1559 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:19.015029  6240 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.016459  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.964752  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:18.966589  6512 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.636s	user 0.004s	sys 0.001s
I20260709 13:01:18.967156  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:19.017267  1559 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:19.021646  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:19.022022  1554 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:01:18.976890  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:18.978873  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:18.979154  6387 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:18.980438  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:18.981681  2327 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:01:18.985327  6517 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.343s	user 0.002s	sys 0.000s
W20260709 13:01:18.987591  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.989351  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:19.042318  1628 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:18.990788  1631 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:01:18.991897  2288 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:18.936391  6456 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.007786  2322 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:18.960879  6436 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.007225  6281 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:19.023244  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:18.896322  6522 raft_consensus.cc:697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:19.018875  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:18.968225  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.026587  1558 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.015072  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:19.028818  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:19.031807  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.033021  1705 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:19.035321  1555 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:19.036950  6387 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:19.054371  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:19.055217  6436 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:19.055671  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:19.056407  1552 raft_consensus.cc:2393] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:19.043299  1631 pending_rounds.cc:85] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 10
I20260709 13:01:19.038115  6347 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.057031  1631 pending_rounds.cc:107] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:01:19.070904  1631 raft_consensus.cc:2889] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:19.057056  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:19.071991  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 110123us
I20260709 13:01:18.959227  6145 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.072993  1601 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:19.073850  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 115008us
I20260709 13:01:19.076151  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:19.076479  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 84691us
I20260709 13:01:19.057878  1556 raft_consensus.cc:2368] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9.
I20260709 13:01:19.072997  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:19.078800  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:19.079224  1552 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:19.076993  1601 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:19.020200  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:19.081869  1599 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:19.052106  6412 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.052507  1551 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:19.052838  6391 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.047817  1630 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:19.084959  1601 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:19.081799  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:19.094519  1704 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:01:19.095085  6393 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:19.095572  6393 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.095938  6393 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:19.098313  1558 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:19.025357  6341 raft_consensus.cc:697] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:19.104082  6535 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.104956  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:19.078694  6281 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:19.112404  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:19.113157  1630 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.105288  6412 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.113572  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:19.102977  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:19.106158  6527 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:19.100867  6436 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:01:19.123214  6527 raft_consensus.cc:697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:19.101989  6391 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.086580  6415 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:19.131414  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:19.132097  1706 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:19.132164  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 284219us
I20260709 13:01:19.118413  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:19.119596  1708 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 10: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:19.088063  6414 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:19.111279  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:19.136986  1705 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:19.119413  6535 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.124289  6527 consensus_queue.cc:237] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:19.126614  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 260669us
I20260709 13:01:19.120919  2288 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:19.027818  6508 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.129421  1559 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:19.134027  1555 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:19.101337  6491 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:19.137362  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:19.148952  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:19.149183  1701 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.137931  1554 raft_consensus.cc:2393] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:19.156409  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:19.114022  6503 consensus_queue.cc:1059] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:01:19.131629  6415 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.135685  6509 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.168118  1630 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:19.166585  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:19.161871  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:19.135378  6506 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:19.140262  6414 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:19.161881  6435 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:19.187471  1705 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:19.170377  6270 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:19.133092  6197 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.184442  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:19.187565  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:19.176833  6415 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:19.197017  6435 raft_consensus.cc:697] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:19.201485  6435 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.205102  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:19.205546  6508 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:19.207111  6535 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:19.207955  6197 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:19.181360  6209 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:19.181452  6506 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:19.229547  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:19.238590  1628 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:19.213136  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:19.188942  6414 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.232292  1703 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:19.188045  6434 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:19.242568  1700 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:19.248421  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:19.249215  1632 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:19.245190  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:19.250733  1704 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.252019  1701 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:19.193991  6270 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:19.253788  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:19.254168  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:19.145371  6522 consensus_queue.cc:237] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.255137  1708 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:01:19.258142  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 96423.6us
I20260709 13:01:19.255246  1628 raft_consensus.cc:2410] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:19.256822  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:19.258960  1675 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:19.259086  1700 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:19.198832  5938 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:19.262452  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:19.205107  6412 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:19.285542  1703 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:19.260437  1675 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:19.287793  1675 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:19.245406  6506 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.258419  6270 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:19.282079  5938 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.301537  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:19.255643  6491 raft_consensus.cc:697] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:19.185633  6509 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.305708  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:19.254062  6536 raft_consensus.cc:2764] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:01:19.286053  6534 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:19.322943  5938 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.296710  6456 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:19.272392  6434 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:19.285617  6535 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:01:19.240394  6508 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:01:19.295390  6436 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:19.249990  6209 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:19.321985  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 153903us
I20260709 13:01:19.322113  6240 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:19.356127  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:19.356794  1557 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:01:19.326468  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 131616us
I20260709 13:01:19.341405  1626 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:19.344383  1552 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:19.283944  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:19.345640  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:19.236109  6341 consensus_queue.cc:237] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.361495  1627 raft_consensus.cc:2393] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:19.349867  1706 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:19.321345  6503 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:19.350544  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:19.351329  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:19.321538  6347 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:19.358526  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:19.369805  1708 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:19.351832  6533 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:01:19.327756  6249 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:19.323459  6429 consensus_queue.cc:1059] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:01:19.363858  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:19.289008  6538 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:01:19.370111  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:19.359053  1599 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:19.390005  1633 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:19.342502  6534 raft_consensus.cc:697] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:19.384838  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:19.350714  6145 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:19.394569  1552 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
W20260709 13:01:19.405088  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 67530.9us
I20260709 13:01:19.371232  6456 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.388422  6391 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:19.388026  6436 raft_consensus.cc:697] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:19.394686  6235 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:19.361752  6457 consensus_queue.cc:1059] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:01:19.394795  6249 raft_consensus.cc:697] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:19.401630  6508 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:19.427663  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:19.429121  6548 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:01:19.417943  6541 log.cc:927] Time spent T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.054s	user 0.000s	sys 0.002s
I20260709 13:01:19.440232  1700 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:19.393115  5938 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:19.452973  6537 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:01:19.371666  6503 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.390738  6491 consensus_queue.cc:237] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:19.461135  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 102176us
I20260709 13:01:19.461246  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:19.464278  1700 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.455116  6249 consensus_queue.cc:237] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.461756  6545 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:19.455107  6235 raft_consensus.cc:697] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:19.479102  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:19.457166  6457 consensus_queue.cc:1243] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:19.425762  6456 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.483920  1700 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:19.502446  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:19.515708  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:19.517817  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:19.503692  1635 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:19.522410  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:19.522410  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:19.523454  1709 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:01:19.542053  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:19.540835  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:19.496912  6545 raft_consensus.cc:697] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:19.544073  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:19.546415  1627 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:19.463088  6434 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.559523  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:19.560207  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:19.561268  1700 raft_consensus.cc:2368] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12.
I20260709 13:01:19.564425  1704 raft_consensus.cc:2410] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:19.566444  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:19.567160  2327 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:19.569407  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:19.564285  1526 connection.cc:256] RPC call timeout handler was delayed by -1.4429387100000213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
I20260709 13:01:19.519660  6436 consensus_queue.cc:237] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.566781  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:19.571538  1526 connection.cc:256] RPC call timeout handler was delayed by -1.3007387100000187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
I20260709 13:01:19.559232  6209 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:19.571882  6549 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:19.575752  6549 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.578296  1630 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:01:19.487471  6534 consensus_queue.cc:237] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.591084  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:19.572739  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0334387100000413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
I20260709 13:01:19.568966  6145 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.597419  1635 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13. Ops: [9.5-12.6]
W20260709 13:01:19.599524  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 120959us
I20260709 13:01:19.617041  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:19.625640  5938 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:19.630781  1557 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:19.630470  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:19.632710  1633 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:19.639442  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:19.653580  6503 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:19.600850  6145 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.640518  6508 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:19.644647  6549 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:19.571579  6235 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:19.684333  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 139890us
I20260709 13:01:19.686195  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:19.686875  1635 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:19.687587  2288 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:19.688617  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 74794us
I20260709 13:01:19.656316  6565 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:19.691272  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:19.673269  6456 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:19.698380  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:19.697634  1599 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:19.707207  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 67696.8us
I20260709 13:01:19.707916  1675 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:19.735550  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48101.5us
I20260709 13:01:19.736402  6563 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:19.731582  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:19.737521  6563 raft_consensus.cc:697] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:19.738011  2288 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:19.738462  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:19.739523  6571 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:19.739977  6556 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:19.740176  6571 raft_consensus.cc:697] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:19.740473  6556 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:19.741207  6503 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:19.739372  6563 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:19.733788  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 44281.8us
I20260709 13:01:19.638464  6545 consensus_queue.cc:237] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.740909  6556 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:19.780658  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 83085.6us
I20260709 13:01:19.698756  6341 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:01:19.731520  6240 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:19.782058  1599 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:19.792101  6581 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:19.792963  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:19.822970  1703 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:01:19.759653  6564 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:19.767992  6414 consensus_meta.cc:287] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.001s
I20260709 13:01:19.822993  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:19.770205  6524 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:19.833114  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:19.837752  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:19.838617  1633 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.823727  6240 raft_consensus.cc:697] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:19.832213  6524 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.843098  6503 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:19.851629  6580 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:19.852072  6415 consensus_meta.cc:287] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.001s
I20260709 13:01:19.852125  6413 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:19.831594  6414 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:19.853145  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.795502  6508 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.853806  6526 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:19.871780  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.860559  1635 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:19.866328  1630 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:19.868623  1633 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:19.874532  1709 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:19.877877  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 82968.7us
I20260709 13:01:19.878655  1630 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:19.879030  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:19.880443  6242 consensus_queue.cc:1059] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:19.881645  6242 raft_consensus.cc:3055] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:19.881994  6242 raft_consensus.cc:740] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:19.867131  6524 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:19.882956  6242 consensus_queue.cc:260] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:19.902172  6242 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.902817  1634 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:19.841794  6571 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.914510  6240 consensus_queue.cc:237] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.870934  6415 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:19.921654  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.925838  6393 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.829s	user 0.005s	sys 0.009s
I20260709 13:01:19.926486  6393 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.928361  1631 raft_consensus.cc:2368] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13.
W20260709 13:01:19.929035  6570 log.cc:927] Time spent T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.106s	user 0.001s	sys 0.001s
W20260709 13:01:19.929702  6506 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.003s
I20260709 13:01:19.930173  6506 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.940327  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:19.951812  6506 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:19.952841  6544 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:19.953315  6544 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:19.954201  6544 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.955451  6544 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:19.959262  1635 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:19.965320  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:19.974118  1635 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:19.947994  6503 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.842058  6581 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:19.957337  6207 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:19.937224  6536 consensus_queue.cc:1059] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:01:19.869496  6580 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:19.972002  6459 consensus_queue.cc:1059] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:01:19.877525  6526 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:19.993526  6270 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.651s	user 0.013s	sys 0.000s
I20260709 13:01:20.020084  6459 consensus_queue.cc:1243] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:01:20.024484  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 52560.4us
I20260709 13:01:19.984804  6503 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.017095  6393 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:20.019178  6341 raft_consensus.cc:3055] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:20.019641  6413 raft_consensus.cc:697] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:20.038892  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:20.039955  1627 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:20.024153  6270 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.021999  6207 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.109637  6526 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:20.033922  6341 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:20.105134  6413 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:20.119848  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58280us
W20260709 13:01:20.120975  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 286287us
W20260709 13:01:20.147210  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 115067us
I20260709 13:01:20.147496  6341 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.110512  6565 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:20.133364  6584 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:01:20.134199  1673 leader_election.cc:336] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.523s (SENT)
I20260709 13:01:20.121521  6397 raft_consensus.cc:3055] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:01:20.159554  1673 leader_election.cc:336] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.531s (SENT)
I20260709 13:01:20.165337  6415 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:20.165194  6556 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:20.167507  6556 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:20.157514  6397 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:20.170696  6207 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:20.172930  6581 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:20.173625  6145 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:20.174463  6503 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:20.187897  6207 consensus_queue.cc:1059] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:20.189095  6207 raft_consensus.cc:3055] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:20.189532  6207 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:20.191033  6207 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:20.192435  6207 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:20.158938  6540 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:20.203159  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:20.159425  6580 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:20.219939  6270 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:20.207479  6556 consensus_queue.cc:1059] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:01:20.222013  6556 raft_consensus.cc:3055] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:20.222607  6556 raft_consensus.cc:740] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:20.208031  6397 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.224514  6397 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:20.230163  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.230967  6529 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:20.231575  6529 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.235638  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:20.212164  6540 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:20.265508  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48532.5us
I20260709 13:01:20.268556  6556 consensus_queue.cc:260] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:20.282229  6601 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:01:20.282609  6556 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:20.286278  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.288221  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:20.294967  1673 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.660s (SENT)
I20260709 13:01:20.295572  1673 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:20.296860  6456 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.298384  2323 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:20.301255  6600 log.cc:927] Time spent T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:01:20.277901  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:20.302557  2329 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:20.308898  2322 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:20.311476  6414 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:20.277189  6524 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:20.315102  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48843.3us
W20260709 13:01:20.319161  1673 leader_election.cc:336] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.743s (SENT)
I20260709 13:01:20.322851  6023 raft_consensus.cc:3055] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:20.323371  6023 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:20.324388  6023 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.272795  6603 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.333097  2323 raft_consensus.cc:1240] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:20.336447  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.337420  1523 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:20.346506  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.346477  6610 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.347445  6023 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.355026  6524 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:20.359524  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:20.360260  2322 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:20.361447  1672 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:20.362118  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:20.362409  6457 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:20.362936  6457 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:20.363333  6457 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.365828  6435 raft_consensus.cc:3055] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:20.366248  6435 raft_consensus.cc:740] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:20.367139  6435 consensus_queue.cc:260] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:20.372844  6609 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:20.372715  6610 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.373579  6609 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.374269  6603 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:20.374701  6603 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:20.375064  6603 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:20.375871  6609 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:20.372875  6397 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:20.376936  6509 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:20.377199  6397 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:20.379256  6397 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:20.383271  6341 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.375497  6610 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:20.387205  6590 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.113s	user 0.002s	sys 0.003s
I20260709 13:01:20.383124  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:20.353895  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:20.391738  1526 leader_election.cc:400] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12.
I20260709 13:01:20.392923  1526 leader_election.cc:403] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:20.400957  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 63654.2us
I20260709 13:01:20.404085  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:20.404745  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:20.406966  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:20.404747  1552 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:20.409731  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:20.410578  1554 raft_consensus.cc:2393] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:20.409792  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:20.413062  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.368407  6435 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:20.419955  1704 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:20.421509  2288 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:20.425175  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:20.424857  6509 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:20.426779  6509 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.427138  6509 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:20.429672  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:20.430716  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:20.430729  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:20.432389  1704 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 10: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:20.433161  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:20.433784  1700 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:20.435940  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:20.436825  1633 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:20.417760  6610 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:20.441967  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:20.444096  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:20.446080  1633 raft_consensus.cc:2368] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13.
I20260709 13:01:20.445086  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:20.447419  1634 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:01:20.448999  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:20.450712  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:20.451915  1629 raft_consensus.cc:2410] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:20.453068  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:20.454205  1705 raft_consensus.cc:2393] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 18: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:20.458618  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2807) took 1295 ms. Trace:
I20260709 13:01:20.459311  1631 rpcz_store.cc:276] 0709 13:01:19.171194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.177191 (+  5997us) service_pool.cc:224] Handling call
0709 13:01:20.458288 (+1281097us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b5400302ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:20.458513 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1691819904}
W20260709 13:01:20.464112  6597 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.182s	user 0.000s	sys 0.003s
I20260709 13:01:20.440620  6610 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.467517  6610 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:20.421651  6603 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.470418  6603 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:20.444871  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:20.471004  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:20.472433  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:20.473170  1707 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:01:20.474126  6457 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.477653  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:20.478281  2323 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:20.480419  6543 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:20.480995  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:20.484282  6608 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.485257  1627 raft_consensus.cc:1275] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
W20260709 13:01:20.485672  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.487735  1634 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:20.487857  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 73361.2us
I20260709 13:01:20.488013  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:20.488775  1700 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:20.489032  1523 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:20.489355  6397 consensus_queue.cc:1059] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:20.490705  6556 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:20.491142  6556 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.491081  6553 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.491674  6556 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:20.491729  1553 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:20.491853  6553 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:20.493290  1704 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:20.494261  6553 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:20.494823  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:20.495426  1708 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:20.496276  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:20.496697  6609 raft_consensus.cc:3055] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:20.497102  6609 raft_consensus.cc:740] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:20.498046  6609 consensus_queue.cc:260] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.499425  6609 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.503541  2323 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:20.503942  6529 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:20.510211  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:20.511096  1629 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:20.504864  2321 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:20.514065  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:20.514734  1552 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:20.515431  6540 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:20.515599  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:20.516413  6460 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.519043  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2828) took 1232 ms. Trace:
I20260709 13:01:20.519472  1702 rpcz_store.cc:276] 0709 13:01:19.286232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.286348 (+   116us) service_pool.cc:224] Handling call
0709 13:01:20.518829 (+1232481us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54002544d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:20.518967 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2107564416}
I20260709 13:01:20.519800  6610 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:20.520661  6457 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:20.521006  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:20.521517  6249 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.527495  6569 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:20.521733  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:20.521056  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 95930.9us
I20260709 13:01:20.529876  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:20.530048  6603 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.530620  6603 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:20.531096  1673 leader_election.cc:336] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.980s (SENT)
W20260709 13:01:20.531147  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 44925.2us
I20260709 13:01:20.531754  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:20.532548  6242 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:20.533479  6610 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:20.533643  6507 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:20.534998  6507 raft_consensus.cc:3055] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:20.535367  6507 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:20.536887  6603 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:20.528261  6556 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.539471  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:20.538004  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:20.540825  1629 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:20.540820  1601 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:20.527856  1551 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:20.538223  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:20.538498  1598 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:20.538745  6582 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:20.538807  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:20.543473  1702 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:20.536278  6507 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.546767  2286 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:20.542013  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:20.542253  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:20.550958  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:20.540822  6554 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:20.541529  6561 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:20.526522  6435 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:20.523409  1672 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:20.544862  1552 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:20.547875  1700 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:20.551692  1557 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:01:20.543248  1675 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:20.554095  1673 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:20.561245  1704 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:20.563599  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:20.561234  1601 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:20.562642  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:20.566864  1554 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:20.554093  6208 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.549938  6540 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:20.570139  1708 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:20.571062  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:20.572729   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:20.572742  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:20.549710  6524 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:20.549140  6556 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:20.576298  2329 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:20.582011  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:20.582652  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:20.584528  1557 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:01:20.582691  2323 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:20.588053  1598 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:20.592487  1554 raft_consensus.cc:1240] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:20.551970  6490 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:01:20.600574  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50767.2us
I20260709 13:01:20.601362  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:20.596839  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.589344  6603 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.603615  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:20.574759  6564 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:20.586130  6507 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:20.582795  6197 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.573632  6561 raft_consensus.cc:697] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:20.597702  6412 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:20.616505  1552 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:20.605538  6542 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:20.576299  6341 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:20.623622  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:20.624553  1553 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:20.597151  6457 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:01:20.597333  6456 consensus_queue.cc:1059] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:01:20.607438  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:20.639866  6509 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.644541  2321 raft_consensus.cc:2368] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:01:20.642670  6509 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:20.658615  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:20.602101  1557 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:20.582792  6540 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:20.606268  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64065.2us
I20260709 13:01:20.574928  6582 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.667050  2329 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
W20260709 13:01:20.620602  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.583930  6554 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.586113  6544 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:01:20.581805  6023 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.631188  6524 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:20.634943  1702 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:01:20.637180  6561 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.598368  6569 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:01:20.669596  1523 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:20.686048  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:20.700570  1523 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:20.656872  6542 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:20.667263  6540 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:20.706367  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:20.707165  1601 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:20.724884  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 59876.8us
I20260709 13:01:20.735194  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:20.735119  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 133548us
I20260709 13:01:20.735975  1552 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:20.736254  1673 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:20.672092  6527 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.703003  6553 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.745769  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:20.732965  6609 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:20.720942  6457 raft_consensus.cc:3055] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:20.751626  1552 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
W20260709 13:01:20.758980  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 51912.2us
I20260709 13:01:20.731693  6564 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:20.705837  6341 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:20.742038  6603 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:20.774202  1630 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:20.741863  6556 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:20.745748  1557 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:01:20.789359  1634 raft_consensus.cc:1275] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:20.789460  1630 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:20.770093  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:20.746371  6381 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:01:20.780530  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:20.801682  1707 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:20.795758  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:20.802764  1557 raft_consensus.cc:2393] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 16: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:20.758946  6609 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.760565  6023 raft_consensus.cc:2764] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:01:20.748986  6524 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:20.765230  6457 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:20.772746  6603 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.770957  6587 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:20.781709  6554 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:20.813982  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:20.827713  1551 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:20.830257  1599 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:20.758206  6553 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.745649  6527 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.813602  6609 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:20.762928  6581 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 13:01:20.834663  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.833832  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:20.811689  6503 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:20.811019  6556 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:01:20.841612  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.842924  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:20.830858  6603 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:20.875722  2286 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:20.851964  6397 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:20.852559  6490 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.904320  1551 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:20.905539  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:20.864814  6612 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.909164  6270 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:20.913040  6457 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:20.914319  6556 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.907579  6582 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:20.921551  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.939301  1707 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:20.884284  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:20.924754  1673 leader_election.cc:336] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.502s (SENT)
I20260709 13:01:20.869586  6554 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.941879  6554 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:20.943059  6538 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:20.944877  6565 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:20.945230  6618 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:01:20.946426  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 62229.1us
I20260709 13:01:20.949491  2329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:20.950619  2329 raft_consensus.cc:606] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:20.950945  2329 raft_consensus.cc:614] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:20.952037  6527 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:20.952725  6524 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:20.953490  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:20.954658  6565 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.958024  6270 raft_consensus.cc:697] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:20.957374  6421 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:20.959167  6270 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.959904  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:20.960632  2323 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:20.929687  1708 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:20.932909  6457 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:20.900910  6341 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.977876  6553 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:20.905746  6614 consensus_queue.cc:1059] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:01:20.979569  6614 raft_consensus.cc:3055] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:20.979864  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:20.980463  6552 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:20.943917  6538 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:20.982087  6413 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:20.913121  6619 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:01:20.985663  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:20.965691  6608 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12.
I20260709 13:01:20.982457  6538 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:20.843025  6587 raft_consensus.cc:697] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:20.988461  6538 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.989436  6587 consensus_queue.cc:237] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:20.991808  2329 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:01:20.993499  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.979938  6614 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:20.982519  6413 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.004071  6413 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:20.962030  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:21.010756  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 48815us
I20260709 13:01:21.013257  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:21.020526  6612 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:21.021148  6612 raft_consensus.cc:697] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:21.022581  6612 consensus_queue.cc:237] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:21.024374  6397 consensus_queue.cc:1059] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:21.025707  6565 raft_consensus.cc:3055] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:21.028324  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:21.031199  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:21.026259  6565 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:21.031922  1704 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:21.032503  6553 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.033958  6553 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:21.034746  2322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:21.035300  2322 raft_consensus.cc:606] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:21.035631  2322 raft_consensus.cc:614] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:21.036041  1628 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:21.036206  6553 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:21.036731  6544 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.033274  1707 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:01:21.039861  1631 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:01:21.009387  6503 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:21.039875  6544 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:21.043246  6544 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:21.044476  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:21.046764  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:21.048841  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:21.049485  1707 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:21.049408  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:21.063314  1557 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:21.008397  6569 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.070437  1601 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:21.091737  1708 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:21.092996  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:21.097307  1707 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:01:21.096244  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 67987.9us
I20260709 13:01:21.101063  1707 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:01:21.101122  1673 leader_election.cc:336] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.681s (SENT)
I20260709 13:01:21.101914  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:21.099876  6414 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:21.103616  6414 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.103991  6414 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.111116  2322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:21.065570  6460 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:21.092015  6526 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:21.057304  6609 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:21.117449  1523 leader_election.cc:400] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:01:21.124261  1523 leader_election.cc:403] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:01:21.119187  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 288974us
I20260709 13:01:21.102532  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:21.079092  6585 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:01:20.855014  6542 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:21.099318  6610 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:01:21.125725  1673 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.004s (SENT) [suppressed 22 similar messages]
I20260709 13:01:21.032413  6565 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:21.076996  6456 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:01:21.094575  6490 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:01:21.155648  1673 leader_election.cc:336] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.034s (SENT)
I20260709 13:01:21.172333  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:21.121672  6023 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:21.120143  6526 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.079404  6569 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:21.126075  6397 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:01:21.106369  6529 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:01:21.124717  6460 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:21.194438  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.183140  6526 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.208318  1704 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:21.180979  6610 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:21.216706  2322 raft_consensus.cc:606] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:21.217211  2322 raft_consensus.cc:614] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:21.201299  6565 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.111228  6614 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:21.200280  6581 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:21.200742  6628 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:21.210870  6381 consensus_queue.cc:1059] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:01:21.230436  6580 raft_consensus.cc:3055] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:21.230867  6580 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:21.230923  6414 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:21.231956  6580 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:21.211892  6610 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:21.238695  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 83110.1us
W20260709 13:01:21.239738  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 137265us
I20260709 13:01:21.243391  1526 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:21.241292  6610 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:21.323544  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:01:21.326666  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 64155.9us
W20260709 13:01:21.329572  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 43507.1us
I20260709 13:01:21.257556  1526 leader_election.cc:400] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13.
I20260709 13:01:21.240955  6628 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:21.279520  6414 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:21.281489  6460 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:21.282580  6609 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:21.283716  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:21.298090  6603 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:21.376986  6569 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:21.378374  6603 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:21.307644  6627 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.111s	user 0.000s	sys 0.003s
W20260709 13:01:21.380193  6540 consensus_meta.cc:287] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.000s
I20260709 13:01:21.315240  6526 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
W20260709 13:01:21.316960  1673 leader_election.cc:336] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.908s (SENT)
I20260709 13:01:21.380965  1673 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:21.349224  1526 leader_election.cc:403] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:21.336658  6632 log.cc:927] Time spent T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:01:21.315500  6413 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:21.345470  6508 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:01:21.365422  6628 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:21.338685  6341 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:21.392307  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 134918us
W20260709 13:01:21.393018  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 76079us
I20260709 13:01:21.361385  6423 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:21.368886  2288 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:21.370976  1557 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:21.372491  2324 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.366045  6625 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:01:21.393504  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:21.387686  6640 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:21.389524  6569 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:01:21.401749  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 215936us
I20260709 13:01:21.404130  1526 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:21.420512  2324 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:21.396804  6637 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13.
I20260709 13:01:21.426489  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:21.424084  1523 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:21.427580  6637 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:21.428177  6637 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:21.400142  6529 raft_consensus.cc:2764] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
W20260709 13:01:21.429508  6507 consensus_meta.cc:287] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.817s	user 0.012s	sys 0.000s
I20260709 13:01:21.429180  6637 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:21.431069  6413 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:21.422947  6640 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:21.423467  6608 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:21.425302  6414 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:21.436838  2321 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:21.437057  1599 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:21.438045  1703 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:01:21.398226  6341 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:21.440116  6341 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:21.438419  1703 pending_rounds.cc:85] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 10
I20260709 13:01:21.440876  1703 pending_rounds.cc:107] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:01:21.441138  1703 raft_consensus.cc:2889] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:21.425920  6526 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
W20260709 13:01:21.448453  6643 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:01:21.450116  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 46023us
I20260709 13:01:21.388484  6540 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:21.451187  1526 leader_election.cc:400] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13.
I20260709 13:01:21.407128  6612 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:21.456976  1526 leader_election.cc:403] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:21.457485  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:21.458777  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.404784  6456 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:21.407440  6397 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.476966  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:21.474069  2288 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:21.477839  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:21.479198  2324 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:21.469481  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:21.453500  6642 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:01:21.480522  6460 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:01:21.416682  6509 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:01:21.481230  6508 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:01:21.458531  6414 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:21.450677  6628 consensus_queue.cc:1059] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:01:21.492720  6609 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.499007  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:21.499778  1560 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:21.459263  6503 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.493351  6609 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:21.475260  6608 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.506791  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:21.501638  6612 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13.
I20260709 13:01:21.494114  6529 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.501098  6642 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:21.523783  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:21.530908  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.538944  1560 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.541307  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:21.541754  1630 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:21.543514  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:21.545961  1633 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:21.477697  6456 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:21.560664  1628 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:01:21.562770  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 111707us
I20260709 13:01:21.564124  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:21.564308  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:21.565073  1558 raft_consensus.cc:2368] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:21.566006  6553 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:21.516678  6503 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:21.525163  6542 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:21.559180  6642 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:21.569144  6542 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:21.570991  6642 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:21.571295  6542 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:21.575098  1554 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:21.580199  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:21.581040  1558 raft_consensus.cc:2376] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14. Re-sending same reply.
I20260709 13:01:21.582085  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:21.579059  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:21.589601  6609 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:21.592126  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:21.592648  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:21.592978  2325 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 12: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:21.524192  6608 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:21.598165  2329 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:21.579593  6565 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:21.605393  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:21.611776  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.614126  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:21.618687  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:21.619689  1551 raft_consensus.cc:2393] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:21.622402  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:21.622992  1551 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.629508  6540 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:21.616999  6565 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:21.618664  6456 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:21.635601  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:21.637871  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58867.6us
I20260709 13:01:21.648443  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:21.655104  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:21.657202  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.668195  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:21.674942  1554 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:21.675926  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:21.679530  1555 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:21.668450  6609 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:01:21.684322  1560 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:21.668831  6628 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.688951  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:21.690290  1555 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:21.701750  6587 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:21.703088  6640 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:21.703501  6608 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:21.705883  1673 leader_election.cc:336] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.570s (SENT)
I20260709 13:01:21.681704  6650 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:21.622218  6610 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:21.706602  1599 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:21.712127  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:21.715514  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:21.716346  1555 raft_consensus.cc:2368] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10.
I20260709 13:01:21.708317  6650 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:21.729583  6503 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:21.745257  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:21.748206  1555 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:21.749625  1559 raft_consensus.cc:2393] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:21.753496  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:21.754312  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:21.753665  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:21.758005  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:21.759533  6565 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:21.710572  6540 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:01:21.721756  6490 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:21.774689  1552 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:21.777835  1551 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:21.780046  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:21.781180  1557 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:21.787997  1709 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:21.767244  6571 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:01:21.790535  1703 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:21.790663  6413 raft_consensus.cc:3055] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:21.791262  6413 raft_consensus.cc:740] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:21.775676  6208 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:01:21.793062  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:21.794134  1705 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:21.769625  6281 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:01:21.769874  6460 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:21.788285  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:21.804275  1673 leader_election.cc:336] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.667s (SENT)
I20260709 13:01:21.804450  1701 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.788089  1634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 13:01:21.807803  1634 raft_consensus.cc:606] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:21.808218  1634 raft_consensus.cc:614] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:21.811811  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:21.814285  1628 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:21.767813  6552 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.833256  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:21.829571  1551 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:21.841317  1552 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:21.810747  6490 raft_consensus.cc:697] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:21.858349  1601 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:21.861681  6553 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.864867  6542 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.865481  6542 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:21.866688  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58807.8us
I20260709 13:01:21.875049  6542 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:21.879608  1551 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:21.792253  6413 consensus_queue.cc:260] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:21.888779  1701 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:21.841483  6552 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:21.878289  6524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.027s	sys 0.036s
I20260709 13:01:21.901541  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:21.904035  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 137952us
W20260709 13:01:21.912103  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 53839.4us
W20260709 13:01:21.903570  6524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.027s	sys 0.036s
W20260709 13:01:21.945276  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:21.972829  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 220941us
I20260709 13:01:21.977895  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:21.909143  6650 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:21.980238  1555 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:21.985435  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:21.986111  1704 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:21.908034  6628 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:01:21.995157  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:21.995890  1709 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:01:22.001662  1555 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:22.004743  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 98801.6us
W20260709 13:01:22.005750  1673 leader_election.cc:336] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.052s (SENT)
W20260709 13:01:22.013736  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.987455  6610 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.045336  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:22.045661  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:22.045987  1555 raft_consensus.cc:2376] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13. Re-sending same reply.
I20260709 13:01:22.046852  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:22.046995  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:22.048943  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.050207  1704 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 19.
I20260709 13:01:21.996557  6208 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:22.053843  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:22.057420  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:22.056556  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.059423  1558 raft_consensus.cc:1275] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:22.060473  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:22.059752  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 79608.6us
I20260709 13:01:21.956550  6490 consensus_queue.cc:237] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:22.034425  6587 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.064047  1703 raft_consensus.cc:2368] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
W20260709 13:01:22.056093  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.077780  1673 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:21.995437  6524 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:01:22.019155  6540 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:22.066017  6661 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:01:22.043674  6281 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:22.056084  6657 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:01:22.083483  2321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:22.088454  2321 raft_consensus.cc:606] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:22.085741  6667 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:01:22.092397  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:22.062673  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 143728us
I20260709 13:01:22.102093  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:22.105422  1630 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:22.054467  6508 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:01:22.112026  1673 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:22.052980  6208 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.115912  1709 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:22.124519  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:22.129812  1630 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:22.125272  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:22.125881  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:22.126508  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:22.127600  1632 raft_consensus.cc:1275] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:22.129726  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:22.131878  1628 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:22.082141  6587 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:22.132812  6662 log.cc:927] Time spent T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:01:22.133031  1628 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:22.133755  6671 log.cc:927] Time spent T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:01:22.134554  6587 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:22.130831  1635 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.077706  6507 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:01:22.138172  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:22.114204  6660 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.228s	user 0.001s	sys 0.001s
I20260709 13:01:22.093627  6281 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:22.140813  6663 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:01:22.142236  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:22.138238  6552 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:22.138167  6553 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:22.147964  1635 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:22.113289  6667 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:22.135241  6670 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:01:22.154201  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:22.152295  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:22.156489  1634 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:22.139557  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:22.156042  6668 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:22.169598  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 149423us
W20260709 13:01:22.166752  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 103205us
I20260709 13:01:22.170050  1601 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:22.159715  6628 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.168545  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:22.175107  1628 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:22.151326  6666 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:01:22.179458  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:22.185246  6608 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:22.185758  6642 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:01:22.229063  6580 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:22.181914  6690 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:22.233335  1601 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:22.234798  6023 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:22.236202  6642 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:22.236837  6642 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:22.237274  6642 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:22.176930  6628 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.178395  6524 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:22.209431  6667 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:22.210398  6281 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.209471  6208 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.174609  6552 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:22.261771  1707 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:22.176403  6686 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.179551  6503 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:22.187534  1526 leader_election.cc:400] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
W20260709 13:01:22.263453  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 82035.2us
I20260709 13:01:22.263638  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:22.240904  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 58921.1us
I20260709 13:01:22.260975  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.267091  1601 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:22.257920  6524 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.280714  6686 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.283169  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.283825  1709 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:22.284751  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.285919  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:22.286616  1709 raft_consensus.cc:2368] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19.
I20260709 13:01:22.288681  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.281271  6524 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:22.290515  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.290844  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.293365  1708 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:22.317793  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:22.304455  6208 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:22.324833  1526 leader_election.cc:400] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19.
I20260709 13:01:22.308362  6553 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:22.312809  6503 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.293363  6552 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.329399  6556 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:22.328516  6208 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:22.353152  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 241338us
I20260709 13:01:22.359887  1700 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:22.360865  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.346446  1526 leader_election.cc:403] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:01:22.370724  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46175.9us
I20260709 13:01:22.356359  6556 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:22.376200  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:22.372387  6650 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:22.367218  6553 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:22.324254  6680 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:01:22.377024  6556 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.367014  6665 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:01:22.356148  6503 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:22.421279  6688 log.cc:927] Time spent T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:01:22.425107  6490 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:22.415185  6686 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:22.434556  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 60150.7us
W20260709 13:01:22.415088  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 211343us
I20260709 13:01:22.321398  6652 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:01:22.371615  6667 consensus_queue.cc:1059] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:01:22.376703  6628 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:22.412122  6693 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:01:22.448948  6697 raft_consensus.cc:3055] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:22.449410  6697 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:22.435144  6696 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.442373  6704 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:22.445209  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:22.446723  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.459046  6208 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.446343  6553 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:22.446584  6642 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:22.459177  6524 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.463763  6503 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.465077  6524 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:22.437808  6490 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:22.465910  1628 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:01:22.432415  6686 consensus_queue.cc:1059] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:01:22.456187  6696 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:22.495779  1629 raft_consensus.cc:2410] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:22.471328  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.471544  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:22.472663  6668 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:22.472651  6642 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.474490  6685 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:22.476563  6650 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19.
I20260709 13:01:22.477210  6614 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.445519  6421 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.482236  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:22.493069  6552 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:22.499387  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:22.495163  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 76717.7us
I20260709 13:01:22.450194  6697 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:22.506184  1627 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:22.516305  6697 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:22.515786  1630 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:22.515518  1673 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:22.505823  6694 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:01:22.503602  6685 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.520147  6650 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.514859  6665 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.523211  6667 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:22.542047  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:22.533697  6023 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:22.554901  6023 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:22.536980  6650 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:22.559396  6650 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.560153  6625 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:22.560636  6625 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:22.533226  6685 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:22.561635  6633 log.cc:927] Time spent T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.199s	user 0.006s	sys 0.002s
I20260709 13:01:22.563048  6652 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:22.542421  6665 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.553807  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:22.565729  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:22.554279  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.560431  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:22.570708  1560 raft_consensus.cc:2376] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13. Re-sending same reply.
I20260709 13:01:22.551952  6705 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:22.554075  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:22.505662  6683 consensus_queue.cc:1059] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:01:22.559922  6650 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.574064  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:22.586022  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:22.574867  1552 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 10: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:22.579725  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:22.588119  1628 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:22.583775  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2468) took 1540 ms. Trace:
I20260709 13:01:22.594946  1560 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:22.593020  1631 rpcz_store.cc:276] 0709 13:01:21.043327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.043427 (+   100us) service_pool.cc:224] Handling call
0709 13:01:21.043727 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:21.044369 (+   642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:21.044397 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:21.045009 (+   612us) log.cc:844] Serialized 52 byte log entry
0709 13:01:21.189224 (+144215us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:21.189263 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.189334 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:22.561201 (+1371867us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b24002aa6b8. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed681e9c4 00007f0ed681cacb 00007f0ed69d7dc9 00007f0ed69d7a55 00007f0ed69d709d 00007f0ed960910e 00007f0ed962088c 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221
0709 13:01:22.563898 (+  2697us) raft_consensus.cc:1685] finished
0709 13:01:22.563922 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:22.583609 (+ 19687us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":10432768,"thread_start_us":143833,"threads_started":1,"wal-append.queue_time_us":271569}
I20260709 13:01:22.610432  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:22.617559  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:22.619001  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.518334  6421 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.567665  6704 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:22.584609  6249 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:22.632709  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 96684.7us
I20260709 13:01:22.604681  6397 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:22.598071  6637 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:22.600246  6490 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.563676  6652 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:22.606568  6683 raft_consensus.cc:3055] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:22.573979  6667 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.660295  6683 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:22.672536  6667 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:22.678123  6281 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:22.678689  6281 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.680536  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:22.681010  6281 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.620311  6503 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:01:22.663174  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:22.686022  6553 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.686601  6553 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.665022  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.665887  6421 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.690663  6553 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:22.694837  6707 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:01:22.604453  6705 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.697729  6569 raft_consensus.cc:3055] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:22.698215  6569 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:22.698518  6705 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:22.699046  6569 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:22.669303  6652 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.669808  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.604321  6650 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.704984  6569 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.561522  6625 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.641230  6704 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.707903  1701 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:22.714519  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.712239  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:22.715229  1706 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:22.715397  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.713192  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:22.716636  1707 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:22.644553  6696 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:22.716676  6706 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:22.618664  6686 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:01:22.728433  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 132840us
I20260709 13:01:22.733654  2288 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:22.710457  6650 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:22.740885  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:22.746115  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:22.751466  6665 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:22.754805  6685 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.719919  6706 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.762261  6706 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:22.765367  6711 log.cc:927] Time spent T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:01:22.671792  6683 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.781769  6683 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:22.782399  6704 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:22.786002  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:22.787212  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:22.788908  6623 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:22.789116  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48633.5us
I20260709 13:01:22.789434  6623 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:22.789883  6623 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.767989  6556 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:22.791159  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.747833  6571 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:22.793637  6571 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:22.794049  6571 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.788324  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:22.794951  1560 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:22.796083  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:22.798305  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.798681  6509 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:22.799358  6509 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.745330  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:22.804286  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:22.807329  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:01:22.805624  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 56878.9us
I20260709 13:01:22.801836  1598 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:22.805109  1552 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:22.816056  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:22.820214  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:22.821216  1560 raft_consensus.cc:2393] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:22.822110  1553 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:22.814873  6524 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:22.816118  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:22.846772  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:22.797832  6556 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.815641  6704 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:22.859239  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:22.860286  1629 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:01:22.860339  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44296.8us
I20260709 13:01:22.839401  6503 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.864758  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:22.871346  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:22.872620  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:22.874317  1673 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:22.857012  6538 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.886677  6397 raft_consensus.cc:697] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:22.887552  6725 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:22.862666  6704 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.896661  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:22.898502  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:22.879684  6667 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:22.880218  6690 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:22.899207  2324 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:22.888456  6668 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:22.913336  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 97269.1us
I20260709 13:01:22.920403  6726 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:22.921236  6726 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.899477  6704 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:22.876797  6503 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:22.957378  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:22.947129  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2356) took 1274 ms. Trace:
I20260709 13:01:22.898285  6725 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.959105  1559 rpcz_store.cc:276] 0709 13:01:21.639919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.640696 (+   777us) service_pool.cc:224] Handling call
0709 13:01:22.914059 (+1273363us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b540023e1d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:22.914208 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162574080}
I20260709 13:01:22.960878  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:22.962607  6725 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.963223  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:22.964013  1559 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:22.949509  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:22.964888  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:22.965574  2326 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:22.969149  6509 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.971503  6706 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.973042  6397 consensus_queue.cc:237] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:22.892620  6538 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:22.978586  6538 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.958662  2329 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:22.982415  6729 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:22.983171  6729 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.987413  6729 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:22.914431  6685 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:22.988811  6414 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:23.002854  6414 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:23.003804  6729 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:23.004380  6729 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.991953  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:23.000438  6623 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:22.949479  6565 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:23.010592  2327 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:23.010907  6565 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.013990  6565 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:23.016783  6540 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:23.017257  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.017467  6540 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.018450  2325 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:22.915083  6668 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:23.019332  6668 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:23.021296  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 45490.6us
I20260709 13:01:23.023334  1598 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:23.025662  6680 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:23.027668  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.028363  1598 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:23.028765  6413 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.028695  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.030582  1628 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:23.031399  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.035580  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.042299  6580 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:23.042894  6580 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.042657  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.044168  2324 raft_consensus.cc:2410] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:01:23.043352  6580 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.050463  2321 raft_consensus.cc:2410] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:01:23.047358  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.051471  1599 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:23.052398  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:23.021286  6729 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.061839  1598 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:23.065023  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:23.063153  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 144136us
I20260709 13:01:23.072062  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:23.076715  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.096956  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.165207  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 96144.9us
W20260709 13:01:23.166019  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 101089us
I20260709 13:01:23.166251  1598 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:23.170677  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.172850  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:23.051469  6540 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:23.175652  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:23.176864  1707 raft_consensus.cc:2368] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11.
I20260709 13:01:23.182371  2324 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:23.060323  6685 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:23.195021  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:23.195415  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.195883  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:23.192559  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.193967  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.201282  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.202129  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:23.067402  6538 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:23.196272  1707 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:23.206912  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.209514  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.217516  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:23.217916  2326 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:23.220364  1635 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:23.210949  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.214636  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.224895  2324 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:23.228277  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:23.077781  6726 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.168939  6724 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:23.236538  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:23.197374  6685 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.189669  6717 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:23.186743  6456 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:23.193447  6614 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.256546  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:23.214133  6524 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:23.228048  6637 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.277416  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.232424  6529 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.233244  6708 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.244843  6503 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.259316  6685 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.284734  6281 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:23.254992  6556 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.298844  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.301868  2288 leader_election.cc:400] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11.
I20260709 13:01:23.302253  2288 leader_election.cc:403] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:23.263521  6524 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:23.333441  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.262426  6507 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:23.303967  2288 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:23.279045  6341 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:23.294821  6571 consensus_meta.cc:287] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.500s	user 0.010s	sys 0.004s
I20260709 13:01:23.272121  6614 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:23.249297  6724 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.285583  6565 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:23.350193  6565 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:23.353093  6733 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:01:23.343149  6507 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.345047  6341 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:23.358214  6507 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:23.358915  6659 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 1.636s	user 0.001s	sys 0.003s
I20260709 13:01:23.359143  6507 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:23.359670  6507 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:23.359858  6341 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:23.360100  6507 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:23.346927  6571 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.360746  6726 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.360853  6721 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:23.361271  6726 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.362531  6571 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.362841  6508 raft_consensus.cc:993] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 13:01:23.363266  6726 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.363394  6508 raft_consensus.cc:1081] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 13:01:23.364071  6706 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:23.364566  6614 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.365170  6614 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:23.365841  6614 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:23.367923  6614 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.369062  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1042) took 1785 ms. Trace:
W20260709 13:01:23.369905  6656 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 1.691s	user 0.003s	sys 0.002s
I20260709 13:01:23.369513  1556 rpcz_store.cc:276] 0709 13:01:21.584079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.584202 (+   123us) service_pool.cc:224] Handling call
0709 13:01:21.613961 (+ 29759us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:21.614418 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:21.614454 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:21.615046 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:01:21.681363 (+ 66317us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:21.681411 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.681477 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.358374 (+1676897us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:23.368741 (+ 10367us) raft_consensus.cc:1685] finished
0709 13:01:23.368766 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.368997 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3485,"raft.queue_time_us":2004,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":2996,"spinlock_wait_cycles":54339968,"thread_start_us":65984,"threads_started":1,"wal-append.queue_time_us":66390}
I20260709 13:01:23.371798  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:23.372905  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:23.373204  1523 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:23.373849  2322 raft_consensus.cc:2410] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:01:23.374863  1523 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:23.343894  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.376168  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:23.302125  6281 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.277405  6456 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:23.348507  6736 log.cc:927] Time spent T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:01:23.377012  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 894) took 1940 ms. Trace:
I20260709 13:01:23.378829  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:23.382297  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:23.284735  6637 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.394006  2325 raft_consensus.cc:2410] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:23.416060  1551 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:01:23.338747  6524 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:23.338428  6624 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:23.413998  1702 rpcz_store.cc:276] 0709 13:01:21.436515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.461010 (+ 24495us) service_pool.cc:224] Handling call
0709 13:01:21.494548 (+ 33538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:21.501940 (+  7392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:21.501973 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:21.502518 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:01:21.565678 (+ 63160us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:21.565720 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.565783 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:22.980360 (+1414577us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b48001701d8. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ede9aeaa1 00007f0ede9a5b37 00007f0ede9a59ca 00007f0edea9d26f 00007f0edea9cf37 00007f0edeab155c 00007f0edeab1508 00007f0edeab1488 00007f0edeab1443 00007f0edeab06ec 00007f0edd9daa96
0709 13:01:23.368973 (+388613us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:23.376821 (+  7848us) raft_consensus.cc:1685] finished
0709 13:01:23.376844 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.376961 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":155,"raft.run_cpu_time_us":7239,"raft.run_wall_time_us":1479607,"spinlock_wait_cycles":19638784,"thread_start_us":29503,"threads_started":1,"wal-append.queue_time_us":93112}
I20260709 13:01:23.415308  1559 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:23.346392  6683 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.428119  2286 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:23.426923  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 48197.2us
I20260709 13:01:23.378432  6614 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:23.306989  6556 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:23.437175  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.372179  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:23.406234  6281 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.433013  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:23.466675  1551 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:23.467994  1551 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:23.462574  1556 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:23.466240  6023 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:01:23.466735  6509 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:23.423208  6731 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:01:23.484906  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 51994.5us
W20260709 13:01:23.500839  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 55439us
I20260709 13:01:23.458626  6538 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:23.422679  6706 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:23.516319  1672 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:23.481516  6565 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:23.535683  6745 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:23.558624  6565 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.559190  6664 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:23.559870  6737 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:01:23.537762  6456 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:23.577517  6724 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:23.578624  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2473) took 1477 ms. Trace:
I20260709 13:01:23.579058  1634 rpcz_store.cc:276] 0709 13:01:22.101086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.101239 (+   153us) service_pool.cc:224] Handling call
0709 13:01:22.156164 (+ 54925us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:22.159907 (+  3743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.578419 (+1418512us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b5400205150. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:23.578562 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56834944}
I20260709 13:01:23.581664  6685 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.584167  6685 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:23.587800  6507 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:23.506819  6736 log.cc:927] Time spent T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:01:23.482369  6623 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.296258  6529 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:23.606194  6668 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.003s
I20260709 13:01:23.607128  2322 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:23.607688  6507 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.417292  6628 consensus_queue.cc:1059] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
W20260709 13:01:23.546587  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.618765  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 314827us
W20260709 13:01:23.541687  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 98941.7us
I20260709 13:01:23.361738  6721 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.295607  6708 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.553517  6281 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.443642  6614 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:23.557369  6556 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.558404  6745 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.536231  6652 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:23.594465  6637 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:23.599231  6704 consensus_meta.cc:287] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.000s
I20260709 13:01:23.539300  6706 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:23.600942  6414 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.003s
I20260709 13:01:23.271534  6717 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.537858  6397 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:23.608065  6529 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:23.632869  2327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:23.681623  2327 raft_consensus.cc:606] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:23.639966  6650 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.618894  6644 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:23.623173  6628 raft_consensus.cc:3055] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:23.682103  2327 raft_consensus.cc:614] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:23.619692  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:23.641098  6023 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:23.647066  6664 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.619369  6668 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.694034  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 887) took 2657 ms. Trace:
W20260709 13:01:23.696094  1553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2362) took 1984 ms (client timeout 1667 ms). Trace:
W20260709 13:01:23.694684  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 75069.6us
I20260709 13:01:23.719313  6721 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:23.681085  6397 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:23.734440  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:23.722601  1553 rpcz_store.cc:269] 0709 13:01:21.711785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.711900 (+   115us) service_pool.cc:224] Handling call
0709 13:01:23.695903 (+1984003us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001f7054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:23.696028 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2398684544}
I20260709 13:01:23.696496  1554 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:23.720615   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:23.721338  1705 rpcz_store.cc:276] 0709 13:01:21.029285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.029484 (+   199us) service_pool.cc:224] Handling call
0709 13:01:21.793823 (+764339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:21.794512 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.686227 (+1891715us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b540012d4d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:23.686368 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1664976256}
W20260709 13:01:23.727329  6413 consensus_meta.cc:287] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.698s	user 0.011s	sys 0.003s
I20260709 13:01:23.677537  6704 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:23.691408  6628 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:23.672029  6652 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:23.752080  6580 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.001s
I20260709 13:01:23.747512  6614 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.721256  6421 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:23.680073  6414 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:23.720777  6553 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:23.740247  6544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.012s	sys 0.015s
I20260709 13:01:23.694173  6644 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:23.753741  6538 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.727905  6524 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.761215  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.755795  6566 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:23.738047  6397 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.769809  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:23.774245  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 258017us
I20260709 13:01:23.776835  1672 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:23.768358  6554 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:01:23.780683  1629 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:23.774154  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 399287us
W20260709 13:01:23.773245  6544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.013s	sys 0.015s
W20260709 13:01:23.790213  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.773722  6678 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:23.783906  1672 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:23.765441  6580 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.742997  6023 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.821414  1672 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:23.820924  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.817420  6281 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.770713  6553 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:23.825861  1629 raft_consensus.cc:2410] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:23.827616  1672 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:23.781870  6664 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:23.773362  6538 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:23.833194  1630 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:23.818400  6581 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:23.836539  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.834923  1628 raft_consensus.cc:2368] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11.
I20260709 13:01:23.837244  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.816141  6652 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:23.818230  6695 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:23.822788  6456 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:23.848574  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.828518  6685 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:23.850764  1630 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:01:23.852219  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.844041  1634 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:23.858049  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.862497  6762 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:23.846203  6695 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:23.869306  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.834297  6708 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:23.870873  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2850) took 1140 ms. Trace:
I20260709 13:01:23.844107  6706 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:23.871266  1633 rpcz_store.cc:276] 0709 13:01:22.730503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.730742 (+   239us) service_pool.cc:224] Handling call
0709 13:01:22.731070 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:22.731442 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:22.731470 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:22.741884 (+ 10414us) log.cc:844] Serialized 26 byte log entry
0709 13:01:23.572339 (+830455us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b1800417a00. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:01:23.772111 (+199772us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:23.772148 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.772987 (+   839us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.868481 (+ 95494us) raft_consensus.cc:1685] finished
0709 13:01:23.868502 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.870814 (+  2312us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1915,"raft.queue_time_us":644,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":10977,"spinlock_wait_cycles":26904448,"thread_start_us":199409,"threads_started":1,"wal-append.queue_time_us":1105997}
I20260709 13:01:23.778617  6628 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:23.874089  6708 consensus_queue.cc:1059] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 13:01:23.880610  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.887590  6553 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.888901  6625 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.889909  6612 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.890416  6612 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:23.895227  6759 raft_consensus.cc:3055] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:23.895676  6759 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:23.896920  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:23.897576  1551 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:01:23.892444  6612 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.896461  6759 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:23.900746  6759 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:23.872565  6745 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:23.913713  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:23.911402  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 127896us
I20260709 13:01:23.919517  1629 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:23.925140  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.925777  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.926674  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.927671  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.928293  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.928630  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.929293  2329 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:23.929399  1675 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:23.908730  6747 log.cc:927] Time spent T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:01:23.930342  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.931456  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:23.934180  1629 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.842027  6664 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:23.939237  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.885038  6717 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:23.882484  6685 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:23.938371  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:23.934976  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.939903  2321 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:01:23.949872  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:23.930485  6704 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:23.955052  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:23.946640  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:23.937942  6706 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:23.982257  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:23.983332  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:23.984287  1705 raft_consensus.cc:1275] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:01:23.985059  1705 pending_rounds.cc:85] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 5
I20260709 13:01:23.985297  1705 pending_rounds.cc:107] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:01:23.985564  1705 raft_consensus.cc:2889] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:23.980955  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:23.989660  1702 raft_consensus.cc:2393] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:23.955844  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:23.946362  6614 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:23.992678  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:23.993093  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:23.999320  1707 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:23.996491  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:23.957298  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:24.001299  1704 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.001468  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:24.003311  1633 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:23.997380  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:23.937254  6628 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.955308  6569 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:24.003458  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:24.009938  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:24.010062  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:23.993791  1700 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:24.004667  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:24.002089  1705 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 7.
I20260709 13:01:23.996448  1629 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:24.014767  1556 raft_consensus.cc:2393] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:23.984472  6759 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.014834  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2901) took 1454 ms. Trace:
I20260709 13:01:23.940918  6760 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
W20260709 13:01:24.019050  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 178538us
I20260709 13:01:24.018364  1557 rpcz_store.cc:276] 0709 13:01:22.560358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.564016 (+  3658us) service_pool.cc:224] Handling call
0709 13:01:22.589523 (+ 25507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:22.678278 (+ 88755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:22.678310 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:22.678353 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:22.678442 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.014607 (+1336165us) spinlock_profiling.cc:243] Waited 88.5 ms on lock 0x7b54000569d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:24.014654 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.014779 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203571968}
I20260709 13:01:23.952800  6748 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.985477  6706 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:23.991045  6524 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:24.028151  1704 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:23.999768  6644 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:24.030694  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2391) took 1121 ms. Trace:
I20260709 13:01:24.017647  6569 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:24.031494  1558 rpcz_store.cc:276] 0709 13:01:22.909330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.185647 (+276317us) service_pool.cc:224] Handling call
0709 13:01:23.192464 (+  6817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:23.214045 (+ 21581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.214077 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:23.254795 (+ 40718us) log.cc:844] Serialized 26 byte log entry
0709 13:01:23.436057 (+181262us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:23.436117 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.436214 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:24.030489 (+594275us) raft_consensus.cc:1685] finished
0709 13:01:24.030510 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.030639 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21201,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":11307,"thread_start_us":134343,"threads_started":1,"wal-append.queue_time_us":355468}
I20260709 13:01:24.033077  1709 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:24.034546  6569 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:24.037104  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:24.037815  1707 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.041805  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:24.042361  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:24.042426  1705 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:24.044661  1707 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
W20260709 13:01:24.046924  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.005700  6668 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:24.043503  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:24.045218  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:23.952930  6685 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:24.051919  1700 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:01:24.052418  1700 pending_rounds.cc:85] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 5
I20260709 13:01:24.052143  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:24.052731  1700 pending_rounds.cc:107] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:01:24.048780  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:24.049629  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:24.053149  1700 raft_consensus.cc:2889] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:24.054447  2322 raft_consensus.cc:2368] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13.
I20260709 13:01:24.036375  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:24.045859  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:24.030650  6744 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:01:24.030992  6706 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:24.040721  6752 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:01:24.055565  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:24.058408  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:24.058981  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:24.067437  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 98212.2us
I20260709 13:01:24.056162  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:24.006328  6614 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:24.073182  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:24.081818  1558 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.077108  1706 raft_consensus.cc:2410] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:24.078200  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:24.083346  1705 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:24.078461  6695 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:24.079443  6704 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:24.090489  2286 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:24.027408  6759 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:24.072978  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:24.110607  1706 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:24.117164  6764 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:24.117810  6764 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:24.120045  6764 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:24.121434  6023 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:24.123027  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:24.123978  6664 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:24.124522  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:24.127842  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:24.138053  6685 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:24.144512  1672 leader_election.cc:400] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13.
I20260709 13:01:24.145049  1672 leader_election.cc:403] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:01:24.148830  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:24.149680  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2386) took 1401 ms. Trace:
I20260709 13:01:24.150591  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:24.151357  2324 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:24.031056  6748 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:24.154985  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:24.149617  2320 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:24.167090  1702 raft_consensus.cc:2410] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:24.152926  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:24.157575  1703 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:24.159332  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:24.168983  1558 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:24.169257  1631 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:24.150064  1560 rpcz_store.cc:276] 0709 13:01:22.747824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.852785 (+104961us) service_pool.cc:224] Handling call
0709 13:01:22.876483 (+ 23698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:22.877380 (+   897us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:23.065041 (+187661us) log.cc:844] Serialized 14 byte log entry
0709 13:01:23.629232 (+564191us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:23.648576 (+ 19344us) log.cc:844] Serialized 26 byte log entry
0709 13:01:23.648763 (+   187us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:23.649024 (+   261us) log.cc:844] Serialized 14 byte log entry
0709 13:01:23.865502 (+216478us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b18004555c0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6912c0a 00007f0ee0052219 00007f0ed699aa40 00007f0ed69954e4 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a8f716 00007f0ed9aa0287 00007f0ed9aa0208
0709 13:01:23.865781 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.865883 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:24.149464 (+283581us) raft_consensus.cc:1685] finished
0709 13:01:24.149484 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.149624 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":239822,"prepare.queue_time_us":329413,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":5516,"raft.queue_time_us":217211,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":16350,"spinlock_wait_cycles":5464320,"thread_start_us":595234,"threads_started":2,"wal-append.queue_time_us":586965}
I20260709 13:01:24.103753  6529 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:24.182948  6748 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:24.174644  6685 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:24.189013  6685 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:24.189481  6685 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:24.171350  6741 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:01:24.171113  6739 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:24.197420  1703 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:01:24.199826  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:24.170743  6023 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.209278  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:24.218022  1601 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:24.219521  1601 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:24.221860  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:24.211339  6683 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.752s	user 0.005s	sys 0.007s
I20260709 13:01:24.224120  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:24.221936  1601 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:24.229264  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:24.210768  6625 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.233640  1700 raft_consensus.cc:2368] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13.
I20260709 13:01:24.233106  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:24.236676  6553 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:24.220677  6644 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:24.247614  6668 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.248339  6668 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:24.251317  6668 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:01:24.252287  1707 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:24.252707  1703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:35632
I20260709 13:01:24.255632  1703 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:24.255915  6678 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:24.256407  6678 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:24.256150  1703 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:24.254745  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 181800us
I20260709 13:01:24.261966  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:24.262161  6580 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:24.262998  1526 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:24.264411  6503 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:24.264791  6652 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:24.264931  6503 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.265203  6652 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.265343  6503 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:24.265594  6652 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.268864  6753 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:24.269568  6753 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:24.270040  6753 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:24.272094  6753 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:24.273036  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:24.259035  6644 consensus_queue.cc:1059] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:24.274453  6644 raft_consensus.cc:3055] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:24.274957  6644 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:24.275770  6644 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:24.274492  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 955) took 1079 ms. Trace:
I20260709 13:01:24.276867  1628 rpcz_store.cc:276] 0709 13:01:23.195034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.195665 (+   631us) service_pool.cc:224] Handling call
0709 13:01:24.274297 (+1078632us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b54000d93d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:24.274438 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1467791104}
W20260709 13:01:24.277375  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.278995  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:24.279328  6580 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:24.279850  6580 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:24.281973  6580 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:24.264355  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:24.282426  6554 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.282902  6554 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:24.283535  6724 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:24.290151  1526 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:24.291360  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:24.293145  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:01:24.254218  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 164243us
I20260709 13:01:24.217533  6764 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:24.215118  6766 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:24.301226  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:24.309401  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:24.234331  6683 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11.
I20260709 13:01:24.316928  6644 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.230755  6628 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:24.291560  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:24.330021  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.330976  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:24.339740  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:24.347649  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:24.348614  1700 raft_consensus.cc:2393] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 11: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:24.354315  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:24.299122  6625 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:24.357566  6721 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:24.328513  6628 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:24.435359  2325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 1175) took 1404 ms (client timeout 1696 ms). Trace:
W20260709 13:01:24.435904  2325 rpcz_store.cc:269] 0709 13:01:23.030252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.030431 (+   179us) service_pool.cc:224] Handling call
0709 13:01:24.415886 (+1385455us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b5400671e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:24.420412 (+  4526us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747978112}
I20260709 13:01:24.301779  6764 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:24.404551  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:24.408370  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 54137.4us
I20260709 13:01:24.300545  6650 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:24.415287  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:24.351935  6756 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:24.418251  2323 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:24.422015  2320 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:24.423867  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:24.418515  1703 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:24.461862  1632 consensus_queue.cc:237] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:24.431624  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:24.308454  6553 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:01:24.466998  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:24.469408  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:24.472723  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:24.474423  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:24.472277  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:24.549142  1700 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:24.420866  6623 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:24.550769  1601 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:24.459175  6414 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:24.557901  6770 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:01:24.558039  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:24.559340  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 127812us
I20260709 13:01:24.364842  6748 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:01:24.319618  6766 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:24.427974  6556 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:24.429169  6554 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:24.441569  6628 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.570149  1703 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:24.548243  6704 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:24.440321  6207 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:24.456857  6612 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:24.582604  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:24.419646  6524 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.148s
I20260709 13:01:24.469012  6764 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.622634  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:24.561199  6760 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:24.549785  6717 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:24.552042  6753 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:24.590811  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:24.569530  6610 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.634912  1628 raft_consensus.cc:2410] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:24.563433  6581 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.593672  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2364) took 2818 ms. Trace:
I20260709 13:01:24.568711  6697 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:24.612274  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:24.705901  2320 raft_consensus.cc:2410] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:24.569504  6759 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:24.621246  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:24.710134  1631 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.593413  6197 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:24.628134  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:24.636150  1554 rpcz_store.cc:276] 0709 13:01:21.770236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.770354 (+   118us) service_pool.cc:224] Handling call
0709 13:01:23.696067 (+1925713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:23.739297 (+ 43230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.587966 (+848669us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54001f7050. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:24.588162 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4427516672}
I20260709 13:01:24.607838  6745 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:24.593823  6414 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:24.589653  6281 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:24.615777  6614 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:24.617533  6207 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:24.742697  6414 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:24.785589  6414 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.787269  1631 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
W20260709 13:01:24.775477  6652 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.000s
I20260709 13:01:24.788501  6652 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:24.789623  6625 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:24.790668  6652 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:24.790805  1556 raft_consensus.cc:2368] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
W20260709 13:01:24.806041  6772 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:01:24.807974  6207 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:24.808432  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:24.813619  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 1124) took 1443 ms. Trace:
I20260709 13:01:24.814684  1700 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:24.618871  6580 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:01:24.817257  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 516026us
I20260709 13:01:24.642567  6760 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:24.823657  6760 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:24.788332  6706 consensus_meta.cc:287] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.707s	user 0.004s	sys 0.003s
I20260709 13:01:24.820327  2288 leader_election.cc:400] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11.
W20260709 13:01:24.828213  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 252132us
I20260709 13:01:24.827081  1700 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:24.814172  2323 rpcz_store.cc:276] 0709 13:01:23.370368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.375930 (+  5562us) service_pool.cc:224] Handling call
0709 13:01:24.813271 (+1437341us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b54008291d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:24.813531 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2161956096}
I20260709 13:01:24.619120  6612 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:24.862915  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:24.743573  6553 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:24.872255  6623 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:24.873529  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:24.755707  6745 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:24.877784  2288 leader_election.cc:400] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13.
I20260709 13:01:24.878201  2288 leader_election.cc:403] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:01:24.878669  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 404242us
I20260709 13:01:24.888003  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:24.703920  6753 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:24.890564  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:24.877373  6023 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.666s	user 0.003s	sys 0.007s
I20260709 13:01:24.913509  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:24.918115  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:24.819840  6554 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:01:24.710731  6610 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:24.714323  6581 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:24.936722  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:24.821352  6281 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:24.909335  6735 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.015s	sys 0.036s
I20260709 13:01:24.950754  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:24.952303  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:24.952661  1551 pending_rounds.cc:85] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 5
I20260709 13:01:24.953015  1551 pending_rounds.cc:107] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:01:24.952913  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:24.953388  1551 raft_consensus.cc:2889] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:24.825369  6644 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:01:24.819339  6197 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:24.880115  6745 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.882747  6751 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:24.836968  6706 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:24.938963  6397 consensus_meta.cc:287] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.155s	user 0.009s	sys 0.004s
I20260709 13:01:24.960945  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:24.961361  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:24.963500  1557 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:01:24.964701  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:24.914304  6755 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:24.825793  6580 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:24.966507  1555 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 10: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:24.938050  2288 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:24.935591  6566 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.937781  6207 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:24.971268  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:24.971915  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:24.940006  6652 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:24.940465  6023 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13.
I20260709 13:01:24.939965  6748 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:24.881119  6553 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:24.975647  1559 raft_consensus.cc:2368] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13.
I20260709 13:01:24.942885  6538 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:24.981416  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:24.976055  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:25.061903  1560 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:25.058364  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 421540us
I20260709 13:01:25.060297  1709 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:24.947036  6668 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.968369  6614 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:24.975445  6503 consensus_meta.cc:287] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.706s	user 0.010s	sys 0.002s
I20260709 13:01:24.941390  6757 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:01:25.072118  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:25.087622  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 149654us
I20260709 13:01:25.089056  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:25.089998  1555 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:25.071002  1598 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:25.095201  2324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.008s	sys 0.023s
I20260709 13:01:24.975159  6207 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:25.198153  1557 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
W20260709 13:01:25.202260  2324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.012s	sys 0.052s
W20260709 13:01:25.198809  2286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.017s	sys 0.033s
W20260709 13:01:25.203305  2286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.018s	sys 0.034s
W20260709 13:01:25.203776  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 874343us
I20260709 13:01:24.977975  6766 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:25.066133  6685 consensus_meta.cc:287] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.876s	user 0.009s	sys 0.002s
I20260709 13:01:25.057767  6556 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:24.969532  6704 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:24.978600  6755 raft_consensus.cc:697] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:01:25.075486  6756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.003s	sys 0.027s
I20260709 13:01:25.076380  6697 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:25.137557  6623 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:25.070849  6614 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:25.086227  6569 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.135779  6625 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:25.210094  6678 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.953s	user 0.011s	sys 0.000s
W20260709 13:01:25.243103  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 287471us
I20260709 13:01:25.228760  1560 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:25.202752  6207 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.969668  6397 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.101136  6668 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.256997  6735 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:25.264418  6569 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.267668  6625 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.271399  6612 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:25.267710  6678 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.233796  6756 raft_consensus.cc:697] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:25.213652  6765 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:01:25.238200  6704 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.285095  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1061) took 1265 ms. Trace:
I20260709 13:01:25.258754  6614 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:25.284418  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:25.286303  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 221718us
W20260709 13:01:25.287815  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 217090us
I20260709 13:01:25.288017  6554 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:25.321877  6756 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.106170  6503 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.291529  6735 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.325662  6735 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:25.326602  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1189) took 1021 ms. Trace:
I20260709 13:01:25.304339  6207 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.282824  6397 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:25.329334  6553 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:25.330370  1558 raft_consensus.cc:2368] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17.
I20260709 13:01:25.306939  6569 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:25.216442  6685 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.331262  1552 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:25.332979  1703 raft_consensus.cc:2410] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:25.333024  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2875) took 1002 ms. Trace:
I20260709 13:01:25.333559  1709 rpcz_store.cc:276] 0709 13:01:24.330587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.330736 (+   149us) service_pool.cc:224] Handling call
0709 13:01:25.332851 (+1002115us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54003f0554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:25.332964 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675475328}
I20260709 13:01:25.334782  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:25.334937  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:25.335847  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:25.269474  6764 consensus_meta.cc:287] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.000s
W20260709 13:01:25.282120  6775 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
I20260709 13:01:25.230495  6556 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:25.291499  6628 consensus_meta.cc:287] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.676s	user 0.012s	sys 0.000s
I20260709 13:01:25.313090  1553 rpcz_store.cc:276] 0709 13:01:24.020257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.020428 (+   171us) service_pool.cc:224] Handling call
0709 13:01:24.020781 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.110631 (+ 89850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.110667 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:24.110710 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:24.110741 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.284850 (+1174109us) spinlock_profiling.cc:243] Waited 89.7 ms on lock 0x7b54001d7ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:25.284913 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.285035 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206203776}
I20260709 13:01:25.313283  6197 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:25.286052  6625 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:25.306833  6580 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:25.259896  6697 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:25.318439  6414 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 13:01:25.327015  2324 rpcz_store.cc:276] 0709 13:01:24.305641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.305873 (+   232us) service_pool.cc:224] Handling call
0709 13:01:24.306284 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.345580 (+ 39296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.345621 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.346072 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.203259 (+857187us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:25.203302 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.203370 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:25.326411 (+123041us) raft_consensus.cc:1685] finished
0709 13:01:25.326429 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.326545 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38854,"raft.queue_time_us":153489,"raft.run_wall_time_us":77870,"spinlock_wait_cycles":31617920,"thread_start_us":643550,"threads_started":1,"wal-append.queue_time_us":882466}
I20260709 13:01:25.282802  6581 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:25.288945  6755 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.281028  6787 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:25.320971  6281 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:25.352031  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2911) took 1153 ms. Trace:
I20260709 13:01:25.350348  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2894) took 1312 ms. Trace:
I20260709 13:01:25.336392  1709 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:25.360541  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2907) took 1248 ms. Trace:
I20260709 13:01:25.414990  1704 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:25.336484  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:25.336601  1599 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:25.338169  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:25.345137  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2866) took 1363 ms. Trace:
I20260709 13:01:25.420650  1700 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:25.420847  1702 rpcz_store.cc:276] 0709 13:01:23.982005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.991320 (+  9315us) service_pool.cc:224] Handling call
0709 13:01:25.344843 (+1353523us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54003eadd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:25.345052 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353504512}
I20260709 13:01:25.407060  1708 rpcz_store.cc:276] 0709 13:01:24.037533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.040973 (+  3440us) service_pool.cc:224] Handling call
0709 13:01:24.053720 (+ 12747us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.089728 (+ 36008us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:24.089758 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.090232 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:01:24.590572 (+500340us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b180041b3c0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:01:24.910395 (+319823us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:24.910440 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.910519 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:25.350022 (+439503us) raft_consensus.cc:1685] finished
0709 13:01:25.350047 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.350280 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15884,"raft.queue_time_us":59751,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":41109248,"thread_start_us":319429,"threads_started":1,"wal-append.queue_time_us":1148032}
I20260709 13:01:25.421769  1703 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:25.413000  1706 rpcz_store.cc:276] 0709 13:01:24.111948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.117207 (+  5259us) service_pool.cc:224] Handling call
0709 13:01:24.288849 (+171642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.289031 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.289055 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:24.289091 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:24.289119 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.289171 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.360317 (+1071146us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400253ad0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:25.360463 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393919872}
W20260709 13:01:25.423732  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 106805us
I20260709 13:01:25.425326  1598 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:25.427659  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 930) took 1071 ms. Trace:
I20260709 13:01:25.428190  1709 rpcz_store.cc:276] 0709 13:01:24.356138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.426642 (+1070504us) service_pool.cc:224] Handling call
0709 13:01:25.427003 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.427225 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.427263 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.427330 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:25.427375 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.427442 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.427573 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:25.406184  1701 rpcz_store.cc:276] 0709 13:01:24.199016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.221221 (+ 22205us) service_pool.cc:224] Handling call
0709 13:01:24.221505 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.616477 (+394972us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:24.708239 (+ 91762us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.195855 (+487616us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.195931 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:25.196028 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.351674 (+155646us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b5400265f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:25.351751 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.351959 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22150,"prepare.queue_time_us":22465,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":27676,"raft.queue_time_us":20530,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":16904,"spinlock_wait_cycles":907689856,"thread_start_us":487154,"threads_started":1}
W20260709 13:01:25.348558  6760 consensus_meta.cc:287] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.000s
W20260709 13:01:25.440204  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 103656us
I20260709 13:01:25.332481  6685 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:25.341027  6678 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:25.336484  6566 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13.
I20260709 13:01:25.337492  6610 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:25.352771  6668 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:25.342439  6753 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:25.341387  6706 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:25.422863  6397 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:25.419329  6764 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.476483  1703 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:25.350492  6614 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.405181  6414 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.418004  6628 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:25.483449  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 155000us
I20260709 13:01:25.461827  6524 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:25.485127  1707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 2896) took 1447 ms (client timeout 1863 ms). Trace:
I20260709 13:01:25.418597  6787 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.463558  6644 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:01:25.488021  1707 rpcz_store.cc:269] 0709 13:01:24.038175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.045634 (+  7459us) service_pool.cc:224] Handling call
0709 13:01:25.484837 (+1439203us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b540012d4d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:25.485043 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448076544}
I20260709 13:01:25.439105  6760 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.493942  6792 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:25.502645  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 61142.8us
I20260709 13:01:25.495093  6697 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:25.495767  6745 consensus_meta.cc:287] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.001s
I20260709 13:01:25.496738  6704 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:25.497942  6628 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:25.498267  6764 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:25.499908  6414 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:25.479991  6397 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.491137  6644 raft_consensus.cc:697] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:25.517165  2288 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:25.490754  6197 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:25.524835  6787 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:25.525699  1554 raft_consensus.cc:2393] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:01:25.526310  1558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 2925) took 1255 ms (client timeout 1518 ms). Trace:
W20260709 13:01:25.526753  1558 rpcz_store.cc:269] 0709 13:01:24.270441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.272774 (+  2333us) service_pool.cc:224] Handling call
0709 13:01:25.526117 (+1253343us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540017f7d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:25.526249 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2429511936}
I20260709 13:01:25.534674  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:25.536628  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:25.538017  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:25.540676  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:25.522076   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:25.543145  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:25.543780  1553 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:25.543150  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:25.546732  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:25.547781  1560 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:25.548794  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:25.602658  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:25.537534  1632 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:25.607404  1554 raft_consensus.cc:1240] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:25.611188  1599 leader_election.cc:400] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17.
I20260709 13:01:25.611788  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:25.615226  1632 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:25.618463  6759 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:25.619403  6759 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.627907  2288 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:25.633443  1599 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:25.543860  6197 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.543509  6778 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:25.643141  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:25.648311  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:25.653170  1631 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:25.654693  1631 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:25.649660  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:25.650326  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:25.658381  1630 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:25.547106  6625 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:25.647559  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:25.667058  1554 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:25.605436  6281 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:25.514801  6745 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.602946  6787 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:25.653436  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:25.670166  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:25.666023  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:25.673623  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:25.610594  6777 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:01:25.693572  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 60215.4us
I20260709 13:01:25.509691  6792 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.644176  6751 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:25.694763  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:25.699529  1634 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:25.650236  6803 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:25.671658  6623 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:25.732236  1627 raft_consensus.cc:2368] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10.
W20260709 13:01:25.733325  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 79979.8us
I20260709 13:01:25.743923  6753 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:25.744673  6753 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.743027  1554 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:25.708493  6554 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.698503  6625 raft_consensus.cc:697] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:25.708642  6580 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:25.719291  6780 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:25.713682  6776 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:25.773425  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 125913us
I20260709 13:01:25.718675  6552 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:25.739673  6623 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.742238  6778 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:25.798622  6778 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:25.799144  6778 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:25.797887  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 311227us
I20260709 13:01:25.804486  1601 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:25.800494  6538 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:25.835628  1598 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:25.696223  6281 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.749785  6764 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:25.813858  1673 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:25.739530  6803 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.821115  6625 consensus_queue.cc:237] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.822619  6397 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:25.827519  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 967) took 1194 ms. Trace:
W20260709 13:01:25.828517  1556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 2926) took 1498 ms (client timeout 1664 ms). Trace:
I20260709 13:01:25.831251  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 932) took 1474 ms. Trace:
I20260709 13:01:25.836578  1601 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:25.719664  6777 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.884379  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:25.786566  6776 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:25.888147  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 51621.6us
I20260709 13:01:25.716255  6787 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:25.889477  1556 rpcz_store.cc:269] 0709 13:01:24.329945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.332274 (+  2329us) service_pool.cc:224] Handling call
0709 13:01:25.828322 (+1496048us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54001d8dd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:25.828460 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":758776064}
I20260709 13:01:25.785883  6759 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:25.785656  6703 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:25.758380  6790 consensus_queue.cc:1059] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 13:01:25.762310  6554 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.786963  6801 consensus_queue.cc:1059] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
W20260709 13:01:25.907331  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 93557.6us
I20260709 13:01:25.931665  1673 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:25.890275  1635 rpcz_store.cc:276] 0709 13:01:24.632856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.633015 (+   159us) service_pool.cc:224] Handling call
0709 13:01:24.633369 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.971053 (+337684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.971108 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:24.971161 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:24.971209 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.827280 (+856071us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54000c8ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:25.827330 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.827459 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776007552}
I20260709 13:01:25.885844  1700 rpcz_store.cc:276] 0709 13:01:24.356818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.424790 (+1067972us) service_pool.cc:224] Handling call
0709 13:01:25.425101 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.431400 (+  6299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.431430 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.431486 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:25.431533 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.830989 (+399456us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b54002567d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:25.831058 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.831195 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13849344}
I20260709 13:01:25.905017  1634 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:25.735415  6644 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:25.923062  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 202234us
I20260709 13:01:25.808545  6623 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:25.886034  6614 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:25.889599  6628 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:25.886315  6566 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:25.883082  6023 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.791760  6780 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.895411  6776 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:25.895341  6542 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:25.951678  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:25.963934  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:25.965458  1673 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:25.789202  6580 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.916522  6524 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:25.936967  6414 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:25.924156  6668 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:25.849203  6421 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:25.854171  6556 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:25.971067  1673 leader_election.cc:400] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13.
I20260709 13:01:25.885156  6764 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.946339  6765 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.807521  6552 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.959970  6759 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:25.952416  6760 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:25.862938  6538 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.925799  6703 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:25.974606  6685 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:25.971642  6795 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:25.978940  6790 raft_consensus.cc:3055] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:26.061439  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:25.979568  6796 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:25.992486  6542 raft_consensus.cc:697] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:25.994380  6801 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:26.074733  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:25.969400  6023 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.966733  6566 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:25.990283  6414 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:26.051630  6753 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:26.063705  6685 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.067054  6790 raft_consensus.cc:740] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:25.999073  6421 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.051965  6765 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:26.076797  6745 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:26.069669  6706 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:26.166347  1673 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.730s (SENT) [suppressed 7 similar messages]
W20260709 13:01:26.250304  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 84017.9us
I20260709 13:01:26.105047  6796 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.255553  6023 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:26.109556  6792 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:26.078948  6529 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:01:26.071758  6795 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.109350  6821 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:26.240031  6806 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.351s	user 0.002s	sys 0.000s
I20260709 13:01:26.136369  6685 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:26.086534  6801 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.288928  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:26.284355  1673 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:26.295363  6023 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:26.295904  6023 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:26.296352  6023 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:26.301067  1556 raft_consensus.cc:1240] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:26.308724  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:26.309464  1700 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:26.278903  6745 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.280498  6608 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:26.300307  6281 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:26.304841  6503 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:26.308218  6802 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:26.329043  6023 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:26.260614  6706 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.263334  6796 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:26.342281  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:26.329552  6608 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.368018  6751 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:26.368878  6751 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.370360  6608 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:26.370955  6751 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:26.371059  6817 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:01:26.371706  6809 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 13:01:26.372335  6811 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:01:26.374258  6751 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.374909  6751 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.375792  6197 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:26.379292  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.380513  2323 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:26.366467  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2920) took 1032 ms. Trace:
I20260709 13:01:26.378057  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.290778  6821 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.327257  6683 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:26.281565  6542 consensus_queue.cc:237] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:26.381717  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 931) took 2025 ms. Trace:
I20260709 13:01:26.381610  1707 rpcz_store.cc:276] 0709 13:01:25.334014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.492285 (+158271us) service_pool.cc:224] Handling call
0709 13:01:25.502206 (+  9921us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.502583 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.502613 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.503066 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.640026 (+136960us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:25.640067 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.640150 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.365286 (+725136us) raft_consensus.cc:1685] finished
0709 13:01:26.366256 (+   970us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.366400 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1369,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":3725,"thread_start_us":130294,"threads_started":1,"wal-append.queue_time_us":256213}
I20260709 13:01:26.395150  2325 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:26.396152  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:26.377014  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:26.342430  6777 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:26.339869  6803 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:26.363721  6787 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:26.403914  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:26.405342  2324 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:26.399135  1704 rpcz_store.cc:276] 0709 13:01:24.356471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.808102 (+451631us) service_pool.cc:224] Handling call
0709 13:01:26.381515 (+1573413us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b5400265a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:26.381646 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267310336}
I20260709 13:01:26.379132  6554 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:26.417682  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:26.422319  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:26.328060  6745 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.379400  6764 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:26.423009  1551 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:26.420917  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:26.424368  1557 raft_consensus.cc:2368] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
I20260709 13:01:26.426326  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:26.427165  1554 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
W20260709 13:01:26.389667  6755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.003s	sys 0.009s
W20260709 13:01:26.400095  6812 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
I20260709 13:01:26.430859  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:26.404867  6756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.002s	sys 0.042s
I20260709 13:01:26.431505  1555 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:26.429674  1599 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:26.437958  1628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.003s	sys 0.028s
W20260709 13:01:26.441740  1628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.004s	sys 0.028s
I20260709 13:01:26.442830  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:26.444691  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:26.444881  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.007s	sys 0.007s
W20260709 13:01:26.445917  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.008s	sys 0.008s
I20260709 13:01:26.447067  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:26.448127  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:26.449150  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:26.450098  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:26.451123  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:26.452692  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 184713us
I20260709 13:01:26.453526  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:26.454602  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:26.455427  1701 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:01:26.463682  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:26.463886  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:26.465484  1701 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:26.311764  6790 consensus_queue.cc:260] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:26.437831  6755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.004s	sys 0.009s
I20260709 13:01:26.475739  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:26.476846  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:26.485097  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:26.442420  6756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.002s	sys 0.043s
I20260709 13:01:26.494972  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:26.495852  1707 raft_consensus.cc:2393] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 8: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:01:26.446305  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 557031us
I20260709 13:01:26.429261  6608 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:26.479561  6805 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.429584  6538 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:26.429354  6751 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:26.439334  6552 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:26.398177  6683 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.490507  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.429236  6566 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:26.445782  6703 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:26.504657  6778 consensus_meta.cc:287] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.003s
I20260709 13:01:26.505745  6803 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:26.508061  6796 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:26.502882  2324 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:01:26.413862  6780 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:26.514506  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.530141  2325 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:26.516830  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:26.532227  2287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.007s	sys 0.006s
W20260709 13:01:26.532908  2287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.008s	sys 0.006s
I20260709 13:01:26.508158  6197 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:26.501410  6503 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:26.531687  6778 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:26.521498  6776 consensus_meta.cc:287] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.000s
I20260709 13:01:26.517781  6790 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:26.509183  6556 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:26.527730  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:26.544232  1701 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:26.551234  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:26.552546  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:26.528384  6207 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:26.613471  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 85815.9us
I20260709 13:01:26.578158  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.578500  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.523937  6765 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:26.520433  6608 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.536003  6421 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:26.728448  6778 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:26.736557  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:26.738895  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:26.740978  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:26.674887  1553 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:26.673817  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:26.656800  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.742496  2327 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:26.673120  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:26.647462  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:26.743661  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:26.577855  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:26.744604  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:26.676759  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:26.692715  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:26.745735  1554 raft_consensus.cc:2393] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:26.745975  2320 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:26.746389  2320 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:26.678275  2325 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:26.689836  1557 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 10: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:26.691510  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:26.538331  6755 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:26.545579  6697 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:26.749586  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:26.747421  1555 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:26.701242  6777 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:26.547609  6503 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:26.555507  6753 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:26.709195  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:26.709502  6816 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 13:01:26.709961  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.771520  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2869) took 1126 ms. Trace:
I20260709 13:01:26.711279  6608 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:26.717259  6706 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:26.554239  6756 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:26.744040  1558 raft_consensus.cc:2393] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:01:26.624260  1523 leader_election.cc:336] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Timed out: RequestConsensusVote RPC to 127.0.107.196:39387 timed out after 1.696s (SENT)
I20260709 13:01:26.775185  1523 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:26.657090  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:26.776386  2329 raft_consensus.cc:2376] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11. Re-sending same reply.
I20260709 13:01:26.553941  6566 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:26.760435  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:26.768487  2327 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:26.773458  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:26.792477  1708 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:26.773618  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.773852  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.524247  6805 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:26.723544  6023 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:26.675199  6825 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:26.788200  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 163961us
I20260709 13:01:26.546116  6795 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:26.756800  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 314685us
W20260709 13:01:26.770200  6819 log.cc:927] Time spent T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.439s	user 0.000s	sys 0.005s
I20260709 13:01:26.731469  6801 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:26.750023  6197 raft_consensus.cc:697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:26.613204  6529 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:26.771986  1628 rpcz_store.cc:276] 0709 13:01:25.645302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.645419 (+   117us) service_pool.cc:224] Handling call
0709 13:01:25.645701 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.645886 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:25.734898 (+ 89012us) log.cc:844] Serialized 14 byte log entry
0709 13:01:26.771197 (+1036299us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:26.771251 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:26.771298 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.771361 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.771471 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":210014,"prepare.queue_time_us":127737,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":86582,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":8793,"thread_start_us":1100227,"threads_started":3}
W20260709 13:01:26.810920  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 280975us
I20260709 13:01:26.814404  1599 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:26.815824  1599 leader_election.cc:400] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
W20260709 13:01:26.818068  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 167816us
I20260709 13:01:26.818881  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:26.820803  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:26.821646  1630 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:26.545177  6776 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:26.620023  6556 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:26.825727  2327 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:26.816176  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:26.826042  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:26.799116  6207 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:26.828959  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.822057  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:26.831233  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.800160  6608 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:26.824226  6685 consensus_meta.cc:287] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.003s
I20260709 13:01:26.832119  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.840310  2329 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:26.826589  6538 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:26.832181  2328 raft_consensus.cc:2410] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:26.537190  6803 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.838198  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:26.838452  1702 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:26.779330  6753 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.838251  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:26.788424  6755 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.830946  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:26.846303  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:26.859056  2322 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:26.841856  6824 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:01:26.856379  1627 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:01:26.849778  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:26.779695  6777 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.853579  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:26.825522  6614 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:26.801563  6566 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.826939  6830 consensus_queue.cc:1059] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:01:26.801695  6756 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:26.855116  6538 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:26.866608  1630 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:26.872267  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.868757  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:26.844184  6821 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:26.879868  1634 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:26.866895  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2867) took 1222 ms. Trace:
I20260709 13:01:26.880137  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:26.876468  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:26.851698  6843 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:26.880568  1632 rpcz_store.cc:276] 0709 13:01:25.644506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.646413 (+  1907us) service_pool.cc:224] Handling call
0709 13:01:25.646681 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.647001 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.647026 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.668119 (+ 21093us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.931626 (+263507us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:25.931676 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.931763 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.866670 (+934907us) raft_consensus.cc:1685] finished
0709 13:01:26.866695 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.866822 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34761,"raft.queue_time_us":23145,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":39968,"thread_start_us":192997,"threads_started":1,"wal-append.queue_time_us":566190}
I20260709 13:01:26.883111  1672 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:26.890039  2328 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:26.824483  6529 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.900384  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:26.904692  1632 raft_consensus.cc:2368] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:26.845517  6685 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:26.841444  6608 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.906664  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:26.896646  6823 log.cc:927] Time spent T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 13:01:26.878877  6538 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:26.866698  6625 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:01:26.919651  6023 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:26.920387  6023 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:26.920894  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:26.921751  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 95759.8us
I20260709 13:01:26.930004  6023 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.897534  6843 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:26.960953  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:26.875386  6614 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.971963  6628 raft_consensus.cc:3055] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:26.972671  6628 raft_consensus.cc:740] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:26.962890  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 61737.5us
I20260709 13:01:26.984573  2321 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:26.902791  6553 consensus_queue.cc:1059] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:01:26.989133  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:26.995441  1702 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:26.996639  1633 raft_consensus.cc:2393] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 17: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:26.988394  6841 raft_consensus.cc:3055] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:26.872789  6197 consensus_queue.cc:237] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:26.999330  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:26.935906  6847 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:26.960116  6843 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.960656  6764 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:26.960255  6745 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.000993  6841 raft_consensus.cc:740] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:27.006897  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:27.029433  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:27.030208  1634 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:27.007544  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:27.009222  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:27.028102  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 105571us
I20260709 13:01:27.031750  1633 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:27.010128  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:27.011637  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:27.033109  1559 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:01:27.012553  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:27.017284  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:27.035035  1526 leader_election.cc:400] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10.
I20260709 13:01:26.993108  6780 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:26.992525  6778 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.014717  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:27.035285  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:27.008622  6847 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.025421  6844 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:27.047348  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:27.001834  6738 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:01:27.039319  1633 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:27.016158  6503 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.028121  6805 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.073032  6756 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.074945  6803 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.075979  6529 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:27.077184  6842 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:01:27.078770  6845 log.cc:927] Time spent T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:27.079929  6503 consensus_queue.cc:1059] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:27.047631  6844 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:27.080994  6844 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:27.081753  6503 raft_consensus.cc:3055] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:27.082129  6503 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:27.083014  6503 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.084404  6503 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:27.029542  6764 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.084676  6802 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:27.085778  1631 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:01:27.087435  2322 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
W20260709 13:01:27.036252  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 56390.9us
I20260709 13:01:27.054719  1599 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:27.049095  6847 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:27.103942  6623 consensus_meta.cc:287] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.132s	user 0.010s	sys 0.000s
I20260709 13:01:27.105180  6566 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.106966  6777 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.057431  6685 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:27.058302  6755 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.037240  1526 leader_election.cc:403] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:01:27.060930  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:27.061560  6580 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.062767  6614 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.063477  6745 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:27.038803  1629 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
W20260709 13:01:27.069792  6846 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:01:27.069665  6841 consensus_queue.cc:260] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:27.067790  6668 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.132648  6668 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:27.133319  6841 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:27.134868  6668 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:27.053287  6832 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:01:27.038870  6751 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:27.048511  6778 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.136601  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 926) took 2801 ms. Trace:
I20260709 13:01:27.136963  1705 rpcz_store.cc:276] 0709 13:01:24.334983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.335092 (+   109us) service_pool.cc:224] Handling call
0709 13:01:24.335372 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.338745 (+  3373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.338776 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.358099 (+ 19323us) log.cc:844] Serialized 26 byte log entry
0709 13:01:26.085304 (+1727205us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b18003a9b40. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:01:26.541572 (+456268us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:26.541631 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.541785 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:27.136299 (+594514us) raft_consensus.cc:1685] finished
0709 13:01:27.136318 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.136520 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51000,"raft.queue_time_us":3488,"raft.run_cpu_time_us":4125,"raft.run_wall_time_us":83599,"spinlock_wait_cycles":3316992,"thread_start_us":456019,"threads_started":1,"wal-append.queue_time_us":2366690}
I20260709 13:01:27.088551  2328 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:27.089617  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:27.099246  6608 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.090927  1523 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:27.116350  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:27.068173  6776 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:27.123168  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 90176.4us
I20260709 13:01:27.085225  6802 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:27.137961  6778 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.095877  6764 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.151257  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:27.212383  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:27.178964  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:27.221827  2322 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:27.223033  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:27.183125  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:27.225890  2329 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:27.188530  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:27.194273  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:27.229449  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:27.231436  6685 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:27.231777  6764 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:27.232203  6685 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:27.232417  6764 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:27.233343  6764 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:27.235354  6685 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.195622  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:27.210445  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 59602us
I20260709 13:01:27.210966  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:27.213248  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 933) took 2384 ms. Trace:
I20260709 13:01:27.224435  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:27.210345  6755 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10.
I20260709 13:01:27.119899  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:27.245754  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 154888us
I20260709 13:01:27.248761  1707 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:27.239176  1709 rpcz_store.cc:276] 0709 13:01:24.828823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.437735 (+608912us) service_pool.cc:224] Handling call
0709 13:01:25.438169 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.502668 (+ 64499us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:25.697956 (+195288us) log.cc:844] Serialized 14 byte log entry
0709 13:01:26.398778 (+700822us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:26.398828 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:26.398883 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.212942 (+814059us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b54003f2854. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:27.213001 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.213173 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":283982,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":10563,"raft.queue_time_us":72110,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":7015,"spinlock_wait_cycles":147825408,"thread_start_us":864647,"threads_started":3,"wal-append.queue_time_us":622641}
W20260709 13:01:27.249732  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 195053us
I20260709 13:01:27.254348  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:27.255112  1559 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:27.270965  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:27.272831  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:27.274567  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:27.275381  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:27.214439  6608 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:27.271972  1555 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:27.120949  6623 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.274036  2288 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:27.288486  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 77599us
I20260709 13:01:27.297426  1559 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:27.305258  1523 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:27.309814  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:27.287725  6738 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:27.240067  6862 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.090s
I20260709 13:01:27.287393  6566 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:27.314421  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.315904  2326 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:27.289043  6855 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:27.323606  6855 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:27.324064  6855 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:27.324340  6776 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:27.327559  6538 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:27.293076  6858 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:27.315869  6803 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.319343  6738 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.293766  6608 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:27.331804  1523 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:27.322817  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:27.334165  6858 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.345023  6858 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.323944  6805 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:27.348204  6805 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:27.348639  6805 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:27.359212  6683 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.365872  6855 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.370563  6738 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.368443  6855 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.340397  6850 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:27.376353  6850 raft_consensus.cc:697] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:27.377563  6850 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.380980  6623 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.382964  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:27.383306  6869 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:27.383667  2327 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:27.385178  2321 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:27.389873  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:27.389698  2320 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.391119  2320 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:27.391372  6847 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:27.392624  1556 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:27.393558  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:27.394312  6780 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.395521  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:27.396483  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:27.413539  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 81839.1us
I20260709 13:01:27.399926  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:27.400462  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:27.400753  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:27.415289  1632 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:27.397328  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:27.314726  6859 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:27.414374  1523 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:27.429908  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:27.429957  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:27.431348  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:27.443220  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:27.419749  1630 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:27.421757  2320 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
W20260709 13:01:27.422397  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 99681.5us
I20260709 13:01:27.479468  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:27.417176  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:27.471760  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:27.320686  6868 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:27.478580  6023 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:27.525625  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:27.525702  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:27.516759  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 99676.9us
I20260709 13:01:27.417832  1598 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:27.339152  6803 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.411629  6795 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.376161  6858 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:27.412262  6668 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:27.420939  6861 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:27.422276  6780 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:27.610548  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:27.611548  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:27.633883  1632 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:27.612825  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:27.462009  6507 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:27.606873  6023 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.613965  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:27.642115  1707 raft_consensus.cc:2368] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
I20260709 13:01:27.616175  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:27.643167  1629 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:27.643225  1704 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:27.629935  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:27.644466  1709 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:27.644562  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:27.596222  6844 consensus_meta.cc:287] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.002s
I20260709 13:01:27.543012  6855 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:27.636451  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 218678us
W20260709 13:01:27.632366  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:27.606637  6818 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:01:27.546238  6735 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:01:27.541292  6868 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:27.641400  1705 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:27.544476  6838 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:27.640389  1708 raft_consensus.cc:1240] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:27.647420  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:27.648099  1704 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:27.613229  6836 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.630714  6683 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.658792  6023 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.640112  6779 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:27.593149  6764 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.666754  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:27.669406  1707 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:27.671217  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:27.652670  6876 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:27.668576  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 279249us
I20260709 13:01:27.674615  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:27.633589  6668 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:27.648609  6861 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:27.633481  6795 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.691676  6795 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.659868  6838 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:27.645984  6805 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.697907  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:27.666298  6868 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:27.655471  6844 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:27.695549  6765 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:27.668876  6683 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.696063  6838 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:27.670537  6836 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.710063  6847 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.714952  6608 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:27.710600  6843 consensus_meta.cc:287] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.000s
W20260709 13:01:27.718834  6873 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:27.710986  6765 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:27.711792  6858 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.717568  6836 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.722286  6803 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.729446  6844 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.722415  6805 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.730176  6745 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:27.725975  6765 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.730762  6745 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:27.729465  6764 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.738994  6753 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.692986  6876 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:27.699007  6861 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:26.730640   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:27.577096  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 238442us
I20260709 13:01:27.555994  1552 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:27.808882  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:27.884285  6414 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.892509  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:27.894814  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:27.895098  1552 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:27.896234  1554 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:27.817906  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:27.923460  1558 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:27.924952  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:27.650244  1601 leader_election.cc:400] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
I20260709 13:01:27.637897  1628 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:01:27.823572  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 171444us
I20260709 13:01:27.926185  1601 leader_election.cc:403] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:01:27.830420  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 286263us
I20260709 13:01:27.831166  1627 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:27.832096  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 2879) took 1387 ms. Trace:
I20260709 13:01:27.933295  1631 rpcz_store.cc:276] 0709 13:01:26.444207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.444352 (+   145us) service_pool.cc:224] Handling call
0709 13:01:27.831539 (+1387187us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54001b9c54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:27.831839 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472043776}
I20260709 13:01:27.833169  1701 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:27.688944  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2922) took 2354 ms. Trace:
I20260709 13:01:27.834357  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:27.937105  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:27.836432  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:27.941807  1560 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:27.942507  1598 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:27.838248  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:27.940850  1675 leader_election.cc:400] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:27.944391  1675 leader_election.cc:403] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:01:27.944597  1702 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:27.945452  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:27.946410  1626 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:27.846346  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:27.741377  6802 consensus_meta.cc:287] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.000s
I20260709 13:01:27.715698  6859 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:27.948457  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2525) took 1083 ms. Trace:
I20260709 13:01:27.948997  6876 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:27.948516  6802 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:27.949497  6859 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:27.936488  1703 rpcz_store.cc:276] 0709 13:01:25.334573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.530987 (+196414us) service_pool.cc:224] Handling call
0709 13:01:25.531628 (+   641us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:25.532242 (+   614us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:25.693632 (+161390us) log.cc:844] Serialized 14 byte log entry
0709 13:01:26.725951 (+1032319us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b180041b2a0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed962523a
0709 13:01:26.763796 (+ 37845us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:26.764560 (+   764us) log.cc:844] Serialized 52 byte log entry
0709 13:01:26.764776 (+   216us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:27.350583 (+585807us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b180041b2a0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0edd47d3c7 00007f0ed9a8f9a7 00007f0ed9a9f0bf 00007f0ed9a9f038
0709 13:01:27.460309 (+109726us) log.cc:844] Serialized 14 byte log entry
0709 13:01:27.688483 (+228174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.688611 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:27.688700 (+    89us) raft_consensus.cc:1685] finished
0709 13:01:27.688719 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.688876 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29367,"prepare.queue_time_us":1000699,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":72,"raft.queue_time_us":135265,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":59858,"spinlock_wait_cycles":30883072,"thread_start_us":677408,"threads_started":4,"wal-append.queue_time_us":551842}
I20260709 13:01:27.952231  6802 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.821010  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:27.953117  1630 rpcz_store.cc:276] 0709 13:01:26.865102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.874475 (+  9373us) service_pool.cc:224] Handling call
0709 13:01:26.874735 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.515442 (+640707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.947846 (+432404us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b5400125054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:27.948194 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252835072}
W20260709 13:01:27.954721  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 304627us
I20260709 13:01:27.957329  6827 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:27.958160  6827 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:27.856420  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:27.738150  6838 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.961095  6837 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:27.962188  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:27.731891  6745 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.962571  6838 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.718664  6843 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.963246  6836 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:27.965346  6566 consensus_queue.cc:1059] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:27.966199  6843 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.892194  6538 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.884284  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 1146) took 1222 ms. Trace:
I20260709 13:01:27.967746  6827 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.968274  2326 rpcz_store.cc:276] 0709 13:01:26.661382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.709724 (+ 48342us) service_pool.cc:224] Handling call
0709 13:01:27.883636 (+1173912us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54005d16d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:27.884084 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231992704}
I20260709 13:01:27.739212  6780 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.905997  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:27.813210  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:27.746819  6868 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.970343  1552 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.880188  6683 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:27.921145  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.973980  6868 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:27.975809  1627 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:27.909927  6861 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:27.932348  6828 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
W20260709 13:01:27.742902  6872 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:01:27.985918  6556 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:27.962006  6837 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:27.963764  6745 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:27.967209  6566 raft_consensus.cc:3055] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:27.956171  1598 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:27.916252  6839 raft_consensus.cc:3055] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:27.902544  6668 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:28.002642  6839 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:28.003613  2286 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:28.004176  6839 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:28.005089  2286 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:28.005549  6825 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:28.005915  6839 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:28.006191  6825 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:28.006748  6825 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:28.006935  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 51024.5us
I20260709 13:01:28.008044  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:27.996621  6566 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:01:28.001583  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 114199us
I20260709 13:01:28.013182  6566 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.014268  6414 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:28.015007  6414 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:28.015641  6414 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:28.015904  6566 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:28.017153  6853 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:28.018486  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:28.018863  6538 raft_consensus.cc:3055] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:28.019347  6538 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:27.980996  6628 consensus_queue.cc:260] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:28.009486  6828 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:28.023089  6828 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.023643  6828 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:28.008509  2286 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:28.021921  6538 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:28.038389  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 355170us
I20260709 13:01:28.054390  1552 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
W20260709 13:01:28.037604  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 75755.2us
I20260709 13:01:28.006620  6870 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:28.058012  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 49665.2us
I20260709 13:01:28.056445  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:28.057389  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:28.067770  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:28.066964  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:28.070029  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.070426  6538 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:28.071542  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:28.073268  2325 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:28.073581  1598 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:28.073696  6828 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.073292  6837 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:28.076493  6828 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:28.077219  6828 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:28.077330  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:28.067426  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:28.079097  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47786.3us
I20260709 13:01:28.081739  6765 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:28.085275  6735 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:28.085875  6735 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.086309  6735 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.086419  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:28.090553  6822 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:28.100726  1707 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:28.102826  6861 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:28.103106  6876 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:28.135571  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:28.136727  6780 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:28.137264  1553 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:01:28.161120  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:28.161942  2323 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:28.162916  6703 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:01:28.164219  6703 raft_consensus.cc:3055] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:28.164675  6703 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:28.165974  6703 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.132421  1601 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:28.124365  6828 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:28.171077  6503 consensus_meta.cc:287] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.086s	user 0.014s	sys 0.009s
I20260709 13:01:28.179171  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:28.187520  6628 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.193813  1558 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:28.194199  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:01:28.205941  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 90818.9us
I20260709 13:01:28.198647  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:28.208865  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:28.213754  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:01:28.208551  1709 consensus_meta.cc:287] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.563s	user 0.012s	sys 0.005s
I20260709 13:01:28.215867  1709 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:28.220855  1632 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:01:28.221788  6580 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:28.222249  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 54291.9us
I20260709 13:01:28.222891  1672 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:28.211916  2323 raft_consensus.cc:2376] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15. Re-sending same reply.
I20260709 13:01:28.227142  1599 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:28.228574  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:28.233621  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:28.234166  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:28.235118  1701 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:28.235486  6503 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:28.236001  6503 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:28.236696  2328 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:28.236999  6874 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:28.236730  6503 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:28.240001  2286 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:28.242944  6738 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:28.243456  2286 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:28.244828  6738 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:28.246656  6703 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:28.249014  6840 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:28.250020  6840 raft_consensus.cc:697] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:28.251127  6840 consensus_queue.cc:237] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:28.252759  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:28.253484  1704 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:28.253615  1707 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:28.255432  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:28.256160  1705 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:28.257248  6414 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.259982  6414 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:28.261220  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 143605us
I20260709 13:01:28.263216  1601 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:28.265296  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 62418.9us
I20260709 13:01:28.266940  1705 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:28.274739  2326 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:28.239600  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:28.299739  1598 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:28.307924  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 64615.3us
I20260709 13:01:28.310467  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:28.315730  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 52511us
I20260709 13:01:28.321990  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:28.213111  6828 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:28.327874  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 150239us
I20260709 13:01:28.329628  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:28.334275  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:28.336558  1630 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:28.337086  6825 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.340169  6825 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:28.340773  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:28.342312  1523 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:28.343154  1554 raft_consensus.cc:1240] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:28.365514  6861 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:28.369354  1553 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:28.344259  6735 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.371517  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:28.372012  6735 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:28.372388  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:28.372897  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:28.373687  1558 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:28.374809  6745 consensus_queue.cc:1059] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:28.375684  2325 raft_consensus.cc:2393] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 12: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:28.376096  6859 raft_consensus.cc:3055] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:28.376556  6859 raft_consensus.cc:740] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:01:28.376749  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 137338us
I20260709 13:01:28.377732  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:28.377557  6859 consensus_queue.cc:260] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.378111  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:28.378942  6859 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:28.379017  6861 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:28.379441  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:28.372397  1554 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:28.380913  6861 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:28.382084  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.384253  6745 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:28.385037  6745 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:28.386711  1705 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:28.387305  6745 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:28.392421  1455 catalog_manager.cc:5697] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.319916  6802 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:28.345722  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 82573.6us
I20260709 13:01:28.346148  6876 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:28.346668  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:28.347308  1630 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:28.347818  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:28.351673  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:28.356019  6828 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:28.320827  6414 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:28.384497  1454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57414 (request call id 192) took 18167 ms (client timeout 15000 ms). Trace:
W20260709 13:01:28.404489  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:28.402308  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 82679.5us
I20260709 13:01:28.406257  1704 raft_consensus.cc:2393] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 16: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:28.407274  1553 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:28.408234  1708 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
W20260709 13:01:28.362360  1673 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.730s (SENT)
I20260709 13:01:28.388023  6503 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:28.416884  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:28.418004  1629 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:28.418246  6882 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:28.419193  6885 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.419831  6885 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:28.421064  2328 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:28.422132  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:28.416043  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:28.426789  1673 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:28.424000  6802 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:28.405740  6876 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.429208  1551 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:28.431078  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:28.435878  1560 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:28.436427  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:28.437513  2323 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:28.446784  1598 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:28.434803  6876 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:28.408280  6765 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:01:28.454249  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:28.460366  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:28.458134  2329 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:28.467718  1559 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:28.428553  6802 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.466928  1599 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:28.449219  6414 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:28.442062  6580 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:28.439715  6874 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:01:28.481777  6778 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:28.490438  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.490646  6870 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:28.478477  1675 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:28.478013  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:28.519595  1629 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:28.519902  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:28.520803  1551 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.469540  6838 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:28.521745  6827 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:28.526700  6827 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.527096  6827 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:28.527832  1455 catalog_manager.cc:5697] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:01:28.528789  6580 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:28.529838  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 68197.9us
I20260709 13:01:28.476248  6503 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:28.531332  6792 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:01:28.532069  6580 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:28.532433  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:28.533179  6759 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:28.536862  6838 raft_consensus.cc:697] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:28.538336  6765 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:28.557051  6765 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:28.558418  6765 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.560144  6765 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:28.539609  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 89946us
I20260709 13:01:28.532094  6778 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.563972  1556 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:01:28.565514  6778 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:28.565858  6838 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:28.523128  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 80155.3us
W20260709 13:01:28.540915  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 94353.4us
W20260709 13:01:28.531648  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 169443us
I20260709 13:01:28.542869  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:28.548727  1627 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.552326  6870 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:28.552809  6837 consensus_queue.cc:1059] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:28.554751  6802 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:28.577996  2288 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:28.571159  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:28.539644  6703 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:28.585006  6735 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:28.585772  6837 raft_consensus.cc:3055] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:01:28.589315  1673 leader_election.cc:336] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.788s (SENT)
I20260709 13:01:28.586519  2323 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:28.609788  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:28.610980  2323 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 11: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:28.611596  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:28.595124  6580 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
W20260709 13:01:28.615563  1673 leader_election.cc:336] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.819s (SENT)
I20260709 13:01:28.615687  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:28.616140  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:28.616601  2322 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:28.617399  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:28.617647  6882 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:28.618481  6882 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:28.618889  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:28.620177  1675 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:28.621449  6697 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:28.622275  6697 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:28.622767  6421 raft_consensus.cc:2764] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:01:28.623401  6697 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:28.623854  6697 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.624223  6697 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:28.625794  2320 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:28.595353  6870 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:28.631812  1627 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:28.594338  6703 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:28.597041  6837 raft_consensus.cc:740] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:28.610005  6778 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:28.613092  6735 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:28.704365  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:28.704237  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 67804.8us
W20260709 13:01:28.409365  1454 rpcz_store.cc:269] 0709 13:01:10.217021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.247025 (+ 30004us) service_pool.cc:224] Handling call
0709 13:01:28.384227 (+18137202us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:19.208935 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:19.209707 (+   772us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:19.209764 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:01:19.209790 (+    26us) tablet.cc:662] Decoding operations
0709 13:01:19.342183 (+132393us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:19.360886 (+ 18703us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:19.365905 (+  5019us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:01:19.683534 (+317629us) tablet.cc:701] Row locks acquired
0709 13:01:19.703739 (+ 20205us) write_op.cc:260] PREPARE: finished
0709 13:01:19.768223 (+ 64484us) write_op.cc:270] Start()
0709 13:01:19.838171 (+ 69948us) write_op.cc:276] Timestamp: P: 1783602079755743 usec, L: 0
0709 13:01:19.841516 (+  3345us) op_driver.cc:348] REPLICATION: starting
0709 13:01:19.989178 (+147662us) log.cc:844] Serialized 7048 byte log entry
0709 13:01:20.344606 (+355428us) op_driver.cc:464] REPLICATION: finished
0709 13:01:20.622492 (+277886us) write_op.cc:301] APPLY: starting
0709 13:01:20.622616 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:21.240925 (+618309us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:21.256440 (+ 15515us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:21.303208 (+ 46768us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:21.303621 (+   413us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:01:21.303699 (+    78us) write_op.cc:312] APPLY: finished
0709 13:01:21.304464 (+   765us) log.cc:844] Serialized 164 byte log entry
0709 13:01:21.310320 (+  5856us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:21.310516 (+   196us) write_op.cc:454] Released schema lock
0709 13:01:21.310593 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:21.316184 (+  5591us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:21.316219 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2504623,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":264373,"apply.run_cpu_time_us":30046,"apply.run_wall_time_us":702897,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79259,"num_ops":18,"prepare.queue_time_us":232605,"prepare.run_cpu_time_us":32592,"prepare.run_wall_time_us":918101,"raft.queue_time_us":21422,"raft.run_cpu_time_us":56604,"raft.run_wall_time_us":214761,"replication_time_us":501230,"thread_start_us":492850,"threads_started":4,"wal-append.queue_time_us":192077,"wal-append.run_cpu_time_us":13747,"wal-append.run_wall_time_us":2090943}]]}
I20260709 13:01:28.641191  1598 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:28.712947  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 71822.1us
I20260709 13:01:28.638535  6703 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.631098  6885 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:28.725315  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:28.616328  6876 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.712841  6882 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:28.723838  6792 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:28.725823  6844 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:28.751533  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 208964us
I20260709 13:01:28.755482  1455 catalog_manager.cc:5697] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 4 to 6, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 6 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.757862  1455 catalog_manager.cc:5697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.750761  6792 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:28.762081  6792 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.763480  6764 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:01:28.765518  6544 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.766206  6544 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:28.771510  1703 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 16: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:01:28.776829  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 158030us
I20260709 13:01:28.784947  6735 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:28.773847  6896 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:01:28.753418  6780 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:28.802549  6837 consensus_queue.cc:260] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:28.804409  6898 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:01:28.806021  6897 log.cc:927] Time spent T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:28.811208  6876 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:28.812711  6870 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:28.815510  1673 leader_election.cc:336] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.065s (SENT)
I20260709 13:01:28.818579  2286 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:28.820571  6822 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:28.821007  6822 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.821393  6822 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:28.768929  6882 raft_consensus.cc:697] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:28.747336  6844 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:28.826014  6844 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.825599  6882 consensus_queue.cc:237] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:28.829895  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:28.830009  6421 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:01:28.830993  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 191598us
W20260709 13:01:28.831935  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.830291  2329 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:28.833431  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:28.843704  6538 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:28.845336  6628 raft_consensus.cc:3055] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:28.845739  6628 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:28.846767  6628 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:28.847887  6628 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:28.849721  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:28.850895  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:28.851300  1706 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:28.855314  1560 raft_consensus.cc:1275] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:28.864918  6759 consensus_queue.cc:1059] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:28.866845  6885 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:28.867375  6885 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:28.868669  6885 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.873509  6885 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.879046  6544 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:28.885903  6837 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:28.838209  1551 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:28.894563  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:28.965229  1709 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:28.902844  6822 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.971127  6822 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:28.816228  1673 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:28.972972  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 157506us
I20260709 13:01:28.919237  6843 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:28.975359  6843 consensus_queue.cc:1243] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:28.978883  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:28.922159  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:28.924402  2286 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:28.980185  1556 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
W20260709 13:01:28.980756  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 160203us
I20260709 13:01:28.930804  6764 consensus_queue.cc:1059] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:28.982111  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:28.982695  6764 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:28.983242  6764 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:28.983745  6566 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:28.984351  6566 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:28.984841  6566 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.984890  6764 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:28.986771  6764 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.715440  6778 raft_consensus.cc:697] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:28.951177  6751 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:28.994114  6778 consensus_queue.cc:237] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:28.997684  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.982100  2286 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:29.000931  6780 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:29.001569  6780 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.002120  6780 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:29.001861  6827 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:29.006247  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.009205  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:29.019935  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 186599us
I20260709 13:01:29.023804  1599 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:29.028307  6843 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:29.028909  6843 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.029322  6843 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.008008  2286 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:29.045853  6822 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:29.047147  6822 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:29.050236  6822 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:29.053522  1556 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:29.060310  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:29.061582  1706 raft_consensus.cc:2410] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:01:29.061753  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.060505  1551 pending_rounds.cc:85] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 3
I20260709 13:01:29.062860  1551 pending_rounds.cc:107] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:01:29.063198  1551 raft_consensus.cc:2889] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:29.081558  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:29.085861  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.090335  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:29.091044  1560 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:29.096334  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:29.092667  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:29.100368  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:29.103344  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:29.104036  1558 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:29.104990  1709 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:29.111037  1630 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:29.019094  6703 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:29.101516  6765 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:29.145753  6765 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:29.144100  6751 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:29.209615  1558 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
W20260709 13:01:29.156246  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.050s	sys 0.062s
W20260709 13:01:29.212255  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.051s	sys 0.062s
I20260709 13:01:29.134845  6827 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:29.220651  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.212853  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 55405.5us
W20260709 13:01:29.215421  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 57261.7us
W20260709 13:01:29.212641  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 592460us
I20260709 13:01:29.087177  6697 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:29.226397  1599 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:29.107538  6844 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:29.279484  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.039s	sys 0.067s
I20260709 13:01:29.225982  6876 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:29.286290  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.039s	sys 0.067s
I20260709 13:01:29.288857  1553 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:29.303830  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 784995us
I20260709 13:01:29.273442  6538 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:29.280643  6421 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:29.278452  6765 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:29.220075  6780 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:29.329838  1559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.007s	sys 0.010s
W20260709 13:01:29.330380  1559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.007s	sys 0.010s
I20260709 13:01:29.322706  6538 raft_consensus.cc:697] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:29.331476  6870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.004s	sys 0.014s
I20260709 13:01:29.329483  6421 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:01:29.349119  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.352047  1555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.044s	sys 0.119s
W20260709 13:01:29.352427  1555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.044s	sys 0.119s
I20260709 13:01:29.352545  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:29.352869  6907 consensus_queue.cc:1059] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:01:29.358139  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:29.358385  1601 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:29.358793  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 998) took 1034 ms. Trace:
I20260709 13:01:29.365478  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 2981) took 1076 ms. Trace:
I20260709 13:01:29.365960  1555 rpcz_store.cc:276] 0709 13:01:28.281391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.287519 (+  6128us) service_pool.cc:224] Handling call
0709 13:01:28.308223 (+ 20704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.380792 (+ 72569us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:28.381133 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.357654 (+976521us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:29.357709 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:29.357755 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.357831 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.357939 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2114,"prepare.queue_time_us":596,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"thread_start_us":971285,"threads_started":1}
I20260709 13:01:29.366936  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:29.367637  1707 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:01:29.348785  6870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.005s	sys 0.014s
I20260709 13:01:29.359170  1632 rpcz_store.cc:276] 0709 13:01:28.320203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.324255 (+  4052us) service_pool.cc:224] Handling call
0709 13:01:28.363604 (+ 39349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.364144 (+   540us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:28.364175 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.364772 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 13:01:28.726603 (+361831us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:28.726640 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.726697 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:29.354358 (+627661us) raft_consensus.cc:1685] finished
0709 13:01:29.354380 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.354503 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7763,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":106,"thread_start_us":361427,"threads_started":1,"wal-append.queue_time_us":894036}
I20260709 13:01:29.382238  1707 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
W20260709 13:01:29.385777  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.389720  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:29.360867  6759 raft_consensus.cc:3055] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:29.395663  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.390122  6580 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:29.409847  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:29.407431  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:29.392778  6703 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:29.396909  6759 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:29.419394  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:29.401242  6668 consensus_queue.cc:1059] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 13:01:29.422778  1598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.004s	sys 0.017s
W20260709 13:01:29.424151  1598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.005s	sys 0.017s
I20260709 13:01:29.429817  1630 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:29.430197  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:29.432451  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 339880us
W20260709 13:01:29.435824  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 80511.1us
I20260709 13:01:29.434934  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:29.449110  2328 raft_consensus.cc:2368] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13.
I20260709 13:01:29.424719  6844 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:29.427338  6697 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:29.458717  2329 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:01:29.469592  6544 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.470520  6544 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:29.474879  6553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.006s	sys 0.013s
W20260709 13:01:29.475289  6553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.006s	sys 0.013s
I20260709 13:01:29.475605  6544 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:29.476660  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:29.483085  1672 leader_election.cc:400] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13.
I20260709 13:01:29.483512  1672 leader_election.cc:403] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:01:29.483247  1560 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
W20260709 13:01:29.482234  6905 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:01:29.512777  1601 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:29.456247  6802 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:29.482589  6780 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:29.433964  6538 consensus_queue.cc:237] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:29.509970  6697 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:29.543183  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 120236us
I20260709 13:01:29.549392  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:29.557713  1700 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:01:29.556105  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 142240us
I20260709 13:01:29.456856  6421 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:29.491042  6544 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
W20260709 13:01:29.563089  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 118683us
I20260709 13:01:29.568245  2328 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:29.567736  2286 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:29.571084  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:29.498245  6759 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:29.573180  6902 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:01:29.574441  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 82786.3us
I20260709 13:01:29.566012  6668 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:29.548885  6802 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:29.580103  6780 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:29.587744  6885 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.713s	user 0.013s	sys 0.001s
I20260709 13:01:29.592841  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1217) took 1042 ms. Trace:
I20260709 13:01:29.593021  6802 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:29.593344  2327 rpcz_store.cc:276] 0709 13:01:28.550160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.550310 (+   150us) service_pool.cc:224] Handling call
0709 13:01:28.565233 (+ 14923us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.565838 (+   605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.565870 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.566390 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:01:28.725875 (+159485us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:28.725944 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.726014 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:29.592498 (+866484us) raft_consensus.cc:1685] finished
0709 13:01:29.592523 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.592769 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":836,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"thread_start_us":158211,"threads_started":1,"wal-append.queue_time_us":659254}
W20260709 13:01:29.595069  6566 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.000s
I20260709 13:01:29.601022  1703 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:29.594901  6668 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:29.576545  6913 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:29.603813  6913 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:29.603960  6668 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:29.604292  6843 consensus_meta.cc:287] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.574s	user 0.013s	sys 0.000s
I20260709 13:01:29.604296  6913 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.604866  6843 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:29.608363  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:29.613211  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:29.619024  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:29.619892  1700 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:29.619904  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:29.620312  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:29.595988  6566 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:29.621619  1701 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:29.621390  1601 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:29.632130  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:29.635759  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 52692.3us
I20260709 13:01:29.638063  2323 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:29.641202  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58423.7us
I20260709 13:01:29.638339  1554 raft_consensus.cc:2376] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13. Re-sending same reply.
I20260709 13:01:29.645571  6566 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:29.641607  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:29.647796  1704 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:29.636791  2288 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:29.638142  6853 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:29.650286  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:29.650913  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.656205  1557 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:29.661689  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:29.662798  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.664920  6918 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:29.665557  6918 raft_consensus.cc:697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:29.666543  6918 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:29.664896  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.670478  1601 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:29.672646  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.678622  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.676967  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.676199  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:29.681999  1555 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:29.683022  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.684096  1559 raft_consensus.cc:2368] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14.
I20260709 13:01:29.685489  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:29.686110  1702 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:29.695698  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.695960  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.706182  6765 raft_consensus.cc:3055] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:29.706738  6765 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:29.707676  6765 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:29.709252  1704 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:29.713629  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:29.714303  2324 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:29.714555  6697 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13.
I20260709 13:01:29.716351  6843 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:29.716768  6765 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.717846  1703 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:01:29.725281  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 63101.9us
I20260709 13:01:29.725848  6917 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:29.726539  6544 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:29.727720  6544 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.728202  6544 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:29.730297  6553 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:29.730597  6544 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:29.730824  6553 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:29.735365  6915 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:01:29.736517  1601 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:29.684571  6538 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:29.755587  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.757380  1702 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:29.758424  6843 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:29.759709  2324 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:29.731868  6553 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:29.761830  1601 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:29.758908  6843 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:29.759981  2288 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:29.774638  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:29.774726  6917 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:29.778023  6917 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:29.779172  6917 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:29.763604  6538 raft_consensus.cc:697] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:29.765877  6876 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.766928  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:29.833956  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.834419  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.835413  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.807641  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.777365  1632 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:29.788133  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.840016  1560 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:29.784644  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.787343  6544 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:29.789152  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:29.813465  1601 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:29.817829  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.773334  6843 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:29.811841  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.788129  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:29.845659  1558 raft_consensus.cc:2368] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:29.787243  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.788982  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:29.791740  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.788463  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.829501  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:29.767279  6913 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:29.831089  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 143501us
I20260709 13:01:29.847805  1629 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:29.853477  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:29.856611  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.858566  1707 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:29.858901  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:29.862788  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.863771  1552 raft_consensus.cc:2393] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 8: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:29.869442  1635 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:29.860353  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:29.871992  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.873605  1551 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:29.874933  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.876677  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.877806  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.878756  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.880285  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.883145  1628 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:01:29.889781  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 76409.6us
I20260709 13:01:29.891472  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:29.892663  1554 raft_consensus.cc:2368] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15.
I20260709 13:01:29.895298  1629 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:29.896698  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.898319  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.903426  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:29.905232  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:29.907435  1635 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:29.908535  1628 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:29.908891  1626 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:01:29.908429  6538 consensus_queue.cc:237] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:29.910302  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.889840  6553 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:29.924482  1553 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:29.875355  6544 raft_consensus.cc:697] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:29.929561  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.844847  6876 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:29.931696  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:29.939116  1560 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.932880  1554 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:29.934080  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:29.935634  1633 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:29.912650  6414 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:29.930018  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:29.954852  6941 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:01:29.958101  6913 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:29.958961  1701 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:29.961040  1628 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:29.961198  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:29.966295  1706 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:29.960278  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.967989  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 54575.3us
I20260709 13:01:29.936156  6837 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.970168  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:29.923118  6580 consensus_queue.cc:1059] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:01:29.976194  1702 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:29.976864  1704 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:29.931056  6840 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:01:29.972699  6765 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:29.985962  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 65557us
W20260709 13:01:29.983870  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 63417.2us
I20260709 13:01:29.994104  6876 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:29.976298  6414 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:30.017297  6765 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:30.023721  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 381505us
I20260709 13:01:30.031064  6765 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:30.048182  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:30.050082  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:30.050943  1554 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:29.982857  6837 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.063052  6837 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:30.063438  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:30.022955  6544 consensus_queue.cc:237] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:30.057549  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:30.077188  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:30.057745  1626 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:30.079715  1631 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:30.048818  6566 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.080925  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:30.100077  1708 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:30.099807  6566 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.102294  6566 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:30.103133  1709 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:30.103801  6942 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.259s	user 0.002s	sys 0.000s
I20260709 13:01:30.104298  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:30.104949  1709 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:30.052822  6683 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:30.090652  1560 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:30.024617  6918 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
W20260709 13:01:30.113255  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 54777.6us
I20260709 13:01:30.115676  1706 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:30.115962  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:30.112627  6874 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:30.119890  6874 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:30.057545  6580 consensus_queue.cc:1059] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:01:30.114678  6683 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.077942  6859 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:30.126561  6683 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:30.126977  1709 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:30.127671  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:30.128077  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:30.120288  6874 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:30.130388  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:30.134694  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:30.137614  1554 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:30.139663  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:30.133808  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:30.141070  1673 leader_election.cc:400] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11.
I20260709 13:01:30.130327  6765 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:30.142447  1626 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:30.134253  6414 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.151021  1633 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:30.150861  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:30.152326  1703 raft_consensus.cc:1275] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:30.152320  1708 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
W20260709 13:01:30.158259  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.165185  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:30.140892  6843 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:30.180820  1633 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:30.182217  6765 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:30.183276  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 114140us
I20260709 13:01:30.184383  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:30.192655  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 76782.8us
I20260709 13:01:30.193760  1633 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:30.199812  1632 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:30.202797  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 43642.9us
I20260709 13:01:30.203912  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:30.163273  6414 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:30.206688  1627 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:30.207198  1526 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:30.210187  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:30.213452  1633 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:30.206982  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:30.216552  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:30.198776  6959 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:30.221858  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:30.223188  6943 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.384s	user 0.002s	sys 0.000s
I20260709 13:01:30.214202  6544 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:30.216425  1673 leader_election.cc:336] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.519s (SENT)
I20260709 13:01:30.225705  6544 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.226547  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:30.227774  6765 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:30.228948  1673 leader_election.cc:336] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.533s (SENT)
I20260709 13:01:30.229415  1673 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:30.229629  6544 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:30.230374  6765 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:30.232025  1700 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:01:30.232409  1700 pending_rounds.cc:85] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 10
I20260709 13:01:30.232646  1700 pending_rounds.cc:107] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:01:30.232882  1700 raft_consensus.cc:2889] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:30.232939  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:30.234138  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:30.234917  1705 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:30.237365  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:30.214691  6764 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:30.244055  6843 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:30.242039  6538 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.212141  6859 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:30.255440  1634 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:30.256385  1701 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:30.256973  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:30.251457  6759 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:30.259142  1708 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:30.263681  2322 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:30.263593  6959 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:30.285622  6959 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:30.304145  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:30.304905  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:30.305644  1707 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.307803  6544 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:30.309324  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:30.287225  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:30.312729  6802 raft_consensus.cc:3055] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:30.278326  6859 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.312674  1635 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:30.251581  6538 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:30.315128  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:30.316859  2286 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:30.316056  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:30.316166  6566 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:01:30.320215  6751 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:30.288718  6959 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:30.320061  6917 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:30.327663  1556 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:30.313297  6802 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:30.349071  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:30.343901  1707 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:30.344036  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:30.351435  1701 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:30.346311  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:30.330722  6780 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:30.358814  1559 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:30.331279  6844 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:30.363718  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:30.365501  1626 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.342104  6764 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.367743  1554 raft_consensus.cc:2393] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 14: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:30.369100  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:30.369936  1704 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.354847  6780 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.376983  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:30.378109  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 59123.8us
I20260709 13:01:30.323917  6859 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.381009  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:30.382177  1633 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:30.395875  1704 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:30.397004  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:30.397625  1635 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:30.378247  6780 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:30.399521  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:30.403254  1553 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:30.380703  6802 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.403597  1675 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:30.405839  1633 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:30.408018  6972 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:01:30.371757  6764 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:30.418462  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 303999us
I20260709 13:01:30.378062  6735 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:30.419958  2286 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:30.423748  6966 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:30.421068  6844 raft_consensus.cc:697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:30.425915  6844 consensus_queue.cc:237] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:30.426898  6751 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:30.429749  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:30.441850  6859 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:30.442153  6538 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:30.442520  6859 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:30.442876  6859 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:30.436805  6885 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:30.409221  6414 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:30.428998  6735 consensus_queue.cc:1243] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:30.453701  6566 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:30.454615  6764 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:30.461191  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:30.463881  6765 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:30.467926  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.472239  1599 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:30.451979  6874 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:30.477718  6668 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:30.478444  6703 consensus_queue.cc:1059] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:30.474028  6683 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.487288  6683 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.488397  1709 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:30.489399  1706 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 13:01:30.489462  6683 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:30.489918  1706 pending_rounds.cc:85] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 11
I20260709 13:01:30.490201  1706 pending_rounds.cc:107] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:01:30.479370  6885 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:30.490449  1706 raft_consensus.cc:2889] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:30.490790  6566 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:30.444051  6859 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.481117  6959 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:30.492882  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:30.493559  1557 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 7.
I20260709 13:01:30.493934  6780 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.494918  6959 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:30.484325  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:30.496476  6556 consensus_queue.cc:1175] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6b9e73092f6146639bf310a3d18cfe37" responder_term: 13 status { last_received { term: 13 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 13 index: 10 } }
I20260709 13:01:30.497815  1626 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:30.502830  6853 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:30.503692  6853 raft_consensus.cc:697] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:30.496114  6780 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:30.525579  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 146718us
I20260709 13:01:30.527944  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:30.520251  1554 pending_rounds.cc:85] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 9
I20260709 13:01:30.529482  1554 pending_rounds.cc:107] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:01:30.529829  1554 raft_consensus.cc:2889] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:30.530522  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:30.531333  2324 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:30.519426  6903 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.532399  1704 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:30.532915  6907 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:30.532758  6903 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.534204  6703 raft_consensus.cc:3055] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:30.534598  6703 raft_consensus.cc:740] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:30.535321  6764 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:30.535730  6764 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:30.535560  6703 consensus_queue.cc:260] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:30.532768  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 48529.6us
I20260709 13:01:30.541061  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:30.550836  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:30.551523  1626 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:30.555042  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:30.545725  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:30.557081  1601 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:30.589413  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:30.593282  2323 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:30.561884  1601 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:30.560403  6765 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:01:30.593432  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 87834.2us
I20260709 13:01:30.530905  6566 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:01:30.605499  1632 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:30.605593  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:30.607369  1707 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:30.594741  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:30.555357  6827 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:30.536687  6764 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.590510  6792 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:30.553306  6840 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.608804  1553 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:01:30.540836  6967 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:01:30.592351  6759 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.589936  6538 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:30.553480  6703 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:30.592991  6544 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 13:01:30.624083  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 78428.3us
W20260709 13:01:30.669003  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46002.8us
I20260709 13:01:30.590394  6553 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:01:30.681486  1707 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:30.678809  1559 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:30.704573  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:30.705350  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.615159  6792 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:30.618216  6764 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:30.617646  6903 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:30.665673  6765 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.739317  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.594472  6975 consensus_queue.cc:1059] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:01:30.673743  6580 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:30.746300  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:30.622220  6751 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.101s
I20260709 13:01:30.751060  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:30.599611  6965 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:01:30.729303  6792 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:30.719774  6683 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:01:30.755008  6870 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.755620  6870 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.759528  6870 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:30.761476  6973 log.cc:927] Time spent T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:01:30.745594  6765 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.763609  6765 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:30.771862  6792 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.616313  6827 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.778002  6827 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:30.744119  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 182297us
I20260709 13:01:30.680868  6971 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:01:30.778914  1601 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:30.612933  6853 consensus_queue.cc:237] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:30.780859  1673 leader_election.cc:336] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.747s (SENT)
I20260709 13:01:30.781463  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:30.724218  6780 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.671911  6759 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:30.665261  6840 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.787889  6765 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:30.796489  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:30.801416  1632 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:30.801215  6961 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.210s
W20260709 13:01:30.803963  6979 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:01:30.798247  6759 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:30.799578  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:30.806211  2320 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:30.806291  6983 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:30.806885  6983 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:30.807937  1672 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:30.807788  6983 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:30.812326  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 44600.2us
I20260709 13:01:30.800429  1634 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:01:30.811090  1632 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:30.823350  1675 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:30.800771  6874 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:30.825568  6838 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:30.827682  1675 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:30.841657  1675 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:30.792687  6792 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:30.808913  6759 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:30.800254  6840 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:30.883767  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 51058.2us
I20260709 13:01:30.826362  6668 raft_consensus.cc:2764] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:01:30.889223  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47685.4us
I20260709 13:01:30.900360  1675 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:30.800488  6780 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.889993  6703 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:30.894302  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2902) took 1035 ms. Trace:
I20260709 13:01:30.906877  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:30.907117  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:30.907656  1673 leader_election.cc:336] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.916s (SENT)
I20260709 13:01:30.908269  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:30.902251  1599 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:30.901247  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 187277us
I20260709 13:01:30.907238  1627 rpcz_store.cc:276] 0709 13:01:29.859110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.883541 (+ 24431us) service_pool.cc:224] Handling call
0709 13:01:29.883977 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.207166 (+323189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.894087 (+686921us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54002c83d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:30.894246 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741598080}
I20260709 13:01:30.878501  6907 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:30.799741  6764 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:01:30.895823  6759 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:30.915658  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 210719us
I20260709 13:01:30.901957  6947 raft_consensus.cc:3055] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:30.917850  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:30.918605  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:30.920408  6759 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.899004  6874 consensus_queue.cc:1059] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:01:30.932178  6967 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:30.933159  6924 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:30.933305  6967 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:30.933835  6924 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:30.934368  6967 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:30.932958  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:30.932413  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:30.936980  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:30.937533  6939 log.cc:927] Time spent T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:01:30.938225  6974 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:30.938676  6974 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.939043  6974 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:30.939352  6975 raft_consensus.cc:3055] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:30.939785  6975 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:30.921641  6947 raft_consensus.cc:740] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:30.942359  6802 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:30.942698  6947 consensus_queue.cc:260] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:30.943921  6947 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:30.949049  2288 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:30.913035  6907 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:30.958798  1557 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:30.963804  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:30.965700  6874 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:30.966368  1553 raft_consensus.cc:3055] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:30.966464  6874 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:30.966822  1553 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:30.967164  6874 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:30.967679  1553 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:30.968829  6751 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:01:30.972869  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 62402.7us
I20260709 13:01:30.973637  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:30.974903  1554 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:30.975209  6765 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:30.976089  6994 raft_consensus.cc:3055] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:30.976910  6994 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:30.964649  1557 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 7.
I20260709 13:01:30.987730  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:30.936406  6924 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:01:30.949297  6421 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.992530  1553 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:30.994064  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.960222  6907 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:30.976047  6765 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:30.962972  6566 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:30.976790  6975 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:31.007893  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:31.046841  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 146335us
I20260709 13:01:31.057781  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:31.006076  6827 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:01:31.059213  6544 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:31.070843  6844 raft_consensus.cc:2764] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:01:31.077376  1601 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.011333  6580 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:01:31.080572  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:31.087515  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 179763us
I20260709 13:01:31.088992  1553 raft_consensus.cc:1275] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:01:31.090170  1673 leader_election.cc:336] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.934s (SENT)
W20260709 13:01:31.088333  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 100715us
I20260709 13:01:31.012048  6421 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:31.096515  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.097890  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:31.098863  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:31.100030  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:31.069577  6703 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:31.103965  1601 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.110373  6414 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:31.111004  6780 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:31.111099  6414 raft_consensus.cc:697] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:31.112435  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:31.112653  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:31.116386  1628 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:01:31.078769  6668 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:31.083470  6544 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.139569  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:31.101122  6874 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:31.080696  6991 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:31.063709  6986 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:01:31.151852  6844 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:31.151750  6414 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:31.148039  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:31.161068  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 70914.2us
I20260709 13:01:31.161418  6703 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:31.163756  6993 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:31.164825  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:31.181988  1704 raft_consensus.cc:2368] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
I20260709 13:01:31.169281  1707 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:01:31.117107  6948 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:31.141026  6765 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:31.176010  6987 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:01:31.141203  6965 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:01:31.146232  6544 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:31.178395  1673 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.655s (SENT) [suppressed 27 similar messages]
I20260709 13:01:31.068720  6994 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:31.175820  6759 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:31.203821  1673 leader_election.cc:336] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.959s (SENT)
I20260709 13:01:31.204272  1704 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:31.207904  1673 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.181602  6993 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:31.208477  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 60550.9us
I20260709 13:01:31.199838  6986 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:31.220917  7005 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:31.222040  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.225790  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.226641  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:31.227932  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:31.229570  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:31.229633  6999 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.230618  6844 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:31.230401  6999 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:31.231427  6844 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:31.232211  6844 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:31.234370  1526 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:31.199077  6948 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:31.244675  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:31.248034  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:31.261025  6844 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.243373  6948 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.269548  6421 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:31.269747  6874 consensus_queue.cc:1059] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:31.271091  7004 raft_consensus.cc:3055] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:31.271529  7004 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:31.272394  7004 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:31.278002  2323 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:31.236397  6993 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:31.292809  6996 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:31.249205  6986 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:31.305392  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 101601us
W20260709 13:01:31.306314  1673 leader_election.cc:336] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.090s (SENT)
I20260709 13:01:31.306787  1673 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.309149  1558 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:31.313645  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:31.314523  2320 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 8.
I20260709 13:01:31.250176  6991 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:31.318657  6668 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:31.326766  6999 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:31.332799  6859 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.332895  6974 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:31.339139  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:31.340313  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.351203  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 91417.5us
W20260709 13:01:31.362653  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 56384.8us
I20260709 13:01:31.361953  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:31.379268  6544 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:31.382439  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:31.401295  1632 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:31.402009  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:31.403106  1635 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:01:31.403484  1635 pending_rounds.cc:85] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 12
I20260709 13:01:31.403707  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:31.403723  1635 pending_rounds.cc:107] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:01:31.405319  1635 raft_consensus.cc:2889] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:31.406286  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:31.409305  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.409317  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:31.438601  6925 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:31.439445  6925 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:31.443513  6925 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:31.457417  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:31.461191  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.470782  1556 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:31.374449  6986 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:31.365734  6553 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:31.458364  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 69621.8us
I20260709 13:01:31.367821  6961 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
I20260709 13:01:31.487772  6991 consensus_queue.cc:1059] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:31.489487  6984 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:01:31.491453  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:31.493801  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:31.485288  6553 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:31.495162  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:31.495941  1706 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:31.497284  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:31.498525  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:31.486861  2323 raft_consensus.cc:2955] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 5 to 9, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:31.500092  1709 raft_consensus.cc:1275] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:31.503669  6553 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:31.366740  6972 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:01:31.477515  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:31.507773  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:31.510540  6874 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:31.369467  6981 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 13:01:31.466763  6966 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.477079  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:31.518038  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.473215  7005 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.533149  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:31.504050  6759 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:31.517376  2288 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:31.478909  6983 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.523206  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:31.528749  1673 leader_election.cc:336] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.781s (SENT)
I20260709 13:01:31.539677  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:31.514863  7013 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.233s	user 0.001s	sys 0.003s
I20260709 13:01:31.581708  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:31.582000  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:31.581616  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:31.572878  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.585988  1707 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:31.586869  6972 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:31.587297  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47720us
I20260709 13:01:31.486901  6986 raft_consensus.cc:697] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:31.588513  1629 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 14: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:31.590480  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:31.596040  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:31.601125  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 72402.1us
W20260709 13:01:31.581489  6967 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.011s	sys 0.025s
W20260709 13:01:31.602341  1673 leader_election.cc:336] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.820s (SENT)
W20260709 13:01:31.615129  6967 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.012s	sys 0.026s
I20260709 13:01:31.615327  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:31.604226  7009 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:01:31.609336  6907 consensus_meta.cc:287] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.003s
I20260709 13:01:31.600224  6972 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:31.613456  6948 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:31.581375  6917 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:31.631219  6917 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:31.633072  1673 leader_election.cc:336] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.219s (SENT)
I20260709 13:01:31.644461  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.597623  6874 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:31.623741  6996 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:31.650808  1635 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:01:31.647840  6917 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:31.652783  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:31.583731  6966 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:31.572724  7005 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:31.588609  6983 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:31.663553  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 268911us
I20260709 13:01:31.665421  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.667131  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:31.668742  1553 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:31.393138  6913 raft_consensus.cc:2955] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Committing config change with OpId 12.9: config changed from index 5 to 9, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:31.668143  1601 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.670027  1673 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.623605  6907 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:31.680626  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:31.680841  1673 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.683621  1601 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.687492  1673 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.689354  1601 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:31.668447  6965 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:31.684633  6553 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:31.677685  6996 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:31.697044  1601 leader_election.cc:400] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
I20260709 13:01:31.686149  6765 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:31.702631  1559 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:31.703341  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:31.704283  1601 leader_election.cc:403] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:31.686702  6840 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:31.692981  6703 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:31.720415  6966 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:31.722059  7022 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:31.722718  6983 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:31.701553  6414 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:31.730414  7016 log.cc:927] Time spent T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:01:31.697415  6544 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:31.745694  1555 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:31.730717  6927 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:31.728451  6844 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:31.761615  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50132.3us
I20260709 13:01:31.681803  6986 consensus_queue.cc:237] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:31.763890  1673 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.766541  1673 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.701974  6965 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:31.769033  7005 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:31.763940  6927 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:31.832969  6927 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:31.836856  6974 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:31.795892  6544 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.796172  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:31.839354  6927 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:31.839778  1701 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:31.840057  6927 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:31.840787  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:31.841498  1701 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:31.807477  6907 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:31.743203  6999 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:01:31.813633  7026 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:31.814432  6996 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:31.763458  6759 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:31.816097  6948 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:31.844622  1601 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:31.820046  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:31.824674  6975 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.839329  6544 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:31.848685  6999 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.848421  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:31.849324  6764 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:31.849573  1629 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:31.781356  6985 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12.
I20260709 13:01:31.849887  6764 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:31.850435  6544 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:31.850625  6985 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:31.851095  6985 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.851435  6985 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.851979  6764 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:31.852342  7015 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.853781  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:31.854107  6924 raft_consensus.cc:3055] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:31.854480  6924 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:31.842322  6927 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:31.856202  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:31.849205  6999 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:31.858382  7004 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.818554  1556 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:31.852828  7015 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:31.860718  6999 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:31.857113  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:31.862948  6957 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:31.863183  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:31.863358  6957 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:31.863770  1708 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:31.864203  6957 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:31.865324  6957 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.862275  2324 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:31.867079  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:31.867408  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:31.869059  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:31.870077  6965 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:31.872465  7015 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:31.873649  1598 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:31.875417  1523 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:31.875620  6963 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:31.876091  6963 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.876490  6963 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.825317  6844 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:31.880340  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:31.881011  2326 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:31.846041  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:31.881279  1675 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:31.881841  1700 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.842373  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:31.883916  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:31.884349  1701 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:31.887166  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:31.887969  2324 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.888474  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:31.889926  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:31.889308  1632 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
W20260709 13:01:31.891422  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 124939us
I20260709 13:01:31.892323  1673 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.887480  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:31.895290  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:31.896469  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:31.921769  1555 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:31.876494  6990 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.931s	user 0.007s	sys 0.000s
I20260709 13:01:31.898972  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:31.928414  1553 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:31.759482  6765 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.126s
I20260709 13:01:31.904829  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:31.905467  6844 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:31.954027  1700 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:31.878468  6735 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:01:31.901901  6764 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:31.925676  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:31.884649  6859 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:32.022085  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 134663us
I20260709 13:01:31.983467  1559 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:32.023106  1675 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:31.907629  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:31.959830  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:31.916558  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:32.029700  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 122149us
I20260709 13:01:31.889750  6778 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:01:31.929814  7003 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:31.930696  6981 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:31.965165  6764 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.020823  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:32.037616  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 80067us
I20260709 13:01:32.042088  6764 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.930040  6882 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:31.927567  6966 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:32.043725  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:32.022693  6683 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:32.034659  6999 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:32.054890  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 990) took 1575 ms. Trace:
I20260709 13:01:32.064066  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:32.047047  6981 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:32.069968  6981 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:32.054937  6544 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:32.065833  7033 consensus_queue.cc:1059] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:32.064787  6996 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:32.071535  1706 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:32.055385  1702 rpcz_store.cc:276] 0709 13:01:30.471425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.471557 (+   132us) service_pool.cc:224] Handling call
0709 13:01:30.491804 (+ 20247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:30.530623 (+ 38819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:30.530667 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:30.540698 (+ 10031us) log.cc:844] Serialized 26 byte log entry
0709 13:01:30.898714 (+358016us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:30.898755 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.898823 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:31.799999 (+901176us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:32.044244 (+244245us) raft_consensus.cc:1685] finished
0709 13:01:32.044264 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.047015 (+  2751us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38388,"raft.queue_time_us":38958,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":9860,"spinlock_wait_cycles":10668288,"thread_start_us":295641,"threads_started":1,"wal-append.queue_time_us":338087}
W20260709 13:01:32.073751  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.035287  6859 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:32.117756  1700 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:31.963579  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:32.119166  1557 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:32.119191  1700 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:32.097100  2324 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:32.125011  1708 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:32.132164  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:32.135107  1523 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:32.137976  6981 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:32.138542  6981 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.139498  6981 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:32.144155  1523 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:32.146564  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:32.148696  7002 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:32.164059  1672 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:32.148418  6778 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:32.150875  1555 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:32.071566  6683 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:32.171443  1702 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:01:32.171094  6778 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:32.172492  6683 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:32.173452  6778 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:32.153052  6859 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:32.157159  6993 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.868s	user 0.012s	sys 0.000s
I20260709 13:01:32.056941  6882 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:32.157311  6985 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:32.158445  6917 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:32.162581  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 126843us
I20260709 13:01:32.193958  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:32.196306  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:32.163558  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 111730us
I20260709 13:01:32.197679  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:32.198150  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:32.115207  1553 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:32.170544  7044 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:32.315093  1673 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:32.316361  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:32.332895  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.415567  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 100571us
I20260709 13:01:32.167491  6966 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:32.418970  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 220858us
I20260709 13:01:32.550318  1708 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:01:32.553406  1705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.039s	sys 0.074s
W20260709 13:01:32.553949  1705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.039s	sys 0.074s
W20260709 13:01:32.315593  7028 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
W20260709 13:01:32.565099  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.114s	sys 0.145s
W20260709 13:01:32.599206  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.117s	sys 0.145s
W20260709 13:01:32.599857  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 575315us
I20260709 13:01:32.607129  2322 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:32.314139  7003 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.614573  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:32.625531  1708 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:01:32.598277  6996 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:32.646314  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:32.610139  7044 raft_consensus.cc:697] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:32.619360  6927 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:32.634827  7015 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:32.615492  1704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.020s	sys 0.047s
I20260709 13:01:32.174980  6993 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:32.654834  1704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.020s	sys 0.048s
I20260709 13:01:32.680042  6962 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:32.680766  6962 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.681258  6962 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:32.650959  6927 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:32.682318  6927 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.672344  7015 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:32.635594  7003 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:32.689122  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:32.689664  6882 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:32.689801  2324 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:32.690856  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2918) took 1177 ms. Trace:
I20260709 13:01:32.691578  1672 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:32.691231  1634 rpcz_store.cc:276] 0709 13:01:31.513667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.513806 (+   139us) service_pool.cc:224] Handling call
0709 13:01:31.514165 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:31.514544 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.514575 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:31.515017 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:01:31.709920 (+194903us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:31.838581 (+128661us) log.cc:844] Serialized 14 byte log entry
0709 13:01:31.838780 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.838854 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:32.688476 (+849622us) raft_consensus.cc:1685] finished
0709 13:01:32.688508 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.690802 (+  2294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137556,"prepare.queue_time_us":128501,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":7544,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":13941,"thread_start_us":194530,"threads_started":1,"wal-append.queue_time_us":416756}
W20260709 13:01:32.690445  6949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.017s	sys 0.047s
W20260709 13:01:32.708277  7004 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.849s	user 0.002s	sys 0.010s
I20260709 13:01:32.690045  6917 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:32.726500  2286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.004s	sys 0.004s
W20260709 13:01:32.726891  2286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.004s	sys 0.004s
W20260709 13:01:32.727154  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 568082us
I20260709 13:01:32.698729  7015 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:32.736244  1558 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:01:32.736779  1558 pending_rounds.cc:85] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 6
I20260709 13:01:32.737345  1558 pending_rounds.cc:107] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:01:32.737771  1558 raft_consensus.cc:2889] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:32.740190  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2975) took 1658 ms. Trace:
I20260709 13:01:32.742488  1705 rpcz_store.cc:276] 0709 13:01:31.082043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.287772 (+205729us) service_pool.cc:224] Handling call
0709 13:01:31.288238 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:31.288779 (+   541us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:31.557795 (+269016us) log.cc:844] Serialized 14 byte log entry
0709 13:01:32.554312 (+996517us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:32.554974 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 13:01:32.560109 (+  5135us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:32.738934 (+178825us) log.cc:844] Serialized 14 byte log entry
0709 13:01:32.739207 (+   273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.739809 (+   602us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:32.739855 (+    46us) raft_consensus.cc:1685] finished
0709 13:01:32.739978 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.740128 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85558,"prepare.queue_time_us":351264,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":86,"raft.queue_time_us":107088,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":243,"thread_start_us":1268806,"threads_started":4,"wal-append.queue_time_us":468766}
W20260709 13:01:32.763247  1700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.004s	sys 0.005s
W20260709 13:01:32.763970  1700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.005s	sys 0.006s
I20260709 13:01:32.765115  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1011) took 1276 ms. Trace:
I20260709 13:01:32.769503  2286 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:01:32.740893  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 546932us
W20260709 13:01:32.779601  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 177539us
I20260709 13:01:32.765672  1700 rpcz_store.cc:276] 0709 13:01:31.488754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.124258 (+635504us) service_pool.cc:224] Handling call
0709 13:01:32.159584 (+ 35326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.159855 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:32.174894 (+ 15039us) log.cc:844] Serialized 14 byte log entry
0709 13:01:32.764646 (+589752us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:32.764720 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:32.764788 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.764877 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.765045 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23851,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"thread_start_us":589239,"threads_started":1}
I20260709 13:01:32.866891  1675 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:32.867852  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.751142  6853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.037s	sys 0.104s
I20260709 13:01:32.869024  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:32.871508  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.740967  6703 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:32.942268  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 73411.4us
I20260709 13:01:32.745172  6844 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:32.949520  6553 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.950223  6553 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:32.950402  7050 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:32.951280  7050 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.951817  7050 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:32.953428  6553 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:32.903370  6853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.037s	sys 0.107s
I20260709 13:01:32.779614  7004 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:32.977349  1709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.000s	sys 0.013s
I20260709 13:01:32.975181  1559 raft_consensus.cc:1240] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:32.984560  1709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.000s	sys 0.014s
W20260709 13:01:32.990286  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 432275us
I20260709 13:01:32.912259  6913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60036 (request call id 92) took 10535 ms. Trace:
I20260709 13:01:32.976944  7015 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:32.985194  6975 consensus_meta.cc:287] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.139s	user 0.008s	sys 0.004s
I20260709 13:01:32.955704  6985 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:32.737879  7044 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:33.093595  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 55529.4us
I20260709 13:01:32.955641  7061 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:32.987844  6882 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.129460  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:32.992693  6966 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.131343  7003 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:33.124228  6907 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:33.123886  6859 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:33.137553  1556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 3056) took 1557 ms (client timeout 1588 ms). Trace:
I20260709 13:01:32.992470  6917 raft_consensus.cc:2764] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:01:33.072814  7041 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
W20260709 13:01:33.085109  7032 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:01:33.150156  1556 rpcz_store.cc:269] 0709 13:01:31.572274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.581757 (+  9483us) service_pool.cc:224] Handling call
0709 13:01:33.129523 (+1547766us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54001f7054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:33.129688 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535028608}
W20260709 13:01:33.176008  1554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.021s	sys 0.045s
W20260709 13:01:33.135872  6764 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.089s	user 0.008s	sys 0.004s
W20260709 13:01:33.179126  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.021s	sys 0.049s
I20260709 13:01:33.174292  2324 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:33.179844  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.021s	sys 0.049s
I20260709 13:01:33.081234  6993 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:33.175365  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 405891us
W20260709 13:01:33.175942  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 186053us
I20260709 13:01:33.145205  1599 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:33.177109  1554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.021s	sys 0.045s
I20260709 13:01:33.185236  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:33.182149  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:32.988158  7004 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:33.235644  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 44402.2us
W20260709 13:01:33.176791  6981 consensus_meta.cc:287] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.037s	user 0.006s	sys 0.008s
I20260709 13:01:33.142833  7061 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.234736  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:33.258189  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:33.149726  6843 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:33.075094  7059 consensus_queue.cc:1059] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:01:33.187723  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:33.273336  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 85722.2us
I20260709 13:01:33.264698  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:33.239212  7061 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:33.187898  6764 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.234510  6838 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:33.150578  6882 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:33.316605  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 327131us
W20260709 13:01:33.291399  7051 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.620s	user 0.000s	sys 0.017s
I20260709 13:01:33.186228  6859 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.186539  6966 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.330191  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:33.348721  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1131) took 2861 ms. Trace:
I20260709 13:01:33.275942  6975 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.275695  7055 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.303406  6983 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.369498  6983 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.371315  7045 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.371677  6983 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.371909  7045 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.330633  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:33.303666  7003 raft_consensus.cc:3055] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:33.373361  7003 raft_consensus.cc:740] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:33.373091  7055 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.374358  7003 consensus_queue.cc:260] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.375669  7003 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:33.375875  7055 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.257727  6981 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:33.377475  6927 consensus_meta.cc:287] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.002s
I20260709 13:01:33.377981  6927 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.378461  6981 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.373135  1629 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:33.380227  6927 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.278043  7060 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:33.383492  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.320554  7015 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.296041  6994 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:33.384090  7015 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.386324  7015 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:33.362958  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 2918) took 1840 ms. Trace:
I20260709 13:01:33.388046  6882 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.386847  1707 rpcz_store.cc:276] 0709 13:01:31.522393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.169016 (+646623us) service_pool.cc:224] Handling call
0709 13:01:32.189364 (+ 20348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:32.190719 (+  1355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:32.190772 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:32.541354 (+350582us) log.cc:844] Serialized 26 byte log entry
0709 13:01:33.056136 (+514782us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:33.134119 (+ 77983us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.134343 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.134419 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.362710 (+228291us) raft_consensus.cc:1685] finished
0709 13:01:33.362733 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.362885 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":196,"prepare.queue_time_us":78287,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":34,"raft.queue_time_us":10770,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":247658,"thread_start_us":420878,"threads_started":1,"wal-append.queue_time_us":664404}
I20260709 13:01:33.070621  6913 rpcz_store.cc:276] 0709 13:01:22.315900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.317458 (+  1558us) service_pool.cc:224] Handling call
0709 13:01:24.401659 (+2084201us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b58006ac1d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed99e10aa 00007f0ed9a63447 00007f0ed9a8070a 00007f0ed9a8176a 00007f0ed9a8091b 00007f0ed9a8c03c 00007f0ed9a8b6b3 00007f0ed9a839fa 00007f0edea4b4c9 00007f0ed7fc7c54
0709 13:01:24.555413 (+153754us) log.cc:844] Serialized 501 byte log entry
0709 13:01:25.285814 (+730401us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b1800410440. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6912c0a 00007f0ee0052219 00007f0ed699aa40 00007f0ed69954e4 00007f0ed6995455 00007f0ed99deb0b 00007f0ed9a63b63 00007f0ed9a8b752 00007f0ed9a839fa
0709 13:01:25.331221 (+ 45407us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:32.764046 (+7432825us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86696,"raft.queue_time_us":338738,"raft.run_cpu_time_us":1612,"raft.run_wall_time_us":233162,"spinlock_wait_cycles":3318206976,"thread_start_us":398192,"threads_started":1,"wal-append.queue_time_us":700570,"wal-append.run_cpu_time_us":4197,"wal-append.run_wall_time_us":1069559}
I20260709 13:01:33.392342  6924 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.263810  7065 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:01:33.364334  7053 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.393775  6924 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:33.394004  7053 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.364847  6885 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.365859  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:33.293854  7061 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.367830  7068 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.372315  6983 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.368752  6985 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.320091  6838 raft_consensus.cc:697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:33.288172  6556 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.349211  1551 rpcz_store.cc:276] 0709 13:01:30.469537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.470444 (+   907us) service_pool.cc:224] Handling call
0709 13:01:31.380519 (+910075us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea5efc0 00007f0edea49929 00007f0edea493d2 00007f0ed7fc0bd4
0709 13:01:31.380718 (+   199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:31.381032 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.381073 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:31.381540 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:01:31.945382 (+563842us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b18000d0ae0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:01:32.268894 (+323512us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:32.268956 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.269057 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.321868 (+1052811us) raft_consensus.cc:1685] finished
0709 13:01:33.321889 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.330518 (+  8629us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76425,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":11257,"spinlock_wait_cycles":12655104,"thread_start_us":323261,"threads_started":1,"wal-append.queue_time_us":1225618}
I20260709 13:01:33.381464  7045 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.382452  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2986) took 1656 ms. Trace:
W20260709 13:01:33.382865  6963 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.506s	user 0.007s	sys 0.007s
I20260709 13:01:33.381460  6703 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.368626  6949 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.410624  1702 rpcz_store.cc:276] 0709 13:01:31.726237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.173158 (+446921us) service_pool.cc:224] Handling call
0709 13:01:32.173432 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:32.173776 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:32.173801 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:32.174249 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:01:32.187344 (+ 13095us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:32.187407 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.187502 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.290818 (+1103316us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b2400249f38. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed681e9c4 00007f0ed681cacb 00007f0ed69d7dc9 00007f0ed69d7a55 00007f0ed69d709d 00007f0ed960910e 00007f0ed962088c 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221
0709 13:01:33.382161 (+ 91343us) raft_consensus.cc:1685] finished
0709 13:01:33.382185 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.382391 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":525,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":50373504,"thread_start_us":12662,"threads_started":1,"wal-append.queue_time_us":422057}
I20260709 13:01:33.406911  7061 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:33.386840  7015 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:33.399591  7004 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.407099  6843 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:33.408350  7068 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.396528  7053 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.421814  7052 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:33.398658  6966 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.397151  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6325e0281aa547efa677c29cabdf5de4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
W20260709 13:01:33.427942  2323 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.003s	sys 0.035s
I20260709 13:01:33.397070  6885 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.400192  6975 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:33.433987  2323 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.003s	sys 0.035s
W20260709 13:01:33.460726  1445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 63716.7us
I20260709 13:01:33.414455  6985 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.411643  6983 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:33.465397  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 227591us
I20260709 13:01:33.465863  7045 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:33.466445  7045 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.468226  7053 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.418889  6556 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.429353  7052 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:33.424814  6703 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.419138  6963 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.423957  7015 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.478646  1556 raft_consensus.cc:2955] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 5 to 9, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:33.430595  6843 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.460573  6966 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.472921  7004 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.490046  7053 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.496960  1551 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:01:33.504542  1551 pending_rounds.cc:85] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 8
I20260709 13:01:33.504940  1551 pending_rounds.cc:107] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:01:33.505174  1551 raft_consensus.cc:2889] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:33.468552  7045 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.480481  7052 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:33.497545  6972 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.495231  6414 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:33.498960  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:33.519012  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:33.511322  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:33.510438  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:33.521241  1555 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 9: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:33.521729  2324 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:33.512547  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:33.507767  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:33.522830  2320 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:33.500052  6981 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.475992  6838 consensus_queue.cc:237] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.504292  6764 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:33.532065  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:33.529147  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:33.533933  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.501854  7055 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.499526  6882 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.549731  1703 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 14: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:33.537195  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:33.421962  6949 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.539304  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:33.541478  1560 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:33.546701  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.585934  1708 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:33.586489  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:33.546015  6962 consensus_meta.cc:287] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.864s	user 0.012s	sys 0.001s
I20260709 13:01:33.577345  7070 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:33.546537  7050 consensus_meta.cc:287] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.566s	user 0.006s	sys 0.005s
I20260709 13:01:33.580559  1703 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:33.582033  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.516716  7045 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.583815  1700 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:33.589689  1702 raft_consensus.cc:1275] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:01:33.616685  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1273) took 2115 ms. Trace:
I20260709 13:01:33.506340  6966 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:33.532490  6751 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:33.578162  7068 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.506104  7004 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.618961  2323 rpcz_store.cc:276] 0709 13:01:31.485942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.486099 (+   157us) service_pool.cc:224] Handling call
0709 13:01:31.486434 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.486707 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:31.572476 (+ 85769us) log.cc:844] Serialized 14 byte log entry
0709 13:01:32.539587 (+967111us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b1800451780. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0edd47d3c7 00007f0ed9a8f9a7 00007f0ed9a9f0bf 00007f0ed9a9f038
0709 13:01:33.445608 (+906021us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.593134 (+147526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.593215 (+    81us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:33.593296 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.600562 (+  7266us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.601029 (+   467us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43989,"prepare.queue_time_us":206913,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":16580,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6242,"spinlock_wait_cycles":39693184,"thread_start_us":1025241,"threads_started":2}
I20260709 13:01:33.621845  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:33.578395  6963 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.632284  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.624330  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.633870  1706 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:01:33.536263  7071 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.635126  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1148) took 1466 ms. Trace:
I20260709 13:01:33.639287  1560 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:33.649262  1560 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:01:33.650115  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 111077us
I20260709 13:01:33.641744  1554 rpcz_store.cc:276] 0709 13:01:32.169179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.175777 (+  6598us) service_pool.cc:224] Handling call
0709 13:01:32.176080 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:32.606081 (+430001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:32.606111 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:32.614867 (+  8756us) log.cc:844] Serialized 26 byte log entry
0709 13:01:33.185161 (+570294us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:33.185201 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.608906 (+423705us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b5400050fd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:33.608977 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.609037 (+    60us) raft_consensus.cc:1685] finished
0709 13:01:33.609056 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.635054 (+ 25998us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":71406,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":122,"spinlock_wait_cycles":987956992,"thread_start_us":528748,"threads_started":1,"wal-append.queue_time_us":717547}
I20260709 13:01:33.526952  6414 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.539949  6981 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.606930  7060 raft_consensus.cc:697] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:33.665905  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:33.654423  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:33.668462  1632 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:33.658434  1559 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:33.665905  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1004) took 2198 ms. Trace:
I20260709 13:01:33.623274  6764 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.525902  6972 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.626124  7061 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.669386  1709 rpcz_store.cc:276] 0709 13:01:31.467927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.623170 (+155243us) service_pool.cc:224] Handling call
0709 13:01:31.646763 (+ 23593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:31.647258 (+   495us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:31.949899 (+302641us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b180034b0a0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0edd47d3c7 00007f0ed9a8f9a7 00007f0ed9a985e5 00007f0ed9a98568
0709 13:01:32.162001 (+212102us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.037426 (+875425us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.092298 (+ 54872us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:33.092915 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:01:33.093081 (+   166us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:33.093125 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.093227 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.665596 (+572369us) raft_consensus.cc:1685] finished
0709 13:01:33.665629 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.665827 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122041,"prepare.queue_time_us":34210,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":86887,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":21126,"spinlock_wait_cycles":3966720,"thread_start_us":934282,"threads_started":2,"wal-append.queue_time_us":1156750}
I20260709 13:01:33.678009  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.639916  6913 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.585974  7055 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.620988  6882 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.686466  1552 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:33.687870  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 119351us
I20260709 13:01:33.621356  6962 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.697875  1673 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:33.630633  7045 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.665329  7079 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:33.629104  7050 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.675122  6963 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:33.640575  6751 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.705372  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:33.706389  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.706441  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.711764  1632 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:01:33.627286  7070 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.677760  7005 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.712775  7057 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.716954  1560 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:33.694025  6975 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.678570  6994 consensus_queue.cc:1059] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:01:33.714246  7079 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:33.656852  7071 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.744549  7079 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:33.746656  7071 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.747294  7071 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:33.747818  7071 raft_consensus.cc:697] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:33.721719  2288 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:33.679224  6764 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.724846  7060 consensus_queue.cc:237] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.725142  7095 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.727617  6972 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.758882  6556 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.728452  6882 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.759193  7095 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.760228  7085 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:33.760983  7085 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.761759  7095 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.719252  6925 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.762590  6925 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.763375  7075 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.728435  6919 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:33.730697  7055 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.731670  6994 raft_consensus.cc:3055] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:33.715628  6985 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.734189  7070 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.735397  7057 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.719683  6963 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.772379  6919 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.742674  6843 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.788763  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:33.790196  6919 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.791318  6963 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.793084  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:33.792477  6962 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.793783  2328 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:33.795776  6751 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.785966  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:33.749588  2288 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:33.798616  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 49116.7us
I20260709 13:01:33.799167  6735 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:33.799863  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:33.743436  7052 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.800850  6751 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:33.802203  7052 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:33.751219  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:33.757005  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:33.697165  6913 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.803265  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.803743  1560 raft_consensus.cc:2393] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 10: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:33.803917  1707 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:33.804579  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:33.805027  6913 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.805171  1560 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.777911  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:33.806020  7050 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.803956  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:33.763942  7075 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.726646  6885 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:33.774837  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:33.775926  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:33.750027  7053 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.780452  7077 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.780906  7082 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.781574  7045 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.781976  7076 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:33.782363  7004 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.782459  7034 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.783281  6925 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:33.797676  6999 raft_consensus.cc:3055] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:33.682484  7061 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.752817  7005 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.763191  7085 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.729285  6966 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:33.777058  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49159.2us
I20260709 13:01:33.850777  1601 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:33.815836  1560 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:33.776207  7078 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.772637  6994 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:33.777002  7015 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:33.821202  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:33.776654  6414 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:33.823031  7095 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.775745  7071 consensus_queue.cc:237] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:33.824240  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 119549us
W20260709 13:01:33.835023  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.839150  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.778376  6981 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.810482  6735 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:33.845312  6999 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:33.868391  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:33.887066  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:33.887549  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:33.850921  2323 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
W20260709 13:01:33.850239  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.815624  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:33.889286  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:33.882637  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.865875  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:33.882356  1630 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:33.866389  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:33.890628  1632 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:33.887907  1627 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:33.889393  1553 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
W20260709 13:01:33.886149  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.818305  6949 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.823968  7053 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.861835  7004 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:33.862043  7055 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.848086  7075 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.928761  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.930421  1633 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:33.936792  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:33.937000  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.908558  6556 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:33.908483  6882 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.938510  7061 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.938339  6882 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.939065  7055 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.907745  7095 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.850322  7077 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.937626  1709 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:33.908284  6981 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:01:33.944732  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.865882  7104 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:33.948864  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:33.946970  1705 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:33.912632  6735 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:33.865448  7045 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 13:01:33.936838  7090 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:01:33.953554  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.905706  6985 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:01:33.947739  6882 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.963673  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.941846  6924 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:01:33.866158  7078 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.928519  7053 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.966743  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.967556  1709 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:33.845928  7082 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.973071  7082 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.964906  6765 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:33.964654  6735 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.974071  6765 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:33.974622  7005 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.975274  7078 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.974946  6765 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.976223  6765 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:33.941500  7004 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.956956  7061 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.959745  7104 raft_consensus.cc:697] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:33.862372  7034 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.988973  7005 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:33.992760  7005 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:33.994299  7004 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.994954  7005 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.946259  6994 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:33.997396  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:33.998091  1709 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:34.001008  6994 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:34.013759  7000 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:34.016858  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:34.014663  7000 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:34.022814  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:34.024080  1705 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 10: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:34.032961  6566 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:34.034572  6566 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:34.035606  7034 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:34.037026  6566 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:34.052933  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:34.055676  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:34.058231  7034 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:34.058403  7095 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:34.065477  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.056537  1553 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:01:34.085443  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:34.100566  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 51464.9us
I20260709 13:01:34.103762  7082 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.106024  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:34.106659  1709 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:34.111349  6566 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:34.113763  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 207861us
I20260709 13:01:34.116005  6994 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.116421  6994 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:34.116936  6982 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:34.117755  6982 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:34.119459  6994 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:33.996541  7061 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:34.059031  7034 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:34.125150  7077 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:34.128615  7105 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:01:34.112007  6566 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:34.141292  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:34.143114  7071 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.148365  1599 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:34.143970  7071 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:34.104382  7082 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:34.164464  1556 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:34.213191  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:34.169824  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.268178  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.270121  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:34.140739  7060 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:34.304169  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:34.305449  1556 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:34.271255  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 91955.2us
I20260709 13:01:34.313838  1599 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:34.130110  7079 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:34.154650  6982 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:34.269623  6985 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:34.338783  1599 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:34.150274  6948 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.174s
I20260709 13:01:34.314416  6993 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:34.285015  7000 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:34.383431  1556 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:34.121930  7104 consensus_queue.cc:237] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:34.346647  7045 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:34.320367  7060 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:34.324193  7085 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:01:34.357101  7053 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:34.389032  6985 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:34.400022  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:34.398139  7045 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:34.450739  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50762.3us
I20260709 13:01:34.452210  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:34.455844  1556 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:01:34.457647  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.387164  6993 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:34.555039  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.610759  1707 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:34.459728  7045 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:34.457511  6838 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:34.454360  6985 raft_consensus.cc:697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:34.453836  7061 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:34.695856  7116 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:01:34.697480  7079 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:34.685081  6566 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:34.704882  7082 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:34.706861  6993 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:34.711491  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.711526  7002 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:34.713305  7115 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.255s	user 0.000s	sys 0.000s
W20260709 13:01:34.713449  7056 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:01:34.682957  7000 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:34.727883  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.684401  7034 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:34.776394  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:34.777356  1630 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:34.760878  7071 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:34.727113  6838 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:34.769979  7000 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:34.794544  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:34.796132  1630 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:34.798290  7060 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:34.799479  7039 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 2.058s	user 0.001s	sys 0.001s
I20260709 13:01:34.801229  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 2980) took 3332 ms. Trace:
I20260709 13:01:34.808077  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:34.814968  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:34.815320  1601 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:34.816041  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:34.816406  1601 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:34.818347  1601 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:34.826639  7053 consensus_queue.cc:1059] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:34.828096  7077 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:34.829815  7077 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:34.830245  7077 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.830595  7077 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.832825  6982 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:34.833559  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:34.834511  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1026) took 1021 ms. Trace:
I20260709 13:01:34.834758  7085 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:34.835332  7085 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:34.835960  7085 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.835175  1709 rpcz_store.cc:276] 0709 13:01:33.813207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.137675 (+324468us) service_pool.cc:224] Handling call
0709 13:01:34.146141 (+  8466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.146432 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.146461 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.153384 (+  6923us) log.cc:844] Serialized 26 byte log entry
0709 13:01:34.764951 (+611567us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:34.764987 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.765060 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:34.834273 (+ 69213us) raft_consensus.cc:1685] finished
0709 13:01:34.834296 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.834450 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":430191,"threads_started":1,"wal-append.queue_time_us":481254}
I20260709 13:01:34.801703  1704 rpcz_store.cc:276] 0709 13:01:31.468664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.923015 (+454351us) service_pool.cc:224] Handling call
0709 13:01:31.941012 (+ 17997us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:31.941389 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.941420 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:31.941923 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:01:32.657935 (+716012us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:32.657992 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.658091 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:34.798898 (+2140807us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:34.800667 (+  1769us) raft_consensus.cc:1685] finished
0709 13:01:34.800695 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.801133 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13824,"raft.queue_time_us":16041,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":71601,"spinlock_wait_cycles":533634432,"thread_start_us":715581,"threads_started":1,"wal-append.queue_time_us":764223}
I20260709 13:01:34.783160  6985 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:34.841885  7077 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:34.834213  1628 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.845623  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:34.847292  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:34.853374  1601 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:34.861763  1601 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:34.737461  7002 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:34.865353  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:34.866107  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1044) took 1209 ms. Trace:
I20260709 13:01:34.866271  1630 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:34.869616  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:34.870492  1632 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:34.866519  1626 rpcz_store.cc:276] 0709 13:01:33.656547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.656677 (+   130us) service_pool.cc:224] Handling call
0709 13:01:33.656944 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.719411 (+ 62467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.719441 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.719490 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:33.719526 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.865705 (+1146179us) spinlock_profiling.cc:243] Waited 62.2 ms on lock 0x7b54000f55d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:34.865753 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.866047 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143152512}
I20260709 13:01:34.864356  6963 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:34.864583  7071 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.876646  7077 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:34.872457  6566 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:34.877991  7055 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:34.879843  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:34.884526  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:34.897630  1632 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:34.886155  1601 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:34.864809  7060 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:34.887318  2286 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:34.890482  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:34.899642  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2595) took 1030 ms. Trace:
I20260709 13:01:34.903154  2326 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:01:34.903085  1632 rpcz_store.cc:276] 0709 13:01:33.869419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.879562 (+1010143us) service_pool.cc:224] Handling call
0709 13:01:34.899562 (+ 20000us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.899783  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:34.889029  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:34.889410  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:34.904815  1551 raft_consensus.cc:1275] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:34.872679  7111 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:34.908627  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:34.920670  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:34.921345  2325 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:34.882692  6963 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:34.920524  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:34.923947  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:34.926251  2328 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:34.928130  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:34.923990  1630 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:01:34.930413  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2596) took 1060 ms. Trace:
I20260709 13:01:34.929256  2328 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:34.931524  1630 rpcz_store.cc:276] 0709 13:01:33.869726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.802341 (+932615us) service_pool.cc:224] Handling call
0709 13:01:34.930340 (+127999us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.933732  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:34.934621  1632 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:34.906980  7060 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.908914  6837 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:34.936756  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:34.937086  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:34.921912  7104 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.023s	sys 0.043s
W20260709 13:01:34.944761  7104 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.023s	sys 0.043s
I20260709 13:01:34.946089  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2589) took 1078 ms. Trace:
I20260709 13:01:34.946605  1626 rpcz_store.cc:276] 0709 13:01:33.867788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.945044 (+1077256us) service_pool.cc:224] Handling call
0709 13:01:34.945449 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.945667 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.945703 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:34.945754 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:34.945800 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.945870 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.946019 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.948959  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:34.930006  6963 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:34.955287  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.909807  7111 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:34.940717  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:34.940382  6837 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:34.943306  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:34.958299  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:34.959735  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:34.960698  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 74620.6us
I20260709 13:01:34.960940  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:34.961647  2328 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:34.963696  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:34.964510  2328 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:34.960186  6837 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.965593  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2593) took 1096 ms. Trace:
I20260709 13:01:34.966224  1630 rpcz_store.cc:276] 0709 13:01:33.868835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.957677 (+1088842us) service_pool.cc:224] Handling call
0709 13:01:34.965531 (+  7854us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.904191  6566 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:34.896005  7071 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:34.942721  7060 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:34.964968  7104 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:34.973613  7104 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:34.976131  7104 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:34.960043  6948 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:34.977180  6948 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:34.958545  7111 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.983697  2328 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:34.969537  7088 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:34.995386  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.007464  2325 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
W20260709 13:01:35.009975  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 422115us
I20260709 13:01:34.987370  7088 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.027405  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:35.028529  1701 raft_consensus.cc:2368] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17.
I20260709 13:01:35.037137  1628 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:35.023535  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:35.038149  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2591) took 1169 ms. Trace:
I20260709 13:01:35.039103  1628 rpcz_store.cc:276] 0709 13:01:33.868233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.833300 (+965067us) service_pool.cc:224] Handling call
0709 13:01:35.037997 (+204697us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:35.014786  7097 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:35.017606  7000 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:35.043337  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:35.038702  6961 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:35.021648  7088 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:35.046418  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:35.048926  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 232917us
I20260709 13:01:35.044898  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:35.025087  7063 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:35.054767  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 520648us
I20260709 13:01:35.055639  1628 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:35.058679  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.041254  6993 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:35.067572  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:35.068619  1630 raft_consensus.cc:2368] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17.
I20260709 13:01:35.054811  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:34.980150  6838 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:35.058650  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.056924  6735 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:35.083590  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2917) took 3668 ms. Trace:
I20260709 13:01:35.084779  1635 rpcz_store.cc:276] 0709 13:01:31.409413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.409560 (+   147us) service_pool.cc:224] Handling call
0709 13:01:31.409914 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:31.653215 (+243301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.076834 (+3423619us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54000f41d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:35.077271 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553309952}
I20260709 13:01:35.094992  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.066407  6993 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:35.074584  7079 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:35.080083  6948 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:35.146009  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.110872  6993 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:35.066890  7063 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:35.151613  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 247081us
I20260709 13:01:35.075071  7097 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:35.153429  1556 raft_consensus.cc:1240] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:01:35.122551  7000 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:35.157929  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:35.113153  7079 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:35.150658  6566 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:35.169903  7079 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:35.186580  7085 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:35.193473  7038 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 2.442s	user 0.010s	sys 0.018s
I20260709 13:01:35.170547  7000 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:35.169592  6735 raft_consensus.cc:2764] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:01:31.812114   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:35.206480  7097 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:35.209273  7121 log.cc:927] Time spent T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:01:35.211285  7071 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:35.223980  7055 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:35.229883  6982 raft_consensus.cc:3055] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:35.253736  7048 log.cc:927] Time spent T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 2.314s	user 0.008s	sys 0.012s
I20260709 13:01:35.253907  6982 raft_consensus.cc:740] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:35.254591  7085 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:35.254827  6764 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:35.255059  6982 consensus_queue.cc:260] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:35.256500  7000 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:35.231099  6927 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:01:35.237190  2322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 1275) took 3534 ms (client timeout 2838 ms). Trace:
I20260709 13:01:35.239063  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2474) took 3043 ms. Trace:
I20260709 13:01:35.258642  1558 rpcz_store.cc:276] 0709 13:01:32.195547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.198831 (+  3284us) service_pool.cc:224] Handling call
0709 13:01:32.199204 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.738304 (+539100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.238822 (+2500518us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b54001d8dd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:35.239002 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1234024192}
I20260709 13:01:35.240443  6414 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:35.247786  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 227892us
I20260709 13:01:35.245734  7097 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:35.258584  2322 rpcz_store.cc:269] 0709 13:01:31.702746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.702895 (+   149us) service_pool.cc:224] Handling call
0709 13:01:35.236951 (+3534056us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b54005c0154. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:35.237084 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2043743104}
I20260709 13:01:35.257223  6927 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:35.209280  6859 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:35.260811  7049 log.cc:927] Time spent T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 2.509s	user 0.031s	sys 0.017s
I20260709 13:01:35.242308  7045 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:35.279922  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.254927  7055 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:35.262382  6414 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:35.300880  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.272279  6982 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:35.310653  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.310890  1630 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:35.354928  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.386754  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.262521  7097 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:35.269227  6837 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:35.304286  7104 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:35.438792  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 363649us
W20260709 13:01:35.488216  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.439841  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:35.547152  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:35.547459  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 107627us
I20260709 13:01:35.548524  2288 leader_election.cc:400] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17.
I20260709 13:01:35.548816  2288 leader_election.cc:403] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:01:35.555385  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47902us
W20260709 13:01:35.555822  2323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 1234) took 1781 ms (client timeout 1695 ms). Trace:
W20260709 13:01:35.556252  2323 rpcz_store.cc:269] 0709 13:01:33.774349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.775686 (+  1337us) service_pool.cc:224] Handling call
0709 13:01:35.555145 (+1779459us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b5400535a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:35.555739 (+   594us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86968064}
I20260709 13:01:35.561115  6837 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:35.562307  7063 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:35.563011  1631 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:35.567819  6735 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:35.568493  6735 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:35.569012  6735 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:35.569586  6859 consensus_queue.cc:1059] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:35.570828  6859 raft_consensus.cc:3055] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:35.571197  6859 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:35.572041  6859 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:35.572695  6780 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:35.573529  6859 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:35.574041  6414 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:35.577905  7055 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:35.438987  7049 log.cc:927] Time spent T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:01:35.579284  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:35.547077  7104 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:35.581792  7045 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:35.307068  6927 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:35.583077  6927 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:35.583448  7104 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:35.586197  7060 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.000s
I20260709 13:01:35.586740  7060 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:35.588096  1633 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:35.591316  6963 consensus_meta.cc:287] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.638s	user 0.009s	sys 0.000s
I20260709 13:01:35.592957  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.594354  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.595266  2325 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:35.597021  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.598821  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.601320  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.606390  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.608378  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.609320  1631 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:35.612146  7000 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.613832  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2477) took 2098 ms. Trace:
I20260709 13:01:35.614375  1635 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:35.620831  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.623273  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.591922  6963 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:35.614383  1552 rpcz_store.cc:276] 0709 13:01:33.515464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.516656 (+  1192us) service_pool.cc:224] Handling call
0709 13:01:33.517079 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.697411 (+180332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.613489 (+1916078us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54002288d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:35.613754 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388962048}
I20260709 13:01:35.631613  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3077) took 1974 ms. Trace:
I20260709 13:01:35.612808  7000 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:35.635597  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 457422us
I20260709 13:01:35.632860  1554 rpcz_store.cc:276] 0709 13:01:33.656956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.657268 (+   312us) service_pool.cc:224] Handling call
0709 13:01:33.658667 (+  1399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.696914 (+ 38247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.696949 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.696990 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:33.697020 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.631308 (+1934288us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b54001c89d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:35.631358 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.631543 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87401344}
I20260709 13:01:35.640440  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.645036  6780 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17.
I20260709 13:01:35.645345  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.645802  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:35.636376  7111 consensus_meta.cc:287] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.638s	user 0.013s	sys 0.000s
I20260709 13:01:35.664081  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1147) took 3538 ms. Trace:
I20260709 13:01:35.666728  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:35.667995  1631 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:35.665839  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:35.669566  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:35.671168  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1048) took 1210 ms. Trace:
I20260709 13:01:35.664510  1557 rpcz_store.cc:276] 0709 13:01:32.125466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.128140 (+  2674us) service_pool.cc:224] Handling call
0709 13:01:32.128525 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.128976 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:32.187486 (+ 58510us) log.cc:844] Serialized 14 byte log entry
0709 13:01:35.256260 (+3068774us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b180040a9e0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed962523a 00007f0ed9a8fa2a
0709 13:01:35.663719 (+407459us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.663773 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:35.663818 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.663906 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.664028 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58469,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":124167,"raft.queue_time_us":106,"spinlock_wait_cycles":3029888,"thread_start_us":465323,"threads_started":2}
I20260709 13:01:35.671741  1632 rpcz_store.cc:276] 0709 13:01:34.461333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.962210 (+500877us) service_pool.cc:224] Handling call
0709 13:01:34.962577 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.962821 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:35.270209 (+307388us) log.cc:844] Serialized 14 byte log entry
0709 13:01:35.666127 (+395918us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.668646 (+  2519us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:35.668723 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.670625 (+  1902us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.671108 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9082,"prepare.queue_time_us":652295,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"thread_start_us":685354,"threads_started":2}
I20260709 13:01:35.678966  1598 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:35.681125  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.682862  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.684937  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:35.665030  6966 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:35.689025  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.695472  1629 raft_consensus.cc:2376] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17. Re-sending same reply.
I20260709 13:01:35.689646  6735 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:35.690184  6993 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
W20260709 13:01:35.702183  1559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2479) took 2179 ms (client timeout 2116 ms). Trace:
I20260709 13:01:35.702028  6993 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:35.702576  1559 rpcz_store.cc:269] 0709 13:01:33.523243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.533375 (+ 10132us) service_pool.cc:224] Handling call
0709 13:01:35.701952 (+2168577us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54002f49d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:35.702083 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247511808}
W20260709 13:01:35.693508  7062 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 2.422s	user 0.015s	sys 0.000s
I20260709 13:01:35.665484  7111 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:35.705372  7111 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:35.705555  6983 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:35.706107  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:35.707022  7129 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:01:35.697023  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.709172  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1047) took 1253 ms. Trace:
I20260709 13:01:35.778604  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:35.777243  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 1041) took 2417 ms (client timeout 1814 ms). Trace:
W20260709 13:01:35.787045  1634 rpcz_store.cc:269] 0709 13:01:33.359776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.365588 (+  5812us) service_pool.cc:224] Handling call
0709 13:01:35.776971 (+2411383us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54001bb054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:35.777134 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278598400}
I20260709 13:01:35.778228  2322 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:35.777628  2325 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:35.777273  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.738193  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:35.789244  1556 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:35.744226  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.708806  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:35.791783  1706 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:35.737474  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:35.793831  1560 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:35.776383  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:35.795509  1552 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:35.708470  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:35.796854  1675 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:35.727218  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:35.798713  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 71582.1us
W20260709 13:01:35.799260  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 120346us
I20260709 13:01:35.800664  1598 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:01:35.779851  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.776639  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.797811  1708 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:35.786728  1626 rpcz_store.cc:276] 0709 13:01:34.455534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.950551 (+495017us) service_pool.cc:224] Handling call
0709 13:01:34.950919 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.951162 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.951196 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.951740 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.241676 (+289936us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:35.241716 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.241785 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:35.708931 (+467146us) raft_consensus.cc:1685] finished
0709 13:01:35.708953 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.709112 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":289434,"threads_started":1,"wal-append.queue_time_us":595284}
I20260709 13:01:35.776947  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.812714  1673 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:35.801889  1632 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
W20260709 13:01:35.833652  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 121407us
W20260709 13:01:35.826757  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.707931  6993 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:35.839284  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.839567  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.841583  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.842384  1635 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:35.843751  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:35.844105  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:35.844326  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:35.845219  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:35.846621  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.851238  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.845125  1701 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
W20260709 13:01:35.853703  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 56929.5us
I20260709 13:01:35.854122  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1025) took 2042 ms. Trace:
I20260709 13:01:35.855158  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:35.711333  7088 consensus_meta.cc:287] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.003s
I20260709 13:01:35.721065  7138 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:35.859921  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:35.778220  7000 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:35.725497  6703 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:35.856129  7092 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:35.797806  7054 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.869333  7059 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:35.873576  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.874336  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.797930  7060 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:35.875373  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 74811us
I20260709 13:01:35.875428  1701 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:35.904805  1598 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:35.854597  1705 rpcz_store.cc:276] 0709 13:01:33.812198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.135606 (+323408us) service_pool.cc:224] Handling call
0709 13:01:34.149288 (+ 13682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.149432 (+   144us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:34.285751 (+136319us) log.cc:844] Serialized 14 byte log entry
0709 13:01:35.596369 (+1310618us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b18003079c0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed962523a 00007f0ed9a8fa2a
0709 13:01:35.853795 (+257426us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.853850 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:35.853894 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.853962 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.854069 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51056,"prepare.queue_time_us":120713,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"spinlock_wait_cycles":66432768,"thread_start_us":206049,"threads_started":1}
I20260709 13:01:35.877174  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:35.840739  7111 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:35.775096  6999 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:35.858280  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.882400  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.770587  7057 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:35.883307  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:35.920691  1707 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:35.882412  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.885331  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.877257  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.886754  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.887638  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:35.924995  1554 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 7.
I20260709 13:01:35.889504  6735 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:35.875911  7088 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:35.859990  6907 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:35.936997  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.938201  1633 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:35.874208  6668 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:35.945807  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.712471  6966 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:35.893605  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.951679  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:35.952349  1705 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:35.895344  2288 leader_election.cc:400] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17.
I20260709 13:01:35.737859  7079 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:35.896692  1555 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:35.881631  7104 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:35.909343  7111 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:35.980439  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.825191  6996 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:01:35.908499  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:36.032208  1631 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:35.912395  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.033205  1551 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:35.914054  1598 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:35.927096  1626 raft_consensus.cc:2368] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15.
I20260709 13:01:35.880208  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:35.927408  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.892910  6703 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:35.930681  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:36.038319  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.039427  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:35.899843  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.041186  1557 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:35.933365  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.042341  1552 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:35.934971  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:35.692294  7097 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:35.899076  7000 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.892170  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:35.885922  6553 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:01:35.892091  7054 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:35.949729  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:35.957222  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 62073.6us
I20260709 13:01:35.957724  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:36.069800  1701 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:35.958204  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:36.070660  1707 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:36.070749  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:35.971482  1556 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:35.974238  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.974547  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:36.071828  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 259250us
I20260709 13:01:36.072314  1555 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:36.073218  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.073819  1555 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:36.074666  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.075217  1555 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:36.075981  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:35.909911  7059 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:35.973779  7044 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.077049  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:36.078294  1601 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:36.079506  2329 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:35.878326  7138 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:35.925709  6961 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:35.977871  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.088186  1560 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:35.989180  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:35.900225  6949 consensus_queue.cc:1059] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:01:36.046404  6838 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:36.095199  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:36.045446  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:36.045668  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.047896  2323 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:36.056744  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.056982  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:35.971689  6907 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.065730  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:36.071484  1701 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:36.112564  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46959us
I20260709 13:01:36.030382  7111 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:35.976091  6668 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:35.921662  7043 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.072343  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:36.121068  1556 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:36.121613  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.122439  1560 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:36.080648  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:35.975950  7104 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:36.038219  6703 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.090621  2322 raft_consensus.cc:1813] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Handling vote request from an unknown peer 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:36.091869  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.135768  2322 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:36.093273  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.136475  1635 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
W20260709 13:01:36.036564  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 122564us
I20260709 13:01:36.138109  1598 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:36.100020  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.140744  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:36.096215  1554 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:36.141673  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:36.101595  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:36.142336  2328 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:36.151542  2328 raft_consensus.cc:1240] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:36.153045  2328 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:36.155206  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:36.089567  7138 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:36.164916  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:36.103461  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.166205  1551 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:36.106770  2288 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:36.113612  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:36.079625  7059 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:36.076527  1555 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:36.094717  6985 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:36.060650  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 193413us
W20260709 13:01:36.168385  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 54893.3us
I20260709 13:01:36.077322  7000 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:36.179557  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:36.182936  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:36.183776  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:36.177399  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 70716.5us
I20260709 13:01:36.184763  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:36.185946  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.196313  2327 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:36.118991  7057 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:36.199698  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.202015  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.202252  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:36.184206  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:36.204217  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:36.205159  1554 raft_consensus.cc:2393] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 10: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:36.207437  1556 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:36.208302  1701 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:36.181715  1675 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:36.211143  1526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.262s (SENT) [suppressed 26 similar messages]
I20260709 13:01:36.194422  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:36.142040  7104 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:36.215420  2326 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:36.220502  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:36.119246  6982 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:36.216497  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.221927  2321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1284) took 1039 ms. Trace:
I20260709 13:01:36.227388  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.228262  1633 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:36.220950  2288 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:36.161410  6703 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:36.162573  6989 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:36.222539  2321 rpcz_store.cc:276] 0709 13:01:34.890056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.890216 (+   160us) service_pool.cc:224] Handling call
0709 13:01:35.555267 (+665051us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.555455 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.555480 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.555521 (+    41us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:01:35.555552 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.555605 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.929694 (+374089us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b5400535a50. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:35.929802 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515741056}
I20260709 13:01:36.231801  1706 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:36.091337  7044 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.233489  1705 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:36.246968  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:36.250553  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.236116  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.193588  6994 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:36.251752  1634 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:36.252676  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:36.193779  6985 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:36.261098  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:36.262859  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:36.255560  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.178134  7151 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:36.258860  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.267308  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:36.218045  6874 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:36.217732  6983 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:36.268112  1701 raft_consensus.cc:2368] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15.
I20260709 13:01:36.161530  7043 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.216454  7057 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:36.217504  7103 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:36.277667  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.278330  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:36.287240  1700 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:36.284782  1633 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:36.252903  6838 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:36.261818  7066 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:36.274667  7140 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.374s	user 0.000s	sys 0.001s
I20260709 13:01:36.294270  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:36.258493  6994 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:36.295034  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:36.302414  1707 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:36.302490  1635 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:36.268321  6985 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:36.305172  1704 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 14: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:36.290416  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.305941  1706 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:36.274309  6874 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:36.272248  7147 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:36.313652  1551 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:36.234226  6982 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.274966  6983 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:36.279275  7057 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:36.305467  6994 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:36.274432  6668 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.323438  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:36.328614  1707 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:36.293946  6838 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:36.290769  6947 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:36.324296  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 250900us
I20260709 13:01:36.326228  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:36.330766  1701 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:36.330787  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.274655  6853 consensus_queue.cc:1059] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:01:36.331545  1551 raft_consensus.cc:1813] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Handling vote request from an unknown peer 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:36.332084  1551 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:36.332753  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:36.334187  2320 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
W20260709 13:01:36.334234  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 164265us
W20260709 13:01:36.335795  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.336241  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:36.285840  6962 consensus_queue.cc:1059] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:01:36.320977  6874 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:36.353350  1672 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:36.270408  7151 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:36.355911  1673 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:36.395311  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.396922  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:36.400671  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 44884.4us
I20260709 13:01:36.328408  6983 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:36.405504  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:36.402303  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 220640us
I20260709 13:01:36.402595  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:36.404398  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 68201.1us
I20260709 13:01:36.406396  1551 raft_consensus.cc:2410] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:01:36.401454  1673 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:36.333452  6838 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:36.410501  1601 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:36.395468  7143 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 13:01:36.404353  1526 leader_election.cc:400] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15.
I20260709 13:01:36.415462  1526 leader_election.cc:403] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:36.413525  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:36.338490  7079 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:36.416165  1551 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:36.422052  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:36.401540  7146 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:36.433843  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:36.438437  1551 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:36.435164  1601 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:36.446003  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:36.446720  1707 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:36.441673  1601 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:36.448525  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 47139us
I20260709 13:01:36.449414  1551 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:36.411623  6989 raft_consensus.cc:3055] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:36.328016  7147 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:36.412685  6947 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:36.395265  6991 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:01:36.411808  7054 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:36.339603  7152 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
W20260709 13:01:36.456277  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 103026us
I20260709 13:01:36.453243  1673 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:36.436481  6962 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:36.452122  6853 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:36.399245  7148 consensus_queue.cc:1059] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 13:01:36.454898  6989 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:36.454238  6996 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:36.480729  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 58687.4us
I20260709 13:01:36.491425  6996 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:36.457417  7160 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15.
I20260709 13:01:36.480899  7054 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:36.499173  1551 raft_consensus.cc:1240] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:36.516171  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 44948us
I20260709 13:01:36.494431  7002 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:36.481287  7000 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:36.493062  7144 log.cc:927] Time spent T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.295s	user 0.000s	sys 0.002s
I20260709 13:01:36.481663  7043 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:36.494850  7154 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 13:01:36.492959  7155 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:01:36.530452  1672 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:36.528972  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 77743.7us
I20260709 13:01:36.494364  7162 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:36.494340  7147 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:36.497612  7161 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:36.497491  6996 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:36.491946  7170 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:36.540251  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 106461us
I20260709 13:01:36.542763  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:36.499215  7044 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:36.536955  7166 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:36.582682  7166 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:36.583228  7166 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:36.584815  6668 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:36.585675  6703 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:36.552553  7162 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.551651  7153 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:36.565621  6989 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.571852  7164 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:36.569836  7165 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:01:36.528512  7167 consensus_queue.cc:1059] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:01:36.581061  7172 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:36.555640  7170 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.587067  1701 raft_consensus.cc:2393] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:01:36.588717  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 67178.6us
I20260709 13:01:36.614691  1709 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:01:36.590932  1706 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:36.615916  1552 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:36.561385  6982 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:36.601642  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 59046.7us
I20260709 13:01:36.587596  6853 raft_consensus.cc:697] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:36.615010  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 136188us
I20260709 13:01:36.609057  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:36.592355  7153 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.629063  2323 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:36.656103  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:36.656229  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47244.2us
I20260709 13:01:36.617202  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:36.680428  2320 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:36.640043  6989 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:36.658412  7162 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:36.616525  7173 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:36.655087  7151 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:01:36.617530  6962 raft_consensus.cc:697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:36.655722  7169 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.663584  6985 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.678339  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:36.678658  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:36.638749  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:36.675473  6668 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:36.701566  2321 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:36.682539  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3091) took 1794 ms. Trace:
I20260709 13:01:36.614275  6764 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:36.615926  7170 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:36.694556  6963 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:36.728938  6999 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:36.729396  7044 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:36.730580  7044 raft_consensus.cc:3055] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:36.730973  7044 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:36.731802  7044 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.668140  6907 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:36.681595  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:36.699018  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:36.677902  7153 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:36.678655  6703 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:36.658413  6982 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:36.705983  7169 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:36.706640  6962 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:36.707675  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.710722  7130 raft_consensus.cc:3055] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:36.710314  6853 consensus_queue.cc:237] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:36.710807  6985 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:36.703593  1553 rpcz_store.cc:276] 0709 13:01:34.888377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.967221 (+ 78844us) service_pool.cc:224] Handling call
0709 13:01:34.983876 (+ 16655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.985841 (+  1965us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:35.007709 (+ 21868us) log.cc:844] Serialized 14 byte log entry
0709 13:01:35.755791 (+748082us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b180042c0a0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed962523a 00007f0ed9a8fa2a
0709 13:01:35.930221 (+174430us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:35.930678 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.930812 (+   134us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:35.930844 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.930929 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:36.671345 (+740416us) raft_consensus.cc:1685] finished
0709 13:01:36.682281 (+ 10936us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.682459 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21595,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":2814,"raft.queue_time_us":3053,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":17124,"spinlock_wait_cycles":31116672,"thread_start_us":174199,"threads_started":1,"wal-append.queue_time_us":1084327}
I20260709 13:01:36.714493  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:36.683530  7164 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:36.719726  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.725956  6949 raft_consensus.cc:3055] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:36.737906  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:36.739518  7160 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:36.728938  7179 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:36.737296  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:36.677466  6838 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.747207  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:01:36.739987  7111 consensus_meta.cc:287] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.000s
I20260709 13:01:36.755455  2328 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:36.741806  6982 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:36.735651  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 54108.7us
I20260709 13:01:36.744766  7043 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:36.701020  7057 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:36.775985  7169 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:36.776767  7057 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:36.768326  7043 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:36.777944  7043 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:36.778533  6983 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:36.779858  1551 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:36.780877  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:36.782044  6983 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:36.764454  7111 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.734598  6764 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:36.784848  6764 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:36.785121  7111 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:36.750032  7167 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:01:36.787413  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:36.733918  6668 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.768816  6703 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:36.762794  7044 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:36.789139  6703 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.788218  7167 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:36.789674  6703 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:36.789762  7167 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:36.760730  1673 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:36.758451  7164 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.791071  7167 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.764873  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:36.758265  6949 raft_consensus.cc:740] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:36.792981  1707 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:36.793349  1702 raft_consensus.cc:1240] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:36.765496  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:36.765461  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:36.794194  1709 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:36.768010  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.767570  6982 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:36.761947  7059 consensus_meta.cc:287] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.543s	user 0.006s	sys 0.006s
I20260709 13:01:36.771284  6838 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:36.771097  6996 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.771821  1629 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:36.767645  7162 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:36.788218  2321 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 11: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:36.787422  7170 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:36.762756  1672 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:36.748876  7130 raft_consensus.cc:740] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:36.755791  7138 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
I20260709 13:01:36.865128  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.866374  1635 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:01:36.744031  7104 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.006s
I20260709 13:01:36.804401  1526 leader_election.cc:400] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15.
W20260709 13:01:36.867923  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 63610.5us
W20260709 13:01:36.804768  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 44162.7us
I20260709 13:01:36.869395  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:36.759720  7179 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:36.857755  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 95054.3us
I20260709 13:01:36.757654  7166 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:36.874634  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:36.875761  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:36.871755  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 179969us
I20260709 13:01:36.811467  7167 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:36.809863  6907 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:36.880087  7165 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:36.877468  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:36.888541  2321 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:36.838083  7057 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:36.876837  6994 consensus_meta.cc:287] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.534s	user 0.017s	sys 0.000s
I20260709 13:01:36.891747  1601 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:36.884006  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:36.865206  7172 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:36.889835  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:36.896939  1673 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:36.880578  7169 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:36.885532  7148 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:36.906786  2328 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:36.810292  6874 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.826649  7059 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.878928  7179 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:36.881588  6907 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:36.809626  6983 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:36.887555  7165 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:36.910555  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:36.893602  7160 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:36.894657  7172 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.879113  7104 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.877537  7138 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.918929  7165 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:36.929049  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:36.939340  1673 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:36.907469  7068 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:36.902185  7151 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:36.903399  7181 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:36.894953  7057 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.915760  6991 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:36.907776  7148 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:36.939529  1707 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:36.907300  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.901976  7169 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:36.917541  7164 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:36.918740  6907 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:36.948287  1673 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:36.984623  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:36.939015  6983 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:01:36.961426  7173 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:36.961840  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3019) took 1117 ms. Trace:
I20260709 13:01:36.961890  7151 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:36.963183  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.934525  7172 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:36.964679  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2939) took 1173 ms. Trace:
I20260709 13:01:37.001156  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:37.035403  1700 rpcz_store.cc:276] 0709 13:01:35.791624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.056653 (+265029us) service_pool.cc:224] Handling call
0709 13:01:36.964468 (+907815us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400397954. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:36.964617 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434945408}
I20260709 13:01:36.967744  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:36.915282  7152 consensus_queue.cc:1059] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:01:36.969491  1708 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:01:36.971287  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.971411  7138 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:36.973719  1630 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:36.923676  7160 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.894806  6994 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:37.068832  1559 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 10: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:37.070042  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2487) took 1169 ms. Trace:
I20260709 13:01:37.070525  1559 rpcz_store.cc:276] 0709 13:01:35.900642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.258585 (+357943us) service_pool.cc:224] Handling call
0709 13:01:37.069847 (+811262us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b54001c89d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:37.069982 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1841325824}
I20260709 13:01:37.071908  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:37.073269  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:37.073652  6994 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:37.074342  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:37.076373  6553 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:37.086529  6982 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:36.977324  1627 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:36.978618  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:37.157424  1709 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:36.893925  7162 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.881080  6949 consensus_queue.cc:260] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:36.985158  1705 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
W20260709 13:01:36.973919  1523 connection.cc:256] RPC call timeout handler was delayed by -1.2140541890000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
W20260709 13:01:37.163718  1523 connection.cc:256] RPC call timeout handler was delayed by -1.1254285219999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
I20260709 13:01:36.951320  7088 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:36.979976  6991 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:36.998472  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.995178  1702 rpcz_store.cc:276] 0709 13:01:35.844009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.544447 (+700438us) service_pool.cc:224] Handling call
0709 13:01:36.793115 (+248668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.803611 (+ 10496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.961606 (+157995us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b540012bbd0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:36.961777 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569955072}
I20260709 13:01:36.996371  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:37.175773  2323 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 13: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:36.975840  7161 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:36.982928  7148 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:37.005666  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 57500.4us
I20260709 13:01:36.908082  7130 consensus_queue.cc:260] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:36.985905  7169 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:37.181499  6703 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:37.190665  1702 raft_consensus.cc:1240] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:37.193461  7057 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:37.047178  7160 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:37.179237  6991 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.048734  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:37.052060  7184 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:01:37.052423  7187 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:37.203874  6989 consensus_meta.cc:287] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.513s	user 0.006s	sys 0.007s
I20260709 13:01:37.056895  1633 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:37.204371  7164 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:37.205988  6982 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:37.174580  7043 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:37.209295  7043 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:37.035226  6999 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:37.057262  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2612) took 1459 ms. Trace:
I20260709 13:01:37.210964  1631 rpcz_store.cc:276] 0709 13:01:35.596882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.695035 (+ 98153us) service_pool.cc:224] Handling call
0709 13:01:37.056346 (+1361311us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54000d98d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:37.056539 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455366528}
W20260709 13:01:37.032924  6947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.041s	sys 0.066s
W20260709 13:01:37.213004  6947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.042s	sys 0.067s
I20260709 13:01:37.212347  7160 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:37.213297  6947 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:37.214248  6947 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:37.215409  7160 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:37.090602  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:37.217715  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:37.218398  1700 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.092772  6996 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:37.039842  7183 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.098732  7104 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:37.100916  6874 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:36.975311  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:37.133868  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 238003us
I20260709 13:01:36.990470  7068 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:37.226902  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:37.146149  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:37.230892  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:37.150624  1598 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:37.152267  1707 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:01:37.152347  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:37.155398  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:37.165621  1523 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:37.233603  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 68064.1us
I20260709 13:01:37.173547  6764 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:37.171305  7060 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:37.036389  7151 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.262234  6966 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:37.161813  7162 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:37.265252  6668 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:37.185303  7170 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:37.223345  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 174675us
I20260709 13:01:37.269977  7059 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:37.270941  1675 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:37.226800  7161 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.272816  7161 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:37.274082  1632 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:37.275282  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2606) took 1889 ms. Trace:
I20260709 13:01:37.275622  1632 rpcz_store.cc:276] 0709 13:01:35.385992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.268823 (+882831us) service_pool.cc:224] Handling call
0709 13:01:37.273916 (+1005093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.274506 (+   590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.275104 (+   598us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000e7750. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:37.275225 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310520576}
I20260709 13:01:37.212347  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:37.231618  7130 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:37.217877  7182 consensus_queue.cc:1175] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" responder_term: 14 status { last_received { term: 11 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:37.285462  6992 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.286322  6992 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:37.291525  7000 raft_consensus.cc:3055] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:37.292053  7000 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:37.293013  7000 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:37.294085  7000 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:37.294801  7169 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:37.297240  7054 raft_consensus.cc:3055] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:37.297672  7054 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:37.298521  7054 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:37.299903  7054 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:37.301519  7068 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:37.304680  6874 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:37.305248  6874 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.305631  6874 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:37.236308  7166 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:37.306377  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 1066) took 1201 ms (client timeout 1558 ms). Trace:
I20260709 13:01:37.306932  7166 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:37.308693  7060 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:37.311064  7060 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:37.237824  7183 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:37.313467  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:37.313719  7183 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:37.315155  1634 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:37.227211  1709 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:37.234685  1523 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:37.316814  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 82319.4us
W20260709 13:01:37.269886  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 1065) took 1558 ms (client timeout 2058 ms). Trace:
I20260709 13:01:37.233639  2326 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 16: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:37.203457  7187 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:37.264420  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:37.234625  1601 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:37.235558  7164 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:37.239679  7160 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:37.239750  7057 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:37.249778  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 99235.6us
I20260709 13:01:37.250478  6989 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:37.154066  6553 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:01:37.257432  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1062) took 1705 ms. Trace:
W20260709 13:01:37.317502  1630 rpcz_store.cc:269] 0709 13:01:35.711920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.723963 (+ 12043us) service_pool.cc:224] Handling call
0709 13:01:37.269654 (+1545691us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000e7754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:37.269825 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2590975872}
I20260709 13:01:37.319309  1523 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:37.306828  1627 rpcz_store.cc:269] 0709 13:01:36.105054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.134097 (+ 29043us) service_pool.cc:224] Handling call
0709 13:01:37.306135 (+1172038us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b5400204754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:37.306316 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780002048}
I20260709 13:01:37.382069  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:37.329952  1700 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:37.332075  2328 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:37.334764  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:37.336341  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:37.386256  2323 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:37.336969  2327 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:37.337554  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:01:37.341132  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 106611us
I20260709 13:01:37.344961  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2951) took 1190 ms. Trace:
I20260709 13:01:37.388216  1705 rpcz_store.cc:276] 0709 13:01:36.125796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.252337 (+126541us) service_pool.cc:224] Handling call
0709 13:01:37.315776 (+1063439us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b54002cbd54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:37.315880 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682123008}
I20260709 13:01:37.345425  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:37.346045  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:37.347193  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 2930) took 1781 ms. Trace:
W20260709 13:01:37.351632  1704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 3016) took 1513 ms (client timeout 1504 ms). Trace:
W20260709 13:01:37.390960  1704 rpcz_store.cc:269] 0709 13:01:35.838646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.861638 (+ 22992us) service_pool.cc:224] Handling call
0709 13:01:37.351386 (+1489748us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b5400397e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:37.351553 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617817856}
I20260709 13:01:37.367658  1556 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:37.369727  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:37.369894  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:37.366402  1558 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:01:37.280393  7150 log.cc:927] Time spent T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.978s	user 0.001s	sys 0.001s
W20260709 13:01:37.409704  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 90521.3us
I20260709 13:01:37.411151  1523 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:37.390883  1633 rpcz_store.cc:276] 0709 13:01:35.565407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.296144 (+730737us) service_pool.cc:224] Handling call
0709 13:01:37.056684 (+760540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.204408 (+147724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.346986 (+142578us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b54000d98d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:37.347134 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1691314432}
I20260709 13:01:37.373746  1629 rpcz_store.cc:276] 0709 13:01:35.552013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.294750 (+742737us) service_pool.cc:224] Handling call
0709 13:01:36.295240 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.810957 (+515717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.257103 (+446146us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54000da7d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:37.257348 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095456000}
I20260709 13:01:37.414928  1555 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 14: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:37.416000  1523 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:37.422902  7182 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:37.423812  7182 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:37.424273  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:37.425688  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3009) took 1635 ms. Trace:
I20260709 13:01:37.425954  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:37.426100  1703 rpcz_store.cc:276] 0709 13:01:35.790248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.792268 (+  2020us) service_pool.cc:224] Handling call
0709 13:01:35.793126 (+   858us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.797504 (+  4378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.797537 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:35.837384 (+ 39847us) log.cc:844] Serialized 26 byte log entry
0709 13:01:36.081251 (+243867us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:36.273333 (+192082us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.273607 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.273707 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:36.496902 (+223195us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b180046d0e0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:01:37.279536 (+782634us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:37.425468 (+145932us) raft_consensus.cc:1685] finished
0709 13:01:37.425489 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.425616 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67509,"prepare.queue_time_us":322528,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":8279,"raft.queue_time_us":201437,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":3969,"spinlock_wait_cycles":102892672,"thread_start_us":311178,"threads_started":2,"wal-append.queue_time_us":368796}
I20260709 13:01:37.434820  1552 raft_consensus.cc:2410] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:37.427716  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:37.439172  1554 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:37.445303  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:37.362171  7183 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:37.343473  6983 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:37.275293  7161 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:37.361353  7160 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:37.466101  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 45767us
I20260709 13:01:37.427596  6982 raft_consensus.cc:2764] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:01:37.489168  2286 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:37.372485  7057 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:37.439723  7146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.023s	sys 0.032s
W20260709 13:01:37.463346  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 231543us
I20260709 13:01:37.546893  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:37.553877  1705 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:37.557590  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:37.428530  6994 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:37.547703  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:37.547077  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 57984.7us
I20260709 13:01:37.438828  7134 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:37.466989  7176 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:37.456596  6966 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:37.439802  6962 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:37.564883  2286 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:37.492126  6961 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:37.514480  7153 consensus_meta.cc:287] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.770s	user 0.009s	sys 0.004s
I20260709 13:01:37.565869  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:37.568619  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:37.456178  7158 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:37.579957  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:37.432421  7104 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.111s
I20260709 13:01:37.561501  1702 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:37.429783  7170 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
W20260709 13:01:37.553121  7146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.066s	user 0.024s	sys 0.032s
I20260709 13:01:37.546684  7057 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:37.606931  1702 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
I20260709 13:01:37.607347  1702 pending_rounds.cc:85] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 14
I20260709 13:01:37.607568  1702 pending_rounds.cc:107] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 13:01:37.607934  1702 raft_consensus.cc:2889] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:37.591724  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:37.592335  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:37.601336  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:37.602010  2286 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:37.602093  1705 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:37.510915  7160 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:37.576758  6992 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:37.615442  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:37.621256  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:37.616560  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:37.541395  7169 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:37.625236  1705 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:37.622511  1709 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:37.622689  1560 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:37.494273  7152 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.109s
W20260709 13:01:37.608191  7179 consensus_meta.cc:287] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.677s	user 0.011s	sys 0.000s
I20260709 13:01:37.574450  7183 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:37.600245  6961 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:37.602628  6996 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:37.619872  7127 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:37.598358  6703 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:37.620009  6982 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:37.601186  6994 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:37.635747  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:37.689657  1552 raft_consensus.cc:2410] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:01:37.624433  6962 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:37.603835  7153 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:37.618549  7146 raft_consensus.cc:697] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:37.605404  7158 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:37.577358  6764 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:37.582626  6668 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:01:37.589232  7134 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:37.635552  6992 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:37.639353  6966 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:37.662823  1702 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:37.664327  6735 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:37.667835  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:37.668885  7182 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:37.670017  6991 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:37.646930  6961 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.651328  7127 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:37.724527  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 236290us
I20260709 13:01:37.730175  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:37.730716  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:37.731477  1629 raft_consensus.cc:2368] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12.
I20260709 13:01:37.732158  1601 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:37.732900  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:37.676932  6982 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:37.646792  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:37.748766  1560 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:37.633397  7163 log.cc:927] Time spent T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:01:37.637446  6544 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 13:01:37.722963  7165 consensus_meta.cc:287] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.740s	user 0.010s	sys 0.000s
I20260709 13:01:37.785410  1551 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:37.674980  7151 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:37.715638  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:37.789371  1556 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.789426  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:37.716225  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:37.790004  1633 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:37.790411  1702 raft_consensus.cc:2393] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:37.643867  7179 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:37.733793  1630 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
W20260709 13:01:37.765142  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.748293  1601 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:37.795462  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47257.1us
W20260709 13:01:37.791260  7044 consensus_meta.cc:287] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.997s	user 0.015s	sys 0.000s
I20260709 13:01:37.796849  1601 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:37.798110  7138 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:37.798679  7138 raft_consensus.cc:697] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:37.799894  6838 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:37.799726  7138 consensus_queue.cc:237] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:37.803685  1675 leader_election.cc:400] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12.
I20260709 13:01:37.804064  1675 leader_election.cc:403] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:37.800382  6838 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:37.807397  6838 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:37.809245  1675 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:37.810212  7193 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12.
I20260709 13:01:37.811355  7193 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:37.811718  7193 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.812031  7193 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:37.814164  1560 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 8.
I20260709 13:01:37.700943  1635 raft_consensus.cc:2410] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:01:37.784315  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:37.719267  6966 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.821107  6966 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:37.820144  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:37.786164  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:37.824930  1558 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:37.825979  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:37.788757  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:37.829133  1627 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:37.829794  1560 raft_consensus.cc:2393] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:37.837610  1675 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:37.838617  6764 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:37.839046  6764 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:37.839435  6764 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:37.843838  1708 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:37.848991  1558 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:37.859603  6966 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:37.861965  6991 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:37.779079  6992 raft_consensus.cc:697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:37.747447  7127 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:37.929987  1707 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:37.930351  1633 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:37.932127  1675 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:37.864502  6907 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.826s	user 0.007s	sys 0.000s
I20260709 13:01:37.894428  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:37.909154  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:37.867543  7192 raft_consensus.cc:3055] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:37.942502  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:37.922439  1705 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:37.784716  7060 consensus_queue.cc:1059] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.152s
I20260709 13:01:37.948230  7060 raft_consensus.cc:3055] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:37.948721  7060 raft_consensus.cc:740] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:37.894868  7134 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:37.892974  7187 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:37.887687  7146 consensus_queue.cc:237] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:37.886655  7158 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:37.794482  7183 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:37.866178  6962 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:37.972812  6992 consensus_queue.cc:237] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.005825  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:01:38.001097  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 489859us
I20260709 13:01:37.901086  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2615) took 1216 ms. Trace:
W20260709 13:01:37.869163  7167 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.989s	user 0.012s	sys 0.000s
W20260709 13:01:37.883519  7162 consensus_meta.cc:287] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.002s
I20260709 13:01:37.861862  7153 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:37.780019  7104 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:01:37.885414  7148 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.654s	user 0.007s	sys 0.003s
I20260709 13:01:37.878568  7067 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.036702  1556 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:37.940830  7192 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:38.025184  1560 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:01:38.010058  6703 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.795516  7165 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:37.946070  7044 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:38.047513  1706 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:38.018011  1626 rpcz_store.cc:276] 0709 13:01:36.684699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.685046 (+   347us) service_pool.cc:224] Handling call
0709 13:01:36.700352 (+ 15306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:36.701250 (+   898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:36.701280 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:37.349640 (+648360us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b2c000f1738. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2
0709 13:01:37.350057 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.717735 (+367678us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:37.717774 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.717843 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.900757 (+182914us) raft_consensus.cc:1685] finished
0709 13:01:37.900781 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.901022 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":955,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":29718,"spinlock_wait_cycles":3929344,"thread_start_us":366872,"threads_started":1,"wal-append.queue_time_us":543232}
I20260709 13:01:38.049453  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:38.010435  6996 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:38.051261  7166 consensus_meta.cc:287] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.744s	user 0.011s	sys 0.000s
W20260709 13:01:38.042395  7172 consensus_meta.cc:287] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.989s	user 0.005s	sys 0.006s
I20260709 13:01:38.008288  6764 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:38.086759  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 467964us
I20260709 13:01:38.087004  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:38.026734  6966 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:38.072875  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.002s	sys 0.022s
W20260709 13:01:38.100060  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.002s	sys 0.022s
I20260709 13:01:37.984200  6907 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:38.075325  7000 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.777s	user 0.012s	sys 0.000s
W20260709 13:01:38.096310  6874 consensus_meta.cc:287] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.790s	user 0.008s	sys 0.003s
I20260709 13:01:38.052482  7104 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:38.100507  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 681662us
I20260709 13:01:38.037070  7162 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.034168  7160 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:38.128997  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:38.129650  1704 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:38.101004  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.012s	sys 0.014s
I20260709 13:01:38.095245  7192 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:38.114372  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.131822  1523 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:38.130465  2288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.003s	sys 0.027s
W20260709 13:01:38.131141  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.012s	sys 0.014s
I20260709 13:01:38.133577  1523 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:38.084880  7166 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:38.132215  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 63817.7us
I20260709 13:01:38.135922  1709 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:38.136408  2288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.003s	sys 0.027s
I20260709 13:01:38.036798  7148 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:38.136708  1523 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:38.052959  7067 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.139688  1523 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:38.084374  7044 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:38.142103  1523 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:38.073565  7185 consensus_queue.cc:1059] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:01:38.070498  6703 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:38.152575  1552 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:38.163938  1557 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:38.146404  6983 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:38.122143  6553 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:38.166128  6553 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.171914  1552 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:38.176690  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.009s	sys 0.005s
W20260709 13:01:38.177116  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.009s	sys 0.005s
W20260709 13:01:38.177630  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 556377us
I20260709 13:01:38.177820  1703 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:38.099315  7172 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:38.145642  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 535633us
I20260709 13:01:38.135248  7187 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:38.185261  1704 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:38.143831  6991 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:38.161320  6994 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:38.185138  6985 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.006s	sys 0.025s
I20260709 13:01:38.203576  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.137521  7130 consensus_queue.cc:1059] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:01:38.171814  6982 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:38.131574  6874 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.236816  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:38.204234  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.224867  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:38.186137  7079 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:38.230859  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:38.190272  6991 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:38.225745  6985 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.007s	sys 0.026s
I20260709 13:01:38.244928  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.225152  7151 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:38.239686  7185 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.253448  6991 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:38.269520  7217 consensus_queue.cc:1059] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:01:38.231555  7134 consensus_queue.cc:1059] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:01:38.283370  6985 raft_consensus.cc:3055] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:38.244596  7204 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:38.293016  7204 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.296056  7160 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:38.298729  6874 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:38.247713  7044 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:38.291782  7200 log.cc:927] Time spent T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:38.267427  6907 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:38.251252  7104 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.178695  6553 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:38.277129  7158 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.288407  7165 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:38.301419  6985 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:38.385363  7205 log.cc:927] Time spent T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:38.385917  6985 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:38.387202  7148 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:38.387832  6985 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:38.329573  7172 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:38.388922  6703 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:38.369724  6764 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:38.370730  6961 consensus_meta.cc:287] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.596s	user 0.013s	sys 0.000s
W20260709 13:01:38.381608  7216 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:38.382275  7162 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:38.383831  7193 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.571s	user 0.013s	sys 0.000s
I20260709 13:01:38.409655  7193 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.413398  7193 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:38.395678  7057 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.761s	user 0.010s	sys 0.001s
I20260709 13:01:38.393155  7158 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.414709  7057 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.416484  7158 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:38.399348  7204 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:38.416919  7057 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:38.336185  6838 consensus_meta.cc:287] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.004s
I20260709 13:01:38.417613  6838 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:38.419941  6838 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:38.417678  6961 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.434727  6961 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:38.434849  6991 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.178514  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:38.483593  1554 raft_consensus.cc:2393] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:38.566089  6982 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:38.566897  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2504) took 1009 ms. Trace:
W20260709 13:01:38.567620  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 389034us
I20260709 13:01:38.567518  1554 rpcz_store.cc:276] 0709 13:01:37.557391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.557500 (+   109us) service_pool.cc:224] Handling call
0709 13:01:38.566342 (+1008842us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54002288d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:38.566635 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009212800}
I20260709 13:01:38.485432  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3114) took 1124 ms. Trace:
I20260709 13:01:38.570598  1559 rpcz_store.cc:276] 0709 13:01:37.361420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.364166 (+  2746us) service_pool.cc:224] Handling call
0709 13:01:37.364489 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.364842 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.364870 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:37.365324 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.720034 (+354710us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:37.720076 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.720149 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.484370 (+764221us) raft_consensus.cc:1685] finished
0709 13:01:38.484438 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.485069 (+   631us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5554,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":52912,"thread_start_us":299402,"threads_started":1,"wal-append.queue_time_us":722848}
I20260709 13:01:38.489548  1555 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:38.490870  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:38.204144  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:38.575248  1526 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:38.575920  1559 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:38.577602  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:38.577373  7079 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:38.578960  7079 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:38.495371  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:38.584936  6982 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:38.585652  6982 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:38.586153  6982 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:38.501201  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 356460us
W20260709 13:01:38.585213  7206 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.363s	user 0.000s	sys 0.004s
I20260709 13:01:38.501667  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3040) took 1422 ms. Trace:
W20260709 13:01:38.502635  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 366263us
I20260709 13:01:38.502983  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.504444  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.505388  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.506462  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:38.507766  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.508332  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:38.509120  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:38.509399  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:38.509127  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.509769  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.510462  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:38.510735  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.510990  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:38.351377  7067 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:38.300096  7127 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.282279  7185 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.611642  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:38.615614  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:38.515435  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:38.517040  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:38.617060  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:38.181365  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:38.618670  1632 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:38.619557  1552 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:38.524354  6764 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:38.621166  6764 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.623204  7127 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:38.525077  7193 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:38.526249  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.529685  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 3041) took 1430 ms. Trace:
I20260709 13:01:38.535951  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:38.537619  7044 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:38.538064  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:38.539850  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.542240  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3118) took 1178 ms. Trace:
W20260709 13:01:38.547312  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 327171us
I20260709 13:01:38.589442  1700 rpcz_store.cc:276] 0709 13:01:37.079110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.395710 (+316600us) service_pool.cc:224] Handling call
0709 13:01:37.396067 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.402176 (+  6109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.402235 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:37.562473 (+160238us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.983543 (+421070us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:37.983600 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.983699 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.500990 (+517291us) raft_consensus.cc:1685] finished
0709 13:01:38.501030 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.501375 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9334,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10215,"thread_start_us":369501,"threads_started":1,"wal-append.queue_time_us":747004}
I20260709 13:01:38.555581  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3043) took 1161 ms. Trace:
I20260709 13:01:38.557646  6838 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.630645  7044 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:38.630762  6838 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:38.633771  6838 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:38.559016  7204 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:38.634455  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2507) took 1076 ms. Trace:
I20260709 13:01:38.634811  7204 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:38.634917  1560 rpcz_store.cc:276] 0709 13:01:37.558250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.832639 (+274389us) service_pool.cc:224] Handling call
0709 13:01:37.833986 (+  1347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.052012 (+218026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.633868 (+581856us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54001d8dd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:38.634288 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438761216}
I20260709 13:01:38.636447  1702 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:38.560149  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.575278  1556 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:01:38.600117  2325 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:38.603690  2323 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:38.608378  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:38.613560  2327 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:38.554200  6949 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:38.630771  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:38.628684  1557 rpcz_store.cc:276] 0709 13:01:37.362792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.366912 (+  4120us) service_pool.cc:224] Handling call
0709 13:01:37.433023 (+ 66111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.164440 (+731417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.528385 (+363945us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b5400056ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:38.540814 (+ 12429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680184192}
I20260709 13:01:38.629276  1703 rpcz_store.cc:276] 0709 13:01:37.394336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.663763 (+269427us) service_pool.cc:224] Handling call
0709 13:01:37.664024 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.180397 (+516373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.554986 (+374589us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b5400266454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:38.555366 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180850944}
I20260709 13:01:38.652503  1631 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:38.627468  1706 rpcz_store.cc:276] 0709 13:01:37.099209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.152090 (+ 52881us) service_pool.cc:224] Handling call
0709 13:01:38.529283 (+1377193us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54002535d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:38.529481 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1828940032}
I20260709 13:01:38.646610  1599 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:38.656914  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:38.641963  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:38.643280  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 3035) took 1660 ms (client timeout 2182 ms). Trace:
W20260709 13:01:38.658838  1708 rpcz_store.cc:269] 0709 13:01:36.982764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.074122 (+ 91358us) service_pool.cc:224] Handling call
0709 13:01:38.642781 (+1568659us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54003eb7d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:38.643047 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660578176}
I20260709 13:01:38.644373  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1054) took 1295 ms. Trace:
I20260709 13:01:38.648422  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:38.650424  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1055) took 1283 ms. Trace:
I20260709 13:01:38.645744  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1052) took 1297 ms. Trace:
I20260709 13:01:38.662320  1709 rpcz_store.cc:276] 0709 13:01:37.366961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.663464 (+296503us) service_pool.cc:224] Handling call
0709 13:01:37.663771 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.136318 (+472547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.649765 (+513447us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b540002cbd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:38.650193 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085318016}
I20260709 13:01:38.663108  1707 rpcz_store.cc:276] 0709 13:01:37.348504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.639036 (+290532us) service_pool.cc:224] Handling call
0709 13:01:37.645641 (+  6605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.930609 (+284968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.645096 (+714487us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b540012cfd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:38.645456 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653380864}
I20260709 13:01:38.644934  6838 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:01:38.642225  7193 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:38.660945  1705 rpcz_store.cc:276] 0709 13:01:37.349309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.662274 (+312965us) service_pool.cc:224] Handling call
0709 13:01:37.662679 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.944704 (+282025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.643783 (+699079us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400396a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:38.644166 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596708992}
I20260709 13:01:38.667855  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2623) took 1941 ms. Trace:
I20260709 13:01:38.668707  7193 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:38.673161  7169 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.673533  1703 raft_consensus.cc:2393] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 11: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:38.673977  7169 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:38.675360  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:38.681092  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.682152  7044 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:38.685133  7204 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:38.688724  1551 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:38.689378  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:38.679152  7060 consensus_queue.cc:260] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:38.668447  1635 rpcz_store.cc:276] 0709 13:01:36.691265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.036516 (+345251us) service_pool.cc:224] Handling call
0709 13:01:38.632207 (+1595691us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54000f3cd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:38.632466 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079721728}
I20260709 13:01:38.700853  1632 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
W20260709 13:01:38.705547  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 134766us
I20260709 13:01:38.707006  1700 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:38.708626  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.701062  7208 raft_consensus.cc:3055] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:38.711056  7208 raft_consensus.cc:740] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:38.713218  7208 consensus_queue.cc:260] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.716185  7179 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:38.717696  7191 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:38.717919  6764 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:38.719715  1700 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:38.779922  7191 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.783062  7191 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:38.780246  6982 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.720778  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.721881  7057 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:38.788229  7057 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:38.790398  6982 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:38.790674  7057 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:38.722594  1705 raft_consensus.cc:1240] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:38.723862  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:38.724566  7185 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:38.725452  2321 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:38.726186  2324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:38.793826  2324 raft_consensus.cc:606] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:38.794298  2324 raft_consensus.cc:614] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:38.795780  1557 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:38.728029  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.728892  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2511) took 1145 ms. Trace:
I20260709 13:01:38.797377  1555 rpcz_store.cc:276] 0709 13:01:37.559195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.579605 (+ 20410us) service_pool.cc:224] Handling call
0709 13:01:38.687859 (+1108254us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54001aa9d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:38.704059 (+ 16200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2063227648}
W20260709 13:01:38.733227  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 86771us
I20260709 13:01:38.732900  7060 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.799705  1560 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:38.801059  7192 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:38.733762  6544 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:38.734827  7218 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.805536  7218 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:38.808504  7218 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:38.824807  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 72259.5us
W20260709 13:01:38.735513  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.741174  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 69606.3us
I20260709 13:01:38.827483  7158 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:38.812345  1630 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:38.710414  6991 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:38.747714  6735 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:38.748801  6992 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:38.751981  6780 consensus_queue.cc:1059] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:38.752753  7208 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:38.753445  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 178410us
I20260709 13:01:38.759150  1702 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:38.759809  7169 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:38.766307  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:38.767048  6967 raft_consensus.cc:3055] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:38.769487  2325 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:38.773113  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:38.776124  7152 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:38.767053  7079 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.783082  1704 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:38.717008  2323 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
W20260709 13:01:38.847086  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 43571.6us
I20260709 13:01:38.868271  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2960) took 1192 ms. Trace:
I20260709 13:01:38.830215  7158 raft_consensus.cc:3055] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:38.872043  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 3046) took 1463 ms (client timeout 1829 ms). Trace:
I20260709 13:01:38.875201  1702 rpcz_store.cc:276] 0709 13:01:37.676008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.534940 (+858932us) service_pool.cc:224] Handling call
0709 13:01:38.868217 (+333277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.876139  7158 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:38.875206  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2962) took 1198 ms. Trace:
I20260709 13:01:38.882623  1708 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:38.875982  1558 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
W20260709 13:01:38.883914  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 85029.5us
W20260709 13:01:38.876269  1701 rpcz_store.cc:269] 0709 13:01:37.399164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.467209 (+ 68045us) service_pool.cc:224] Handling call
0709 13:01:38.861899 (+1394690us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540012c5d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:38.862058 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2978860416}
I20260709 13:01:38.888228  2322 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:38.882668  1704 rpcz_store.cc:276] 0709 13:01:37.677283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.577010 (+899727us) service_pool.cc:224] Handling call
0709 13:01:38.875107 (+298097us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:38.889249  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 91155.4us
I20260709 13:01:38.872480  6967 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:38.880906  7158 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.893818  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:38.899848  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 61225.4us
I20260709 13:01:38.900372  6780 raft_consensus.cc:3055] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:38.900876  6780 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:38.901036  7063 consensus_queue.cc:1059] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:01:38.902494  7063 raft_consensus.cc:3055] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:38.902148  6780 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.903003  7063 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:38.905792  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:38.907105  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:38.911731  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3044) took 1501 ms. Trace:
I20260709 13:01:38.912150  1708 rpcz_store.cc:276] 0709 13:01:37.395454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.660186 (+1264732us) service_pool.cc:224] Handling call
0709 13:01:38.874945 (+214759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.886109 (+ 11164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.895256 (+  9147us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54003eadd0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:38.896542 (+  1286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421284608}
I20260709 13:01:38.891786  6991 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.933437  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:38.935505  6780 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:38.938042  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:38.939577  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:38.941812  7127 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:38.942298  7127 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:38.942934  7127 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:38.945045  7209 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:38.945713  7209 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:38.946372  7209 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:38.949033  7161 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:38.949813  7161 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:38.950759  1675 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:38.952417  7161 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:38.953691  7079 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:38.955042  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:38.956571  7097 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:01:38.959244  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:38.961550  1456 catalog_manager.cc:5697] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.964193  1456 catalog_manager.cc:5697] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.966435  1701 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:01:38.983990  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 57217.1us
I20260709 13:01:38.876111  6735 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:38.908341  6907 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:39.006254  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 79190.5us
I20260709 13:01:39.031665  1707 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:39.032472  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:38.934448  7179 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:39.007062  7169 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:01:39.034564  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 95151.7us
I20260709 13:01:39.036713  1702 raft_consensus.cc:2368] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15.
I20260709 13:01:39.032704  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:39.039980  1700 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:38.906703  7152 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:39.037415  2327 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
W20260709 13:01:39.041405  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 90729.2us
I20260709 13:01:38.904295  7063 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.029801  7161 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:39.048362  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 157799us
I20260709 13:01:38.984393  6991 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:39.049705  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:39.014567  7097 consensus_queue.cc:1059] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:01:39.051103  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 175023us
I20260709 13:01:39.044365  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:39.049244  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:39.061404  1635 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:39.062978  6967 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.044994  1456 catalog_manager.cc:5697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:01:39.051786  7158 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.096599  7183 consensus_queue.cc:1059] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:39.098114  7183 raft_consensus.cc:3055] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:39.098511  7183 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:39.056751  1675 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:39.099514  7183 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.075824  7127 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:39.078065  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.078733  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.080807  1672 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:39.082319  6735 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:39.038798  6927 consensus_queue.cc:1175] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e4c78b411eb34b3d92183a86d34a81f1" responder_term: 12 status { last_received { term: 11 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:39.065359  6992 consensus_queue.cc:1059] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:01:39.083657  7097 raft_consensus.cc:3055] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:39.109437  7097 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:39.110126  6992 raft_consensus.cc:3055] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:39.084738  1456 catalog_manager.cc:5697] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:39.085958  1455 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41166 (request call id 326) took 70820 ms (client timeout 15000 ms). Trace:
I20260709 13:01:39.086210  6967 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.091168  7063 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:39.091415  7138 consensus_queue.cc:1059] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:39.092653  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:39.092883  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:39.096053  1700 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:39.101078  7146 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:39.108484  1632 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:39.117285  1706 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:39.088177  6780 consensus_queue.cc:1059] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
W20260709 13:01:39.141462  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 90756.7us
W20260709 13:01:39.134227  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 199868us
W20260709 13:01:39.143308  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 63239.6us
I20260709 13:01:39.046036  6907 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:39.145956  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:39.103886  7161 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:39.147478  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:39.142163  1601 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:39.110574  6992 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:39.153561  2328 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:39.153638  1633 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 17. Current term is 18. Ops: []
W20260709 13:01:39.156037  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 44309.5us
I20260709 13:01:39.151827  1634 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:39.158842  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 66114.9us
I20260709 13:01:39.110572  7097 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:39.165493  1635 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:39.170154  2286 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:39.170013  6927 consensus_queue.cc:1059] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:39.171316  6927 raft_consensus.cc:3055] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:39.171690  6927 raft_consensus.cc:740] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:39.173082  7162 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:39.173614  7162 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:39.173807  7057 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.174414  7057 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.174772  7162 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.176607  7057 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:39.172842  6927 consensus_queue.cc:260] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.177928  6927 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.139549  7138 consensus_queue.cc:1243] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:39.183668  7097 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:39.184623  2329 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:39.185007  2329 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:39.185879  2329 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.187062  2329 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.189137  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:39.190255  7057 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:39.153337  7146 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:39.193534  7146 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.194372  6992 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.177049  7152 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:39.159314  7169 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:39.107112  7179 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:39.146664  1456 catalog_manager.cc:5697] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:39.203806  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.196316  6992 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:39.111749  1455 rpcz_store.cc:269] 0709 13:00:28.265199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.265530 (+   331us) service_pool.cc:224] Handling call
0709 13:00:30.876965 (+2611435us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540029f754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ef090 00007f0ed9a8df3a 00007f0edf8441cc 00007f0edf94237e 00007f0edde032a4 00007f0edde03232 00007f0edde03161 00007f0edde030dc 00007f0edde02392 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:39.085701 (+68208736us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:29.551521 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:29.574041 (+ 22520us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:29.574093 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:01:29.574111 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:29.574805 (+   694us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:29.574900 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:29.574928 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:01:29.575495 (+   567us) tablet.cc:701] Row locks acquired
0709 13:01:29.575545 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:01:29.575758 (+   213us) write_op.cc:270] Start()
0709 13:01:29.575917 (+   159us) write_op.cc:276] Timestamp: P: 1783602089575686 usec, L: 0
0709 13:01:29.575950 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:01:29.633259 (+ 57309us) log.cc:844] Serialized 1706 byte log entry
0709 13:01:29.907287 (+274028us) op_driver.cc:464] REPLICATION: finished
0709 13:01:29.995183 (+ 87896us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed697b0ac 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0edd4bbef0
0709 13:01:30.324338 (+329155us) write_op.cc:301] APPLY: starting
0709 13:01:30.351174 (+ 26836us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:30.446624 (+ 95450us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:30.446672 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:30.559103 (+112431us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:30.685357 (+126254us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:01:30.723905 (+ 38548us) write_op.cc:312] APPLY: finished
0709 13:01:30.775440 (+ 51535us) log.cc:844] Serialized 49 byte log entry
0709 13:01:30.775680 (+   240us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:30.775823 (+   143us) write_op.cc:454] Released schema lock
0709 13:01:30.775906 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:30.776462 (+   556us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:30.776504 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5217313,"reported_tablets":47,"spinlock_wait_cycles":3415281024,"child_traces":[["op",{"apply.queue_time_us":358187,"apply.run_cpu_time_us":10303,"apply.run_wall_time_us":470542,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20823,"num_ops":4,"prepare.queue_time_us":393772,"prepare.run_cpu_time_us":10842,"prepare.run_wall_time_us":237523,"raft.queue_time_us":92116,"raft.run_cpu_time_us":89551,"raft.run_wall_time_us":265146,"replication_time_us":331182,"spinlock_wait_cycles":12218624,"thread_start_us":669416,"threads_started":4,"wal-append.queue_time_us":101100,"wal-append.run_cpu_time_us":19257,"wal-append.run_wall_time_us":2213962}]]}
I20260709 13:01:39.200382  7183 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:39.215234  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:39.219485  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.227345  1560 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:39.209132  7152 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:39.237844  1557 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:39.243495  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:39.201855  7044 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.228375  1456 catalog_manager.cc:5697] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.213660  7138 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:39.254482  1555 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:39.254905  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.258790  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 46023.3us
W20260709 13:01:39.258925  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 111524us
I20260709 13:01:39.199730  7218 consensus_queue.cc:1059] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:01:39.266630  1635 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:39.266912  1556 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:39.268393  7044 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.271857  7044 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:39.214824  6927 consensus_queue.cc:1059] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:01:39.293728  7225 raft_consensus.cc:3055] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:39.294252  7225 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:39.295338  7225 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:39.299191  7225 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.300716  7248 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:39.305652  6907 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:39.305891  6927 raft_consensus.cc:3055] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:39.307338  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 51321.9us
I20260709 13:01:39.293660  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:39.310245  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 202715us
I20260709 13:01:39.323539  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:39.277007  7161 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.328367  1556 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:39.306365  6927 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:39.305666  7248 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:39.291036  7138 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:39.340559  6989 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:01:39.358039  2329 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 13:01:39.341238  7241 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:39.341502  7127 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:39.345508  7169 raft_consensus.cc:3055] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:39.346391  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:39.330082  7167 consensus_queue.cc:1059] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:01:39.311084  1456 catalog_manager.cc:5697] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 12 to 13, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.277868  6735 consensus_queue.cc:1059] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:01:39.283483  6780 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:01:39.284746  7209 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.328403  7192 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:39.330998  6991 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:39.340329  7179 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:39.377171  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:39.373744  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 113421us
I20260709 13:01:39.351547  7248 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:39.396749  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:39.404860  7138 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.387952  2329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:39.396849  7203 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:39.391359  1672 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:39.410862  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 59017.3us
I20260709 13:01:39.378235  7169 raft_consensus.cc:740] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:01:39.408102  2288 connection.cc:256] RPC call timeout handler was delayed by -1.1422451570000476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 13:01:39.422070  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:39.423040  7060 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:39.423877  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:39.424670  2322 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:39.426029  1557 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:39.422310  2324 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:01:39.421958  7067 consensus_queue.cc:1059] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:01:39.430022  1556 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:01:39.433900  1555 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:39.435760  7169 consensus_queue.cc:260] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:39.387480  6927 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.437750  1672 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:39.438357  7179 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:39.415320  7218 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:39.438879  7167 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.385890  6989 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:01:39.389063  7192 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:39.416708  7203 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:39.437336  7044 raft_consensus.cc:3055] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:39.433797  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:39.411240  7104 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:01:39.453840  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 107566us
I20260709 13:01:39.442520  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:39.428638  6907 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:39.456930  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:39.463773  1557 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:39.448932  1456 catalog_manager.cc:5697] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 3 to 8, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.442013  7169 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:39.387598  7152 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:39.474133  1556 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:39.477631  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:39.450191  7208 raft_consensus.cc:3055] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:01:39.480309  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 49073.3us
I20260709 13:01:39.481302  2286 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:39.458076  7162 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:39.449548  7179 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.491460  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:39.462513  7044 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:39.483819  7208 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:39.495419  7208 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.497097  7208 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:39.486510  7162 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.469380  6907 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:39.487721  7067 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:39.484030  7104 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:39.491755  1456 catalog_manager.cc:5697] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.505398  1630 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:01:39.509562  1556 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:39.518663  7067 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:39.501047  7158 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:39.460023  7167 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.503657  6907 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.504076  7162 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:39.528687  1456 catalog_manager.cc:5697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 6 to 9, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:01:39.508080  7218 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:39.531807  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:39.534082  1555 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 14: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:39.534785  7158 raft_consensus.cc:697] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:39.535786  7158 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.541077  7067 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.543097  7044 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.544608  7044 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:39.545610  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 57733.2us
I20260709 13:01:39.547174  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:39.548058  7218 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:39.548612  7218 raft_consensus.cc:697] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:39.549281  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:39.549640  7218 consensus_queue.cc:237] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:39.519066  7192 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.554864  7192 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.555023  7209 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:39.556226  6735 raft_consensus.cc:3055] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:39.556717  6735 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:39.557649  6735 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.559093  6735 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.566416  7167 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:39.530985  1601 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:39.567631  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:39.567677  7060 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:39.568836  6989 consensus_queue.cc:1059] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:39.570704  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:39.571405  1630 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:39.571439  6989 raft_consensus.cc:3055] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:39.572044  6989 raft_consensus.cc:740] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:39.577340  1557 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:01:39.578636  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:39.568964  1601 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:39.582839  1555 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:39.583024  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:39.583808  1560 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:39.589893  6989 consensus_queue.cc:260] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:39.591337  6989 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:39.596012  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:39.596910  1555 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 14: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:39.601610  7167 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:01:39.604398  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.608845  1560 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:01:39.616067  7253 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.616777  7253 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.619151  7253 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:39.619776  7060 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:39.620261  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:39.621096  2325 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:39.622663  1672 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:39.623417  7253 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:39.623819  7253 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.624162  7253 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:39.624362  2325 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:39.624853  2325 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:39.625603  2325 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.626673  2325 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:39.624876  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:39.507663  6949 consensus_queue.cc:1059] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 13:01:39.633671  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.637585  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.637181  1456 catalog_manager.cc:5697] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:39.639310  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 70542.5us
I20260709 13:01:39.534355  7203 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.555924  7104 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.640982  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:39.606622  7063 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:39.644332  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:39.645258  1557 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:39.648563  7167 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.648821  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:39.649561  1630 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:39.640959  6949 raft_consensus.cc:3055] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:39.663614  1601 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:39.682687  1456 catalog_manager.cc:5697] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 6 to 9, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 9 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } }
I20260709 13:01:39.687155  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:39.649333  7167 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.701077  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:39.703446  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.707024  2325 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 13:01:39.707543  2325 pending_rounds.cc:85] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 14
I20260709 13:01:39.655980  6927 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.656523  7063 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:39.659533  6949 raft_consensus.cc:740] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:39.727911  1709 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:01:39.729157  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 72723.2us
I20260709 13:01:39.699568  7167 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:39.660772  7179 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:39.736387  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.699601  7057 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:39.736354  6544 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:39.638278  7152 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:39.745831  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 179397us
I20260709 13:01:39.742143  2324 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:39.751616  1672 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:39.749994  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:39.707779  2325 pending_rounds.cc:107] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:01:39.756089  2325 raft_consensus.cc:2889] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:39.765465  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.765921  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 102025us
I20260709 13:01:39.723774  7060 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:01:39.776278  7260 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:01:39.749315  6544 raft_consensus.cc:697] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:39.754149  1456 catalog_manager.cc:5697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 5 to 9, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:39.766348  7179 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:39.799615  7261 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.077s	user 0.003s	sys 0.000s
I20260709 13:01:39.799984  7063 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.801417  1601 leader_election.cc:400] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15.
W20260709 13:01:39.804399  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.821290  1630 raft_consensus.cc:2410] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:01:39.803113  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:39.754720  7057 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:39.833591  1709 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:39.796802  7179 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:39.848117  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 63365.4us
I20260709 13:01:39.849684  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:39.775102  7167 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 13:01:39.848222  7252 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:39.854609  1456 catalog_manager.cc:5697] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.851711  7179 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.849329  7203 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:39.875583  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:39.795256  6949 consensus_queue.cc:260] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:39.863701  1673 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:39.873860  7183 consensus_meta.cc:287] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.003s
W20260709 13:01:39.885201  7097 consensus_meta.cc:287] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.701s	user 0.013s	sys 0.000s
W20260709 13:01:39.907395  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 101385us
W20260709 13:01:39.910432  7254 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:01:39.919396  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.909444  7255 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 13:01:39.934386  7167 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:39.937896  2325 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:39.939411  6544 consensus_queue.cc:237] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:39.926143  1456 catalog_manager.cc:5697] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 6 to 7, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.950258  1456 catalog_manager.cc:5697] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.953122  7146 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:39.951658  1456 catalog_manager.cc:5697] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 6 to 7, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:39.975370  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.986788  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 59111us
W20260709 13:01:39.991037  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 81401.8us
I20260709 13:01:39.998972  1601 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:40.015376  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:40.016233  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 158968us
I20260709 13:01:40.022055  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:40.026535  2325 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:40.032447  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:40.035163  1704 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:40.036998  7256 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.303s	user 0.000s	sys 0.002s
I20260709 13:01:40.041575  1601 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:40.046159  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:40.063202  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.062005  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.000771  6907 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.084215  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:40.086302  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:40.098826  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.085585  1700 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:40.105939  1633 raft_consensus.cc:2393] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:40.112195  7273 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:01:40.113667  7263 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:40.114069  7263 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:40.114984  6907 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:40.114874  7263 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.051429  7268 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:40.093143  1456 catalog_manager.cc:5697] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:40.122841  1456 catalog_manager.cc:5697] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:40.127969  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 45220.9us
I20260709 13:01:40.138425  1704 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:40.077908  7270 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:40.052788  7252 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 13:01:40.144814  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 102317us
W20260709 13:01:40.154650  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.148887  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:40.155922  2323 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:40.144743  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:40.117726  7253 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:40.158257  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.161532  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:40.166496  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:40.125325  7265 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:40.170855  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.174382  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:40.171166  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:40.149958  7270 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:40.190199  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 71843.5us
I20260709 13:01:40.191716  1706 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:40.203061  1704 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:40.202930  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:40.141207  7167 consensus_queue.cc:1059] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:01:40.207075  1456 catalog_manager.cc:5697] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 8 to 10, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:40.208956  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.175335  7057 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:40.179989  6780 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:40.212419  6989 consensus_meta.cc:287] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.621s	user 0.015s	sys 0.002s
I20260709 13:01:40.218940  2323 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:40.197516  7270 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:40.240228  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:40.223378  1672 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:40.239574  1709 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
W20260709 13:01:40.222867  7248 consensus_meta.cc:287] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.830s	user 0.009s	sys 0.004s
W20260709 13:01:40.243098  7264 log.cc:927] Time spent T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:01:40.189059  7265 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:40.266259  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 58609.9us
I20260709 13:01:40.242758  6947 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:40.253783  7225 consensus_meta.cc:287] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.954s	user 0.012s	sys 0.007s
I20260709 13:01:40.290064  2325 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:40.291426  1635 raft_consensus.cc:2410] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:40.283048  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:40.252620  7044 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:40.297636  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.295974  2326 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
W20260709 13:01:40.283099  7259 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.303s	user 0.000s	sys 0.002s
I20260709 13:01:40.236804  6780 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.303242  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:40.305027  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.308044  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.260895  7057 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:40.309438  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.310549  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:40.311558  7044 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:40.312954  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:40.312678  7044 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.313799  1629 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:40.314857  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:40.315590  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.258599  7248 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.316816  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:40.317873  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:40.317987  7248 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:40.318711  2321 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:40.308135  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:40.308296  7183 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.320688  7183 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:40.321575  7272 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:40.322971  7183 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:40.323190  7269 log.cc:927] Time spent T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
W20260709 13:01:40.324272  7266 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 13:01:40.325711  1628 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:40.330440  6907 raft_consensus.cc:3055] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:40.331137  6907 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:01:40.333863  6927 consensus_meta.cc:287] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.003s
I20260709 13:01:40.334575  2329 raft_consensus.cc:606] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:40.238965  7271 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:01:40.335104  2329 raft_consensus.cc:614] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:40.332011  6907 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:40.338681  1633 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:40.344355  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.352910  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.353700  1626 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:01:40.360767  7057 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:40.367635  7263 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:40.369123  7282 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:40.345325  1634 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:40.377485  6907 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:40.372448  1456 catalog_manager.cc:5697] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 7 to 9, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:40.383414  7267 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.243s	user 0.003s	sys 0.000s
I20260709 13:01:40.384208  7253 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:40.394275  6780 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:40.395797  7279 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.091s	user 0.002s	sys 0.000s
W20260709 13:01:40.398703  7276 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:01:40.400487  1560 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:01:40.400698  1557 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:40.400969  1560 pending_rounds.cc:85] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 8
I20260709 13:01:40.402046  1560 pending_rounds.cc:107] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:01:40.402383  1560 raft_consensus.cc:2889] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:40.404055  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 100846us
I20260709 13:01:40.301699  6947 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:40.394284  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33322 (request call id 26) took 1028 ms. Trace:
I20260709 13:01:40.407406  6947 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:40.407299  2329 rpcz_store.cc:276] 0709 13:01:39.365924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.366062 (+   138us) service_pool.cc:224] Handling call
0709 13:01:40.394079 (+1028017us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b5400431f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a7f853 00007f0edea4d60a 00007f0ed7fd37d4 00007f0ed7fd3762 00007f0ed7fd3691 00007f0ed7fd360c 00007f0ed7fd28c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:40.394192 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2125828352}
I20260709 13:01:40.409075  7265 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:40.410749  7162 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.821s	user 0.010s	sys 0.001s
W20260709 13:01:40.416628  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.418740  1705 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:40.420570  1627 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:40.421586  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:40.419184  1523 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:40.425181  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 53738.3us
I20260709 13:01:40.414634  6949 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:40.420708  7252 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.427762  7253 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.428247  1552 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:40.437768  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:40.417973  7167 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.463111  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:40.432176  7169 consensus_meta.cc:287] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.951s	user 0.012s	sys 0.001s
W20260709 13:01:40.429579  7179 consensus_meta.cc:287] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 13:01:40.468284  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:40.476087  2326 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:40.470258  2322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:40.476881  2322 raft_consensus.cc:606] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:40.479311  1556 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:40.429474  7063 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.412334  7162 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.440892  7265 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:40.484440  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.488451  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:40.489768  2321 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:40.491740  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.498353  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.475729  7057 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.502916  7057 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.505264  7138 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.506184  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:40.505910  7138 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:40.508494  7138 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:40.509025  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.509409  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.510054  1633 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:40.510186  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.510419  1626 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:01:40.510833  1632 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:40.510941  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.511533  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.512085  1632 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:40.512413  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.466336  7192 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.515025  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.519757  2326 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:01:40.520893  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.478317  7282 consensus_queue.cc:1243] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 18.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
W20260709 13:01:40.532109  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.523067  1634 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:01:40.431985  7252 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:40.541895  1700 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:01:40.525602  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 96123us
I20260709 13:01:40.536067  1560 raft_consensus.cc:1240] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:40.536854  1628 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:40.537742  2328 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:40.538592  1556 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:01:40.538767  1632 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:40.539342  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.540773  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.461638  7253 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:40.546816  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 70030.5us
I20260709 13:01:40.505712  7057 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:40.560570  1672 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:40.528499  6991 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:40.569777  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:40.551795  1523 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:40.478653  7167 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:40.481998  7179 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.551931  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:40.494758  7265 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:40.495137  7169 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.557952  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:40.573787  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:40.492019  7063 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.572769  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:40.524819  7225 consensus_queue.cc:1059] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:01:40.576962  7057 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:40.570225  7152 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:40.534736  7192 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.569501  6992 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:01:40.576747  7265 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:40.597146  7280 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:40.602969  7192 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:40.575047  6544 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:01:40.586412  7079 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:01:40.604777  6962 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:01:40.606253  7285 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.607309  7288 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:40.607755  7288 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:40.593115  7057 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:40.613140  7057 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:40.613220  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:40.606909  7285 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.618775  7285 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:40.620558  1630 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:40.621215  7063 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:40.622769  1709 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:40.625164  7167 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:40.625771  7162 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:40.625909  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:40.626633  1705 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:40.627254  7252 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:40.628083  1708 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:40.629350  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:40.629493  1709 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:01:40.628728  2321 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:40.637889  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:40.639328  1701 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:01:40.641355  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 67616.4us
W20260709 13:01:40.639762  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 55074us
I20260709 13:01:40.643746  1675 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:40.645743  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:40.647152  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:40.651800  1700 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:40.627672  7270 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:40.583225  7169 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.661072  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:40.660004  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 93294.7us
I20260709 13:01:40.662133  1558 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:40.663179  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:40.667744  1523 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:40.675482  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:40.681757  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 52476.4us
I20260709 13:01:40.664651  1601 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:40.686249  2321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:40.687250  2321 raft_consensus.cc:606] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:40.645727  7248 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:40.687774  2321 raft_consensus.cc:614] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:40.645321  7285 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.652887  7167 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:40.651687  7146 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:40.651953  7218 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:40.645520  7152 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:40.693461  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:40.656170  7162 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:40.690228  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:40.694553  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:40.695360  1551 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:01:40.691368  2286 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:40.688568  7203 consensus_meta.cc:287] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.801s	user 0.008s	sys 0.005s
I20260709 13:01:40.656481  7271 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:01:40.697733  7169 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:40.700242  6947 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:40.692934  7067 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:40.685007  6991 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:40.705108  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:40.749607  1635 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:40.705687  7299 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:40.706388  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:40.753252  1630 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:40.707669  7270 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:40.659684  7288 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.760042  7288 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:40.715049  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:40.761020  1708 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:40.715389  1627 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:01:40.764886  1627 pending_rounds.cc:85] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 11
I20260709 13:01:40.765216  1627 pending_rounds.cc:107] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:01:40.765470  1627 raft_consensus.cc:2889] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:40.706502  1707 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:40.715783  7253 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:40.716256  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:40.696158  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 134624us
I20260709 13:01:40.766194  7152 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:40.727217  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 237827us
I20260709 13:01:40.689205  7158 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:01:40.697225  7225 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:40.729779  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:40.744268  7079 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:40.780840  1629 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:01:40.775722  2322 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
W20260709 13:01:40.730253  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 44748.5us
I20260709 13:01:40.653435  7252 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:01:40.735225  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:40.739866  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 64495us
I20260709 13:01:40.739982  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:40.661059  7044 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.068s
I20260709 13:01:40.715073  7268 raft_consensus.cc:3055] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:40.743902  6947 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.751766  6991 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.757242  7169 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:40.751796  7273 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:01:40.758384  2324 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:40.720984  7285 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.714308  2329 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:01:40.808180  1553 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:40.727681  7162 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:40.768721  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.695045  6544 consensus_queue.cc:1059] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:40.740018  6989 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:40.817719  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 134928us
I20260709 13:01:40.803949  2321 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:40.806732  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:40.820308  2326 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:40.799360  1523 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:40.811378  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 123904us
I20260709 13:01:40.812263  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:40.809577  1632 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:40.751147  7060 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:01:40.822376  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:40.798070  7079 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.798767  6962 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.806119  6947 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:40.827950  1707 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 8.
I20260709 13:01:40.838032  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:40.804387  7268 raft_consensus.cc:740] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:40.830658  1630 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:40.813647  6991 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:40.831364  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:40.780401  7138 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:01:40.817868  7248 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:40.817426  7162 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:40.840327  1708 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:40.880210  2326 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:40.906821  1601 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:40.830107  7079 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:40.814808  6949 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:01:40.834797  7063 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:40.811489  7225 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.867883  6780 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:40.935869  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 108738us
W20260709 13:01:40.925966  1673 leader_election.cc:336] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.541s (SENT)
I20260709 13:01:40.825240  7281 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:01:40.906140  7270 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.831162  7057 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:40.979084  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 148523us
W20260709 13:01:40.980628  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:40.982295  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 159954us
I20260709 13:01:40.972980  6780 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:40.991205  7304 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:01:40.991474  6780 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:40.992093  7307 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:40.993054  7268 consensus_queue.cc:260] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:40.994642  7268 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:40.842101  6962 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.004046  2288 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:41.005013  7318 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:41.005467  7057 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:40.915648  7179 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:41.014170  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:40.985850  6949 consensus_queue.cc:1243] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:41.023437  1675 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:41.027725  1675 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:41.031404  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:41.033833  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.977106  7270 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:41.050977  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47008.5us
I20260709 13:01:41.055245  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:41.055006  7063 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:41.056633  7158 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:41.057035  7158 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:41.057281  7063 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.057420  7158 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:41.057828  7063 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.054833  7161 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:41.052776  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 126832us
W20260709 13:01:41.065378  1673 leader_election.cc:336] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.546s (SENT)
I20260709 13:01:41.070474  1673 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:41.074247  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:41.048666  7307 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:41.049793  7253 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:41.053071  7179 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:41.052054  6780 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:41.083621  2286 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:41.072602  6989 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:01:41.084878  7307 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.091522  7311 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:41.092027  7311 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.092366  7311 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:41.093041  7307 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:41.093618  7307 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:41.094141  7307 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:41.096647  7262 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 13:01:41.098096  7192 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:41.098667  7192 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.099047  7192 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:41.099963  7270 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:41.105031  2326 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:41.070585  7057 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:41.102478  2286 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:41.116623  1631 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:41.085547  6780 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:41.116770  7218 raft_consensus.cc:697] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:01:41.125893  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 117247us
W20260709 13:01:41.132512  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 68499.3us
I20260709 13:01:41.086198  7253 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.087721  7179 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:41.154269  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 352606us
I20260709 13:01:41.122540  7218 consensus_queue.cc:237] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:41.165692  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:41.164222  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:41.172477  1552 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:01:41.125288  6780 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:41.183411  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:41.184087  2326 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.184784  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:41.186085  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 120748us
W20260709 13:01:41.186896  1673 leader_election.cc:336] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.581s (SENT)
I20260709 13:01:41.187247  1673 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:41.156522  7253 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:41.156711  7179 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:41.188694  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:41.158737  7285 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:41.132045  7280 consensus_queue.cc:1059] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:01:41.167277  7057 raft_consensus.cc:697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:41.202159  1554 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:41.235308  2321 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:41.238382  1705 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:41.169931  7161 raft_consensus.cc:697] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:41.183960  7044 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:01:41.246915  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.242018  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 92340.5us
I20260709 13:01:41.188246  7318 raft_consensus.cc:697] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:41.241539  1523 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:41.262253  2288 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.770s (SENT) [suppressed 27 similar messages]
W20260709 13:01:41.264519  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 144140us
W20260709 13:01:41.266955  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 59717.8us
W20260709 13:01:41.270388  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 83456.3us
I20260709 13:01:41.291327  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:41.292505  1700 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:41.294884  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:41.295768  1700 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:41.297685  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:41.298538  1700 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:41.238962  7307 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:41.300092  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:41.304219  1700 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:41.245167  7285 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:01:41.301680  7309 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.356958  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 191366us
W20260709 13:01:41.357491  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 87668.6us
I20260709 13:01:41.356400  7309 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:41.375401  1673 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.594s (SENT)
I20260709 13:01:41.377259  6544 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.377875  6544 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.375097  7341 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:41.380066  6544 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:41.380753  7300 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.125s	user 0.000s	sys 0.002s
W20260709 13:01:41.382627  7313 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:01:41.383316  7328 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:41.385062  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:41.384764  1673 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:41.345022  7338 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:41.402212  2326 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
W20260709 13:01:41.385324  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 123090us
I20260709 13:01:41.413362  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:41.364310  7225 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:41.423002  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 47634.5us
W20260709 13:01:41.428517  7295 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:01:41.419051  7308 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:41.413039  7063 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:41.383926  7328 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:41.669591  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 208210us
W20260709 13:01:41.697832  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.425832  7167 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.670797  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 256847us
I20260709 13:01:41.394240  7161 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.511368  7339 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.413009  7318 consensus_queue.cc:237] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:41.442418  7345 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
W20260709 13:01:41.671657  1673 leader_election.cc:336] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.642s (SENT)
I20260709 13:01:41.670548  7063 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.671432  7338 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:41.714066  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:41.360715  7057 consensus_queue.cc:237] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:41.470571  7330 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:41.677042  7285 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:41.679821  1672 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:41.406503  2288 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:41.700443  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:41.700340  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 382107us
W20260709 13:01:41.723563  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 315639us
I20260709 13:01:41.731518  1634 raft_consensus.cc:3055] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:41.721079  7320 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.464s	user 0.014s	sys 0.009s
I20260709 13:01:41.732069  1634 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:41.726773  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.024s	sys 0.093s
W20260709 13:01:41.733950  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.024s	sys 0.093s
W20260709 13:01:41.734226  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 901447us
I20260709 13:01:41.735571  1628 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:41.735986  1628 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:41.722884  7330 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.747243  1599 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:41.748014  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.741657  1634 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.710671  7167 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:41.759199  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 87573.1us
I20260709 13:01:41.761757  1634 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.753149  1628 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.733469  7317 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.763373  1628 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:41.730026  7356 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:41.720034  6780 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.767277  2288 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:41.724025  7044 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:01:41.723390  7063 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.727780  7285 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.741885  7337 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:41.805080  7337 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:01:41.805469  7311 consensus_meta.cc:287] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.713s	user 0.014s	sys 0.004s
I20260709 13:01:41.806222  7311 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.806550  7337 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.809371  7350 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:41.809859  7350 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.810232  7350 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:41.810418  7288 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.050s	user 0.019s	sys 0.000s
I20260709 13:01:41.811029  7321 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:41.811404  1628 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:01:41.811834  1628 pending_rounds.cc:85] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 12
I20260709 13:01:41.811915  7315 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:41.812175  1628 pending_rounds.cc:107] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:01:41.812501  1628 raft_consensus.cc:2889] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:41.813773  7311 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:41.710171  7339 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.763252  6544 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.817946  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1212) took 1134 ms. Trace:
I20260709 13:01:41.769497  7356 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:41.786957  6991 consensus_meta.cc:287] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.873s	user 0.008s	sys 0.003s
I20260709 13:01:41.747679  7330 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:41.820408  1560 rpcz_store.cc:276] 0709 13:01:40.683537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.690112 (+  6575us) service_pool.cc:224] Handling call
0709 13:01:40.718546 (+ 28434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:40.810915 (+ 92369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.810968 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:40.826941 (+ 15973us) log.cc:844] Serialized 52 byte log entry
0709 13:01:41.053668 (+226727us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:41.053701 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.053765 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.817631 (+763866us) raft_consensus.cc:1685] finished
0709 13:01:41.817652 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.817862 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4248,"raft.queue_time_us":38114,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"thread_start_us":225039,"threads_started":2,"wal-append.queue_time_us":246819}
I20260709 13:01:41.832919  2328 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:41.814828  7063 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:41.840988  1599 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:41.846622  7340 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:01:41.849356  7079 consensus_meta.cc:287] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.916s	user 0.008s	sys 0.020s
I20260709 13:01:41.849812  7079 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.858008  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:41.830170  7309 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:41.857646  1673 leader_election.cc:336] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.827s (SENT)
I20260709 13:01:41.831529  7356 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:41.864441  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:41.863521  1554 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 9.
I20260709 13:01:41.871011  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:41.873381  1554 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:01:41.874974  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:41.875730  1559 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:41.875954  1553 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:41.827117  6544 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.879762  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:41.881412  1560 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:41.884792  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:41.778000  7317 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:41.838056  6991 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.889308  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:41.881064  7268 consensus_meta.cc:287] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.886s	user 0.018s	sys 0.000s
W20260709 13:01:41.888871  7192 consensus_meta.cc:287] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.789s	user 0.015s	sys 0.003s
I20260709 13:01:41.897903  7167 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:41.900636  7253 consensus_meta.cc:287] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.003s
I20260709 13:01:41.887462  7044 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:41.890053  7162 consensus_meta.cc:287] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.958s	user 0.022s	sys 0.007s
W20260709 13:01:41.901273  6947 consensus_meta.cc:287] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.998s	user 0.023s	sys 0.016s
I20260709 13:01:41.909510  1556 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:01:41.883270  7158 consensus_meta.cc:287] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.825s	user 0.017s	sys 0.012s
I20260709 13:01:41.903481  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:41.906023  1559 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
W20260709 13:01:41.890375  7265 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.244s	user 0.015s	sys 0.006s
I20260709 13:01:41.864168  7321 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:01:41.884333  7355 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:41.924815  7317 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:41.925258  6991 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:41.922156  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 64541.1us
W20260709 13:01:41.927752  1673 leader_election.cc:336] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.868s (SENT)
I20260709 13:01:41.907689  6949 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.934900  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:41.907271  7192 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.926771  7307 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:41.910218  7253 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:41.913028  6947 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:41.912216  7162 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:41.921515  7158 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.960232  7346 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:41.959913  7311 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:41.959926  7167 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:41.972811  7343 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:41.973196  7325 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:41.936903  7328 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:41.991187  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 290782us
I20260709 13:01:41.993507  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:41.921778  7265 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.982553  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3082) took 1280 ms. Trace:
I20260709 13:01:41.996912  1705 rpcz_store.cc:276] 0709 13:01:40.702290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.706690 (+  4400us) service_pool.cc:224] Handling call
0709 13:01:40.706974 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.241660 (+534686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.982243 (+740583us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54002535d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:41.982471 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221184896}
I20260709 13:01:41.998862  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:41.980947  7179 consensus_meta.cc:287] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.727s	user 0.007s	sys 0.006s
W20260709 13:01:42.001279  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 73554.3us
W20260709 13:01:41.962285  7360 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:01:42.004022  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 773860us
I20260709 13:01:41.963076  7358 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.937412  6949 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:41.961105  7309 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.974479  6544 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:42.013564  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:42.001438  7343 raft_consensus.cc:697] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:42.011734  2286 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:41.998624  7339 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:42.000905  7346 raft_consensus.cc:697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:41.960824  7307 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:42.046239  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47454.9us
I20260709 13:01:42.060557  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:42.045128  2324 raft_consensus.cc:2393] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:42.061417  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:42.015199  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:42.061450  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:01:42.057940  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 46312.3us
I20260709 13:01:42.009799  7311 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:42.062558  2329 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 10: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:42.011317  7167 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.975919  7350 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.006911  7179 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:42.082978  7167 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.084196  7307 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:42.085306  7265 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:42.087972  6949 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:42.089121  7346 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.097594  7167 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:42.101640  7307 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:42.101858  7364 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:01:42.101536  7311 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:42.102341  7307 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:42.103147  7311 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.103806  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.104444  1552 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:42.104558  7307 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:42.105288  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:42.105751  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.106019  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.106736  1557 raft_consensus.cc:2393] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:42.107409  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.109064  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.109840  1552 raft_consensus.cc:2393] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 9: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:42.105791  7158 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:42.103647  7363 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:01:42.113760  7162 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:42.070282  7339 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:42.114917  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:42.114848  7339 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.116958  7339 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:42.118276  7365 log.cc:927] Time spent T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:41.997176  7325 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:42.123240  1630 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:42.124825  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:42.063781  6735 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:42.138845  1634 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:42.141314  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:42.141903  1705 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
W20260709 13:01:42.144966  1673 leader_election.cc:336] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.565s (SENT)
I20260709 13:01:42.145365  1673 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:42.015491  7309 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:42.080539  7368 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:42.144666  2288 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:42.164268  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.135088  6949 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.166963  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:42.167866  1705 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:42.012275  7358 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:42.138576  6735 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.160370  7328 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:42.181705  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.182082  7343 consensus_queue.cc:237] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:42.184463  2288 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:42.188140  1551 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:42.188995  2329 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:01:42.163739  7368 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:42.193698  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.197768  1557 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:42.178877  7252 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:42.179297  6949 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.205195  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.185626  6735 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:42.224253  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.224887  1557 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:42.216841  7253 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:42.217427  6947 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:42.218771  7309 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:42.206971  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.233546  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:42.234499  1629 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:42.204154  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.213474  7350 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:42.212227  7325 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:42.226009  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.228981  1554 raft_consensus.cc:2393] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:42.245947  1557 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:01:42.227989  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:42.247949  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 75821.8us
I20260709 13:01:42.250869  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.203648  7368 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:42.203567  7379 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:42.266353  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.267242  1553 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:42.269551  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:42.268712  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 84351.7us
I20260709 13:01:42.277549  1629 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:42.279210  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.280049  1551 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:42.281843  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.281857  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.282797  1557 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:42.282564  1554 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:42.285766  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.286556  1554 raft_consensus.cc:2368] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 8. Current term is 9.
I20260709 13:01:42.270563  7379 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.287312  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.238420  7356 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.290424  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.291250  1557 raft_consensus.cc:2393] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:42.292096  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.293215  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.293821  6949 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:42.289292  7330 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.294308  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.294955  1557 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:42.295929  7330 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:42.293429  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.301219  1560 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:42.294610  7285 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:42.288751  7379 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:42.304697  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:42.304924  1553 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:01:42.305955  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:42.306578  2325 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:42.293514  7097 raft_consensus.cc:3055] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:42.308426  7097 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:42.309187  7305 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.478s	user 0.001s	sys 0.004s
I20260709 13:01:42.309046  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:42.309829  2323 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:42.309355  7097 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.310725  7097 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:42.310868  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:42.311529  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.301999  6962 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:42.317034  2326 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:42.316020  1557 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:01:42.319806  1557 pending_rounds.cc:85] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 5
I20260709 13:01:42.319429  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.320274  1557 pending_rounds.cc:107] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:01:42.323130  1557 raft_consensus.cc:2889] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:42.322461  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:42.329473  7317 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:42.330175  7318 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:42.330129  7317 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.330858  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.317986  7384 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:42.332060  7179 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:42.330941  7341 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:42.334272  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:42.318104  6949 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.354166  1598 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:42.408416  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 54372.4us
I20260709 13:01:42.366559  1557 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:42.332187  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:42.409479  1629 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:42.398170  1673 leader_election.cc:336] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.945s (SENT)
I20260709 13:01:42.411547  1634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 13:01:42.412513  1634 raft_consensus.cc:606] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:42.415006  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.415760  1553 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:42.416548  1627 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:01:42.420514  7314 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:42.421551  7314 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.426370  1630 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:42.417505  7063 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:42.429306  7063 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.429765  7341 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.431622  7063 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:42.431969  7341 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:42.434466  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:42.436167  7225 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:42.436618  7225 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.436990  7225 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:42.437275  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 99322.9us
W20260709 13:01:42.438004  1673 leader_election.cc:336] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.952s (SENT)
I20260709 13:01:42.438361  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:42.439507  1673 leader_election.cc:336] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.018s (SENT)
I20260709 13:01:42.439873  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:42.440707  7252 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:42.445039  7371 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:01:42.446094  7317 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:42.448110  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:42.440752  7253 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:42.424454  7314 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:42.417901  2286 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:42.459951  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.460700  1553 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:42.434193  6735 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.464394  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:42.467404  1557 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:01:42.465076  2286 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:42.402807  7384 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.412243  7282 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:42.474515  1673 leader_election.cc:336] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.162s (SENT)
I20260709 13:01:42.499799  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:42.484792  2286 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:42.524498  1629 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:01:42.476542  7330 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:42.330859  7318 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.482779  7384 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:42.558892  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:42.563153  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 78459.6us
I20260709 13:01:42.564445  1559 raft_consensus.cc:2393] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:42.480068  7358 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:42.498834  7063 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:42.503058  7282 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.461192  6949 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:42.575109  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 100613us
I20260709 13:01:42.568204  7179 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:42.579944  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.581759  1559 raft_consensus.cc:2368] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16.
I20260709 13:01:42.569276  7330 raft_consensus.cc:697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:42.584637  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:42.571041  7282 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:42.569855  7063 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:42.586352  1634 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:42.570096  7389 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:42.589428  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:42.581748  7381 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 13:01:42.593478  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:42.578460  7379 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:42.609534  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.587320  7203 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:01:42.616720  1559 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:42.664155  2322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:42.601086  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:42.601028  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:42.680181  1627 raft_consensus.cc:2376] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16. Re-sending same reply.
I20260709 13:01:42.595717  1560 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:42.680516  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:42.643328  1626 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:42.617674  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.682566  1557 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:42.588300  7063 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:42.674713  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1273) took 1585 ms. Trace:
I20260709 13:01:42.683518  2328 rpcz_store.cc:276] 0709 13:01:41.078250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.078427 (+   177us) service_pool.cc:224] Handling call
0709 13:01:41.087323 (+  8896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.839824 (+752501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.662837 (+823013us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b54004f3b54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:42.663079 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1701657472}
I20260709 13:01:42.593596  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:42.667837  7322 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.762s	user 0.000s	sys 0.001s
I20260709 13:01:42.692919  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:42.694875  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:42.649251  7287 raft_consensus.cc:3055] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:42.665621  6780 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:42.703523  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:42.704341  1707 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:42.690878  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:42.592918  7389 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:42.594652  7356 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:42.701663  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:42.708714  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:42.714174  1708 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:42.715018  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:42.717742  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.721336  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:42.722126  1701 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:42.724720  7358 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:42.724889  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.725589  1559 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:42.685788  7318 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:42.730058  1701 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:42.733812  1708 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:01:42.735190  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:42.737367  1706 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:01:42.741335  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:42.741513  1673 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.627s (SENT)
I20260709 13:01:42.742035  1704 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:42.742942  6949 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:42.743911  7391 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:01:42.724953  7079 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:42.699358  7287 raft_consensus.cc:740] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:42.746347  7287 consensus_queue.cc:260] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:42.747807  7287 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:42.748898  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.750252  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.750169  7225 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.751451  1632 raft_consensus.cc:2368] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12.
I20260709 13:01:42.751559  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.752161  1551 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:42.708575  7203 consensus_queue.cc:1059] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:01:42.753530  7203 raft_consensus.cc:3055] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:42.753901  7203 raft_consensus.cc:740] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:42.754789  7203 consensus_queue.cc:260] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.755995  7203 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:42.700182  7340 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:01:42.617683  7385 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.093s
I20260709 13:01:42.759183  1599 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:42.761269  1704 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:42.762648  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:42.763761  2328 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:42.742221  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:42.767206  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:42.767918  2323 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:42.773453  1707 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 9.
I20260709 13:01:42.771497  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.775758  2288 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:42.752420  7225 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:42.783002  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:42.784017  1632 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:42.786141  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:42.787200  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.789991  1560 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
W20260709 13:01:42.790373  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.791694  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:42.792337  1626 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:42.792755  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 51285us
W20260709 13:01:42.793704  1673 leader_election.cc:336] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.668s (SENT)
I20260709 13:01:42.793963  1673 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:42.727205  6735 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:42.601276  7330 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.734834  7358 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:42.797742  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:42.803762  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:42.814824  1628 raft_consensus.cc:2376] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10. Re-sending same reply.
I20260709 13:01:42.797353  2288 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:42.811859  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:42.813673  2322 raft_consensus.cc:606] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:42.813966  1673 leader_election.cc:336] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.746s (SENT)
I20260709 13:01:42.811416  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:42.792294  7274 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:42.837412  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:42.815549  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.815114  1701 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:42.841333  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1094) took 2437 ms. Trace:
I20260709 13:01:42.838423  1635 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:42.773283  6992 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:42.845248  1555 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:42.843037  1631 rpcz_store.cc:276] 0709 13:01:40.397323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.404550 (+  7227us) service_pool.cc:224] Handling call
0709 13:01:41.080232 (+675682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.120965 (+ 40733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.834653 (+1713688us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b54002c7ed0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:42.834849 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552948992}
I20260709 13:01:42.799598  7350 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:42.840272  2288 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:42.847458  1704 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:42.796052  7342 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:42.795864  7097 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:42.845610  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:42.851099  2323 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:42.854069  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:42.855886  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:42.848536  1559 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:42.859782  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.865927  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:42.864427  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.866895  1708 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:42.860666  1632 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:01:42.847720  6735 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:42.873086  7379 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:42.873350  7192 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 9 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:42.854249  6780 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:42.815964  7271 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:01:42.876770  1706 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:01:42.869042  2286 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:42.816179  7252 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:01:42.879029  1598 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:42.866011  1560 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:42.879977  1552 raft_consensus.cc:1217] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 11.10->[13.11-13.11]   Dedup: 13.11->[]
I20260709 13:01:42.888100  1552 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:01:42.882246  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 68287.8us
I20260709 13:01:42.883370  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1211) took 2196 ms. Trace:
I20260709 13:01:42.862875  7339 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:42.884076  7179 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:42.888932  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.897758  1555 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:42.843144  7282 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.890960  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:42.897751  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.900178  1559 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:42.914513  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.877146  7097 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:42.878305  7350 raft_consensus.cc:697] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:42.893978  1558 rpcz_store.cc:276] 0709 13:01:40.683178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.689452 (+  6274us) service_pool.cc:224] Handling call
0709 13:01:40.689798 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:40.826290 (+136492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.826324 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:40.839882 (+ 13558us) log.cc:844] Serialized 52 byte log entry
0709 13:01:41.053396 (+213514us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:41.174100 (+120704us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.898139 (+724039us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b18003a3fc0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6912c0a 00007f0ee0052219 00007f0ed699aa40 00007f0ed69954e4 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a8f716 00007f0ed9aa0287 00007f0ed9aa0208
0709 13:01:42.002140 (+104001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.002423 (+   283us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:42.667208 (+664785us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:42.879667 (+212459us) raft_consensus.cc:1685] finished
0709 13:01:42.879699 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.879902 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82152,"prepare.queue_time_us":116934,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":818581,"raft.run_cpu_time_us":609,"raft.run_wall_time_us":41630,"spinlock_wait_cycles":16935040,"thread_start_us":402250,"threads_started":4,"wal-append.queue_time_us":939266}
I20260709 13:01:42.919420  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.851609  6992 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.892241  7356 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:42.929337  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:42.930294  1706 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:42.931440  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 125123us
I20260709 13:01:42.931663  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.932654  1559 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:42.921275  7339 raft_consensus.cc:697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:42.925823  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.914291  7287 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:42.927078  1634 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:42.932507  1675 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:42.918406  7097 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:42.945477  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.922009  7379 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:42.890327  6780 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.852118  7389 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.946162  1560 raft_consensus.cc:2376] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12. Re-sending same reply.
W20260709 13:01:42.955847  1673 leader_election.cc:336] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.617s (SENT)
I20260709 13:01:42.957623  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.956933  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.959046  1559 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:01:42.963508  1673 leader_election.cc:336] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.659s (SENT)
I20260709 13:01:42.964214  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:42.943141  7179 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:42.969551  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.969301  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:42.980073  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.980472  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:42.981108  1558 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:42.982709  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 126847us
I20260709 13:01:42.977681  7405 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:42.985189  7405 raft_consensus.cc:697] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:42.986155  6780 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:42.986601  7405 consensus_queue.cc:237] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:42.987613  7271 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:42.990013  7282 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:42.992564  1708 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:01:42.965802  7368 consensus_meta.cc:287] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.004s
I20260709 13:01:43.009519  1626 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:43.010421  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:43.000720  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:42.984953  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:43.012851  2325 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:43.009255  1551 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:43.014019  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:43.014148  1706 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:43.014707  1551 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:43.015693  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.949196  7287 raft_consensus.cc:697] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:43.017335  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:42.997718  2288 leader_election.cc:400] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12.
I20260709 13:01:43.037971  2288 leader_election.cc:403] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:42.965969  7379 raft_consensus.cc:697] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:43.038792  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:43.038915  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:43.039237  1551 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:43.048098  1706 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:43.050483  1553 raft_consensus.cc:2393] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:43.052301  1555 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:43.054140  2325 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:43.055945  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:42.978261  6735 raft_consensus.cc:697] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:43.061100  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:43.063449  1553 raft_consensus.cc:1813] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Handling vote request from an unknown peer 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:43.065761  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:43.066656  1559 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:01:43.074307  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 90089us
I20260709 13:01:43.074435  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:43.075394  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:43.077558  1553 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:01:43.093101  1673 leader_election.cc:336] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.784s (SENT)
I20260709 13:01:43.094890  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:43.094247  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:43.095774  1551 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:43.020960  7252 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:43.097877  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:43.099186  1555 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:42.995981  7179 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:43.100487  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:43.060854  7067 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.103935  1553 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:43.108419  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:43.073737  7358 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:43.114437  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:43.114717  2288 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:43.093283  7380 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12.
I20260709 13:01:43.022312  7368 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:43.143370  2288 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:43.116175  7395 log.cc:927] Time spent T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:01:43.009127  7350 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:42.981801  7339 consensus_queue.cc:237] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.153590  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:43.153741  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:43.147446  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:43.162772  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:43.121031  7405 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:43.147936  7379 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.155936  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:43.172870  1633 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 17: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:43.169437  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:43.170588  1559 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:43.174227  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:43.175429  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:43.175448  1559 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:43.176226  1632 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 10: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:43.176965  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:43.181073  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 222121us
I20260709 13:01:43.182755  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:43.185619  1555 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:01:43.186194  1627 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:43.130841  7358 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:43.115923  7067 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.199682  1708 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:43.140683  7404 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:43.157183  7402 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:43.170325  7388 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:43.208487  1635 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:43.184728  1675 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:43.187263  6780 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.223138  7274 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:43.239662  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:43.240057  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:43.239758  1705 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:01:43.240815  1673 leader_election.cc:336] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.937s (SENT)
I20260709 13:01:43.241407  1673 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:43.194003  7403 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:43.157390  7389 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
W20260709 13:01:43.217505  7063 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 13:01:43.240567  1559 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:43.146106  7287 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:43.240352  7398 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:01:43.236497  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:43.170882  6735 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.262904  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:43.242249  7282 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:43.208841  7405 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:01:43.249980  6992 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:43.270584  7400 log.cc:927] Time spent T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:01:43.266937  1601 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:43.282598  1708 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:43.274217  2286 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:43.287153  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:43.255574  7388 raft_consensus.cc:697] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:01:43.289074  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 104244us
W20260709 13:01:43.290591  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 51532.9us
I20260709 13:01:43.253254  6780 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:43.311623  1673 leader_election.cc:336] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.982s (SENT)
I20260709 13:01:43.274196  7342 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:43.307067  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:43.312165  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:43.312260  1601 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:43.315062  1631 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:43.257544  7403 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.315917  1553 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:43.259778  7063 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.297214  7326 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:43.308212  7281 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.331892  1673 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:43.312099  7341 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:43.339196  2321 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:43.295262  7282 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:43.313066  7424 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:43.335924  7384 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.762s	user 0.001s	sys 0.013s
W20260709 13:01:43.355432  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.285303  7358 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.338963  7341 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:43.424737  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:43.342607  7424 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:43.429605  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 117317us
I20260709 13:01:43.351011  7179 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:43.333071  7060 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:43.423377  1558 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:43.431416  1601 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:43.418948  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 101915us
I20260709 13:01:43.458513  1675 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:43.353860  7274 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:43.324999  7342 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.456207  2286 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:43.464386  1601 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:43.491585  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.340410  7281 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.507162  7158 raft_consensus.cc:993] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: : Instructing follower e4c78b411eb34b3d92183a86d34a81f1 to start an election
W20260709 13:01:43.507347  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 51226us
I20260709 13:01:43.507781  7158 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:43.521468  7403 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:43.433738  7424 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:43.454459  7060 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:43.454128  7203 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.004s
I20260709 13:01:43.415113  7384 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.466781  7340 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:43.437357  7341 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:43.522969  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:43.337949  7388 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:43.508502  7415 log.cc:927] Time spent T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
I20260709 13:01:43.509696  7067 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:43.518615  7330 raft_consensus.cc:1081] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Signalling peer e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 13:01:43.581744  2328 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
W20260709 13:01:43.597219  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 404164us
I20260709 13:01:43.529373  7060 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:43.600291  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:43.521708  7281 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:43.584471  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 252656us
I20260709 13:01:43.531698  7274 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:43.527218  7158 raft_consensus.cc:697] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:01:43.605276  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 100264us
I20260709 13:01:43.604264  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:43.601715  7067 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:43.606272  6989 raft_consensus.cc:993] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: : Instructing follower 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 13:01:43.613353  1673 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:43.614018  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:43.591315  7203 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 13:01:43.650015  7411 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 13:01:43.590080  7432 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:43.596494  7326 raft_consensus.cc:697] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:43.690354  1601 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:43.700933  1526 connection.cc:256] RPC call timeout handler was delayed by -2.0584080250000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260709 13:01:43.701396  1526 connection.cc:256] RPC call timeout handler was delayed by -2.0449080249999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
W20260709 13:01:43.701709  1526 connection.cc:256] RPC call timeout handler was delayed by -2.031408024999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 13:01:43.651623  7345 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:43.693461  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 233763us
I20260709 13:01:43.693499  1598 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:43.656015  7402 raft_consensus.cc:697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:01:43.689335  7418 log.cc:927] Time spent T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.374s	user 0.000s	sys 0.001s
W20260709 13:01:43.701999  1526 connection.cc:256] RPC call timeout handler was delayed by -1.8901080249999609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 13:01:43.715337  1526 connection.cc:256] RPC call timeout handler was delayed by -1.8514080249999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 13:01:43.716228  1526 connection.cc:256] RPC call timeout handler was delayed by -1.6903080249999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
W20260709 13:01:43.716619  1526 connection.cc:256] RPC call timeout handler was delayed by -1.6714080250000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
W20260709 13:01:43.716950  1526 connection.cc:256] RPC call timeout handler was delayed by -1.6597080249999863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
W20260709 13:01:43.717254  1526 connection.cc:256] RPC call timeout handler was delayed by -1.6516080249999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
W20260709 13:01:43.717581  1526 connection.cc:256] RPC call timeout handler was delayed by -1.5895080249999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
W20260709 13:01:43.717829  1526 connection.cc:256] RPC call timeout handler was delayed by -1.5490080249999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2267s for a response
W20260709 13:01:43.718070  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0423080249999543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28300000000000003s for a response
I20260709 13:01:43.718608  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:43.690537  7179 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:43.703284  1601 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:43.653822  6780 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:43.720299  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 107010us
I20260709 13:01:43.703675  6989 raft_consensus.cc:1081] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Signalling peer 4f6fa2fd61114dc190d8f9b310696e1a to start an election
I20260709 13:01:43.721374  7044 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:43.721626  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:43.722944  1673 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:43.722826  7158 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.731783  1601 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:43.723474  7429 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:43.705713  7345 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.709362  7321 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:43.701457  7439 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:43.736621  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:43.745723  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 131780us
I20260709 13:01:43.735417  7203 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:43.735237  7438 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:43.723977  7281 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:43.719082  7063 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:43.725186  7403 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:43.723030  7402 consensus_queue.cc:237] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.700079  7067 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.701848  7427 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
W20260709 13:01:43.736493  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 84019.4us
W20260709 13:01:43.796710  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 73825us
I20260709 13:01:43.731132  7443 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:43.842337  1673 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:43.844368  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:43.845952  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:43.846890  1630 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:01:43.735417  7282 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:43.850739  1673 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:43.854707  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 136145us
I20260709 13:01:43.842482  7281 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.852727  7437 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.853082  7299 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:43.834545  7445 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:43.851112  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.856197  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:01:43.856458  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 120036us
I20260709 13:01:43.743696  7345 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:43.778669  7097 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.821s	user 0.011s	sys 0.002s
I20260709 13:01:43.870337  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:43.804332  7442 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:43.758647  7384 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:43.840342  7438 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.834785  7262 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:43.757768  7330 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.760084  7321 raft_consensus.cc:697] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:43.883476  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:43.746366  7179 raft_consensus.cc:697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:43.849404  7443 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:43.859364  7281 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:43.855721  6780 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:43.904745  7450 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:43.905413  7450 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.905783  7450 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:43.909236  7423 log.cc:927] Time spent T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.494s	user 0.000s	sys 0.003s
I20260709 13:01:43.877345  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:43.879022  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:43.873911  1703 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:43.878551  7097 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:43.860502  7403 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:43.896749  7448 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.902583  1635 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 13:01:43.923727  1635 pending_rounds.cc:85] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 11
I20260709 13:01:43.924113  1635 pending_rounds.cc:107] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:01:43.924433  1635 raft_consensus.cc:2889] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:43.902992  7262 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.903694  7330 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.904932  7321 consensus_queue.cc:237] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:43.859475  1559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33810
I20260709 13:01:43.933326  1559 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.933827  1559 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:43.861629  7340 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:43.861109  7441 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:43.892151  7443 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:43.887715  7438 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:43.962702  1559 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.872272  7445 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:43.779577  7326 consensus_queue.cc:237] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:43.933698  7067 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:43.861104  7437 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:43.904829  6780 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:43.973974  1559 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:43.973975  1627 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:43.965701  7203 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:43.979638  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 123485us
I20260709 13:01:43.982245  1632 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:01:43.938611  7441 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:43.985443  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:43.989454  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:43.966341  7274 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:01:43.931147  7448 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.006027  7262 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:44.006970  6780 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:44.007911  7436 log.cc:927] Time spent T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:44.004145  7060 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.013042  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3175) took 1159 ms. Trace:
I20260709 13:01:44.014350  7060 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:43.988215  7441 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:44.024430  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:44.013635  1553 rpcz_store.cc:276] 0709 13:01:42.853942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.321862 (+467920us) service_pool.cc:224] Handling call
0709 13:01:43.323945 (+  2083us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.389907 (+ 65962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.450051 (+ 60144us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.450783 (+   732us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.610918 (+160135us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:43.610957 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.611253 (+   296us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.012815 (+401562us) raft_consensus.cc:1685] finished
0709 13:01:44.012835 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.012981 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4671,"raft.queue_time_us":464141,"thread_start_us":149478,"threads_started":1,"wal-append.queue_time_us":407747}
I20260709 13:01:44.056447  1553 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:01:44.058214  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 139973us
I20260709 13:01:44.059551  7464 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:43.986680  7341 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:43.986073  7203 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.072731  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:44.075999  2328 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:44.065708  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:44.067054  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.077276  1557 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:43.984303  7345 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.070776  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:44.073794  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.073910  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1366) took 1146 ms. Trace:
I20260709 13:01:43.982169  7179 consensus_queue.cc:237] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.078197  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:44.080850  1598 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:44.080765  2323 rpcz_store.cc:276] 0709 13:01:42.927510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.927678 (+   168us) service_pool.cc:224] Handling call
0709 13:01:42.943172 (+ 15494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.980416 (+ 37244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.980451 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.980505 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:42.980548 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.073604 (+1093056us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b54008291d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:44.073669 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.073842 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85099904}
I20260709 13:01:44.086251  1553 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:44.092383  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:43.997102  7403 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.091670  7060 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:44.105003  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:44.107257  7460 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:44.108083  7460 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:44.108680  7460 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.111848  7460 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:44.115427  2321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1364) took 1349 ms. Trace:
I20260709 13:01:44.115934  2321 rpcz_store.cc:276] 0709 13:01:42.765845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.765979 (+   134us) service_pool.cc:224] Handling call
0709 13:01:42.766268 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.341274 (+575006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.115126 (+773852us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b5400358254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:44.115347 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316910464}
W20260709 13:01:44.118549  7458 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:01:44.125538  7457 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:01:44.128743  7463 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:44.131006  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33322 (request call id 29) took 1470 ms. Trace:
I20260709 13:01:44.131506  2322 rpcz_store.cc:276] 0709 13:01:42.660756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.660975 (+   219us) service_pool.cc:224] Handling call
0709 13:01:44.130812 (+1469837us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400783a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a7f853 00007f0edea4d60a 00007f0ed7fd37d4 00007f0ed7fd3762 00007f0ed7fd3691 00007f0ed7fd360c 00007f0ed7fd28c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:44.130913 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311032192}
I20260709 13:01:44.133101   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:44.135425   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:44.135525  7368 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:44.136842  7328 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:44.137431  7328 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:44.137693  7341 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:44.138365  7341 consensus_queue.cc:1059] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:44.139900  7432 raft_consensus.cc:3055] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:01:44.141124  2326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 1276) took 2095 ms (client timeout 1622 ms). Trace:
W20260709 13:01:44.141602  2326 rpcz_store.cc:269] 0709 13:01:42.046128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.046291 (+   163us) service_pool.cc:224] Handling call
0709 13:01:44.140808 (+2094517us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54006446d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:44.140999 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581201792}
I20260709 13:01:44.089008  7104 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:44.143245  7104 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:44.143694  7104 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:44.146221  2321 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:44.159772  7448 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:44.160882  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 1102) took 1572 ms (client timeout 2046 ms). Trace:
I20260709 13:01:44.161479  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.163677  7437 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
W20260709 13:01:44.165544  7421 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.579s	user 0.006s	sys 0.000s
I20260709 13:01:44.166060  7345 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:44.078812  7464 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.140304  7432 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:44.148128  7281 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.106063  1553 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:44.161298  1634 rpcz_store.cc:269] 0709 13:01:42.588542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.588690 (+   148us) service_pool.cc:224] Handling call
0709 13:01:44.160684 (+1571994us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54000da7d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:44.160825 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774098176}
W20260709 13:01:44.168402  7420 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.474s	user 0.000s	sys 0.003s
W20260709 13:01:44.178663  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 90459.2us
I20260709 13:01:44.171566  7330 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:44.183311  7432 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.184820  7432 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:44.184959  7450 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.188174  7464 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:44.189934  7203 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:44.198308  7424 consensus_meta.cc:287] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.000s
I20260709 13:01:44.199059  7424 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.180534  7448 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:01:44.179785  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:44.219429  1559 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:01:44.220803  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 231460us
I20260709 13:01:44.221753  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:44.224949  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:44.225764  1554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2542) took 1938 ms (client timeout 1945 ms). Trace:
W20260709 13:01:44.226125  1554 rpcz_store.cc:269] 0709 13:01:42.287254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.301892 (+ 14638us) service_pool.cc:224] Handling call
0709 13:01:44.224730 (+1922838us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b5800002798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 13:01:44.225704 (+   974us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31148800}
I20260709 13:01:44.228461  1635 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:01:44.229979  1673 leader_election.cc:336] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.650s (SENT)
I20260709 13:01:44.219326  2321 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
W20260709 13:01:44.232553  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 53193.8us
I20260709 13:01:44.234416  1553 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:44.237277  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:44.253822  1554 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:44.252741  1599 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:44.262012  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:44.262544  1599 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:44.235548  7448 consensus_queue.cc:1059] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:01:44.266218  1557 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:44.265403  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:44.251478  7343 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:44.269023  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.255441  7183 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:44.271090  7183 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.271492  7183 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.268198  7318 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:44.272079  7443 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.272847  7318 raft_consensus.cc:697] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:44.273746  7318 consensus_queue.cc:237] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.263672  7350 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:01:44.277586  7104 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.277693  7328 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.255594  7341 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:01:44.289469  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:44.281549  7281 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:44.272122  7448 raft_consensus.cc:3055] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:44.271025  7464 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:44.289289  1554 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:44.290369  2322 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:44.291725  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:44.293056  7438 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.303490  7345 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:44.293402  7448 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:44.304320  7345 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.305236  7448 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.306555  7448 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.307559  7345 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:44.303701  7438 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:44.313840  7441 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.289659  7443 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:44.295552  7424 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:44.319442  7328 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:44.268689  7203 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:44.320210  7203 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.319478  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:44.320665  7203 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.295073  7450 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:44.295017  7299 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:44.329254  1599 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:44.330827  2322 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:44.331262  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:44.331890  1553 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:44.334497  1598 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:44.334615  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 66740.3us
W20260709 13:01:44.326339  7467 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:01:44.318564  7441 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:44.346107  1526 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:44.333047  7328 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:44.352535  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:44.355803  7203 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.341689  7281 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.343096  7299 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:44.359431  7342 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:44.359934  7464 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:44.359953  7463 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:44.333724  7438 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:44.343773  7262 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:44.382077  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:44.388460  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:44.380926  1553 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:01:44.382674  7450 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:44.389113  2322 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:44.383283  7379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.003s	sys 0.013s
I20260709 13:01:44.390966  2286 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:44.385284  7463 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.385658  7438 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.391342  1526 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:44.344420  6780 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:01:44.422504  7389 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:44.423297  7389 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:44.408092  7438 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:44.386458  7104 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:44.394959  7379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.003s	sys 0.013s
I20260709 13:01:44.394181  7464 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:44.415408  2322 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:44.382340  7281 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.418272  7465 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:44.419502  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:44.394129  7262 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:44.383744  7299 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.403921  7424 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:44.384773  7183 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.440989  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:44.454995  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:44.461047  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:44.461328  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:44.461366  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:44.441032  7340 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.469669  2325 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:01:44.447079  7343 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:44.471714  1598 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:44.452122  7104 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.473457  2325 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:44.473990  2326 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:44.453976  7357 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.478432  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:44.462882  7464 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:44.439489  7465 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:44.483315  2323 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:44.424171  7389 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.488377  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:44.463207  7424 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:44.490630  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:44.494196  2326 raft_consensus.cc:1813] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Handling vote request from an unknown peer 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:44.467028  7460 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:01:44.494876  2326 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:01:44.452919  7346 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:01:44.475172  7340 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:44.492053  7465 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:44.504722  2324 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:01:44.506196  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 46906.7us
I20260709 13:01:44.490939  7466 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:44.514735  1634 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:44.515960  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:44.503247  7460 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:01:44.483942  7104 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.491134  7357 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.533679  1634 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:44.509886  7389 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:44.531908  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:44.534924  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:44.539294  1634 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:44.510022  7203 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:44.543085  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:44.544389  2326 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:44.540565  2324 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:44.539491  1627 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:44.546000  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:44.547935  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:44.548916  1633 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:44.553488  2322 raft_consensus.cc:2376] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17. Re-sending same reply.
I20260709 13:01:44.539994  7447 raft_consensus.cc:993] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: : Instructing follower e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 13:01:44.540115  7477 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.564900  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:44.496930  7262 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.540349  7346 raft_consensus.cc:3055] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:44.562562  7466 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:44.559648  7463 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:44.567957  7472 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:01:44.579361  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:44.591271  1556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 1213) took 3902 ms (client timeout 1671 ms). Trace:
I20260709 13:01:44.591491  1634 raft_consensus.cc:2410] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:44.566610  7385 raft_consensus.cc:1081] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Signalling peer e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 13:01:44.586180  1560 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:44.586114  1672 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:44.591681  1556 rpcz_store.cc:269] 0709 13:01:40.683810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.684247 (+   437us) service_pool.cc:224] Handling call
0709 13:01:44.585553 (+3901306us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000578d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:44.585725 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2716381440}
I20260709 13:01:44.594213  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:44.585486  2326 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:44.586969  1702 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:01:44.588073  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2519) took 2452 ms. Trace:
W20260709 13:01:44.592337  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.595712  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3091) took 1794 ms. Trace:
I20260709 13:01:44.596015  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.596729  1554 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:44.596299  1702 rpcz_store.cc:276] 0709 13:01:42.801908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.802094 (+   186us) service_pool.cc:224] Handling call
0709 13:01:42.802452 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.586790 (+1784338us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b540039e020. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed99fcdc0 00007f0ed9a871c0 00007f0ed9a88231 00007f0ed9a84d8f 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c
0709 13:01:44.595297 (+  8507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.595633 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71662464}
I20260709 13:01:44.570499  7346 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:44.595726  1552 rpcz_store.cc:276] 0709 13:01:42.135595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.135800 (+   205us) service_pool.cc:224] Handling call
0709 13:01:42.879867 (+744067us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.890275 (+ 10408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.587854 (+1697579us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54000b7cd0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:44.588004 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1666849024}
I20260709 13:01:44.608032  7152 consensus_queue.cc:1059] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:44.585158  7306 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.600728  7443 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:44.614279  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:44.615023  1556 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.614282  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.609259  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:44.590595  7281 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:44.616485  2323 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.595160  7183 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:44.609714  7429 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:01:44.590961  7179 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:01:44.603580  7299 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:44.606765  7340 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:01:44.567004  7424 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.590169  7342 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:01:44.593300  7441 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:01:44.595420  7460 consensus_queue.cc:1059] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:01:44.632741  2324 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:44.625558  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.633469  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:44.639274  7438 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.645200  7357 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:44.645471  7445 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:44.646132  7104 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:44.602337  7486 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:01:44.647544  7342 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:44.647980  7342 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:44.648850  7342 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.650501  7342 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:44.613525  7437 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:01:44.653237  7437 raft_consensus.cc:3055] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:01:44.653566  7479 log.cc:927] Time spent T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:01:44.653635  7437 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:44.620666  7152 consensus_queue.cc:1243] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:44.657301  2323 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
W20260709 13:01:44.657917  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 159146us
W20260709 13:01:44.660234  1673 leader_election.cc:336] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.836s (SENT)
I20260709 13:01:44.593379  7483 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:01:44.660750  1673 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:44.605520  7345 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:01:44.625929  7481 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:44.666114  1556 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:44.667097  1553 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:01:44.670617  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 76491.3us
I20260709 13:01:44.672147  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:44.673103  7448 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:44.673427  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:44.673641  7448 raft_consensus.cc:697] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:44.674081  2323 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:44.672426  7262 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:44.674690  7448 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.675231  7262 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.678226  7262 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:44.679378  1598 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:44.680317  7262 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:44.680723  7262 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.681082  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:44.682979  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.681089  7262 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:44.669297  7445 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:44.669166  7299 raft_consensus.cc:3055] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:44.569949  7477 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.619402  7306 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.681690  7441 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:44.696538  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.698058  1553 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:44.698117  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.635473  7466 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:44.700417  7484 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:01:44.702512  1557 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:44.694483  7299 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:44.703809  7299 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.705044  7299 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:44.692025  7486 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:44.719121  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:44.717913  7486 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.733490  1554 raft_consensus.cc:1275] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:44.741616  2321 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:01:44.745815  1634 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:01:44.745153  1673 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:44.693692  7437 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.740733  7306 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:44.757555  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:44.758284  1554 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:44.741269  7357 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:01:44.754923  7441 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:44.762427  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:44.764698  1634 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 15: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:44.754933  7488 consensus_queue.cc:1059] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:01:44.766271  7486 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:44.773487  7464 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:44.759259  7438 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:44.783758  6544 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:44.784704  7487 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:01:44.784353  6544 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.765853  7441 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.786150  7441 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.788075  6544 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:44.778329  7493 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:44.778649  7437 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:44.811340  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.811467  1554 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
W20260709 13:01:44.813400  7489 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:01:44.794149  7483 raft_consensus.cc:3055] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:44.829241  7493 raft_consensus.cc:697] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:44.830353  7493 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.832907  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.834165  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.837247  1554 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:01:44.837699  2323 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:44.838231  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:44.838804  1702 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:44.839684  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:44.840898  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:44.841495  1628 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:44.846659  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:44.846714  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.820434  7483 raft_consensus.cc:740] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:44.849562  7477 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:44.850184  7483 consensus_queue.cc:260] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:44.851655  7483 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:44.855520  1702 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
W20260709 13:01:44.818714  7428 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 1.366s	user 0.002s	sys 0.000s
I20260709 13:01:44.871174  1628 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:44.874056  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:44.875574  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:44.819279  7488 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:44.877722  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:44.877805  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:44.885794  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:44.779481  7460 consensus_queue.cc:1059] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:01:44.889084  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:44.889730  1554 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:44.892756  1628 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:01:44.894392  1632 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:44.895603  1632 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:44.899266  1554 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:44.900502  1702 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:44.900712  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.901465  1554 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:44.799008  7465 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.905550  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:44.879472  7488 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:44.903656  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:44.909231  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64734.5us
I20260709 13:01:44.902298  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:44.904686  1629 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:44.902021  2325 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:44.906198  1702 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
W20260709 13:01:44.907655  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 68203us
W20260709 13:01:44.908159  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 103818us
I20260709 13:01:44.909916  1706 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:01:44.911762  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.914914  1632 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:44.916055  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:44.911155  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:44.917572  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:44.919200  1709 raft_consensus.cc:3055] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:44.919603  1709 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:44.920271  1558 raft_consensus.cc:2393] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 10: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:44.921743  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:44.922127  7339 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:44.922566  7339 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:44.922992  7339 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:44.923177  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:44.923550  7385 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:44.924444  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:44.927714  1704 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:44.927945  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:44.929201  1554 raft_consensus.cc:2376] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17. Re-sending same reply.
I20260709 13:01:44.930154  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.931397  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:44.926220  1632 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:01:44.936813  1554 raft_consensus.cc:2393] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:44.929538  1709 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.939575  1709 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.916451  7368 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:44.942481  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:44.950685  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:44.953145  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3098) took 2092 ms. Trace:
I20260709 13:01:44.953888  1701 rpcz_store.cc:276] 0709 13:01:42.860995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.861183 (+   188us) service_pool.cc:224] Handling call
0709 13:01:42.877574 (+ 16391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.893086 (+ 15512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.893123 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.893167 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:42.893199 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.952878 (+2059679us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b5400265f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:44.952949 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.953072 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34682752}
I20260709 13:01:44.910939  7486 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:01:44.932680  7385 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:44.964547  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:44.937299  7450 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:45.036091  7372 consensus_queue.cc:1059] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:01:45.044691  7450 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:45.047381  7450 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:45.141100  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.051828  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:45.105538  1526 leader_election.cc:336] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.928s (SENT)
W20260709 13:01:45.156615  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.162184  2328 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:45.158341  1554 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:01:45.187253  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:45.188194  1632 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:45.190596  1554 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:45.156075  1709 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:45.037329  6544 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.078790  7262 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:44.950745  7368 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:45.219408  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.218012  1632 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:01:45.238041  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:45.157569  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:45.036705  7385 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:45.077643  7486 consensus_queue.cc:1243] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:01:45.221679  7434 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:01:45.143579  7450 raft_consensus.cc:3055] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:45.249974  7424 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:45.250360  7442 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:45.249578  2288 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:45.257109  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 151599us
I20260709 13:01:45.267848  1634 raft_consensus.cc:2368] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 15. Current term is 16.
I20260709 13:01:45.249498  6544 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:45.284282  6544 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:45.285458  7406 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 1.759s	user 0.004s	sys 0.009s
I20260709 13:01:45.275628  7097 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:45.289610  7431 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.556s	user 0.007s	sys 0.002s
I20260709 13:01:45.290028  7368 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:45.292382  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1113) took 2133 ms. Trace:
I20260709 13:01:45.293838  7262 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:45.292851  1626 rpcz_store.cc:276] 0709 13:01:43.159302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.167726 (+  8424us) service_pool.cc:224] Handling call
0709 13:01:43.168198 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.183759 (+ 15561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.183794 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.195922 (+ 12128us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.415847 (+219925us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:01:43.472136 (+ 56289us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.744959 (+272823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.745051 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.288827 (+1543776us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:45.292048 (+  3221us) raft_consensus.cc:1685] finished
0709 13:01:45.292173 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.292317 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1991,"prepare.queue_time_us":49149,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":8385,"raft.queue_time_us":103288,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":8260,"spinlock_wait_cycles":95308032,"thread_start_us":375636,"threads_started":2,"wal-append.queue_time_us":411219}
I20260709 13:01:45.303215  7454 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.303846  7454 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:45.305848  7346 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:45.306926  7454 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:45.309849  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 60367.4us
I20260709 13:01:45.310689  2288 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:45.315281  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:45.317337  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:45.317986  1626 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:45.320573  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:45.331723  1626 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:45.319379  6780 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:45.336656  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3087) took 2534 ms. Trace:
I20260709 13:01:45.270675  7450 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:45.335918  1526 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:45.337090  1707 rpcz_store.cc:276] 0709 13:01:42.798728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.800737 (+  2009us) service_pool.cc:224] Handling call
0709 13:01:42.801321 (+   584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.862774 (+ 61453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.862804 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:42.886547 (+ 23743us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.042605 (+156058us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:43.042646 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.825754 (+1783108us) spinlock_profiling.cc:243] Waited 61.1 ms on lock 0x7b54002f2454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:44.825816 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.284621 (+458805us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:45.332790 (+ 48169us) raft_consensus.cc:1685] finished
0709 13:01:45.332812 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.332980 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10529,"raft.queue_time_us":4215,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7918,"spinlock_wait_cycles":150587008,"thread_start_us":121231,"threads_started":1,"wal-append.queue_time_us":488765}
I20260709 13:01:45.339349  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.340639  1701 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:45.341626  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.342877  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:45.343583  1701 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:45.344084  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.344827  1707 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:45.323704  7454 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:45.325512  7067 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:45.346166  1700 raft_consensus.cc:2393] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:45.348476  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:45.350953  1709 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:45.351336  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.349246  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:45.352061  1700 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:45.352442  1701 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:45.353902  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.354650  1704 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:45.328431  7447 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:45.355557  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:45.356125  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.356922  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.360802  1707 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:45.362666  1626 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:45.368217  1626 raft_consensus.cc:1240] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:45.377449  1705 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 17: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:45.365998  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.379798  1700 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:45.336827  6780 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:45.383210  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.378413  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:45.383903  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.341640  7271 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:45.326229  7368 consensus_queue.cc:1059] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:01:45.387276  1709 raft_consensus.cc:2393] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:45.381479  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:45.388181  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.353377  7493 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:45.390545  1705 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:45.393374  1700 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:45.393805  1701 raft_consensus.cc:2393] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 9: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:45.335348  7335 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260709 13:01:45.553334  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 62116.2us
I20260709 13:01:45.396309  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:45.428646  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.567173  1704 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 17: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:45.429520  1707 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:45.377985  7067 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:45.391256  6780 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:45.612048  1709 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:45.621487  1707 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:44.958244  7488 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:45.398275  7271 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:45.569619  7410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.033s	sys 0.078s
I20260709 13:01:45.600140  7325 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:45.634562  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.389948  7450 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:45.621503  7493 raft_consensus.cc:697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:01:45.633313  7410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.033s	sys 0.079s
I20260709 13:01:45.641474  1709 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:45.630044  7262 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.645839  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:45.655681  1626 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:45.640051  7325 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:45.716369  1598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.021s	sys 0.033s
I20260709 13:01:45.694469  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:45.748693  1598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.030s	sys 0.033s
I20260709 13:01:45.704506  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2685) took 1733 ms. Trace:
I20260709 13:01:45.749436  1635 rpcz_store.cc:276] 0709 13:01:43.970878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.971965 (+  1087us) service_pool.cc:224] Handling call
0709 13:01:43.977037 (+  5072us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.229420 (+252383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.703902 (+1474482us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54000e7254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:45.704312 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577351040}
W20260709 13:01:45.707855  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.690090  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.759179  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.647394  7442 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.656104  7342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.015s	sys 0.030s
I20260709 13:01:45.762609  7504 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:45.808921  1632 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.042s	sys 0.080s
W20260709 13:01:45.809430  1632 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.042s	sys 0.080s
I20260709 13:01:45.766935  1704 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:01:45.816107  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.675745  7483 consensus_meta.cc:287] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.824s	user 0.013s	sys 0.000s
I20260709 13:01:45.775314  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.782706  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:45.797920  7271 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:45.799551  7325 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:45.803951  7385 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.534s	user 0.005s	sys 0.001s
I20260709 13:01:45.807065  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1249) took 1747 ms. Trace:
I20260709 13:01:45.829375  1560 rpcz_store.cc:276] 0709 13:01:44.059846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.114169 (+ 54323us) service_pool.cc:224] Handling call
0709 13:01:44.585692 (+471523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.593976 (+  8284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.806865 (+1212889us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54000578d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:45.807004 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083604224}
I20260709 13:01:45.830030  1707 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:45.807814  7437 consensus_meta.cc:287] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.987s	user 0.000s	sys 0.009s
W20260709 13:01:45.771193  7441 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.984s	user 0.011s	sys 0.000s
I20260709 13:01:45.812904  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.836304  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:45.837453  1701 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:45.675140  7097 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.838052  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:45.838804  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:45.839672  1560 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:01:45.675621  7481 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:45.836479  1704 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:45.657907  7067 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:45.675364  7430 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.841946  1554 raft_consensus.cc:1275] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:01:45.846431  1554 pending_rounds.cc:85] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 5
I20260709 13:01:45.846692  1554 pending_rounds.cc:107] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:01:45.846911  1554 raft_consensus.cc:2889] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:45.846942  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:45.658098  7492 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.848028  1701 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:45.858064  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.760258  6989 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:45.784276  7342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.015s	sys 0.031s
I20260709 13:01:45.853971  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.651895  7262 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:45.886605  1701 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:45.888924  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.774003  7442 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:45.897154  1705 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:45.827147  7384 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:01:45.898217  1707 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:01:45.899858  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.894258  1704 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:01:45.902438  1701 raft_consensus.cc:2393] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:45.903420  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.904392  1700 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:45.846520  7097 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:45.844153  7441 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:45.845225  7325 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:01:45.843526  7403 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
W20260709 13:01:45.900244  7414 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 2.637s	user 0.011s	sys 0.026s
I20260709 13:01:45.817817  7493 consensus_queue.cc:237] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:45.839107  7385 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:45.881496  7430 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:45.919145  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.916421  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:45.828850  7504 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:45.932870  1705 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:45.915653  7356 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:45.930181  1701 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:01:45.881686  7492 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:45.848846  7481 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:45.891124  6989 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:45.937136  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 178213us
I20260709 13:01:45.944999  1701 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:01:45.946615  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:45.932598  7323 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.954141  7162 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:45.935600  7437 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.936471  7413 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.965706  1700 raft_consensus.cc:3055] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:45.935331  7483 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.950738  7342 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:45.953855  7345 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.970892  1700 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:45.971910  2286 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:45.958357  7410 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:45.965162  7252 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.989713  7252 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:45.976884  7345 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:45.977315  7097 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:45.970709  7162 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:45.992817  7413 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:45.994918  7162 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:45.978559  7271 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:45.995461  7413 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:45.996079  7271 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:45.996629  7271 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.000900  7492 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:45.979926  7385 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:46.005309  7385 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:46.005915  7385 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.006244  7441 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:46.006502  7385 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:45.974586  1700 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.007624  1700 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:45.981745  7342 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:45.966559  7323 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:45.985212  7507 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:01:45.985176  7262 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:45.987762  7339 consensus_meta.cc:287] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.064s	user 0.006s	sys 0.006s
I20260709 13:01:45.988998  6989 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:46.005366  7426 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 2.413s	user 0.000s	sys 0.011s
I20260709 13:01:45.980386  7483 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.004390  7504 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:45.992836  7345 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:46.012742  7097 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:01:46.013888  7410 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:45.973824  7384 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:01:45.973067  7437 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.071846  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.085230  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.095777  1700 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:46.077622  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3162) took 3465 ms. Trace:
I20260709 13:01:46.130824  1551 rpcz_store.cc:276] 0709 13:01:42.612379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.099292 (+486913us) service_pool.cc:224] Handling call
0709 13:01:43.116371 (+ 17079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.228096 (+111725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.228168 (+    72us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.229334 (+  1166us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.252734 (+ 23400us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:43.252794 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.252899 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.955525 (+2702626us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:46.077307 (+121782us) raft_consensus.cc:1685] finished
0709 13:01:46.077329 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.077559 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1551789,"raft.queue_time_us":224986,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":1473656,"spinlock_wait_cycles":428917120,"thread_start_us":133687,"threads_started":2,"wal-append.queue_time_us":236610}
I20260709 13:01:46.110587  2329 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:46.068017  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:46.139689  1555 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:46.093624  2326 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:01:46.125629  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 1274) took 1646 ms. Trace:
I20260709 13:01:46.125488  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.126960  7323 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:46.127229  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 3203) took 1340 ms. Trace:
W20260709 13:01:46.127697  7454 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.772s	user 0.006s	sys 0.004s
I20260709 13:01:46.147029  1558 rpcz_store.cc:276] 0709 13:01:44.787178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.846464 (+ 59286us) service_pool.cc:224] Handling call
0709 13:01:46.126991 (+1280527us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b54002292d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:46.127148 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159751424}
I20260709 13:01:46.148780  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:46.150574  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:46.151710  1558 raft_consensus.cc:2410] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 18 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 6.
W20260709 13:01:46.128558  6780 consensus_meta.cc:287] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.001s
I20260709 13:01:46.129889  7271 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:46.144690  2326 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:46.135804  1523 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:46.140708  2325 rpcz_store.cc:276] 0709 13:01:44.479765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.480791 (+  1026us) service_pool.cc:224] Handling call
0709 13:01:44.481220 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.910393 (+429173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.125389 (+1214996us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b5400107554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:46.125564 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":967226112}
I20260709 13:01:46.058691  7483 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.154063  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:46.157734  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.159464  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:46.160226  2329 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:46.153846  7454 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:46.163658  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:46.166235  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.166554  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.081874  7342 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:46.061296  7343 raft_consensus.cc:3055] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:46.077046  7481 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:46.057302  7430 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.082566  7442 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.170624  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.064011  7465 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.124439  7389 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:46.175905  7271 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:46.177821  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.178480  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:46.179324  1558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33810
I20260709 13:01:46.204725  1558 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:46.205363  1558 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:46.016850  7339 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.181041  1706 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
W20260709 13:01:46.183161  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 47423.8us
I20260709 13:01:46.186369  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.191406  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.210853  2322 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 18: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:46.210780  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:46.210567  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 372516us
I20260709 13:01:46.211623  1706 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:46.187037  7441 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.195081  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.173134  7323 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.219867  7323 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.222313  7323 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.196417  1700 raft_consensus.cc:2410] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:46.222998  7339 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:46.197397  7345 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:01:46.225337  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.225796  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2582) took 1422 ms. Trace:
I20260709 13:01:46.202783  1702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e"
dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:39868
I20260709 13:01:46.226159  1554 rpcz_store.cc:276] 0709 13:01:44.803144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.191673 (+388529us) service_pool.cc:224] Handling call
0709 13:01:45.192024 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.847604 (+655580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.225574 (+377970us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54001c89d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:46.225741 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493508352}
I20260709 13:01:46.226887  1702 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:46.227274  1702 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:46.228114  1559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 3179) took 2315 ms (client timeout 1991 ms). Trace:
W20260709 13:01:46.228508  1559 rpcz_store.cc:269] 0709 13:01:43.913021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.985194 (+ 72173us) service_pool.cc:224] Handling call
0709 13:01:46.227894 (+2242700us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54001c8ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:46.228026 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535887232}
I20260709 13:01:46.229990  1559 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:46.207713  1707 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:46.235309  1559 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:46.196264  7343 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:46.213184  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.235817  1702 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.190220  7483 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:46.169859  6780 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.218125  7465 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:46.249866  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.219022  7403 consensus_queue.cc:1059] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:46.223014  2324 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:46.250761  1700 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:46.251847  1703 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:46.225320  7501 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:01:46.176473  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 229900us
W20260709 13:01:46.236605  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:46.257248  1675 connection.cc:256] RPC call timeout handler was delayed by -1.0904000190000147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260709 13:01:46.209067  1704 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:46.258778  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.238334  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.238924  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:46.259450  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 1087) took 3090 ms (client timeout 1904 ms). Trace:
I20260709 13:01:46.194835  1555 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
W20260709 13:01:46.260028  1708 rpcz_store.cc:269] 0709 13:01:43.160398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.182472 (+ 22074us) service_pool.cc:224] Handling call
0709 13:01:46.250204 (+3067732us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b54003f2854. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:46.250510 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36456320}
I20260709 13:01:46.245502  1559 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:46.248839  1706 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:46.259837  1701 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:46.254411  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1263) took 1001 ms. Trace:
I20260709 13:01:46.263083  1551 rpcz_store.cc:276] 0709 13:01:45.253131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.217729 (+964598us) service_pool.cc:224] Handling call
0709 13:01:46.253915 (+ 36186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.254107 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:46.254132 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.254173 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:46.254204 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.254254 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.254354 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.268392  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.269078  1560 raft_consensus.cc:1240] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:46.269148  1700 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:46.270042  1673 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:46.272814  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.274541  2329 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:46.208544  7342 consensus_queue.cc:1059] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:01:46.255035  7465 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.276062  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.276999  1706 raft_consensus.cc:2410] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:46.276189  1707 raft_consensus.cc:1240] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:46.242801  7287 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:46.255784  7483 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:46.243815  7330 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:01:46.283339  2320 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:46.286522  1599 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.672s (SENT) [suppressed 46 similar messages]
I20260709 13:01:46.296919  7343 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:46.298132  7343 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:46.281342  7437 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.208863  7389 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.294559  1702 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.312309  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.312964  1707 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:46.284397  7516 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.283262  7483 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.317982  7516 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.281816  7287 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.285563  7424 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:01:46.285352  7384 raft_consensus.cc:3055] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:46.324903  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.325155  7384 raft_consensus.cc:740] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:01:46.326076  2321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 1280) took 1876 ms (client timeout 1879 ms). Trace:
W20260709 13:01:46.326514  2321 rpcz_store.cc:269] 0709 13:01:44.449260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.449409 (+   149us) service_pool.cc:224] Handling call
0709 13:01:46.325905 (+1876496us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400729054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:46.326018 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609355904}
I20260709 13:01:46.285102  7403 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:46.327586  7403 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.329749  7403 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:46.311163  7414 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:01:46.332959  1707 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:46.333271  6780 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:46.239111  7441 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.335091  7389 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:46.336031  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 66066.4us
I20260709 13:01:46.336149  7441 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.336853  7441 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:46.337353  7441 raft_consensus.cc:697] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:46.326316  7384 consensus_queue.cc:260] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.338328  7441 consensus_queue.cc:237] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:46.339359  7384 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:46.340687  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:46.340950  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 68755us
I20260709 13:01:46.342310  1675 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:46.342411  7342 consensus_queue.cc:1059] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:46.343485  1675 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:46.343415  7342 raft_consensus.cc:3055] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:46.344137  7342 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:46.344861  7437 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:46.345615  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1099) took 1461 ms. Trace:
I20260709 13:01:46.345772  7518 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:46.346393  1703 rpcz_store.cc:276] 0709 13:01:44.884434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.884647 (+   213us) service_pool.cc:224] Handling call
0709 13:01:46.251541 (+1366894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.252289 (+   748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.345389 (+ 93100us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003f2850. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:46.345537 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3106116992}
I20260709 13:01:46.348556  7323 consensus_queue.cc:1059] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:46.349373  7323 consensus_queue.cc:1243] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer 8106dfc0bda54df0ae10ba13c28ccc18 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:46.349421  7493 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.344789  7162 consensus_queue.cc:1059] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:46.350394  7162 raft_consensus.cc:3055] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:46.350016  7493 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.350751  7162 raft_consensus.cc:740] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:46.351537  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:46.352166  1552 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:01:46.351753  7162 consensus_queue.cc:260] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:46.345063  7413 raft_consensus.cc:3055] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:46.354620  7413 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:46.353523  7342 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.353014  7493 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.333884  1706 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:46.358731  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.360771  1675 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:46.361186  1599 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:46.362706  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.366168  1700 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:46.369630  1675 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:46.373901  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.379896  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.373899  1599 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:46.409813  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:46.320442  7516 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:46.371627  7345 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:01:46.417613  7517 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.385706  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:46.418203  7517 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.419269  7346 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:46.419456  1552 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:01:46.420157  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1269) took 1078 ms. Trace:
I20260709 13:01:46.386072  6962 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:46.420454  1552 rpcz_store.cc:276] 0709 13:01:45.341519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.418855 (+1077336us) service_pool.cc:224] Handling call
0709 13:01:46.419142 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.419911 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.420103 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.386154  7477 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:46.387639  7445 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:46.387846  7225 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:46.388404  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:46.427958  2321 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:46.405862  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.372098  1701 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:46.382289  7097 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:46.394878  7342 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:46.432473  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1117) took 2588 ms. Trace:
I20260709 13:01:46.432947  1631 rpcz_store.cc:276] 0709 13:01:43.843693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.843855 (+   162us) service_pool.cc:224] Handling call
0709 13:01:43.844313 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.859372 (+ 15059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.859401 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.859939 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.976062 (+2116123us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b180040c120. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:01:46.240868 (+264806us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:46.241446 (+   578us) log.cc:844] Serialized 14 byte log entry
0709 13:01:46.241722 (+   276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.241843 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:46.431790 (+189947us) raft_consensus.cc:1685] finished
0709 13:01:46.432263 (+   473us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.432408 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14547,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":5485,"raft.queue_time_us":14758,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":17503,"spinlock_wait_cycles":2520576,"thread_start_us":264569,"threads_started":1,"wal-append.queue_time_us":2512913}
I20260709 13:01:46.392796  7162 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.401896  1558 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.370852  7518 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:46.423532  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1270) took 1070 ms. Trace:
I20260709 13:01:46.442981  1552 rpcz_store.cc:276] 0709 13:01:45.353602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.422818 (+1069216us) service_pool.cc:224] Handling call
0709 13:01:46.423079 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.423220 (+   141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.423244 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.423283 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:46.423314 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.423364 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.423470 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.445518  1552 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:46.447124  1552 raft_consensus.cc:1275] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:46.429670  1707 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:46.430889  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.404762  7389 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.452710  7389 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.454984  7389 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:46.280223  7385 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.439689  7343 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.456118  7343 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:46.458520  7385 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:46.459035  7343 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:46.459903  1701 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:46.424365  7282 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:46.467288  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.472518  1558 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.476500  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.477329  2327 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:46.478164  7358 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:46.478789  1672 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:01:46.475965  7447 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.006s	sys 0.010s
W20260709 13:01:46.480165  7447 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.006s	sys 0.010s
I20260709 13:01:46.481360  1552 raft_consensus.cc:1240] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:46.483701  1630 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:01:46.484305  1552 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:46.488055  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.495090  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:33810 (request call id 1261) took 1244 ms. Trace:
I20260709 13:01:46.495816  1558 rpcz_store.cc:276] 0709 13:01:45.229007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.179155 (+950148us) service_pool.cc:224] Handling call
0709 13:01:46.473181 (+294026us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:46.510803  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 251244us
I20260709 13:01:46.511202  1552 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:46.405948  7413 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:46.431216  7445 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.468969  7517 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.552520  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.554571  6780 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:46.557123  7445 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.545433  7385 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:01:46.478768  7358 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.566985  7358 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.571836  7389 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:01:46.574823  7516 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:46.542322  7447 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:01:46.437837  7225 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:46.584879  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.486083  7518 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:01:46.607230  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:46.607956  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 198160us
W20260709 13:01:46.599520  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 229950us
I20260709 13:01:46.601070  2321 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:01:46.618265  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:46.624045  1701 raft_consensus.cc:2410] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:46.598788  7517 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.635715  1706 raft_consensus.cc:1275] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:01:46.644732  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 166019us
I20260709 13:01:46.646687  1672 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:46.647797  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.655256  7504 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:46.635288  7097 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:46.644047  7345 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:46.643370  7271 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:46.671386  1704 raft_consensus.cc:1275] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:46.646449  7447 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:46.681124  7483 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.683830  7483 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:46.686287  7483 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:46.689020  7523 log.cc:927] Time spent T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:01:46.640066  7517 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.675771  7345 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.702826  7442 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:46.703406  7442 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.703754  7225 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.705433  7287 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.705837  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.706624  1706 raft_consensus.cc:2410] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:01:46.710937  1553 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:46.712257  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.712489  7531 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:46.712750  2321 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
I20260709 13:01:46.713111  2327 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:46.713464  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1258) took 2315 ms. Trace:
I20260709 13:01:46.713896  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.714036  7343 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.715126  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.714759  7343 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.716652  6962 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:46.717332  6962 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.719508  7299 raft_consensus.cc:3055] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:46.719617  6962 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.720057  7299 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:46.719937  7537 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:01:46.721727  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.722436  1598 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:46.722958  7252 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.681386  7271 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.725224  7097 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:46.737702  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:46.738545  7503 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.979s	user 0.005s	sys 0.000s
I20260709 13:01:46.725828  6962 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:01:46.744424  7522 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:46.726948  7183 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:01:46.691995  7532 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:46.713912  1553 rpcz_store.cc:276] 0709 13:01:44.397766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.698792 (+301026us) service_pool.cc:224] Handling call
0709 13:01:44.713479 (+ 14687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.711518 (+1998039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.713233 (+  1715us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b540017f7d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:46.713396 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4592141696}
I20260709 13:01:46.729446  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.730525  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.702147  7345 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:46.761780  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 128369us
I20260709 13:01:46.762907  1599 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:46.751947  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 133765us
I20260709 13:01:46.656739  7282 raft_consensus.cc:697] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:46.757827  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.774417  2321 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:46.729075  7533 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.724574  7252 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:46.691695  7447 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.705394  7442 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.786135  1701 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:01:46.753057  6962 raft_consensus.cc:697] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:46.787609  1701 pending_rounds.cc:85] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 10
I20260709 13:01:46.798445  1701 pending_rounds.cc:107] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:01:46.800549  7342 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:46.801426  7342 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.803457  7424 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.804011  7424 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.806567  7424 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:46.806404  6962 consensus_queue.cc:237] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:46.809440  7514 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.606s	user 0.003s	sys 0.000s
I20260709 13:01:46.788069  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:46.816079  7444 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:46.817487  7271 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.819027  7488 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:46.817445  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:46.821134  7465 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.822012  7321 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:46.822431  7321 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:46.822819  7321 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.823186  7271 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:46.824098  7530 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:46.830513  7342 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:46.831370  7525 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:01:46.857515  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.858259  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1264) took 1598 ms. Trace:
I20260709 13:01:46.858867  1554 rpcz_store.cc:276] 0709 13:01:45.259849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.227046 (+967197us) service_pool.cc:224] Handling call
0709 13:01:46.227377 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.237914 (+ 10537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.237955 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.244526 (+  6571us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.542990 (+298464us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:46.543046 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.543143 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:46.830516 (+287373us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:46.857937 (+ 27421us) raft_consensus.cc:1685] finished
0709 13:01:46.857962 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.858198 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10215,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":6946,"spinlock_wait_cycles":2738432,"thread_start_us":258133,"threads_started":1,"wal-append.queue_time_us":359895}
I20260709 13:01:46.834170  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.799057  1701 raft_consensus.cc:2889] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:46.861404  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.862325  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.862579  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.863126  1703 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:46.863440  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.863916  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.838231  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.864711  2328 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:46.835225  1702 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:46.866245  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:46.835664  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.840751  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.866775  7517 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.868178  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:46.853461  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.858214  1706 raft_consensus.cc:2376] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13. Re-sending same reply.
I20260709 13:01:46.869096  2321 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:46.869580  7539 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:46.870129  7539 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:46.713110  7531 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:46.866350  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1260) took 1638 ms. Trace:
I20260709 13:01:46.869117  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.874089  1560 rpcz_store.cc:276] 0709 13:01:45.228491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.840675 (+612184us) service_pool.cc:224] Handling call
0709 13:01:46.128430 (+287755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.286165 (+157735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.865235 (+579070us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54002292d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:46.866165 (+   930us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54002292d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:46.866296 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":983778560}
I20260709 13:01:46.863981  1701 raft_consensus.cc:2376] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16. Re-sending same reply.
I20260709 13:01:46.890795  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.894840  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.896998  1701 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:46.895601  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.899560  1703 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:46.872398  7539 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:46.904217  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:46.904745  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:46.907065  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:46.907624  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.907176  1556 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:46.854984  7252 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:46.911116  1701 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:46.912132  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:46.918071  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:46.858131  7444 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:01:46.789630  7533 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:46.940809  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:46.946473  1706 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:46.952193  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:46.953176  1556 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:46.956449  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:46.957319  1632 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:46.914856  7544 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:46.965734  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:46.921262  6989 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:46.901875  7530 consensus_queue.cc:1059] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:01:46.969758  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:46.980398  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:46.985162  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:46.976449  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:46.990859  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:47.010699  1632 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:01:47.018631  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:47.019384  1626 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:01:46.933246  7534 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:01:46.969110  7544 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:47.023972  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:46.915987  7282 consensus_queue.cc:237] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:47.066431  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:47.071063  7542 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:01:46.951927  7321 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:47.029039  7389 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:47.078428  7389 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:47.078908  7389 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:47.082165  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.406s	user 0.011s	sys 0.007s
I20260709 13:01:46.985715  6989 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:47.104878  7546 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:01:47.029904  7358 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:47.381134  6989 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:47.381495  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2679) took 3500 ms. Trace:
W20260709 13:01:47.123893  7192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.242s	user 0.005s	sys 0.000s
W20260709 13:01:47.164479  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.338521  7447 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:47.339177  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1259) took 2829 ms. Trace:
I20260709 13:01:46.995908  7516 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:01:47.341697  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1276) took 1034 ms. Trace:
I20260709 13:01:47.346140  7533 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:47.347244  7345 consensus_meta.cc:287] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.005s
W20260709 13:01:47.348256  7508 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.562s	user 0.002s	sys 0.009s
I20260709 13:01:47.409694  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:47.349093  1706 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:01:47.353780  2329 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:47.012362  7384 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:47.354558  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1275) took 1094 ms. Trace:
I20260709 13:01:47.415606  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:47.415594  1558 rpcz_store.cc:276] 0709 13:01:46.259948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.540953 (+281005us) service_pool.cc:224] Handling call
0709 13:01:46.541228 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.545906 (+  4678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.545957 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.870699 (+324742us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b2c00000658. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2
0709 13:01:46.871200 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.997778 (+126578us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:46.997817 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.997889 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.354189 (+356300us) raft_consensus.cc:1685] finished
0709 13:01:47.354221 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.354499 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7256,"spinlock_wait_cycles":31126272,"thread_start_us":126130,"threads_started":1,"wal-append.queue_time_us":202882}
I20260709 13:01:47.354729  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:47.356734  1626 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:47.418236  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.364156  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:47.365777  7410 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:47.372251  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:47.419492  1700 raft_consensus.cc:2376] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18. Re-sending same reply.
I20260709 13:01:47.078466  7252 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:47.376451  1703 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:47.379158  7445 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:47.433100  7445 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:47.433326  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:47.434108  7543 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:47.434023  7445 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:47.435122  7527 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:47.380075  1635 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:01:47.055747  7544 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:47.382055  1627 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:47.381916  1630 rpcz_store.cc:276] 0709 13:01:43.881329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.881442 (+   113us) service_pool.cc:224] Handling call
0709 13:01:44.162077 (+280635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.484353 (+2322276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.380318 (+895965us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b54000da7d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:47.381316 (+   998us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54000da7d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:47.381442 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5982021248}
W20260709 13:01:47.386595  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.711s	user 0.015s	sys 0.012s
W20260709 13:01:47.386802  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.437626  1701 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
W20260709 13:01:47.438321  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 1.78072e+06us
W20260709 13:01:47.387463  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.387732  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:47.441345  1626 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:01:47.346273  7321 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:47.390133  7517 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:47.390173  7465 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.393115  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:47.393674  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.466440  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:01:47.468278  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.392848  1557 rpcz_store.cc:276] 0709 13:01:44.509736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.703238 (+193502us) service_pool.cc:224] Handling call
0709 13:01:44.703511 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.827927 (+124416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.827960 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.828003 (+    43us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:01:44.828035 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.080818 (+2252783us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400027e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:47.339005 (+258187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.339110 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285619456}
I20260709 13:01:47.348563  7531 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:47.384871  7488 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.003s
I20260709 13:01:47.366982  7343 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:47.385517  7192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.514s	user 0.005s	sys 0.000s
I20260709 13:01:47.398993  1552 rpcz_store.cc:276] 0709 13:01:46.307413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.548521 (+241108us) service_pool.cc:224] Handling call
0709 13:01:46.548944 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.549285 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.549312 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.554610 (+  5298us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.759205 (+204595us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:46.759244 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.759539 (+   295us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.338084 (+578545us) raft_consensus.cc:1685] finished
0709 13:01:47.338230 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.339370 (+  1140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":176,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":204097,"threads_started":1,"wal-append.queue_time_us":361941}
I20260709 13:01:47.421424  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:47.422859  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:47.408891  7358 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:47.426165  7533 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:47.440410  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.442520  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:47.491290  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:47.442817  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:47.443424  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:47.444875  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:47.445672  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:47.494310  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.494544  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 48957.1us
W20260709 13:01:47.494975  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 56838.2us
I20260709 13:01:47.447304  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:47.454861  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:47.462212  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:47.498415  2322 raft_consensus.cc:3055] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:47.463783  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:47.473558  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:47.498929  2322 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:47.476900  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:47.467285  2324 raft_consensus.cc:2376] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17. Re-sending same reply.
I20260709 13:01:47.482921  2320 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:47.484128  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:47.485873  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64554.1us
I20260709 13:01:47.501044  2288 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:47.501142  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:47.502454  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:47.415410  7384 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:47.489789  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:47.505723  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2687) took 2621 ms. Trace:
I20260709 13:01:47.508912  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:47.507846  1628 rpcz_store.cc:276] 0709 13:01:44.884769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.894340 (+  9571us) service_pool.cc:224] Handling call
0709 13:01:44.894637 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.894951 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.894979 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.895394 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.325936 (+430542us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b18004c5220. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:01:45.653719 (+327783us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:45.653761 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.653825 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.347649 (+1693824us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:47.505390 (+157741us) raft_consensus.cc:1685] finished
0709 13:01:47.505424 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.505611 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":4820,"spinlock_wait_cycles":82049664,"thread_start_us":327598,"threads_started":1,"wal-append.queue_time_us":889886}
I20260709 13:01:47.460840  6962 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:47.515033  2325 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:47.499864  2322 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:47.516144  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:47.502015  1630 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:47.517261  1626 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:47.509706  1701 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
W20260709 13:01:47.462379  7552 log.cc:927] Time spent T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:01:47.465678  7517 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:47.516521  2322 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:47.510809  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:47.512198  7447 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:47.415035  7345 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:47.572444  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:47.481877  7410 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:47.582008  1626 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:47.569977  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 56473.2us
I20260709 13:01:47.581971  2323 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:47.589919  7502 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 1.779s	user 0.009s	sys 0.000s
I20260709 13:01:47.592730  7541 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.474512  7539 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:01:47.494563  7509 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.504683  7531 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.504444  7533 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:47.481563  7465 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:47.562091  7404 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:47.493332  7339 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 13:01:47.561745  7561 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:47.561628  7342 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.601821  1560 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:47.520373  7321 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:47.519309  7384 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:47.618240  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:47.619668  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:47.625067  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:47.635739  1702 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 14: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:47.623024  2322 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:47.634660  7541 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:47.646189  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 1.48449e+06us
I20260709 13:01:47.487960  7389 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:47.521345  7341 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 13:01:47.680850  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:47.609684  7518 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:01:47.736003  1701 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:47.647794  7404 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.674672  1629 raft_consensus.cc:2376] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14. Re-sending same reply.
I20260709 13:01:47.687211  1560 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:01:47.620683  7410 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:47.763264  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 278642us
W20260709 13:01:47.764200  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.770015  2321 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:47.672912  7321 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:47.771517  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.777599  1601 connection.cc:256] RPC call timeout handler was delayed by -1.3536197490000177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.265s for a response
I20260709 13:01:47.646087  7285 consensus_queue.cc:1059] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
W20260709 13:01:47.781764  1526 connection.cc:256] RPC call timeout handler was delayed by -1.4539770499999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:01:47.782297  1526 connection.cc:256] RPC call timeout handler was delayed by -1.2910770500000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
W20260709 13:01:47.782997  1526 connection.cc:256] RPC call timeout handler was delayed by -1.164177049999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
W20260709 13:01:47.783152  1601 connection.cc:256] RPC call timeout handler was delayed by -1.1187197490000358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2911s for a response
W20260709 13:01:47.783507  1526 connection.cc:256] RPC call timeout handler was delayed by -1.12129115099998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260709 13:01:47.784224  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0648061329999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 13:01:47.784689  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0198935610000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 13:01:47.776962  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 177614us
I20260709 13:01:47.646864  7531 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:47.756017  7404 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:47.754395  7568 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.646611  7509 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:47.746124  7561 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:47.800064  7321 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:47.825325  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:47.826757  7341 consensus_queue.cc:1059] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:47.811691  1557 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:47.830833  1560 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:01:47.805532  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:47.837713  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:47.838243  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:47.839354  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:47.977252  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.977845  1554 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:47.838562  1557 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:47.673873  7342 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:47.854696  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.887216  2326 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:47.987815  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:47.806552  7438 consensus_queue.cc:1059] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:01:47.812755  7540 consensus_queue.cc:1059] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 13:01:47.900555  1709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 2999) took 2279 ms (client timeout 2217 ms). Trace:
W20260709 13:01:47.994776  1709 rpcz_store.cc:269] 0709 13:01:45.621494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.622012 (+   518us) service_pool.cc:224] Handling call
0709 13:01:47.900338 (+2278326us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b5400265a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:47.900472 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12417792}
I20260709 13:01:47.996380  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:47.996554  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:47.894584  7538 raft_consensus.cc:3055] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:47.918002  7416 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:47.918193  7533 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:47.919265  7343 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:47.823582  7225 consensus_queue.cc:1059] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:01:47.921088  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:47.921717  7569 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:01:48.046350  2325 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
W20260709 13:01:47.922570  7563 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:48.047313  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1134) took 1093 ms. Trace:
W20260709 13:01:47.923086  7555 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 13:01:47.925874  7541 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:47.926528  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.047999  1633 rpcz_store.cc:276] 0709 13:01:46.953482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.954835 (+  1353us) service_pool.cc:224] Handling call
0709 13:01:46.981895 (+ 27060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.009128 (+ 27233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.009195 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.009871 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.632920 (+623049us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:47.632959 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.633022 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.046988 (+413966us) raft_consensus.cc:1685] finished
0709 13:01:48.047024 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.047242 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61189,"raft.queue_time_us":15858,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":18437,"thread_start_us":231551,"threads_started":1,"wal-append.queue_time_us":746540}
W20260709 13:01:48.050771  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.051172  1634 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:47.928766  7465 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:47.929020  7410 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:48.054502  7533 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:48.055928  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1111) took 1222 ms. Trace:
I20260709 13:01:48.001821  7538 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:48.056421  1704 rpcz_store.cc:276] 0709 13:01:46.833162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.851267 (+ 18105us) service_pool.cc:224] Handling call
0709 13:01:46.851678 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.855240 (+  3562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.855426 (+   186us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.881576 (+ 26150us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.026033 (+144457us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:47.026099 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.026292 (+   193us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.055666 (+1029374us) raft_consensus.cc:1685] finished
0709 13:01:48.055694 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.055859 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10760,"raft.queue_time_us":5067,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":35936,"thread_start_us":86371,"threads_started":1,"wal-append.queue_time_us":545049}
I20260709 13:01:48.057786  7538 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.058732  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:48.059046  7538 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:48.059441  1704 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:47.929312  7447 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.929499  7413 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:48.012714  7416 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:48.061129  7447 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.062071  7416 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:48.063679  7447 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:47.929847  7285 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:47.931310  7531 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:47.931519  7543 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:48.064898  7579 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.064896  7465 consensus_queue.cc:1059] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:48.065550  7579 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:47.819803  7568 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.060500  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:48.067819  1704 raft_consensus.cc:2410] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:01:48.067939  7568 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:47.938256  7345 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:47.939726  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3147) took 1086 ms. Trace:
I20260709 13:01:48.068813  1708 rpcz_store.cc:276] 0709 13:01:46.852999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.853364 (+   365us) service_pool.cc:224] Handling call
0709 13:01:46.853839 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.901335 (+ 47496us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:47.124334 (+222999us) log.cc:844] Serialized 14 byte log entry
0709 13:01:47.475084 (+350750us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.475173 (+    89us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:47.475242 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.938329 (+463087us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b1800330ac0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69662a6 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419
0709 13:01:47.939347 (+  1018us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b54002544d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:47.939489 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.939654 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":417,"prepare.queue_time_us":455099,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":520,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":7884,"spinlock_wait_cycles":185715072,"thread_start_us":329113,"threads_started":2,"wal-append.queue_time_us":398252}
I20260709 13:01:48.070209  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:48.070950  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:48.071359  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:47.942791  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3217) took 1057 ms. Trace:
I20260709 13:01:47.929580  7561 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.072925  1707 raft_consensus.cc:2410] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:01:48.073349  7531 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.073920  7531 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:47.896723  7566 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:01:47.823521  7539 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.077s
W20260709 13:01:47.953500  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 301729us
I20260709 13:01:47.957453  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:48.071913  1559 rpcz_store.cc:276] 0709 13:01:46.885485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.887339 (+  1854us) service_pool.cc:224] Handling call
0709 13:01:46.887696 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.887941 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:47.216317 (+328376us) log.cc:844] Serialized 14 byte log entry
0709 13:01:47.942228 (+725911us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b18004488a0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a8f716 00007f0ed9aa0287
0709 13:01:47.942344 (+   116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.942405 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:47.942461 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.942538 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.942725 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21403,"prepare.queue_time_us":472671,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":38171,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":56522624,"thread_start_us":402927,"threads_started":3,"wal-append.queue_time_us":122429}
I20260709 13:01:48.082341  1558 raft_consensus.cc:2410] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:48.082675  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:47.929708  7389 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:47.948283  7544 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:47.974874  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:47.990180  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.087034  1560 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:48.089985  2325 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:47.978754  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:48.099985  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 150002us
I20260709 13:01:48.000614  1523 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:48.010118  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.011960  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:48.013381  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:48.012136  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 198511us
I20260709 13:01:48.013923  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:48.020278  7430 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.022014  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:48.023800  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1108) took 2080 ms. Trace:
I20260709 13:01:48.109006  1705 rpcz_store.cc:276] 0709 13:01:45.943840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.945472 (+  1632us) service_pool.cc:224] Handling call
0709 13:01:47.901191 (+1955719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.901417 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.901451 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.901496 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:47.901526 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.901598 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.023555 (+121957us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b5400265a50. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:48.023726 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4496395008}
I20260709 13:01:48.024817  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1401) took 1288 ms. Trace:
I20260709 13:01:48.110355  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:47.997215  1557 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:01:48.031853  2288 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:01:48.041612  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.113374  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 112849us
I20260709 13:01:48.064428  7541 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:47.932612  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 1117) took 1076 ms. Trace:
I20260709 13:01:48.065933  7410 raft_consensus.cc:3055] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:48.077271  1708 raft_consensus.cc:2368] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18.
I20260709 13:01:48.072373  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:48.121150  1702 rpcz_store.cc:276] 0709 13:01:46.856441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.865980 (+  9539us) service_pool.cc:224] Handling call
0709 13:01:47.932399 (+1066419us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b54002cc254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:47.932535 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1767531904}
W20260709 13:01:48.079072  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.039s	sys 0.101s
W20260709 13:01:48.122371  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.040s	sys 0.102s
W20260709 13:01:48.126412  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.088529  7586 raft_consensus.cc:3055] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:48.083979  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:48.051971  7321 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:48.085690  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 228328us
W20260709 13:01:48.099752  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 174458us
I20260709 13:01:48.106438  2320 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:48.105453  1601 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:48.000478  1701 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:48.067970  7579 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:48.030447  7404 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.110574  2327 rpcz_store.cc:276] 0709 13:01:46.736606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.736759 (+   153us) service_pool.cc:224] Handling call
0709 13:01:46.737098 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.852666 (+115568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.852698 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.852746 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:46.852777 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.024532 (+1171755us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400111554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:48.024608 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.024757 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265232256}
I20260709 13:01:48.168462  7404 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:48.124976  7568 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:48.169786  7568 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:48.171113  7568 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.171716  7248 raft_consensus.cc:3055] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:48.172219  7248 raft_consensus.cc:740] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:48.174629  7544 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:48.176549  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1127) took 1226 ms. Trace:
I20260709 13:01:48.176982  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:48.177614  1701 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:48.178442  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:48.178599  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.179119  7321 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:48.180426  1631 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:01:48.111124  1554 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:48.110419  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:48.181905  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:48.182304  1705 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:48.182709  1554 raft_consensus.cc:2410] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:01:48.183672  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:48.114940  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 83184.4us
I20260709 13:01:48.182878  1560 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:48.185588  2288 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:48.186146  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:48.177012  1703 rpcz_store.cc:276] 0709 13:01:46.950400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.432050 (+481650us) service_pool.cc:224] Handling call
0709 13:01:47.432414 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.437695 (+  5281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.437728 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.438175 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.899198 (+461023us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:47.899271 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.899386 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.176279 (+276893us) raft_consensus.cc:1685] finished
0709 13:01:48.176316 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.176480 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4317,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":336812,"threads_started":1,"wal-append.queue_time_us":610039}
I20260709 13:01:48.115926  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:48.116575  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:48.083220  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:48.195729  1558 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:48.196664  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:48.197283  1558 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
W20260709 13:01:48.197315  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.130573  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:48.189492  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:48.134492  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:48.199536  1554 raft_consensus.cc:2410] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:01:48.107939  7345 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.201484  1709 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
I20260709 13:01:48.151916  1523 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:48.152132  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:48.203179  1709 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:48.153211  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:48.153733  7486 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:48.156284  7162 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.130383  7586 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:48.157990  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:48.209925  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 57854.3us
I20260709 13:01:48.210355  1553 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:48.209542  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 57824.1us
I20260709 13:01:48.162595  7505 consensus_queue.cc:1059] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:48.164546  7536 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:48.125056  7389 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:48.120637  7430 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:48.165679  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1125) took 1228 ms. Trace:
I20260709 13:01:48.166021  7285 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:48.133059  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:48.199328  1704 raft_consensus.cc:2376] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12. Re-sending same reply.
I20260709 13:01:48.137439  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:48.128211  7410 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:48.205992  1558 raft_consensus.cc:1275] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:01:48.180189  7576 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.211143  1709 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:01:48.206493  1598 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:48.215152  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:48.214325  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:48.217552  2320 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:48.247790  2327 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:48.247889  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:48.223003  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:48.249254  1703 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:48.206761  1555 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:48.233055  1554 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:48.222692  1706 rpcz_store.cc:276] 0709 13:01:46.937693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.462849 (+525156us) service_pool.cc:224] Handling call
0709 13:01:47.498168 (+ 35319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.578985 (+ 80817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.579038 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.618510 (+ 39472us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.969383 (+350873us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:47.969444 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.969541 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.165365 (+195824us) raft_consensus.cc:1685] finished
0709 13:01:48.165408 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.165602 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34732,"raft.queue_time_us":34890,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":19494,"thread_start_us":304302,"threads_started":1,"wal-append.queue_time_us":526342}
I20260709 13:01:48.201556  7067 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:48.253877  1555 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:01:48.261511  1703 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:48.262467  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:48.206851  7585 raft_consensus.cc:3055] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:01:48.264770  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 58371.2us
I20260709 13:01:48.132140  7541 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:48.209461  7579 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:48.277225  1560 raft_consensus.cc:2410] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:01:48.277989  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 172607us
W20260709 13:01:48.282919  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 151905us
I20260709 13:01:48.268083  7574 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:48.211308  7424 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:01:48.268217  7321 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:48.311713  1553 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:48.212100  7345 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:48.223450  7404 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:01:48.220341  7162 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:48.312341  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 89335us
I20260709 13:01:48.304459  7585 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:48.316507  7586 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 14.15, Last appended by leader: 15, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.363219  7067 raft_consensus.cc:697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:01:48.359931  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 227893us
I20260709 13:01:48.372457  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:48.387069  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:48.304915  7587 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:48.282831  7516 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
W20260709 13:01:48.377830  7570 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 13:01:48.363791  7389 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:48.371004  7413 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.372622  7574 raft_consensus.cc:697] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:48.365309  7591 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:48.340868  7579 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.273134  7576 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.283631  7248 consensus_queue.cc:260] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:48.420511  7557 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:01:48.416165  7586 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:48.447907  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 133680us
I20260709 13:01:48.386525  7486 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:01:48.454403  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:48.457194  7594 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:01:48.458652  7270 raft_consensus.cc:3055] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:48.459020  7594 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:48.459734  7594 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:48.461340  7430 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:48.461494  2329 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:48.461843  7541 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:48.463441  7585 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:48.456982  7517 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.459153  7270 raft_consensus.cc:740] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:48.469785  1559 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:48.432080  7591 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.433059  7342 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:48.370751  7410 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:48.478858  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 165298us
I20260709 13:01:48.452394  7587 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:48.488111  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:48.429919  7413 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:48.478555  7517 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:48.500556  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.479246  7605 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:48.503386  7162 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:48.482599  7591 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:48.494271  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:48.505169  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1141) took 1540 ms. Trace:
I20260709 13:01:48.482661  7593 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:01:48.509842  7576 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:48.511209  7345 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:48.489667  7585 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:48.513976  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 308090us
I20260709 13:01:48.518386  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:48.574061  2329 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:48.519447  1627 rpcz_store.cc:276] 0709 13:01:46.964882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.967697 (+  2815us) service_pool.cc:224] Handling call
0709 13:01:46.968215 (+   518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.437590 (+469375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.504703 (+1067113us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54001bb054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:48.505081 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951093504}
W20260709 13:01:48.553297  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.497646  7410 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:48.586074  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 91874us
W20260709 13:01:48.587199  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.587272  1601 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:48.588146  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.588047  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 201045us
W20260709 13:01:48.588650  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.589179  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.589669  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.589834  1526 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:48.504220  7605 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:48.463482  7067 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.597075  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:48.598363  2286 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:48.586074  7384 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.818s	user 0.013s	sys 0.000s
W20260709 13:01:48.609083  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 222993us
I20260709 13:01:48.634068  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:48.635548  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:48.636643  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:48.640705  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 51019.2us
I20260709 13:01:48.641772  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:48.643514  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:48.644508  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47499.9us
I20260709 13:01:48.497785  7389 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.579679  7594 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:48.576293  7540 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 13:01:48.650686  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.609198  7605 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:48.660045  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.640661  7192 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:48.635571  7162 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:48.654218  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 67048.5us
I20260709 13:01:48.653024  7611 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:48.649686  7606 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:48.655476  7598 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:48.512823  7574 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.592669  7270 consensus_queue.cc:260] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:48.644739  7384 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.659192  7603 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:48.688416  7611 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:48.708904  7579 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:48.756726  7604 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:01:48.761325  7601 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 13:01:48.762501  7609 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:01:48.718160  7606 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:48.773366  7591 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:48.773687  7606 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:48.786986  7587 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:48.807698  7591 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:48.780112  7611 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:48.644722  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:48.870348  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 231619us
I20260709 13:01:48.673373  7162 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:49.012358  7579 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:49.013042  7618 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.812098  7605 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:49.014192  2328 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:49.019079  7586 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:49.019529  7517 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 13:01:49.022056  7540 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:49.012358  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 349018us
I20260709 13:01:49.030856  7413 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:49.031456  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.031901  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.034245  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:49.035101  7325 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:49.040442  7606 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:49.046576  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3155) took 1310 ms. Trace:
I20260709 13:01:49.048719  2323 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:49.052958  7624 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:49.073276  7384 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:49.054396  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1128) took 2090 ms. Trace:
I20260709 13:01:49.077266  1701 rpcz_store.cc:276] 0709 13:01:46.954568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.179223 (+1224655us) service_pool.cc:224] Handling call
0709 13:01:48.180521 (+  1298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.180840 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.180867 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.204907 (+ 24040us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.415504 (+210597us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:48.591225 (+175721us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.591594 (+   369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.591728 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.001899 (+410171us) raft_consensus.cc:1685] finished
0709 13:01:49.007252 (+  5353us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.044687 (+ 37435us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":346713,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":46916,"raft.run_cpu_time_us":442,"raft.run_wall_time_us":45727,"thread_start_us":320602,"threads_started":2,"wal-append.queue_time_us":363209}
W20260709 13:01:49.084227  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.085052  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.087184  1558 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:01:49.090195  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 1148) took 2022 ms (client timeout 1759 ms). Trace:
I20260709 13:01:49.089681  7618 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:49.090669  1629 rpcz_store.cc:269] 0709 13:01:47.067924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.354459 (+286535us) service_pool.cc:224] Handling call
0709 13:01:49.089715 (+1735256us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b5400246654. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:49.089934 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589733760}
W20260709 13:01:49.092506  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 124939us
I20260709 13:01:49.097571  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 3016) took 1619 ms. Trace:
I20260709 13:01:49.098095  1634 rpcz_store.cc:276] 0709 13:01:47.478209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.478403 (+   194us) service_pool.cc:224] Handling call
0709 13:01:48.050880 (+572477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.051734 (+   854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.097011 (+1045277us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54000f50d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:49.097292 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315460480}
I20260709 13:01:49.099828  7641 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:49.053701  7605 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:49.037243  7579 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:49.124572  7527 consensus_queue.cc:1059] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:01:49.130738  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 59308us
I20260709 13:01:49.095448  1601 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:49.137349  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 138691us
I20260709 13:01:49.081060  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:01:49.154696  2326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.003s	sys 0.016s
I20260709 13:01:49.113130  7517 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.164613  2326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.004s	sys 0.016s
W20260709 13:01:49.167042  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.171571  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 76275.5us
I20260709 13:01:49.172852  1601 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:49.141112  7612 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:49.057054  7625 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.118s
W20260709 13:01:49.183022  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 102273us
I20260709 13:01:49.187983  7527 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:49.188127  7586 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:49.188778  7586 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:49.188832  7527 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:49.189378  7586 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:49.191032  7162 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:49.187906  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.185256  7636 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:49.048063  1705 rpcz_store.cc:276] 0709 13:01:47.733810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.200105 (+466295us) service_pool.cc:224] Handling call
0709 13:01:48.200498 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:48.200907 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.200957 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:48.206280 (+  5323us) log.cc:844] Serialized 52 byte log entry
0709 13:01:48.282292 (+ 76012us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:48.282335 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.282411 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.005001 (+722590us) raft_consensus.cc:1685] finished
0709 13:01:49.007800 (+  2799us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.044408 (+ 36608us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17841,"raft.queue_time_us":85781,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":24171,"thread_start_us":68248,"threads_started":1,"wal-append.queue_time_us":292433}
W20260709 13:01:49.194850  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 549968us
I20260709 13:01:49.174204  7612 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.190580  7527 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.15, Last appended by leader: 15, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.197608  7299 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:49.193346  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.184237  7486 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:49.212201  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.214612  7486 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:49.217325  7517 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.222877  7225 raft_consensus.cc:3055] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:49.215835  7540 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:49.161831  7606 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:49.228749  7225 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:49.246459  7225 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:49.249464  7642 log.cc:927] Time spent T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:01:49.250737  7606 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:49.251121  1601 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:49.208171  7612 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:49.254894  7225 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:49.261526  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:49.262425  7641 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:49.263468  7641 raft_consensus.cc:697] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:49.263868  7183 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:49.265025  7183 consensus_queue.cc:1243] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:49.265260  7540 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:49.266136  7540 raft_consensus.cc:697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:49.269624  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.271543  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:49.272495  1551 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:49.255364  7486 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:49.248355  7517 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:49.255831  7416 consensus_meta.cc:287] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.193s	user 0.013s	sys 0.011s
I20260709 13:01:49.196465  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:49.268308  7585 consensus_meta.cc:287] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.011s
I20260709 13:01:49.277187  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:49.257644  7579 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:49.257753  1601 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:49.197609  7162 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.295418  7416 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:49.299592  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 103377us
I20260709 13:01:49.300879  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:49.301363  7562 log.cc:927] Time spent T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 1.387s	user 0.006s	sys 0.000s
I20260709 13:01:49.301688  7416 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:49.301865  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:49.295511  7538 consensus_meta.cc:287] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.101s	user 0.021s	sys 0.000s
I20260709 13:01:49.302770  1701 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:49.303259  7162 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.248373  7632 consensus_queue.cc:1059] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:01:49.304778  7579 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:49.304421  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46888us
W20260709 13:01:49.289079  7410 consensus_meta.cc:287] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.688s	user 0.004s	sys 0.011s
I20260709 13:01:49.305186  7538 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:49.326010  1601 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:49.298655  7540 consensus_queue.cc:237] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.277457  7641 consensus_queue.cc:237] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:49.330883  7611 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:49.331791  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.345054  7162 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:49.345252  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 44545.1us
I20260709 13:01:49.346565  7632 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:49.346684  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:49.347182  7632 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.347790  7632 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:49.353241  7589 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.597s	user 0.002s	sys 0.000s
I20260709 13:01:49.355052  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1413) took 1518 ms. Trace:
W20260709 13:01:49.355896  7599 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.618s	user 0.000s	sys 0.000s
I20260709 13:01:49.355511  2322 rpcz_store.cc:276] 0709 13:01:47.836387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.836518 (+   131us) service_pool.cc:224] Handling call
0709 13:01:47.836967 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.842901 (+  5934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.842950 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.856164 (+ 13214us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.094026 (+237862us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:48.094096 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.094194 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.352184 (+1257990us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:49.354466 (+  2282us) raft_consensus.cc:1685] finished
0709 13:01:49.354486 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.354822 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5280,"raft.queue_time_us":6775,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":34246,"spinlock_wait_cycles":48913152,"thread_start_us":147721,"threads_started":1,"wal-append.queue_time_us":841166}
I20260709 13:01:49.357565  7492 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:49.359478  7492 raft_consensus.cc:2764] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:49.361210  7416 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:49.368162  7564 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.470s	user 0.002s	sys 0.000s
W20260709 13:01:49.369506  7614 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.606s	user 0.000s	sys 0.002s
I20260709 13:01:49.371317  7603 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:49.371598  7531 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:49.373193  7615 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.611s	user 0.002s	sys 0.000s
W20260709 13:01:49.378731  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.341527  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:49.391283  1551 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:49.394922  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:01:49.399984  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.404835  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:49.417832  1701 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:49.423813  1555 raft_consensus.cc:1240] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:49.428646  7648 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:01:49.432750  7183 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:49.433261  7585 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:49.433169  7341 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:49.434454  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1132) took 1185 ms. Trace:
W20260709 13:01:49.438182  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49926.9us
I20260709 13:01:49.401120  7540 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.472244  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.476379  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 153389us
W20260709 13:01:49.482076  7634 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:01:49.482256  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:49.483961  7660 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:01:49.483784  7183 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.484457  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:49.487246  7183 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:49.434258  7585 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.493271  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:49.501820  7540 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.504760  1626 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:49.505868  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:49.507272  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:49.434392  7341 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.440104  1702 rpcz_store.cc:276] 0709 13:01:48.213090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.213212 (+   122us) service_pool.cc:224] Handling call
0709 13:01:48.262668 (+ 49456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.262973 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.263000 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.263433 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.406028 (+142595us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:48.406100 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.409847 (+  3747us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.368383 (+958536us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:49.376366 (+  7983us) raft_consensus.cc:1685] finished
0709 13:01:49.376386 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.398669 (+ 22283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7349,"raft.queue_time_us":124228,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":26701,"spinlock_wait_cycles":35648896,"thread_start_us":41532,"threads_started":1,"wal-append.queue_time_us":449723}
W20260709 13:01:49.546031  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 227922us
I20260709 13:01:49.542802  7657 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.551451  7657 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
W20260709 13:01:49.552685  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.554481  7544 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.555217  7544 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:49.557086  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 81617.3us
I20260709 13:01:49.558476  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:49.560837  7492 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:49.561576  7492 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:49.562068  7492 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:49.567536  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1309) took 1200 ms. Trace:
I20260709 13:01:49.568078  2325 rpcz_store.cc:276] 0709 13:01:48.367461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.367630 (+   169us) service_pool.cc:224] Handling call
0709 13:01:48.407631 (+ 40001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.415581 (+  7950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.415621 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.416124 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.177448 (+761324us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b180030e380. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:01:49.393498 (+216050us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:49.393575 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.393679 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.567016 (+173337us) raft_consensus.cc:1685] finished
0709 13:01:49.567038 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.567335 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":9280,"spinlock_wait_cycles":9185536,"thread_start_us":126440,"threads_started":1,"wal-append.queue_time_us":1010997}
I20260709 13:01:49.572104  7579 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:49.572690  7579 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:49.573081  7579 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:49.576473  7611 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:49.518247  7621 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.615s	user 0.001s	sys 0.000s
I20260709 13:01:49.547026  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:49.589543  7341 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:49.592962  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 85886.2us
I20260709 13:01:49.597259  1633 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:49.604036  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:49.611374  7585 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:49.607887  7410 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.605549  7341 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:49.617434  7410 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:49.630141  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.637029  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.605706  2288 leader_election.cc:336] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.759s (SENT)
I20260709 13:01:49.644691  7341 raft_consensus.cc:697] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:49.652901  1601 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:49.609938  7586 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:49.648654  2288 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:49.664875  7657 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:01:49.672778  7416 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:49.683677  7658 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:01:49.684193  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 45812.5us
W20260709 13:01:49.684501  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 1143) took 2718 ms (client timeout 1669 ms). Trace:
I20260709 13:01:49.684747  7625 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.685477  1635 rpcz_store.cc:269] 0709 13:01:46.965550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.967010 (+  1460us) service_pool.cc:224] Handling call
0709 13:01:49.684015 (+2717005us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54001bc954. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:49.684256 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870937344}
I20260709 13:01:49.691578  7585 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:49.695047  7341 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.697188  7585 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:49.698172  7585 consensus_queue.cc:1243] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:49.698628  1601 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:49.695034  7625 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.700565  7593 raft_consensus.cc:3055] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:49.654242  7587 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:49.702113  7593 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:49.703033  7665 log.cc:927] Time spent T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:01:49.663420  7540 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:49.703905  7593 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.719751  7410 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:49.720156  7625 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:49.718232  7657 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:49.739636  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 158668us
I20260709 13:01:49.731940  7540 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:49.746197  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.747433  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49055.8us
I20260709 13:01:49.748561  7625 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:49.749199  7358 raft_consensus.cc:3055] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:49.749667  7358 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:49.758143  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:49.754283  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 240575us
I20260709 13:01:49.750020  7579 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.753571  7593 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:49.753347  7544 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:49.769939  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.781355  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:49.781087  1635 raft_consensus.cc:1275] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
W20260709 13:01:49.767462  7225 consensus_meta.cc:287] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.508s	user 0.003s	sys 0.011s
I20260709 13:01:49.789096  7358 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:49.795105  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:49.796548  7067 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:49.797112  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:49.797931  7544 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:49.798676  7544 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:49.800983  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.786583  7659 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:49.786697  1630 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:49.804395  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:49.797128  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:49.764773  7657 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:49.807029  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:49.820708  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:49.806871  1630 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:49.823171  1672 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:49.822057  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:49.835412  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.784268  7611 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:49.837539  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:49.804123  7586 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:01:49.807222  7632 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:49.848304  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:49.850136  7419 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:49.853152  7567 log.cc:927] Time spent T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.963s	user 0.004s	sys 0.002s
I20260709 13:01:49.854390  1526 leader_election.cc:400] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18.
I20260709 13:01:49.857208  1632 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:01:49.856950  7611 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.858378  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:49.858636  7603 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:49.859123  7603 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:49.859980  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:49.861357  1675 leader_election.cc:336] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.694s (SENT)
I20260709 13:01:49.861666  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:49.863380  7627 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 1.101s	user 0.003s	sys 0.000s
I20260709 13:01:49.865375  7657 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:49.866636  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:49.867511  7579 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:49.881330  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:49.891091  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 155193us
W20260709 13:01:49.892205  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.892478  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.890380  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 97975.2us
W20260709 13:01:49.896062  1675 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.721s (SENT)
I20260709 13:01:49.896651  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:49.901413  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 78487.6us
I20260709 13:01:49.878746  7611 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:49.906059  1630 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:01:49.911439  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:49.913455  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:49.912273  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:49.917660  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:49.918623  1630 raft_consensus.cc:2393] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:49.918924  7539 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:49.919610  7539 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:49.919958  1630 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:49.920840  7539 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.922947  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1153) took 2290 ms. Trace:
I20260709 13:01:49.913072  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:49.923472  1631 rpcz_store.cc:276] 0709 13:01:47.632092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.632933 (+   841us) service_pool.cc:224] Handling call
0709 13:01:47.633311 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.180815 (+547504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.922403 (+1741588us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54000c8ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:49.922758 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1257045376}
I20260709 13:01:49.926015  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3222) took 3001 ms. Trace:
W20260709 13:01:49.935627  1673 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.721s (SENT)
I20260709 13:01:49.936632  1551 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:01:49.933216  1555 pending_rounds.cc:85] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 5
I20260709 13:01:49.935285  7574 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:49.946112  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:49.943627  7532 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:49.950533  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:49.952252  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:49.954643  1673 leader_election.cc:336] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.694s (SENT)
I20260709 13:01:49.955371  7419 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:49.955222  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:49.956278  7419 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:49.960305  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:49.938789  1555 pending_rounds.cc:107] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 11.6
W20260709 13:01:49.965224  1675 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.769s (SENT)
I20260709 13:01:49.965497  1555 raft_consensus.cc:2889] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:49.963538  1632 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 3015) took 2490 ms (client timeout 1774 ms). Trace:
W20260709 13:01:49.977444  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 43594.3us
W20260709 13:01:49.977393  1632 rpcz_store.cc:269] 0709 13:01:47.473148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.473278 (+   130us) service_pool.cc:224] Handling call
0709 13:01:49.963314 (+2490036us) spinlock_profiling.cc:243] Waited 2.36 s on lock 0x7b54002c7ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:49.963457 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5421176704}
I20260709 13:01:49.979655  7465 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:49.927985  1556 rpcz_store.cc:276] 0709 13:01:46.886916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.977571 (+ 90655us) service_pool.cc:224] Handling call
0709 13:01:46.977995 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.984048 (+  6053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.984078 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.017165 (+ 33087us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.604009 (+586844us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:47.625462 (+ 21453us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.651907 (+2026445us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b18002bfb40. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a8f716 00007f0ed9aa0287 00007f0ed9aa0208
0709 13:01:49.840118 (+188211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.845791 (+  5673us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.880195 (+ 34404us) raft_consensus.cc:1685] finished
0709 13:01:49.885632 (+  5437us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.888301 (+  2669us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21276,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":10660,"raft.queue_time_us":295442,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":13472,"spinlock_wait_cycles":8832256,"thread_start_us":361975,"threads_started":2,"wal-append.queue_time_us":688611,"wal-append.run_cpu_time_us":3420,"wal-append.run_wall_time_us":1304925}
W20260709 13:01:49.986047  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.963229  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:49.986265  7611 consensus_queue.cc:1059] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:01:49.990183  7492 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:49.960523  7518 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:49.968525  7629 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 1.201s	user 0.001s	sys 0.001s
I20260709 13:01:49.970098  7450 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:49.966929  7357 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:49.971442  7574 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:50.027601  7574 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:49.971622  7544 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:49.969828  7632 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:49.998984  1553 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 14: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:01:50.004768  1675 leader_election.cc:336] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.533s (SENT)
I20260709 13:01:50.052062  7492 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:50.054160  1707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 3138) took 3503 ms (client timeout 2180 ms). Trace:
W20260709 13:01:50.054615  1707 rpcz_store.cc:269] 0709 13:01:46.550894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.552201 (+  1307us) service_pool.cc:224] Handling call
0709 13:01:50.053720 (+3501519us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400253ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:50.053960 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3492265856}
I20260709 13:01:50.061335  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1126) took 3115 ms. Trace:
I20260709 13:01:50.061890  1700 rpcz_store.cc:276] 0709 13:01:46.945591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.427110 (+481519us) service_pool.cc:224] Handling call
0709 13:01:47.438630 (+ 11520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.439016 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.439047 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.439510 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.681647 (+242137us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:47.681702 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.681815 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.962723 (+280908us) raft_consensus.cc:1685] finished
0709 13:01:47.962744 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.060846 (+2098102us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5400397950. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:50.061147 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21916,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":11251,"spinlock_wait_cycles":25626496,"thread_start_us":241476,"threads_started":1,"wal-append.queue_time_us":521581,"wal-append.run_cpu_time_us":2221,"wal-append.run_wall_time_us":1046355}
I20260709 13:01:50.005362  1630 raft_consensus.cc:1275] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:01:50.007179  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.007591  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:50.010802  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.022845  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:50.016259  7299 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:50.026993  1559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 3238) took 1897 ms (client timeout 1551 ms). Trace:
I20260709 13:01:50.036688  2288 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:50.041757  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:50.079126  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 124522us
I20260709 13:01:50.109006  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:50.095386  1675 leader_election.cc:336] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.555s (SENT)
I20260709 13:01:50.093180  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:50.112655  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:50.093165  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:50.115182  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.066489  1559 rpcz_store.cc:269] 0709 13:01:48.129469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.137175 (+  7706us) service_pool.cc:224] Handling call
0709 13:01:50.026626 (+1889451us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b540017e8d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:50.026781 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564148480}
I20260709 13:01:50.116910  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:50.119300  7509 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:50.109036  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:50.121297  7357 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:50.105144  7527 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:50.120442  7345 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.108505  7389 raft_consensus.cc:3055] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:50.145911  1631 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:50.148573  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:50.094062  7617 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.141292  7357 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:50.152052  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:50.156354  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 119793us
W20260709 13:01:50.140077  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 176987us
I20260709 13:01:50.096820  7603 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:50.161602  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.145795  7389 raft_consensus.cc:740] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:50.145443  7299 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.169276  1629 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:50.182284  7282 consensus_queue.cc:1059] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:01:50.183557  7282 raft_consensus.cc:3055] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:50.183935  7282 raft_consensus.cc:740] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:50.184026  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.184703  1627 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:50.185304  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.185693  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.186800  1629 raft_consensus.cc:2410] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:01:50.187040  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.188057  1627 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:50.188494  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:50.188720  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 93437.6us
I20260709 13:01:50.146039  7345 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:50.179894  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:50.193193  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:50.195215  1673 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.769s (SENT)
I20260709 13:01:50.195919  1673 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:50.199713  7603 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:50.203238  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.165052  7248 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.155915  7527 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:50.209538  1627 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:50.215189  1523 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:50.204265  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:50.222745  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.225184  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:50.226338  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.229674  1627 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:01:50.236860  7389 consensus_queue.cc:260] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:50.238708  7389 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.239776  7438 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:50.240262  7438 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:50.240705  7438 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:50.241235  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 73399.2us
I20260709 13:01:50.242431  1526 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:50.244961  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 49773.4us
I20260709 13:01:50.246244  7527 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:50.246430  7509 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.248281  1700 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:50.236876  7617 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:50.249567  7617 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.250006  7617 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.237502  7603 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:50.244441  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:50.251960  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.254896  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.255539  1635 raft_consensus.cc:2410] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:01:50.258800  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:50.228868  7299 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:50.263213  1701 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:50.265017  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:50.265858  1702 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:50.211862  7282 consensus_queue.cc:260] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:50.268054  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.272802  7282 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.273934  7299 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.274638  7299 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:50.276873  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:50.277776  1554 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:50.256105  7603 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.281004  7603 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:50.281992  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.282831  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:50.284958  7488 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.286019  7488 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:50.288441  1557 raft_consensus.cc:2410] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:01:50.294833  7574 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:50.301172  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 56863.4us
I20260709 13:01:50.301950  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:50.303004  1701 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:50.303448  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:50.256441  7682 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:50.304348  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:50.389761  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.388878  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.388257  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:50.360828  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:50.404819  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 172460us
I20260709 13:01:50.416808  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.368536  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:50.417928  7450 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:50.363721  7419 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.136s
I20260709 13:01:50.499255  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:50.500412  1702 raft_consensus.cc:2368] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15.
I20260709 13:01:50.361163  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:50.297603  7574 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:50.361578  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:50.376917  1700 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:50.365373  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:50.362998  7325 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.362582  7299 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:50.546898  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.538246  1708 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:50.535992  7328 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.554750  1554 raft_consensus.cc:3055] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:50.555218  1554 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:01:50.557545  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.561964  1707 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:01:50.564141  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1417) took 2364 ms. Trace:
I20260709 13:01:50.564213  1706 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:50.566200  2327 rpcz_store.cc:276] 0709 13:01:48.195173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.197049 (+  1876us) service_pool.cc:224] Handling call
0709 13:01:48.247623 (+ 50574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.248232 (+   609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.548491 (+2300259us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b540077e550. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:50.559463 (+ 10972us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115623296}
I20260709 13:01:50.577080  7328 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:50.579885  7328 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:50.580969  1709 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:50.542995  7225 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.582778  7225 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:50.586768  7225 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:50.591048  7611 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.591780  7611 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:50.594342  7617 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:50.596832  7357 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.597551  7357 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:50.598235  7438 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:50.552620  7450 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.556360  7682 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.562618  1703 raft_consensus.cc:2376] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12. Re-sending same reply.
I20260709 13:01:50.602059  1552 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:01:50.607602  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 304278us
I20260709 13:01:50.612540  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:50.613289  1629 raft_consensus.cc:2376] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18. Re-sending same reply.
I20260709 13:01:50.617484  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:50.618306  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:50.627717  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:50.628813  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.629421  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.631007  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:50.632922  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:50.628652  1554 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:50.632100  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:50.640998  7447 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:01:50.637806  7328 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:50.644256  7192 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:01:50.644699  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.645300  1631 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:50.646020  1559 raft_consensus.cc:2410] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 18 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 6.
I20260709 13:01:50.646252  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.648267  1559 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:50.646852  7516 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:50.652365  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.622329  7325 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:50.659210  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.676129  1554 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:50.676434  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.679265  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.680035  1631 raft_consensus.cc:2393] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:50.680953  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.681694  1631 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:50.682498  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.676427  1709 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:50.686568  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:50.685807  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 54884.8us
I20260709 13:01:50.690644  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:50.691319  1707 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.692065  7339 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:01:50.693154  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 53765.8us
I20260709 13:01:50.694106  1559 raft_consensus.cc:1240] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:50.661907  7617 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:50.619731  7682 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:50.626214  7299 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:01:50.701297  2288 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:50.654290  7516 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:50.706110  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.707049  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.709734  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:50.650838  7450 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:50.677727  7192 consensus_queue.cc:1059] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:01:50.720505  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:50.723857  1554 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:01:50.724818  1554 pending_rounds.cc:85] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 12
I20260709 13:01:50.725198  1554 pending_rounds.cc:107] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:01:50.725435  1554 raft_consensus.cc:2889] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:50.708112  7516 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:50.712513  7617 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:50.733337  7603 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:50.733948  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:50.735925  7603 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:50.737253  1700 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:50.742026  1707 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:50.712461  7544 consensus_queue.cc:1059] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:01:50.751374  1554 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:50.751626  1703 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:50.754283  7438 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:50.755813  7357 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:50.757282  7544 raft_consensus.cc:3055] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:50.757593  7379 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:50.757797  7544 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:50.758910  7544 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:50.762295  7544 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.767433  1707 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:01:50.776966  1554 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:01:50.770875  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.807004  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:50.751514  7585 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:50.836974  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.788230  1707 pending_rounds.cc:85] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 6
I20260709 13:01:50.838317  1707 pending_rounds.cc:107] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:01:50.838626  1707 raft_consensus.cc:2889] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:50.839112  1673 leader_election.cc:336] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.099s (SENT)
W20260709 13:01:50.839320  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.843766  1560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2591) took 2873 ms (client timeout 2823 ms). Trace:
I20260709 13:01:50.844542  1554 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:01:50.845073  7488 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:50.850224  7667 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.120s	user 0.010s	sys 0.011s
I20260709 13:01:50.862043  7450 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:50.862692  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2715) took 1066 ms. Trace:
I20260709 13:01:50.863212  1630 rpcz_store.cc:276] 0709 13:01:49.796485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.921074 (+124589us) service_pool.cc:224] Handling call
0709 13:01:49.921500 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.064533 (+143033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.862448 (+797915us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b54000d9dd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:50.862630 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191977856}
I20260709 13:01:50.865304  1700 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:50.865746  7618 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:50.844388  1560 rpcz_store.cc:269] 0709 13:01:47.787853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.185808 (+397955us) service_pool.cc:224] Handling call
0709 13:01:50.530258 (+2344450us) spinlock_profiling.cc:243] Waited 86 ms on lock 0x7b54002206d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:50.661055 (+130797us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197802368}
I20260709 13:01:50.866797  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:50.867941  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1306) took 2654 ms. Trace:
I20260709 13:01:50.868358  2323 rpcz_store.cc:276] 0709 13:01:48.213286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.214781 (+  1495us) service_pool.cc:224] Handling call
0709 13:01:48.263093 (+ 48312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.049330 (+786237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.867687 (+1818357us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54004376d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:50.867892 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1796593408}
I20260709 13:01:50.871025  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.872860  1630 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:01:50.873643  1557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2594) took 3064 ms (client timeout 2272 ms). Trace:
W20260709 13:01:50.874094  1557 rpcz_store.cc:269] 0709 13:01:47.808813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.115639 (+306826us) service_pool.cc:224] Handling call
0709 13:01:50.873418 (+2757779us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54002f49d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:50.873586 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4815037824}
I20260709 13:01:50.875731  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:50.883531  7682 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:50.887107  1556 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:01:50.887903  1556 pending_rounds.cc:85] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 9
I20260709 13:01:50.888240  1556 pending_rounds.cc:107] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:01:50.888517  1556 raft_consensus.cc:2889] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:50.890156  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2712) took 1094 ms. Trace:
I20260709 13:01:50.890578  1635 rpcz_store.cc:276] 0709 13:01:49.795589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.796800 (+  1211us) service_pool.cc:224] Handling call
0709 13:01:50.889950 (+1093150us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54000e7254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:50.890098 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043538176}
I20260709 13:01:50.891901  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:50.891237  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:50.901284  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:50.902478  1704 raft_consensus.cc:2410] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:01:50.905598  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:50.906078  2329 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:50.905521  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.884532  7682 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:50.917490  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 216210us
I20260709 13:01:50.920573  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.910902  7632 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.922832  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:50.923164  7632 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:50.925616  7404 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:50.926177  7632 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:50.926635  7404 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:50.926993  7682 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:50.910108  7389 consensus_meta.cc:287] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.671s	user 0.012s	sys 0.004s
I20260709 13:01:50.929908  7682 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:50.842914  7585 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:50.933921  7585 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:50.936502  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.937379  1626 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:50.941536  1630 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:50.943176  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:50.943346  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:50.943921  1552 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:50.945046  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:50.945863  1557 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:50.948107  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.949071  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:50.949445  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.950937  7611 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:50.951558  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.952366  1626 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 15: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:01:50.945093  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 135733us
I20260709 13:01:50.952925  1703 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:50.902948  7413 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:50.949803  2323 raft_consensus.cc:1813] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Handling vote request from an unknown peer 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:50.954792  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:50.954835  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:50.950901  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.973621  1703 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:50.957396  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:50.974017  1628 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:50.976418  2323 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:50.984143  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.984946  1628 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 10.
I20260709 13:01:50.984226  1704 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.988418  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:50.985905  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:50.996909  1702 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:01:50.978861  7610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.221s	user 0.031s	sys 0.019s
I20260709 13:01:51.002115  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:51.007025  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:51.005192  7610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.249s	user 0.031s	sys 0.020s
I20260709 13:01:51.026069  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:51.026688  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:51.016522  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.027760  1560 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:51.017577  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:51.014956  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 285788us
I20260709 13:01:51.019433  1557 raft_consensus.cc:2410] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:01:51.021548  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:51.026098  1553 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:01:51.016412  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:51.021306  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:51.030041  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:51.045917  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:51.048198  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:51.047685  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 208595us
I20260709 13:01:51.061262  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.057502  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.058905  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:51.062842  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:51.046835  7389 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:51.063295  1557 raft_consensus.cc:2410] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:01:51.066491  2324 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:51.066936  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.061132  1552 raft_consensus.cc:2376] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11. Re-sending same reply.
I20260709 13:01:51.069752  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.074625  1630 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:01:51.077929  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:51.080855  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:51.080960  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 50502.1us
I20260709 13:01:51.081475  1553 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 11: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:51.083199  1601 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:51.089787  7343 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:01:51.091008  7343 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:51.091421  7343 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:51.076256  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:51.033772  7413 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:01:51.094762  7516 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:51.095494  7610 consensus_queue.cc:1059] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:51.095826  7413 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:51.097231  7516 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:51.061895  7404 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:51.098080  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.095018  7248 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:51.104360  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.107285  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:51.115247  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:51.134264  1554 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:51.092269  7343 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:51.118518  1630 raft_consensus.cc:2410] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 16 because replica has last-logged OpId of term: 14 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 14.
I20260709 13:01:51.120779  1628 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:51.093901  1675 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:51.131898  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:51.103811  1703 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:51.101886  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.103092  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.103157  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3258) took 1197 ms. Trace:
I20260709 13:01:51.173084  2324 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:51.172489  1556 rpcz_store.cc:276] 0709 13:01:49.906116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.988973 (+ 82857us) service_pool.cc:224] Handling call
0709 13:01:50.886574 (+897601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.889263 (+  2689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.102907 (+213644us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54002f49d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:51.103042 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2063125888}
I20260709 13:01:51.144380  1552 raft_consensus.cc:1240] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:51.175016  1557 raft_consensus.cc:2410] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:51.175168  1704 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
W20260709 13:01:51.167760  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 76901.1us
I20260709 13:01:51.176483  2288 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:51.151471  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 358001us
W20260709 13:01:51.183248  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 89450.3us
I20260709 13:01:51.184715  1675 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:51.190650  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:51.161659  7699 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:01:51.176558  7509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.019s	sys 0.011s
I20260709 13:01:46.386512   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:51.193646  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:51.197284  1630 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
W20260709 13:01:51.198494  1673 leader_election.cc:336] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.829s (SENT)
I20260709 13:01:51.198683  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:51.199769  1630 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 15: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:51.204924  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.205794  1556 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:51.210522  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.214740  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.214888  1630 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:51.214921  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:51.204818  7509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.019s	sys 0.011s
I20260709 13:01:51.217160  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:51.217732  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.221073  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:51.230368  1703 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:51.222448  1701 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:51.216612  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.223774  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:51.204660  7539 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:51.191418  7606 raft_consensus.cc:476] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Not starting pre-election -- already a leader
I20260709 13:01:51.233466  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.231510  1557 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:51.236342  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:51.237764  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 61389.1us
I20260709 13:01:51.238299  1556 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:01:51.207000  7610 consensus_queue.cc:1059] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
W20260709 13:01:51.235270  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.235855  1673 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:51.238472  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:51.245605  1703 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.238631  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:51.237402  1632 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:51.225502  7518 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:51.261804  1560 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:51.281829  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.230703  7488 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.427909  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:51.503111  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 264561us
W20260709 13:01:51.487883  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 404721us
W20260709 13:01:51.499485  1598 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:39387 timed out after 1.723s (SENT) [suppressed 57 similar messages]
I20260709 13:01:51.244354  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.243255  1704 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:51.498805  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1411) took 3998 ms. Trace:
I20260709 13:01:51.507648  1701 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:51.504272  1675 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:51.280130  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.511107  1559 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:51.492293  1632 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:51.499752  1552 raft_consensus.cc:2393] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:51.507195  2328 rpcz_store.cc:276] 0709 13:01:47.500482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.500639 (+   157us) service_pool.cc:224] Handling call
0709 13:01:47.500926 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.071121 (+1570195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.487666 (+2416545us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54008291d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:51.498716 (+ 11050us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3357438720}
I20260709 13:01:51.236871  7539 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.509315  1706 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:51.514859  7618 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:51.515455  7618 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.515908  7618 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:51.516345  1706 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:01:51.521621  7299 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:51.523211  7533 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.523905  7533 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:51.526823  7533 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:51.238934  7696 raft_consensus.cc:3055] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:51.528442  7696 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:51.513629  1601 leader_election.cc:400] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15.
I20260709 13:01:51.305084  7709 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.529596  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:51.241016  6989 raft_consensus.cc:2764] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:51.497880  7518 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.531406  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:51.533915  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:51.545100  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.545508  1709 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:51.530716  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.542344  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:51.542699  1703 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:51.532693  1705 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:51.535744  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.547736  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 3259) took 1128 ms. Trace:
I20260709 13:01:51.546027  1559 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:51.548964  1701 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:51.548130  1551 rpcz_store.cc:276] 0709 13:01:50.419316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.513190 (+1093874us) service_pool.cc:224] Handling call
0709 13:01:51.547673 (+ 34483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:51.553969  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.558233  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:51.530272  7539 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:51.564935  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 366400us
I20260709 13:01:51.558763  1632 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:51.568419  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:51.536109  7413 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:51.577322  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.549207  7518 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.569329  1705 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:01:51.592264  1551 raft_consensus.cc:2393] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:51.590863  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.588917  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.596365  1632 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.597285  1554 raft_consensus.cc:2410] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:51.597710  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.601199  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:51.598513  1559 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:01:51.529520  7488 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:51.662385  1705 raft_consensus.cc:1240] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:51.678330  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:51.679574  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 173015us
I20260709 13:01:51.681097  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.544291  7709 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:51.686280  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:51.688845  1560 raft_consensus.cc:1813] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Handling vote request from an unknown peer 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:51.689469  1552 raft_consensus.cc:2393] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:01:51.695281  2287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.007s	sys 0.055s
W20260709 13:01:51.695716  2287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.007s	sys 0.055s
I20260709 13:01:51.698321  1560 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:01:51.690146  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 84915.9us
W20260709 13:01:51.700317  1673 leader_election.cc:336] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.225s (SENT)
I20260709 13:01:51.700862  1673 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:51.696651  1523 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:51.702642  1559 raft_consensus.cc:1240] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:51.601238  7516 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:51.705132  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 170299us
I20260709 13:01:51.708716  1556 raft_consensus.cc:2410] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:51.712553  1551 pending_rounds.cc:85] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 12
I20260709 13:01:51.713171  1551 pending_rounds.cc:107] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:01:51.713397  1551 raft_consensus.cc:2889] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:51.712754  1675 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:51.719445  1704 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:01:51.722988  2324 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:51.715823  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:51.733328  2321 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:51.741765  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:51.742491  7358 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:51.734710  7710 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:51.744187  1553 raft_consensus.cc:1240] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:51.710480  7509 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:51.742631  2323 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:01:51.751013  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50738.5us
W20260709 13:01:51.751710  1673 leader_election.cc:336] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.243s (SENT)
I20260709 13:01:51.752147  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:51.754302  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 73999.2us
I20260709 13:01:51.762918  2324 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:51.751470  2286 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:51.739938  7413 raft_consensus.cc:2764] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:51.765758  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:51.600387  7696 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:51.778676  2328 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:51.732918  7516 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:51.779384  1555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.033s	sys 0.052s
I20260709 13:01:51.778568  2286 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:51.782651  1555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.033s	sys 0.052s
I20260709 13:01:51.782088  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:51.789083  2322 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:51.789216  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:51.790218  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:51.791038  2322 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:51.791252  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:51.791976  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:51.792914  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:51.766089  7710 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:51.794582  1673 leader_election.cc:336] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.249s (SENT)
I20260709 13:01:51.793036  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:51.800240  2326 raft_consensus.cc:2410] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:01:51.797511  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:51.801889  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:51.802575  1673 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:51.779078  7701 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:51.797019  7699 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.551s	user 0.008s	sys 0.008s
I20260709 13:01:51.808207  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2747) took 1579 ms. Trace:
W20260709 13:01:51.809288  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 54300.7us
I20260709 13:01:51.793679  7389 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:51.820770  2321 raft_consensus.cc:3055] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:51.825011  7445 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:51.825163  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:51.825700  7705 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:01:51.826040  2328 raft_consensus.cc:2410] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:01:51.827054  2320 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:01:51.827476  2320 pending_rounds.cc:85] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 9
I20260709 13:01:51.827705  2320 pending_rounds.cc:107] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:01:51.827951  2320 raft_consensus.cc:2889] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:51.828730  7413 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:51.828871  7710 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:51.821199  2321 raft_consensus.cc:740] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:51.831715  2321 consensus_queue.cc:260] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:51.832712  2321 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.833039  7709 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:51.833279  1633 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
W20260709 13:01:51.838881  7711 log.cc:927] Time spent T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:01:51.806818  7701 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.839564  7701 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:51.839605  2320 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:51.811586  7611 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:51.840976  7533 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.841506  7533 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:51.842308  1553 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:51.843918  7606 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:51.810369  1629 rpcz_store.cc:276] 0709 13:01:50.229307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.710985 (+481678us) service_pool.cc:224] Handling call
0709 13:01:50.723565 (+ 12580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.768410 (+ 44845us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:51.206063 (+437653us) log.cc:844] Serialized 14 byte log entry
0709 13:01:51.807889 (+601826us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:51.807943 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:51.807988 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.808051 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.808158 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":105317,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":40,"raft.queue_time_us":6515,"thread_start_us":791861,"threads_started":2}
I20260709 13:01:51.849305  7488 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:51.855662  1632 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:01:51.826946  7537 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
W20260709 13:01:51.859328  2288 leader_election.cc:336] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.669s (SENT)
I20260709 13:01:51.818409  7389 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:51.864971  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 44042.1us
W20260709 13:01:51.859373  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 64810.8us
W20260709 13:01:51.858232  7708 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:01:51.865020  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:51.860774  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3178) took 1307 ms. Trace:
W20260709 13:01:51.854897  7716 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:01:51.860281  7537 consensus_queue.cc:1243] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:51.841507  7682 consensus_queue.cc:1059] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:01:51.864630  7389 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:51.867650  1708 rpcz_store.cc:276] 0709 13:01:50.553722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.553880 (+   158us) service_pool.cc:224] Handling call
0709 13:01:50.600928 (+ 47048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.627163 (+ 26235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.627185 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.655178 (+ 27993us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.788840 (+133662us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:50.857091 (+ 68251us) log.cc:844] Serialized 14 byte log entry
0709 13:01:51.185825 (+328734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.185906 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:51.776485 (+590579us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b2400249f38. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed681e9c4 00007f0ed681cacb 00007f0ed69d7dc9 00007f0ed69d7a55 00007f0ed69d709d 00007f0ed960910e 00007f0ed962088c 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221
0709 13:01:51.858150 (+ 81665us) raft_consensus.cc:1685] finished
0709 13:01:51.860543 (+  2393us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.860718 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5670,"prepare.queue_time_us":68737,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":59417,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":2489,"spinlock_wait_cycles":25155456,"thread_start_us":408536,"threads_started":2,"wal-append.queue_time_us":321134}
I20260709 13:01:51.884349  2321 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:01:51.893508  2321 pending_rounds.cc:85] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 10
I20260709 13:01:51.895051  2321 pending_rounds.cc:107] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:01:51.895917  2321 raft_consensus.cc:2889] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:51.941761  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 122738us
I20260709 13:01:51.876758  7717 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:51.945854  1673 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:51.868424  7285 consensus_queue.cc:1059] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
W20260709 13:01:51.955875  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 98219.2us
I20260709 13:01:51.944271  1601 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:51.959748  2288 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:51.968271  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:51.969395  7357 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:51.969919  7357 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.970381  7357 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:51.972689  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.973584  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 50843.2us
I20260709 13:01:51.956838  7719 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.969106  7339 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:51.980312  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:51.944334  7710 consensus_queue.cc:1059] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:01:51.983475  7339 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:51.990264  7335 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:51.990773  7339 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:51.994570  1705 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:51.973990  7509 raft_consensus.cc:697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:51.972071  7709 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:52.008128  7183 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:51.993453  7516 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:52.021981  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:52.006973  7544 raft_consensus.cc:3055] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:51.985702  7719 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.033960  7719 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:52.023293  7734 consensus_queue.cc:1059] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:01:52.034893  7509 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:52.038111  1673 leader_election.cc:336] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.206s (SENT)
I20260709 13:01:52.038720  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:52.029389  7544 raft_consensus.cc:740] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:01:52.041589  7718 log.cc:927] Time spent T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:01:52.041687  7544 consensus_queue.cc:260] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:52.043371  7544 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.043967  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3249) took 2537 ms. Trace:
I20260709 13:01:52.044335  1555 rpcz_store.cc:276] 0709 13:01:49.506378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.868051 (+361673us) service_pool.cc:224] Handling call
0709 13:01:49.888904 (+ 20853us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:50.011721 (+122817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.011752 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:50.012517 (+   765us) log.cc:844] Serialized 52 byte log entry
0709 13:01:51.111476 (+1098959us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b18000ecce0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:01:51.788428 (+676952us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:51.940611 (+152183us) log.cc:844] Serialized 14 byte log entry
0709 13:01:51.941282 (+   671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.941525 (+   243us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.043653 (+102128us) raft_consensus.cc:1685] finished
0709 13:01:52.043747 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.043906 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":151815,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":1348,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":246,"spinlock_wait_cycles":15282048,"thread_start_us":822912,"threads_started":2,"wal-append.queue_time_us":1832108}
I20260709 13:01:52.039466  1598 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:51.990948  7335 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:52.062247  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 118088us
W20260709 13:01:52.066157  7720 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:01:52.067126  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1151) took 1087 ms. Trace:
W20260709 13:01:52.104425  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 73669.9us
I20260709 13:01:52.026882  7727 consensus_queue.cc:1059] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:01:52.067534  1706 rpcz_store.cc:276] 0709 13:01:50.979568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.517451 (+537883us) service_pool.cc:224] Handling call
0709 13:01:51.518010 (+   559us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:51.534033 (+ 16023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.534063 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:51.563685 (+ 29622us) log.cc:844] Serialized 52 byte log entry
0709 13:01:51.957446 (+393761us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:51.980035 (+ 22589us) log.cc:844] Serialized 14 byte log entry
0709 13:01:51.980371 (+   336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.980465 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.066800 (+ 86335us) raft_consensus.cc:1685] finished
0709 13:01:52.066836 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.067049 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19150,"prepare.queue_time_us":22392,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":8381,"raft.queue_time_us":16223,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":19527,"spinlock_wait_cycles":13162368,"thread_start_us":279543,"threads_started":1,"wal-append.queue_time_us":418612}
W20260709 13:01:52.111292  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47448.3us
I20260709 13:01:52.112146  1601 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:52.061364  7709 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:52.105189  1673 leader_election.cc:336] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.272s (SENT)
I20260709 13:01:52.117362  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:52.105425  7726 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.065490  7732 consensus_queue.cc:1059] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
W20260709 13:01:52.199537  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 177606us
I20260709 13:01:52.202308  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:52.206682  7505 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:01:52.218250  7335 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:52.200208  7709 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.226629  7743 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:52.264801  7701 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.163017  7710 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:52.266606  1634 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:52.267113  7357 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:52.246574  1633 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2709) took 2452 ms (client timeout 1694 ms). Trace:
W20260709 13:01:52.246893  7618 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.730s	user 0.014s	sys 0.000s
I20260709 13:01:52.254557  7709 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:52.258471  7736 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:52.167658  7339 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:52.280293  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 78099.9us
W20260709 13:01:52.353474  1633 rpcz_store.cc:269] 0709 13:01:49.794633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.826584 (+ 31951us) service_pool.cc:224] Handling call
0709 13:01:52.246302 (+2419718us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54002c83d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:52.246468 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4563828608}
I20260709 13:01:52.354367  7636 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:52.152030  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 112601us
I20260709 13:01:52.368881  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:52.250576  7518 consensus_meta.cc:287] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 13:01:52.343438  7509 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:52.381494  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 222123us
W20260709 13:01:52.382561  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.393210  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 287990us
W20260709 13:01:52.394330  1673 leader_election.cc:336] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.339s (SENT)
I20260709 13:01:52.394897  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:52.359751  7183 raft_consensus.cc:697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:52.402499  7539 consensus_meta.cc:287] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.812s	user 0.012s	sys 0.000s
I20260709 13:01:52.376919  7736 raft_consensus.cc:697] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:52.449579  7345 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:52.452765  7682 raft_consensus.cc:3055] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:52.453295  7682 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:52.454262  7682 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.455600  7682 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:52.457340  7710 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:52.457559  7270 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.458662  7742 consensus_queue.cc:1059] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:01:52.372576  7618 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.378764  7389 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.462687  7618 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:52.463129  7389 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:52.463234  7447 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:01:52.374713  7636 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:52.464475  7539 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:52.465849  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.467164  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.467628  7539 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:52.468050  7636 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:52.468330  7285 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:52.375499  7726 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.095s
I20260709 13:01:52.471191  7726 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:52.471649  7339 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:52.471722  7726 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:52.472967  1703 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:01:52.401338  7727 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:52.474555  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2730) took 2323 ms (client timeout 1692 ms). Trace:
I20260709 13:01:52.475019  7736 consensus_queue.cc:237] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:52.476070  7707 raft_consensus.cc:3055] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:52.476542  7707 raft_consensus.cc:740] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:52.465921  1701 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:52.401726  7509 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:52.475111  1634 rpcz_store.cc:269] 0709 13:01:50.151380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.168702 (+ 17322us) service_pool.cc:224] Handling call
0709 13:01:52.474356 (+2305654us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b5400205b54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:52.474472 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4759121152}
W20260709 13:01:52.482448  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 113654us
W20260709 13:01:52.484743  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 325145us
W20260709 13:01:52.488188  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 376067us
I20260709 13:01:52.377720  7518 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:52.496229  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.484984  7509 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.526592  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:52.527436  1555 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:52.531312  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 137033us
W20260709 13:01:52.537184  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 53312us
I20260709 13:01:52.540269  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:52.538228  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:52.543740  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:52.545179  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:52.545847  1553 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.477442  7707 consensus_queue.cc:260] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.499387  7636 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:01:52.525108  7727 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:52.559286  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 65228.5us
I20260709 13:01:52.541414  7701 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:52.579358  1598 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:52.566327  7339 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.566534  7610 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.586383  7740 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:52.589232  7753 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:52.595403  7753 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:52.595892  7753 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:52.591199  1601 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:52.590304  7709 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:52.610955  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3272) took 1496 ms. Trace:
I20260709 13:01:52.611518  1559 rpcz_store.cc:276] 0709 13:01:51.114606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.605014 (+490408us) service_pool.cc:224] Handling call
0709 13:01:51.688457 (+ 83443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.708869 (+ 20412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.610553 (+901684us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b540023ebd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:52.610855 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24088832}
I20260709 13:01:52.617453  1675 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:52.619503  1560 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:01:52.621323  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 77688.5us
I20260709 13:01:52.585381  6989 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:52.642398  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:52.644134  7739 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:52.611672  7225 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:01:52.648123  7747 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:01:52.651960  7533 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:52.653131  7518 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:52.619273  7734 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:52.639346  7445 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:52.654124  1631 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:52.668535  7726 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:52.668372  7445 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.669108  7739 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.670639  7445 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:52.671248  7739 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:52.671705  7743 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.672139  7743 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:52.638806  7744 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
W20260709 13:01:52.661152  7756 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:01:52.613063  7707 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.684718  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:52.685412  1559 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:52.686517  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:52.612118  7610 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.566464  7183 consensus_queue.cc:237] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:52.662159  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:52.593190  7357 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:52.646073  1706 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:52.619663  7709 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:52.665282  7754 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:52.666138  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:52.576062  7727 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.666760  7736 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.675691  1553 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:52.674641  7624 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:52.677807  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.678100  7734 raft_consensus.cc:697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:52.678589  7533 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.679358  7740 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.679858  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 3050) took 1129 ms. Trace:
I20260709 13:01:52.680220  7739 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:52.680822  7744 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.681370  7225 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.683449  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:52.683812  1599 connection.cc:256] RPC call timeout handler was delayed by -1.5068730799999912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
I20260709 13:01:52.684022  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:52.612334  7339 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.716023  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1155) took 1540 ms. Trace:
I20260709 13:01:52.695933  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:52.775990  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:52.693382  1708 raft_consensus.cc:2410] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:01:52.795334  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 154277us
I20260709 13:01:52.781132  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:52.763180  7225 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:52.799543  2323 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:52.800500  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:52.715755  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:52.768888  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:52.769565  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:52.691993  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:52.771690  7697 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.773209  7343 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:52.717968  7727 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:52.775115  1552 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:52.791170  1555 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:52.764670  7734 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:52.788233  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.787324  1701 rpcz_store.cc:276] 0709 13:01:51.550839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.557903 (+  7064us) service_pool.cc:224] Handling call
0709 13:01:52.679640 (+1121737us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b540012c5d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:52.679780 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2084907776}
I20260709 13:01:52.802206  2321 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:52.695578  7736 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.696069  1557 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:01:52.795996  1704 rpcz_store.cc:276] 0709 13:01:51.175315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.603151 (+427836us) service_pool.cc:224] Handling call
0709 13:01:51.603404 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.719878 (+116474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.715717 (+995839us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400396554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:52.715947 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255280384}
W20260709 13:01:52.802927  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.770684  7762 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:52.804747  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:52.795245  2286 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:52.845788  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:52.804936  1634 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
W20260709 13:01:52.830483  1599 connection.cc:256] RPC call timeout handler was delayed by -1.032560033999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 13:01:52.851452  1599 connection.cc:256] RPC call timeout handler was delayed by -1.032560033999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 13:01:52.845789  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:52.839675  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:52.845726  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:52.805400  7744 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.846941  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:52.689291  7610 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:52.848874  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:52.807114  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:52.865795  1635 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:52.849990  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:52.873220  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:52.874536  2325 raft_consensus.cc:2368] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14.
I20260709 13:01:52.875065  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:52.873593  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 78448.4us
I20260709 13:01:52.873600  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:52.782902  7709 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:01:52.878031  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:52.878976  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:52.690038  7509 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:52.881064  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:52.881944  1633 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:52.883893  1634 raft_consensus.cc:2410] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:01:52.885419  1598 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:52.848994  7339 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:52.889092  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 84487.3us
I20260709 13:01:52.891114  1632 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:52.805289  7739 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.863003  7613 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:52.802950  7533 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:52.863860  7225 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:52.919438  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:52.899353  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:52.829142  7624 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.775564  7740 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.906437  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:52.891433  7192 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:52.915174  6962 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.915652  7636 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:52.863372  7727 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:52.907313  1675 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:52.911648  7537 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.910254  7744 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:52.914880  7753 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:52.923183  1706 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:01:52.918027  7696 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:52.911177  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1152) took 1931 ms. Trace:
I20260709 13:01:52.977800  1601 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:52.912811  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:52.920650  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:52.930630  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:52.979876  1700 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:52.932523  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:52.935168  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.935717  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 52395.2us
I20260709 13:01:52.979370  2323 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:52.977901  1703 rpcz_store.cc:276] 0709 13:01:50.979799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.547532 (+567733us) service_pool.cc:224] Handling call
0709 13:01:51.547934 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.473399 (+925465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.910664 (+437265us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54002535d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:52.911087 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2126575360}
W20260709 13:01:52.944154  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 44881.1us
I20260709 13:01:52.943986  1633 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.947435  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:52.891808  7610 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:52.938231  2286 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:52.958340  1559 raft_consensus.cc:2410] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:01:52.829901  7697 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:52.930195  7358 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:52.956631  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:52.983543  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:52.985138  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 77908.1us
I20260709 13:01:52.980798  1708 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:52.983824  1626 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:52.961045  7587 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.988907  1701 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:52.992676  1552 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
W20260709 13:01:52.993691  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 55579.7us
I20260709 13:01:52.988248  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:52.998010  2286 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:53.004142  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:53.006609  1675 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:53.007325  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:53.011369  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:52.923600  7762 consensus_queue.cc:1059] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:01:52.959323  7527 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:01:52.987776  7192 raft_consensus.cc:697] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:53.024870  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:53.043550  1599 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:53.022161  7746 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.036835  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:53.044461  1633 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:53.082329  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:52.988507  7358 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:52.991678  7270 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:53.021894  7764 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:01:53.017917  7450 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:01:53.043241  7733 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.965s	user 0.000s	sys 0.019s
W20260709 13:01:53.086174  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 95972us
I20260709 13:01:53.009069  7248 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:52.977052  6962 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.017315  7413 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:53.015913  7734 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:53.036973  7727 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:52.982175  7613 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.104318  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:53.122339  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:53.122900  7613 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:53.123584  7613 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:53.126768  7709 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.127295  7413 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:53.127882  7413 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.128257  7413 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.985212  7636 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.133500  7636 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:53.109874  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:53.134527  1626 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:53.137610  7611 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:53.138196  7611 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:53.138360  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:53.139151  1628 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:53.097817  7270 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.140038  7270 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.142323  1675 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:53.144804  7533 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:53.146466  7505 raft_consensus.cc:3055] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:53.146751  2320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1321) took 1294 ms. Trace:
I20260709 13:01:53.045641  7754 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:53.113890  7358 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.147220  7739 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:53.147830  7358 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:53.148303  7740 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:53.114970  1634 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:53.046320  7624 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:53.102609  7587 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.149214  7737 raft_consensus.cc:3055] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:53.149768  7737 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:53.158632  7737 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.159745  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:53.159976  7737 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.160774  7762 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:53.161238  7762 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:53.161736  7762 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:53.117139  7763 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:01:53.115329  6962 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:53.149832  7587 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:53.164400  7743 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:53.165457  7587 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:53.116559  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.151687  7753 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:53.153288  7736 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:53.154348  7509 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:53.156317  7729 raft_consensus.cc:3055] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:53.147010  7505 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:53.157069  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:53.157395  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.161151  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:53.089087  7343 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:53.147167  2320 rpcz_store.cc:276] 0709 13:01:51.852321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.852500 (+   179us) service_pool.cc:224] Handling call
0709 13:01:51.858515 (+  6015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.866374 (+  7859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.866407 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.868790 (+  2383us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.947902 (+ 79112us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:51.947949 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.948034 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.880177 (+932143us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:53.146447 (+266270us) raft_consensus.cc:1685] finished
0709 13:01:53.146473 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.146692 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5044,"raft.queue_time_us":2397,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3160,"spinlock_wait_cycles":18537216,"thread_start_us":69728,"threads_started":1,"wal-append.queue_time_us":130650}
I20260709 13:01:53.177392  1626 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
W20260709 13:01:53.195731  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.217736  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 174251us
W20260709 13:01:53.194078  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 178238us
I20260709 13:01:53.248660  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:53.180204  7729 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:01:53.252367  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 60074.7us
I20260709 13:01:53.254454  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:53.260012  2325 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 18: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:53.258247  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:53.265908  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:53.248189  7343 raft_consensus.cc:697] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:53.249315  7248 raft_consensus.cc:697] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:53.276000  7526 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.276919  7526 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.279750  1599 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:53.254158  7740 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:01:53.289258  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2626) took 2060 ms. Trace:
I20260709 13:01:53.289723  1560 rpcz_store.cc:276] 0709 13:01:51.228959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.718437 (+489478us) service_pool.cc:224] Handling call
0709 13:01:52.617150 (+898713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.639247 (+ 22097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.289058 (+649811us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b540023ebd0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:53.289193 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2027495808}
I20260709 13:01:53.293977  1634 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:01:53.299739  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2739) took 3112 ms. Trace:
I20260709 13:01:53.300248  1631 rpcz_store.cc:276] 0709 13:01:50.187471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.683541 (+496070us) service_pool.cc:224] Handling call
0709 13:01:50.684033 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.668345 (+1984312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.289960 (+621615us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400246b54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:53.299646 (+  9686us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4529505024}
I20260709 13:01:53.304708  2325 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:53.305773  2320 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:53.249163  7192 consensus_queue.cc:237] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.299362  7585 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:01:53.298718  6989 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:53.317144  6989 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.317967  6989 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.342010  7248 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.345175  7183 consensus_queue.cc:1059] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:01:53.345223  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 47787.9us
I20260709 13:01:53.346356  7183 raft_consensus.cc:3055] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:53.346776  7183 raft_consensus.cc:740] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:53.348650  1599 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:53.349711  7585 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:53.350145  7585 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.350476  7585 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:53.351444  7518 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:53.351290  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:53.351969  7518 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.352497  7744 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:53.352952  7744 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:53.353437  7744 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:53.355034  7697 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:53.261392  7445 consensus_queue.cc:1059] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:01:53.359131  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:53.361284  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:53.363984  7585 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:53.365051  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:53.365332  1632 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:53.352407  7518 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:53.347709  7183 consensus_queue.cc:260] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:53.375607  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 338791us
I20260709 13:01:53.381150  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:53.376083  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 263065us
W20260709 13:01:53.381665  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 239394us
W20260709 13:01:53.385082  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.385043  1558 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:53.305459  7743 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:01:53.375988  7505 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.303006  7729 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:53.562160  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:53.583185  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.584918  7727 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:53.585235  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.406996  7270 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:53.585649  7727 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:53.587280  7270 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:53.588083  7726 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.588150  7729 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.588729  7726 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.590878  7726 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:53.420001  7183 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.592723  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:53.593333  1633 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:01:53.593168  7754 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:53.596272  1627 raft_consensus.cc:2410] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:53.587698  7727 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:53.597303  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:53.582154  7509 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:53.598023  1627 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:53.598374  7509 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:53.604729  2286 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:53.606099  7682 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:53.606559  7682 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.606928  7682 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:53.391549  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.619782  1633 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
W20260709 13:01:53.392079  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 141187us
I20260709 13:01:53.621333  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:53.562709  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:53.419116  7585 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:53.588182  7775 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:53.566195  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.709162  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:53.709805  2321 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:01:53.600513  7509 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:53.442169  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:53.393462  7753 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:53.655884  7358 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:53.375563  7748 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:53.688126  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.702999  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.627744  7709 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.500s	user 0.013s	sys 0.000s
I20260709 13:01:53.388307  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:53.724047  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:53.421627  1632 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:01:53.712121  7734 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.594s	user 0.016s	sys 0.003s
I20260709 13:01:53.639541  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:53.724954  1628 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
W20260709 13:01:53.733451  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 345178us
W20260709 13:01:53.733946  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.734753  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:53.706578  7780 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:53.714607  1523 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:53.714654  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 1.18244e+06us
I20260709 13:01:53.628860  1601 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:53.712620  7611 consensus_meta.cc:287] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.574s	user 0.016s	sys 0.006s
I20260709 13:01:53.388761  7343 consensus_queue.cc:237] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:53.388669  1675 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:53.713425  1631 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
W20260709 13:01:53.721374  7762 consensus_meta.cc:287] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.559s	user 0.000s	sys 0.012s
I20260709 13:01:53.711505  7782 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:53.723521  2321 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:53.736217  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:53.720562  7753 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:53.627578  7413 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.720350  7358 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:53.758857  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 130063us
I20260709 13:01:53.763190  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:53.730171  7505 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:53.767318  1627 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:01:53.736887  7709 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:53.773389  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.739353  7734 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:53.777015  1601 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:53.777534  1702 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:53.711915  7744 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.789150  1631 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 14 index: 15. Preceding OpId from leader: term: 15 index: 16. (index mismatch)
I20260709 13:01:53.752945  7726 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:53.746583  7339 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.746564  7509 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:53.789970  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:53.795809  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.760191  7587 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:53.765317  7773 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:53.806103  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:53.799948  1601 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:53.765522  7753 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.801074  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:53.803546  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:53.814013  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:53.774224  7358 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:53.779354  7750 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:53.805383  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:53.807430  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:53.808182  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:53.826989  1704 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:53.827495  1628 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:53.760526  7727 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:01:53.811926  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:53.813764  1626 raft_consensus.cc:1240] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:53.817196  2288 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:53.817808  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:53.818869  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:53.714738  7775 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:53.826515  1552 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:53.848727  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:53.849371  1552 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:53.825902  1560 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:53.850664  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:53.854511  1559 raft_consensus.cc:3055] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:53.855090  1559 raft_consensus.cc:740] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:53.761149  7762 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.757938  7611 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.799777  7509 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:53.836282  1598 leader_election.cc:336] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Timed out: RequestConsensusVote RPC to 127.0.107.196:39387 timed out after 1.963s (SENT)
I20260709 13:01:53.800083  7726 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.753634  7780 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.857580  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:53.860661  1700 raft_consensus.cc:2393] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:53.811926  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:53.826337  7709 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.842427  1702 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:53.808791  7587 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.824841  7270 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:53.867193  1559 consensus_queue.cc:260] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:53.869109  1703 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:53.869997  1627 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:53.824961  7732 raft_consensus.cc:2764] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:01:53.835516  1673 connection.cc:256] RPC call timeout handler was delayed by -1.5951365700000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2839s for a response
I20260709 13:01:53.892513  2327 raft_consensus.cc:1240] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:53.893206  2326 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:53.894438  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:53.828456  7717 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:53.899245  1559 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:53.831362  7750 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.764439  7782 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:53.887408  1560 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:53.889438  1558 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:01:53.905750  1558 pending_rounds.cc:85] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 8
I20260709 13:01:53.906111  1558 pending_rounds.cc:107] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:01:53.868491  7726 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.906378  1558 raft_consensus.cc:2889] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:53.890324  1555 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:53.813016  7696 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.059s
I20260709 13:01:53.868722  7509 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:53.909781  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:53.862386  7729 consensus_queue.cc:1059] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:01:53.812701  7339 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.889605  7587 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:53.908318  7696 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:53.881192  7740 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.895782  7697 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:53.944084  7697 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:53.944288  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 555655us
I20260709 13:01:53.944567  7697 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:53.945144  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:53.947701  7777 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:01:53.947839  7339 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:53.933038  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:53.948915  1560 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.949343  7682 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:53.951623  7778 log.cc:927] Time spent T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:01:53.951696  7682 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:53.953263  7413 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:53.905296  7786 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.890956  7709 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.957690  7786 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:53.959955  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2763) took 1088 ms. Trace:
I20260709 13:01:53.905124  7750 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:53.888296  7270 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.932783  1706 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:53.960783  1599 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:53.932809  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:53.960484  1635 rpcz_store.cc:276] 0709 13:01:52.871816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.872082 (+   266us) service_pool.cc:224] Handling call
0709 13:01:52.891482 (+ 19400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.919571 (+ 28089us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.919618 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:52.933108 (+ 13490us) log.cc:844] Serialized 26 byte log entry
0709 13:01:53.386413 (+453305us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:53.386473 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.386570 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.959733 (+573163us) raft_consensus.cc:1685] finished
0709 13:01:53.959752 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.959896 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30534,"raft.queue_time_us":28319,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":9225,"thread_start_us":452791,"threads_started":1,"wal-append.queue_time_us":693724}
W20260709 13:01:53.949043  7779 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.231s	user 0.001s	sys 0.001s
W20260709 13:01:53.986518  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.917855  7717 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:53.941145  1703 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:53.962091  1552 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:53.960215  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1444) took 1150 ms. Trace:
W20260709 13:01:54.010018  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.931506  7696 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:54.044930  7696 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.046630  7696 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:54.017776  7790 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:54.048884  7790 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:54.049347  1560 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:54.049839  7790 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:54.050256  7790 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.050796  7790 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:54.048348  7737 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.888s	user 0.013s	sys 0.000s
W20260709 13:01:54.022187  1526 connection.cc:256] RPC call timeout handler was delayed by -1.5614598439999554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:01:54.025082  7783 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:01:54.025206  7791 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:54.026863  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:53.976186  7413 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:54.026695  7717 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.028070  7782 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:54.029631  7780 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:54.032886  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:54.033267  7744 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:54.033464  7697 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.957729  7762 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:54.038266  7775 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:54.039389  1555 raft_consensus.cc:1240] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:53.963387  7740 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.040750  7754 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:54.041530  7611 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:54.041695  7585 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:54.042906  7786 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:54.000895  2323 rpcz_store.cc:276] 0709 13:01:52.810007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.989223 (+179216us) service_pool.cc:224] Handling call
0709 13:01:52.989642 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:52.996491 (+  6849us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:53.021549 (+ 25058us) log.cc:844] Serialized 14 byte log entry
0709 13:01:53.367201 (+345652us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.367836 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 13:01:53.367982 (+   146us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:53.368035 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.368101 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.960013 (+591912us) raft_consensus.cc:1685] finished
0709 13:01:53.960034 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.960164 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61616,"prepare.queue_time_us":24873,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":7599,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":18191,"thread_start_us":344022,"threads_started":1,"wal-append.queue_time_us":595071}
I20260709 13:01:54.069031  7413 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:53.973855  7270 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:54.078022  7413 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:54.082443  7697 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:54.083103  7726 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.085338  7726 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:54.085913  7726 raft_consensus.cc:3055] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:54.086239  7726 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:54.087188  7726 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:54.089944  6989 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.771s	user 0.021s	sys 0.002s
I20260709 13:01:54.090571  6989 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.093753  6989 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:54.057307  1526 connection.cc:256] RPC call timeout handler was delayed by -1.3886598439999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 13:01:54.102267  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0673598439999523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
I20260709 13:01:54.103176  7740 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:54.103992  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.104084  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:54.105119  1627 raft_consensus.cc:2368] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16.
I20260709 13:01:54.105793  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.106134  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:54.107465  1627 raft_consensus.cc:2393] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:54.108894  7754 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.099992  7270 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.112155  7754 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:54.025130  7709 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:54.075470  7585 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.082518  7753 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:54.072098  7518 consensus_meta.cc:287] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.012s
I20260709 13:01:54.052099  7587 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.104161  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.061774  7791 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.113258  7270 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:54.110731  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:54.149979  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:54.112936  7509 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.066881  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1445) took 1256 ms. Trace:
I20260709 13:01:54.064079  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1330) took 1276 ms. Trace:
I20260709 13:01:54.115548  1559 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:54.163847  1551 rpcz_store.cc:276] 0709 13:01:52.787357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.787475 (+   118us) service_pool.cc:224] Handling call
0709 13:01:53.183535 (+396060us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.184019 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.184046 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:53.184089 (+    43us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:01:53.184117 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.184177 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.063862 (+879685us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b540017f7d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:54.064025 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":814999936}
W20260709 13:01:54.118046  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 223692us
I20260709 13:01:54.107468  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.127334  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:54.165524  1627 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:01:54.130515  1630 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
W20260709 13:01:54.064971  7746 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.963s	user 0.017s	sys 0.007s
I20260709 13:01:54.138964  1632 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
W20260709 13:01:54.139963  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 322826us
I20260709 13:01:54.143231  1555 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:54.146703  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2765) took 1258 ms. Trace:
I20260709 13:01:54.147292  1629 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:54.112397  7790 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.170850  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:54.175565  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.166270  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:54.171182  1634 rpcz_store.cc:276] 0709 13:01:52.888027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.888283 (+   256us) service_pool.cc:224] Handling call
0709 13:01:54.146516 (+1258233us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400204754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:54.146643 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354191232}
I20260709 13:01:54.176724  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.177445  1559 raft_consensus.cc:2393] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:54.138608  7585 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.178702  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:54.180088  1557 raft_consensus.cc:2368] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 18. Current term is 19.
W20260709 13:01:54.187453  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.193106  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.162696  2329 rpcz_store.cc:276] 0709 13:01:52.810829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.038313 (+227484us) service_pool.cc:224] Handling call
0709 13:01:53.038681 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.083312 (+ 44631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.083342 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.083845 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:01:53.386826 (+302981us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:53.386873 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.386985 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.066633 (+679648us) raft_consensus.cc:1685] finished
0709 13:01:54.066655 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.066810 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96535,"raft.queue_time_us":47954,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5446,"thread_start_us":261699,"threads_started":1,"wal-append.queue_time_us":518150}
I20260709 13:01:54.187569  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.200086  1559 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:01:54.201267  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.202456  1559 raft_consensus.cc:2393] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:54.204301  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.205258  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:54.205631  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.206275  1560 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:54.209785  1673 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:54.210924  7413 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:54.211297  7791 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:54.211983  7791 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:54.213351  1634 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:01:54.224570  7379 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:54.213506  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.213920  7587 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:54.174526  7794 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:54.143612  7518 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.226466  7379 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:54.227401  7248 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:54.227742  7248 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:54.228147  7518 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:54.217357  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.229123  7248 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.229810  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.230384  7248 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:54.230919  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:54.231482  1551 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:54.219122  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.233027  1703 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 17: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:54.199075  7339 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.233897  7339 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.236155  7339 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:54.222062  7790 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:54.238876  7753 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:54.240899  7753 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:54.244035  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:54.245329  7753 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:54.186993  7682 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
I20260709 13:01:54.179528  7746 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:54.249933  7709 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:54.223320  7773 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:54.169158  7754 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:54.257598  7509 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:54.258925  7750 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.186719  7697 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:54.261245  7697 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:54.261742  7697 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:54.271814  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 326690us
I20260709 13:01:54.271950  1554 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
W20260709 13:01:54.279678  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.281517  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:54.282106  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.282349  1700 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:54.279572  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:54.291256  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.291744  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:54.292054  1702 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:54.293571  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:54.293728  1551 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
W20260709 13:01:54.292620  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 331835us
I20260709 13:01:54.304454  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.295266  1599 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:54.308499  1702 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 14: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:54.309327  1526 leader_election.cc:400] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16.
I20260709 13:01:54.309796  1526 leader_election.cc:403] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:01:54.309787  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.311003  1702 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:54.304142  1675 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:54.313584  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.313635  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:54.314925  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:54.307040  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.005s	sys 0.021s
I20260709 13:01:54.315783  1704 raft_consensus.cc:2393] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:54.317178  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.314814  1599 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:54.315999  1675 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:54.320089  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.320894  1560 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:54.324229  1675 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:54.325227  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.325625  7505 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:54.326539  7505 raft_consensus.cc:697] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:54.327256  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:54.327605  7505 consensus_queue.cc:237] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.328281  1702 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:54.337565  1599 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:54.317940  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.005s	sys 0.021s
I20260709 13:01:54.339254  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:54.339933  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 572199us
W20260709 13:01:54.343755  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.340030  1707 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:54.346115  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:54.307475  7509 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:54.307200  7798 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.313899  7773 raft_consensus.cc:2764] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:01:54.351295  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:54.315094  7754 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:54.349269  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:54.354908  2323 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 19: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:54.313727  7794 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16.
W20260709 13:01:54.358140  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.005s	sys 0.026s
I20260709 13:01:54.356532  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.357460  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:54.359597  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.323416  7518 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:54.360762  1709 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 19: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:54.324610  7746 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:54.366117  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.358870  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.006s	sys 0.026s
I20260709 13:01:54.390787  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:54.368219  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.361922  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:54.320025  7270 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 13:01:54.391534  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.317126  7740 consensus_queue.cc:1059] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:01:54.385529  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:54.394584  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:54.351915  7509 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.405958  1707 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 17: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:54.360280  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:54.416424  1552 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 16: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:54.353224  7737 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:54.398370  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:54.417876  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:54.420315  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:54.420914  1634 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:01:54.421284  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:54.341832  7780 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:01:54.428903  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1177) took 1067 ms. Trace:
I20260709 13:01:54.390560  7746 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.454270  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:54.426015  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:54.361735  7790 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:54.428828  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:54.429512  1626 rpcz_store.cc:276] 0709 13:01:53.361245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.361358 (+   113us) service_pool.cc:224] Handling call
0709 13:01:53.361627 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.843131 (+481504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.428647 (+585516us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54000e6d54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:54.428834 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1039289088}
I20260709 13:01:54.454931  1709 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:54.458134  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:54.458221  1702 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:54.364230  7526 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:54.353478  7743 consensus_queue.cc:1059] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 13:01:54.445403  7358 consensus_meta.cc:287] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.013s
I20260709 13:01:54.445653  7740 consensus_queue.cc:1243] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:54.446316  1601 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:54.447198  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:54.448570  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.355654  7183 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:01:54.420013  7509 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.453303  7750 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:54.382548  7798 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.456461  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:54.462814  1673 leader_election.cc:336] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.545s (SENT)
I20260709 13:01:54.500490  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:54.499612  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:54.501878  1626 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:54.481604  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:54.485249  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:54.505589  7518 raft_consensus.cc:697] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:54.454480  7799 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:54.457213  7746 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:54.454977  7780 consensus_queue.cc:1243] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer 8106dfc0bda54df0ae10ba13c28ccc18 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:54.394562  7800 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.098s
I20260709 13:01:54.501305  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:54.443950  7709 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:54.523200  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 100896us
W20260709 13:01:54.497401  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 51188.4us
W20260709 13:01:54.524559  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 61800.9us
W20260709 13:01:54.525219  1673 leader_election.cc:336] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.676s (SENT)
I20260709 13:01:54.524226  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.525660  1673 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:54.526731  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:54.511505  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 55130.8us
I20260709 13:01:54.529867  1634 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:01:54.481655  7727 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:54.504287  7740 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:54.484293  7790 raft_consensus.cc:697] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:54.492146  7343 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:54.491920  7762 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:54.425719  7804 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:01:54.522954  1708 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:54.500689  7743 raft_consensus.cc:3055] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:01:54.510047  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 124584us
W20260709 13:01:54.531103  1673 leader_election.cc:336] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.692s (SENT)
W20260709 13:01:54.560432  1673 leader_election.cc:336] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.696s (SENT)
W20260709 13:01:54.561364  1673 leader_election.cc:336] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.735s (SENT)
I20260709 13:01:54.561853  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:54.532104  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.408430  7794 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 13:01:54.534901  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 1176) took 1174 ms. Trace:
I20260709 13:01:54.563174  1630 rpcz_store.cc:276] 0709 13:01:53.360880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.361033 (+   153us) service_pool.cc:224] Handling call
0709 13:01:54.534734 (+1173701us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b54000e7754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:54.534840 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573807488}
I20260709 13:01:54.510772  7791 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:54.513691  7754 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:54.513972  7192 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:54.553938  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.567850  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:54.497454  7358 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:54.579870  1673 leader_election.cc:336] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.855s (SENT)
I20260709 13:01:54.591162  1673 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:54.514073  7737 raft_consensus.cc:697] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:54.536803  7740 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:54.530642  7786 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:54.558727  6989 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:54.545562  7248 raft_consensus.cc:3055] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:54.593199  1558 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:54.595685  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:54.587339  1630 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:54.605751  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:54.607105  1700 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:01:54.587199  7822 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:54.551657  7343 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:54.622395  1631 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:54.607479  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:54.558596  7743 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:54.507552  7518 consensus_queue.cc:237] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:54.606128  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 69790.1us
I20260709 13:01:54.583916  7709 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:54.611248  1634 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:54.577489  7696 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:54.604656  1626 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:54.618971  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:54.626648  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.628798  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:54.589627  7799 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:54.634176  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:54.649335  1702 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:54.550354  7727 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.653781  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.657172  1704 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:01:54.599313  7740 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:54.641628  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:54.649621  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:54.609650  6989 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:54.653708  7810 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:01:54.654127  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:01:54.654945  7811 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:01:54.654795  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:54.655160  7780 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:01:54.667506  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.631807  7753 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:54.653544  7413 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:54.608891  7248 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:54.679916  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1440) took 1871 ms. Trace:
W20260709 13:01:54.682267  7813 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:54.630138  7343 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.721305  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.722458  1704 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:01:54.658663  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:54.688298  7488 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:54.694345  7780 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.710459  1709 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:54.654845  7696 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.712131  2322 rpcz_store.cc:276] 0709 13:01:52.808937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.893129 (+ 84192us) service_pool.cc:224] Handling call
0709 13:01:52.922417 (+ 29288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.026217 (+103800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.026260 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.161085 (+134825us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b180045d2a0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69662a6 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69662a6 00007f0ed6966240
0709 13:01:53.161543 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:01:53.436610 (+275067us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:53.700253 (+263643us) log.cc:844] Serialized 14 byte log entry
0709 13:01:53.746877 (+ 46624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.679616 (+932739us) spinlock_profiling.cc:243] Waited 95.5 ms on lock 0x7b5400829e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:54.679667 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.679712 (+    45us) raft_consensus.cc:1685] finished
0709 13:01:54.679725 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.679860 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55240,"prepare.queue_time_us":246989,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":45063,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":17249,"spinlock_wait_cycles":229880448,"thread_start_us":274564,"threads_started":1,"wal-append.queue_time_us":443585}
I20260709 13:01:54.738124  1601 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:54.690423  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:54.698625  7709 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:54.741505  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 51211.8us
I20260709 13:01:54.742693  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:54.746433  1704 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:54.686981  6989 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.748740  7803 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:54.752650  7803 raft_consensus.cc:697] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:54.753154  7817 log.cc:927] Time spent T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:01:54.754160  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:54.754962  1709 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:54.743444  7791 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:54.781361  7791 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.785475  7285 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:01:54.787669  7585 consensus_meta.cc:287] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
I20260709 13:01:54.789844  7696 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:54.790212  7780 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:54.791388  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.791864  7358 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:54.737586  7743 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.799501  1555 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:54.749009  7488 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:54.723853  7798 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:54.803759  7488 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:54.823905  7488 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:54.788130  7585 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.724342  7737 consensus_queue.cc:237] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.828727  7682 consensus_queue.cc:1059] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:54.698042  7790 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.850167  1702 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
W20260709 13:01:54.853816  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 195228us
I20260709 13:01:54.854298  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:54.854760  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:54.855136  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 313074us
I20260709 13:01:54.855237  7794 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:54.855988  7794 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:54.855543  1702 raft_consensus.cc:2393] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 17: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:54.778591  7697 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.862534  7799 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.614713  7822 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.831827  7753 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:54.893961  7753 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:54.866261  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.880488  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.900620  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 45627.1us
I20260709 13:01:54.901875  2288 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:54.903541  2288 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:54.864326  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 284422us
I20260709 13:01:54.776181  1709 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:54.908740  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3283) took 1110 ms. Trace:
I20260709 13:01:54.908982  7754 raft_consensus.cc:697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:01:54.908309  1673 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.076s (SENT)
I20260709 13:01:54.909839  1556 rpcz_store.cc:276] 0709 13:01:53.798400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.798528 (+   128us) service_pool.cc:224] Handling call
0709 13:01:53.798851 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.163541 (+364690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.163587 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.203690 (+ 40103us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.463664 (+259974us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:54.463718 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.463814 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.908433 (+444619us) raft_consensus.cc:1685] finished
0709 13:01:54.908462 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.908670 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130496,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":28307,"thread_start_us":601003,"threads_started":2,"wal-append.queue_time_us":318956}
I20260709 13:01:54.913035  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:54.911746  1673 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:54.914372  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.915036  1556 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:54.915951  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:54.917928  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:54.891659  7759 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:01:54.923753  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.924942  1702 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:01:54.925235  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:54.919866  7801 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.925858  1709 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:54.920753  1704 raft_consensus.cc:2410] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:01:54.929716  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:54.931761  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:54.897336  7822 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:54.929112  7717 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:54.952139  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:54.906580  7750 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:54.951987  7803 consensus_queue.cc:237] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.952922  7343 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.926203  7775 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:54.953516  7585 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:54.953907  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:55.022625  1701 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:54.955300  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:54.921054  7800 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:55.001019  7804 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.954155  7799 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:55.013356  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 105179us
I20260709 13:01:55.001360  7830 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:55.014019  1556 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:55.039899  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:55.021320  7827 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.160s	user 0.003s	sys 0.002s
I20260709 13:01:55.026252  7537 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.021251  7798 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.034292  1704 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:54.945029  7794 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:54.849140  7248 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.955508  7759 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:55.022786  7753 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:55.064308  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:55.066061  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.035823  7717 raft_consensus.cc:697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:55.043442  7800 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:55.080379  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:55.055390  7775 raft_consensus.cc:697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:55.126766  7753 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:55.144371  7775 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.145471  7753 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.144416  7727 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:55.148156  7509 consensus_meta.cc:287] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.639s	user 0.013s	sys 0.000s
I20260709 13:01:55.148670  7509 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.149379  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 3280) took 1357 ms. Trace:
I20260709 13:01:55.149780  1557 rpcz_store.cc:276] 0709 13:01:53.791868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.792107 (+   239us) service_pool.cc:224] Handling call
0709 13:01:55.149186 (+1357079us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54001d83d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:55.149324 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":811133184}
I20260709 13:01:55.151311  7509 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:55.153035  7748 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:55.153584  7748 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:55.135766  7488 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.157146  7772 raft_consensus.cc:3055] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:55.157940  7772 raft_consensus.cc:740] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:55.158057  7488 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:55.158959  7772 consensus_queue.cc:260] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.054818  7697 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:55.030332  7750 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:54.934741  7801 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.068346  7826 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:55.072193  7759 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:55.151340  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:55.164646  7759 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:55.164836  1557 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:01:55.085551  7825 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.288s	user 0.005s	sys 0.006s
I20260709 13:01:55.168018  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3285) took 1363 ms. Trace:
I20260709 13:01:55.066111  7537 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.168524  7772 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:55.173661  7815 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.146s	user 0.004s	sys 0.000s
I20260709 13:01:55.168450  1553 rpcz_store.cc:276] 0709 13:01:53.804684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.811891 (+  7207us) service_pool.cc:224] Handling call
0709 13:01:53.812382 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.930838 (+118456us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:54.482786 (+551948us) log.cc:844] Serialized 14 byte log entry
0709 13:01:54.556907 (+ 74121us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.557568 (+   661us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.557732 (+   164us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:54.557777 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.557865 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:55.167644 (+609779us) raft_consensus.cc:1685] finished
0709 13:01:55.167767 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.167947 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103683,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":36,"raft.queue_time_us":159014,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":60972,"thread_start_us":564307,"threads_started":3,"wal-append.queue_time_us":156153}
I20260709 13:01:55.171085  7537 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:55.177609  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:55.178465  1553 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:01:55.182631  7717 consensus_queue.cc:237] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.065496  7754 consensus_queue.cc:237] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.121137  1634 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:55.185765  7800 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.122970  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:55.189043  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:55.125142  7837 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:01:55.190503  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:55.191283  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:55.125217  7835 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:55.125437  1701 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:01:55.056015  7799 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:55.071470  1673 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:55.040405  7804 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.134238  7343 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:55.135707  1702 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 15 index: 16. (index mismatch)
I20260709 13:01:55.138773  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 1194) took 1353 ms. Trace:
I20260709 13:01:55.124269  6989 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.069968  7798 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.189204  1704 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:01:55.064348  7762 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.192350  1556 raft_consensus.cc:2393] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:55.187441  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.195101  1557 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:55.198532  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:55.215269  1703 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:01:55.215444  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:55.187441  7748 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.201285  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:55.180395  7488 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:55.206763  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:55.208913  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:55.209574  1632 rpcz_store.cc:276] 0709 13:01:53.785699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.789654 (+  3955us) service_pool.cc:224] Handling call
0709 13:01:55.138565 (+1348911us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54002c74d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:55.138706 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783954304}
W20260709 13:01:55.225833  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 154470us
I20260709 13:01:55.226691  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:55.140902  7285 raft_consensus.cc:3055] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:55.210573  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:55.211638  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:55.200870  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:55.216300  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:55.232362  2325 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:55.199782  7835 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.236840  7339 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:55.242502  7339 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.243194  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:55.244118  7835 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:55.230722  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:55.245244  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:55.230149  7343 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:55.246665  7343 raft_consensus.cc:697] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:55.234494  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:55.248024  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:55.248564  1557 raft_consensus.cc:2410] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:01:55.248878  2323 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:55.249794  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:55.250087  7748 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:55.250761  1557 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:55.251665  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:55.252218  1557 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:55.209617  7799 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.253590  7488 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.254472  7799 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:55.222826  1630 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:55.240267  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:55.245363  1702 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:55.232395  1701 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:55.256855  1672 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:55.222033  7806 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:55.258663  1556 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:01:55.266817  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:55.268987  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:55.273765  1557 raft_consensus.cc:1240] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:55.274142  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:55.276387  1702 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:01:55.268885  1632 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:01:55.270364  1634 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
W20260709 13:01:55.277738  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.278005  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.270982  1701 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
I20260709 13:01:55.270905  1673 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:55.231570  7285 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:55.279837  1673 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:55.280444  1632 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:01:55.280761  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:55.281723  1672 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:55.274050  7445 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.330s	user 0.008s	sys 0.011s
I20260709 13:01:55.258442  7748 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:55.285007  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:55.287166  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:55.285035  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:55.289486  1673 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:55.289821  1672 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:55.289979  1701 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:55.275048  7806 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:55.227205  7762 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.274619  7838 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:55.273842  7826 raft_consensus.cc:2764] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:01:55.279294  7505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.016s	sys 0.009s
W20260709 13:01:55.302104  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.281095  7836 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:55.308760  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3215) took 1001 ms. Trace:
I20260709 13:01:55.298554  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:55.308789  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:55.286854  7445 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.343s	user 0.009s	sys 0.011s
I20260709 13:01:55.248041  7343 consensus_queue.cc:237] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.315670  1702 rpcz_store.cc:276] 0709 13:01:54.307836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.288122 (+980286us) service_pool.cc:224] Handling call
0709 13:01:55.308075 (+ 19953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.308342 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.308383 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:55.308434 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:55.308477 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.308555 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.308704 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:55.320641  1702 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:55.291838  7835 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:55.317836  1673 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:55.324816  7488 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:55.285162  7759 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.297943  7697 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:55.293838  7782 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:55.307399  7746 consensus_meta.cc:287] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.764s	user 0.012s	sys 0.002s
I20260709 13:01:55.293320  7780 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:55.327262  6989 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:55.333794  1673 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:55.305392  7806 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:55.328446  7791 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:55.337925  7740 consensus_meta.cc:287] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.003s
I20260709 13:01:55.359807  1557 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:55.361096  1673 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:55.298707  7748 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.314745  7518 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:55.310459  7830 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:55.388959  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:55.389818  7762 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:55.318609  7505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.017s	sys 0.009s
I20260709 13:01:55.365715  7822 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.391781  1700 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:55.391968  1628 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 15. Current term is 16. Ops: [15.16-15.16]
I20260709 13:01:55.392558  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1179) took 1005 ms. Trace:
I20260709 13:01:55.393033  1700 rpcz_store.cc:276] 0709 13:01:54.387170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.391313 (+1004143us) service_pool.cc:224] Handling call
0709 13:01:55.391612 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.392292 (+   680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.392499 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:55.394412  1700 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:55.395468  7782 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:55.398460  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1446) took 2587 ms. Trace:
I20260709 13:01:55.367666  7798 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:55.370585  7804 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:55.337146  7697 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:55.398859  2326 rpcz_store.cc:276] 0709 13:01:52.828549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.266242 (+437693us) service_pool.cc:224] Handling call
0709 13:01:53.293279 (+ 27037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.903240 (+609961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.398195 (+1494955us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b5400078d54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:55.398380 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367484800}
W20260709 13:01:55.378309  1598 leader_election.cc:336] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Timed out: RequestConsensusVote RPC to 127.0.107.196:39387 timed out after 2.072s (SENT)
I20260709 13:01:55.399652  7285 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.399672  7697 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:55.400961  7339 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:55.401572  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 3047) took 1590 ms. Trace:
I20260709 13:01:55.351442  7746 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.401921  1631 rpcz_store.cc:276] 0709 13:01:53.810898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.812488 (+  1590us) service_pool.cc:224] Handling call
0709 13:01:53.812774 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.637065 (+824291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.401350 (+764285us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b5400205b54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:55.401520 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842985216}
I20260709 13:01:55.403982  7746 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:55.342159  7818 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:55.405808  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 44842.3us
I20260709 13:01:55.378978  7740 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.378324  7759 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:55.390334  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:55.399942  1598 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:55.407618  1707 raft_consensus.cc:2393] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 12: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:55.400892  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.380486  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 3057) took 1563 ms. Trace:
I20260709 13:01:55.340720  1632 pending_rounds.cc:85] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 10
I20260709 13:01:55.396154  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.418030  1632 pending_rounds.cc:107] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 13.11
W20260709 13:01:55.410758  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.421777  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:55.422338  1598 connection.cc:256] RPC call timeout handler was delayed by -1.2942457540000305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
W20260709 13:01:55.424748  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.411415  1631 raft_consensus.cc:1240] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:55.426570  1631 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:55.427145  1706 rpcz_store.cc:276] 0709 13:01:53.817332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.817489 (+   157us) service_pool.cc:224] Handling call
0709 13:01:55.380215 (+1562726us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b540012d9d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:55.380399 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204467968}
I20260709 13:01:55.428411  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:55.419502  1628 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:55.429286  1706 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 14: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:55.389895  2329 raft_consensus.cc:2410] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:01:55.432848  1632 raft_consensus.cc:2889] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:55.434092  1551 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:01:55.434387  1598 connection.cc:256] RPC call timeout handler was delayed by -1.1022405660000345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 13:01:55.434957  1598 connection.cc:256] RPC call timeout handler was delayed by -1.0818457540000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
I20260709 13:01:55.438431  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:55.349172  7835 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:55.477579  7835 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.440799  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:55.363396  7791 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:55.479918  7791 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:55.480441  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:55.481455  1706 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 17: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:55.482714  1706 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:01:55.483278  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 3059) took 1060 ms. Trace:
I20260709 13:01:55.483609  1706 rpcz_store.cc:276] 0709 13:01:54.422811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.482166 (+1059355us) service_pool.cc:224] Handling call
0709 13:01:55.482497 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.483053 (+   556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.483230 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:55.443960  1626 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:55.409713  7804 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:55.465554  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:55.488121  1551 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:55.466389  7339 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:55.471550  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:55.491909  1706 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:01:55.416733  7823 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:55.481308  1630 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:55.443208  1598 leader_election.cc:400] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14.
I20260709 13:01:55.494127  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1180) took 1068 ms. Trace:
I20260709 13:01:55.497064  1706 rpcz_store.cc:276] 0709 13:01:54.425286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.491293 (+1066007us) service_pool.cc:224] Handling call
0709 13:01:55.491690 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.493859 (+  2169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.494077 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:55.496290  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 59697.2us
I20260709 13:01:55.498674  1598 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:55.499924  1598 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:55.501322  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:55.504642  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:55.512210  1702 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:55.512769  1598 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:55.419446  7746 consensus_queue.cc:1059] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:01:55.517472  1706 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:55.514437  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2657) took 1006 ms. Trace:
I20260709 13:01:55.515441  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:55.515867  1702 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:55.492406  7067 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.486814  7759 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:55.487073  7488 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:55.516737  7358 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:55.510151  7505 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:55.529636  7818 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:55.491609  7762 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:55.584251  7762 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:55.586019  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 285161us
I20260709 13:01:55.586897  7762 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:55.520052  7736 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:55.533138  1706 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:55.510447  6989 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:55.540670  7067 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.541117  7805 consensus_queue.cc:1059] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:55.544245  2329 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:55.546248  7822 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:55.524855  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:55.559762  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:55.564275  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1180) took 2149 ms. Trace:
I20260709 13:01:55.590739  1551 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:01:55.590785  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:55.591106  1629 rpcz_store.cc:276] 0709 13:01:53.414948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.415144 (+   196us) service_pool.cc:224] Handling call
0709 13:01:54.147132 (+731988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.171962 (+ 24830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.564015 (+1392053us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b5400204750. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:55.564207 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1681924352}
I20260709 13:01:55.561884  7488 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.556205  7759 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.499810  7339 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.575078  7697 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.579516  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:55.602367  1553 raft_consensus.cc:2393] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:55.561376  7830 consensus_queue.cc:1059] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:01:55.582760  7740 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:55.554956  7775 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:55.587062  1672 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:55.594880  7805 consensus_queue.cc:1243] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:55.607676  7847 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:55.611076  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:55.614439  7067 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:55.615795  7339 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:55.616560  7801 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:55.616861  1557 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:55.618050  1557 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:55.618649  7759 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:55.608405  7775 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.619899  1557 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:55.621279  7775 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:55.621444  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 1177) took 1303 ms (client timeout 1622 ms). Trace:
W20260709 13:01:55.621889  1708 rpcz_store.cc:269] 0709 13:01:54.318296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.338653 (+ 20357us) service_pool.cc:224] Handling call
0709 13:01:55.621288 (+1282635us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400265a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:55.621388 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375187200}
I20260709 13:01:55.625268  7585 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:55.625947  7585 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.632345  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:55.634760  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:55.637006  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:55.637868  1629 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:55.639808  7505 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.640395  7505 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.642504  7505 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:55.643232  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:55.644008  1628 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 19: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:55.644274  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1325) took 2058 ms. Trace:
I20260709 13:01:55.644656  2327 rpcz_store.cc:276] 0709 13:01:53.586068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.598141 (+ 12073us) service_pool.cc:224] Handling call
0709 13:01:53.598449 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.904687 (+306238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.644019 (+1739332us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400529ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:55.644208 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675784576}
I20260709 13:01:55.645129  1628 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:55.646435  1628 raft_consensus.cc:1240] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:55.647625  1628 raft_consensus.cc:1240] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:55.648752  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3295) took 1691 ms. Trace:
I20260709 13:01:55.649122  1554 rpcz_store.cc:276] 0709 13:01:53.957627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.047593 (+ 89966us) service_pool.cc:224] Handling call
0709 13:01:54.048024 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.290783 (+242759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.648470 (+1357687us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54002f49d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:55.648672 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514251008}
I20260709 13:01:55.650554  1554 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:55.520143  1556 rpcz_store.cc:276] 0709 13:01:54.507865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.272663 (+764798us) service_pool.cc:224] Handling call
0709 13:01:55.284074 (+ 11411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.284264 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:55.485117 (+200853us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.514081 (+ 28964us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:55.514142 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:55.514192 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.514267 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.514383 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4691,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":12048,"thread_start_us":220233,"threads_started":2,"wal-append.queue_time_us":41999}
I20260709 13:01:55.654873  7585 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:55.656175  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:55.657030  1551 raft_consensus.cc:2393] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:01:55.657382  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 142046us
I20260709 13:01:55.658049  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3226) took 1237 ms. Trace:
W20260709 13:01:55.658293  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 71349.4us
I20260709 13:01:55.659384  7830 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:55.658479  1700 rpcz_store.cc:276] 0709 13:01:54.420323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.396380 (+976057us) service_pool.cc:224] Handling call
0709 13:01:55.429508 (+ 33128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.429712 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:55.463530 (+ 33818us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.657599 (+194069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:55.657675 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:55.657738 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.657828 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.657977 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61251,"prepare.queue_time_us":34692,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":61693,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":132343,"threads_started":1,"wal-append.queue_time_us":146249}
I20260709 13:01:55.659770  7830 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.660195  7830 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:55.657485  7746 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:55.660935  7746 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.661306  7746 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:55.660475  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2647) took 1550 ms. Trace:
I20260709 13:01:55.663518  1555 rpcz_store.cc:276] 0709 13:01:54.109920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.205278 (+ 95358us) service_pool.cc:224] Handling call
0709 13:01:55.660318 (+1455040us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54001c8ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:55.660424 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958316928}
I20260709 13:01:55.664681  2323 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:55.612023  7762 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.601428  7806 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.669291  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.669436  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:55.674299  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.678673  2327 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:01:55.679265  2327 pending_rounds.cc:85] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 13
I20260709 13:01:55.679616  2327 pending_rounds.cc:107] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:01:55.679931  2327 raft_consensus.cc:2889] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:55.680526  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.680784  7805 consensus_queue.cc:1059] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:55.682619  7748 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:55.684105  7726 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:55.684626  7804 raft_consensus.cc:3055] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:55.685040  7804 raft_consensus.cc:740] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:55.685966  7804 consensus_queue.cc:260] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.686923  1704 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:55.687592  7804 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:55.688129  7806 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:55.688364  1701 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:55.671525  7820 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 13:01:55.689260  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 3217) took 1368 ms. Trace:
I20260709 13:01:55.689838  7820 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:55.689699  1707 rpcz_store.cc:276] 0709 13:01:54.320477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.433781 (+113304us) service_pool.cc:224] Handling call
0709 13:01:55.689049 (+1255268us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b54002553d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:55.689198 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2078880128}
I20260709 13:01:55.690529  7820 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:55.690770  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3220) took 1342 ms. Trace:
I20260709 13:01:55.691700  7820 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.698271  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:55.682723  7488 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:55.691260  1701 rpcz_store.cc:276] 0709 13:01:54.348497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.314100 (+965603us) service_pool.cc:224] Handling call
0709 13:01:55.688156 (+374056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.688889 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.690569 (+  1680us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54002544d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:55.690704 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":811150080}
I20260709 13:01:55.701692  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:55.714713  2288 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:55.716624  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:55.721700  1629 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:55.726022  1634 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:55.726912  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:55.721323  1675 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:55.724356  2288 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:55.635377  7775 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:01:55.733709  2288 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:01:55.736371  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.736620  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:55.736388  7780 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:55.739275  7780 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:55.739863  7780 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:55.744778  7067 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:55.745261  7067 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.745636  7067 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:55.750069  7800 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:55.750617  7800 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.751130  7800 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:55.758064  7780 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.761286  7339 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:55.765394  7791 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.716214  7717 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.769735  7717 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.782555  1702 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:55.787034  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.789628  1630 raft_consensus.cc:2393] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 19: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:55.730175  7527 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:55.730664  7750 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:55.715924  7806 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.068s
W20260709 13:01:55.794540  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.699576  7762 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.801246  1599 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:55.800086  1552 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:55.804330  1558 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:55.808974  1599 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:55.811717  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:55.812373  1630 raft_consensus.cc:2393] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:55.813220  7740 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:55.814683  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:55.816056  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:55.816972  1556 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
I20260709 13:01:55.817384  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.817756  7270 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:55.788290  7801 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.818631  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.818953  7801 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.819741  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.821170  7801 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:55.821367  7856 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:01:55.826135  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:55.827589  7759 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:55.828305  7759 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:55.829782  7759 consensus_queue.cc:1059] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:01:55.857242  7759 consensus_queue.cc:1243] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer 8106dfc0bda54df0ae10ba13c28ccc18 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:55.857857  7759 raft_consensus.cc:3055] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:55.858242  7759 raft_consensus.cc:740] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:55.859331  7759 consensus_queue.cc:260] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.828565  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:55.860823  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 125925us
I20260709 13:01:55.837201  1560 raft_consensus.cc:2410] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:01:55.846160  1599 leader_election.cc:400] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 18. Current term is 19.
I20260709 13:01:55.863773  1599 leader_election.cc:403] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:55.832103  1627 raft_consensus.cc:3055] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:55.864372  1627 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:55.865041  7270 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 18. Current term is 19.
I20260709 13:01:55.865185  1627 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.866317  7750 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.866540  1627 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:55.866889  7750 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.867944  7527 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:55.868494  7488 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:55.862010  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:55.859447  7067 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.807713  7791 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:55.863997  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:55.874315  1599 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:55.874895  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:55.877687  1702 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:55.876310  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:55.880874  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:55.882247  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:55.831568  7753 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:55.838090  7762 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:55.883374  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:55.884053  1700 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:55.884845  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:55.884984  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:55.885824  7801 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:55.886230  7801 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:55.886602  7801 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:55.887189  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:55.888139  1599 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:55.886397  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:55.889376  1599 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:55.894975  1627 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:55.895849  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1201) took 1483 ms. Trace:
I20260709 13:01:55.897867  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:55.899251  1706 raft_consensus.cc:1240] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:55.896394  1627 rpcz_store.cc:276] 0709 13:01:54.412027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.457231 (+ 45204us) service_pool.cc:224] Handling call
0709 13:01:54.487435 (+ 30204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.832008 (+1344573us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54000e63a0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed99fcdc0 00007f0ed9a871c0 00007f0ed9a88231 00007f0ed9a84d8f 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c
0709 13:01:55.895543 (+ 63535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.895779 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1883196672}
W20260709 13:01:55.901204  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.893085  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:55.907208  7585 consensus_queue.cc:1059] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:55.865372  7759 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:55.911870  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:55.913064  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:55.904924  7797 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:55.914733  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:55.908411  7585 raft_consensus.cc:3055] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:55.920974  1599 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:55.917695  7727 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:55.914505  7797 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.923446  7736 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:55.923964  7797 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:55.901171  7744 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:55.905649  7726 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:55.931208  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.930491  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.935685  1627 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:55.931974  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.936784  1635 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:01:55.932492  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:55.933543  7736 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:55.910167  7740 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:55.910562  7379 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:55.963971  7750 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:55.934321  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.861438  7746 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:55.895771  7488 consensus_queue.cc:1059] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:01:55.912161  7762 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.912570  7697 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:55.914840  7753 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:55.927251  7771 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:55.927675  7794 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:55.917485  7192 consensus_queue.cc:1059] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:01:55.935012  7726 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:55.943095  7527 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:55.909286  7803 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:01:55.949218  1700 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:55.921056  7585 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:55.916013  6989 consensus_queue.cc:1059] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:01:55.939123  7719 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:01:55.985181  7750 raft_consensus.cc:3055] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:55.959241  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:55.982687  7794 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:55.927241  1702 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:55.993506  7726 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:55.923929  7727 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:55.973220  7772 raft_consensus.cc:3055] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:56.037071  7772 raft_consensus.cc:740] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:56.037714  7727 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:56.038149  7772 consensus_queue.cc:260] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:55.969202  7780 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:55.984364  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 69702.1us
I20260709 13:01:55.988125  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:55.989866  1631 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:56.040524  7801 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.041443  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:55.979125  7753 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.041697  7285 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:56.042146  7753 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:56.042615  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:55.976725  7067 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:56.044672  7775 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:56.044972  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:55.918098  7343 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:56.045512  7775 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:55.982820  7771 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.046136  7754 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:55.998342  7358 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:01:56.046325  7771 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:56.005739  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:56.047623  1627 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:01:56.011371  1633 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:01:56.009159  1632 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:01:56.053206  1633 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 1196) took 1642 ms (client timeout 1622 ms). Trace:
I20260709 13:01:55.938968  7736 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:55.994837  7740 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:55.971937  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.968719  7800 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.018229  6989 raft_consensus.cc:3055] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:56.010674  7750 raft_consensus.cc:740] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:01:56.021433  7863 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:01:56.028920  7746 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:55.980541  7748 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:01:56.043166  7801 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:56.002545  1630 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:01:55.993840  7527 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.045434  7248 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:56.053696  1633 rpcz_store.cc:269] 0709 13:01:54.410453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.412747 (+  2294us) service_pool.cc:224] Handling call
0709 13:01:55.959075 (+1546328us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b5800153f98. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960eee 0000000000375939 00007f0ede9d41e0 00007f0edea9d0c4 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 13:01:56.053137 (+ 94062us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9069568}
I20260709 13:01:55.976362  7762 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:56.052320  7537 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:55.973306  7830 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.016469  7803 consensus_queue.cc:1243] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:56.055240  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:56.059399  1628 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:56.046325  7794 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:56.063704  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 79484us
W20260709 13:01:56.064153  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 76658.6us
I20260709 13:01:56.086863  1554 raft_consensus.cc:2393] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 12: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:56.064410  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:56.065080  7358 consensus_queue.cc:1059] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:56.058446  6989 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:56.107702  6989 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:56.109169  6989 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:56.088960  7803 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:56.061126  7823 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:01:56.089131  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:56.089818  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:56.089862  1601 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:56.090211  1702 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:56.114044  1707 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:01:56.090529  7780 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.115191  1601 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:56.115903  7780 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.116364  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:56.116876  7537 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:56.117564  7537 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:56.091212  1700 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 15. Current term is 16. Ops: [14.15-15.16]
I20260709 13:01:56.118075  7537 raft_consensus.cc:697] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:56.091828  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:56.119127  1555 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:56.119117  7537 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.120364  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:56.121038  2327 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:56.118186  7823 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:56.124294  7823 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:56.123476  7797 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:56.097852  1557 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:56.098184  7729 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:56.125344  7823 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 14.15, Last appended by leader: 15, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.099558  7748 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 14.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:56.126204  7797 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:56.126588  7748 raft_consensus.cc:3055] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:56.062417  7445 consensus_queue.cc:1059] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:01:56.127018  7748 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:56.076082  7527 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:56.128489  7800 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:56.128795  1555 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:56.100548  7833 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:56.101420  7611 consensus_queue.cc:1059] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:56.133929  7611 raft_consensus.cc:3055] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:56.134498  7611 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:56.134709  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:56.135345  1555 raft_consensus.cc:2376] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12. Re-sending same reply.
I20260709 13:01:56.135747  7611 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.103974  7719 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:56.104930  7750 consensus_queue.cc:260] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.138936  7750 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:56.139096  1700 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:01:56.105705  7379 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:56.086541  7632 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:01:56.125767  7729 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:56.058158  7740 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.127993  7748 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.16, Last appended by leader: 16, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.103276  7762 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:56.105549  2288 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:56.145599  1707 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:01:56.145961  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:56.153681  2286 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:56.159238  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:56.162532  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 57052.4us
I20260709 13:01:56.175840  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:56.178043  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:56.179359  2326 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 19: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:56.178537  7729 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:56.118144  7780 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:56.181244  7611 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:56.184810  7285 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:56.185039  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:56.185617  7285 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:56.186754  7285 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:56.187631  7379 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:56.186087  2327 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:01:56.188490  7379 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:56.189102  7379 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:56.192169  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:56.192885  1559 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:56.199036  7784 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 2.331s	user 0.002s	sys 0.008s
I20260709 13:01:56.199648  1559 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
W20260709 13:01:56.200774  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 47192.9us
I20260709 13:01:56.201941  2286 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:56.177680  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:56.195863  7527 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.206897  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:56.208925  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:56.221474  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:56.221772  1557 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:01:56.221643  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:56.222349  1557 pending_rounds.cc:85] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 12
I20260709 13:01:56.223006  1557 pending_rounds.cc:107] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:01:56.223305  1557 raft_consensus.cc:2889] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:56.225841  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:56.226212  2288 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:56.225234  7748 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:56.233736  7847 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:56.234315  7847 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:56.230381  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:56.119108  7753 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.220440  7067 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:56.217700  7800 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:56.262850  1707 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:56.162518  7797 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:01:56.271574  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:56.226559  7729 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:56.210724  7719 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:56.268471  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:56.220139  7734 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.270864  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:56.262040  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 45091us
I20260709 13:01:56.272763  1554 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:01:56.226792  7830 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:56.212759  7771 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:56.276003  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:56.287062  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:56.288914  1554 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 19: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:56.291042  2328 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:56.300570  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:56.270218  7746 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.304302  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:56.306023  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:56.306882  2324 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:01:56.310062  2329 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:56.311908  1523 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:56.315327   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:56.282014  7067 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:01:56.362648  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.313282  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:56.383384  1554 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:56.372681  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 60909.1us
W20260709 13:01:56.379173  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.310882  7537 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.278697  7800 raft_consensus.cc:697] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:56.395440  7537 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.389991  7746 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.290856  7835 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 13:01:56.459842  7800 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.464393  1523 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:56.298667  7734 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:56.465525  7874 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:01:56.315019  7696 consensus_queue.cc:1059] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.167s
I20260709 13:01:56.473003  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:56.523761  1707 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:56.483645  7537 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:56.486897  7794 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:56.487995  7875 log.cc:927] Time spent T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.102s	user 0.003s	sys 0.005s
I20260709 13:01:56.494558  7527 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:56.391860  7719 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
I20260709 13:01:56.500620  7285 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.501942  7740 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:56.504318  7771 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:56.315232  7759 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:56.518038  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 53722us
I20260709 13:01:56.526369  7067 raft_consensus.cc:697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:56.449085  7526 consensus_queue.cc:1059] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
W20260709 13:01:56.552958  1456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41160 (request call id 298) took 48747 ms (client timeout 15000 ms). Trace:
I20260709 13:01:56.558671  1707 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:01:56.559990  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:56.562721  1707 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 19. Current term is 20. Ops: []
W20260709 13:01:56.527019  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.527071  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:56.567153  2325 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 19.
I20260709 13:01:56.531893  1554 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:01:56.521637  7762 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:56.535393  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:56.574360  7794 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:56.517359  7445 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.544409  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 318335us
I20260709 13:01:56.575098  7445 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.577332  7445 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:56.577442  2288 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:56.577724  7696 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:56.578764  7527 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:56.578897  7696 consensus_queue.cc:1243] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:56.579378  7527 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:56.579444  7753 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:56.579720  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:56.580365  7527 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:56.582285  1673 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.129s (SENT) [suppressed 17 similar messages]
I20260709 13:01:56.584013  7067 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.588459  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:56.590560  7526 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:56.591176  7526 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:56.594659  7734 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:56.577696  7726 consensus_meta.cc:287] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
W20260709 13:01:56.553462  1456 rpcz_store.cc:269] 0709 13:01:07.598389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.600099 (+  1710us) service_pool.cc:224] Handling call
0709 13:01:56.303268 (+48703169us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:41.063456 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:41.356898 (+293442us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:41.366203 (+  9305us) write_op.cc:435] Acquired schema lock
0709 13:01:41.368345 (+  2142us) tablet.cc:662] Decoding operations
0709 13:01:41.728145 (+359800us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:41.741714 (+ 13569us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:41.745703 (+  3989us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:01:41.814890 (+ 69187us) tablet.cc:701] Row locks acquired
0709 13:01:41.814960 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:01:41.815196 (+   236us) write_op.cc:270] Start()
0709 13:01:41.845595 (+ 30399us) write_op.cc:276] Timestamp: P: 1783602101815100 usec, L: 0
0709 13:01:41.862072 (+ 16477us) op_driver.cc:348] REPLICATION: starting
0709 13:01:41.891149 (+ 29077us) log.cc:844] Serialized 8273 byte log entry
0709 13:01:42.301702 (+410553us) op_driver.cc:464] REPLICATION: finished
0709 13:01:42.640729 (+339027us) write_op.cc:301] APPLY: starting
0709 13:01:42.648872 (+  8143us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:43.598606 (+949734us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:43.691498 (+ 92892us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:44.280885 (+589387us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:44.281314 (+   429us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:01:44.281378 (+    64us) write_op.cc:312] APPLY: finished
0709 13:01:44.281944 (+   566us) log.cc:844] Serialized 188 byte log entry
0709 13:01:44.349247 (+ 67303us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:44.375807 (+ 26560us) write_op.cc:454] Released schema lock
0709 13:01:44.381741 (+  5934us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:44.392025 (+ 10284us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:44.394545 (+  2520us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":303466,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":313177,"apply.run_cpu_time_us":48615,"apply.run_wall_time_us":1759928,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91781,"num_ops":21,"prepare.queue_time_us":215670,"prepare.run_cpu_time_us":50024,"prepare.run_wall_time_us":1046720,"raft.queue_time_us":104825,"raft.run_cpu_time_us":51275,"raft.run_wall_time_us":200677,"replication_time_us":439466,"thread_start_us":460724,"threads_started":5,"wal-append.queue_time_us":284758,"wal-append.run_cpu_time_us":22827,"wal-append.run_wall_time_us":2359961}]]}
I20260709 13:01:56.605430  7805 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:56.592255  7526 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.607342  1559 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:56.610842  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:56.611836  2322 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:56.617045  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:56.626578  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1206) took 1704 ms. Trace:
I20260709 13:01:56.627023  1626 rpcz_store.cc:276] 0709 13:01:54.922238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.932929 (+ 10691us) service_pool.cc:224] Handling call
0709 13:01:54.933194 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.484787 (+551593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.626326 (+1141539us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54000d8ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:56.626519 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174091648}
I20260709 13:01:56.629817  2286 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:56.621129  7823 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:56.634954  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:56.635449  2286 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:56.607961  7726 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.635644  1705 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:01:56.638899  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:56.632997  7823 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.633392  7611 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:56.668396  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:56.669414  7726 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:56.646088  7696 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:56.675855  1705 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:56.671885  7823 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:56.687472  7780 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.688305  7780 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:56.637432  7719 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:01:56.698909  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:56.699365  7743 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:56.700083  7862 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:56.703806  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3213) took 2418 ms. Trace:
I20260709 13:01:56.676383  7879 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:56.709622  1704 raft_consensus.cc:1275] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:56.716686  7879 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.731621  7879 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:56.714282  1709 rpcz_store.cc:276] 0709 13:01:54.285818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.012739 (+726921us) service_pool.cc:224] Handling call
0709 13:01:55.380398 (+367659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.380713 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:55.381027 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.497836 (+116809us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:55.497890 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:55.497930 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.498013 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.655197 (+157184us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b18002fb7e0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6912c0a 00007f0ee0052219 00007f0edd95958f 00007f0ed6998571 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd
0709 13:01:56.703574 (+1048377us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540012d9d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:56.703726 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15538,"prepare.queue_time_us":582,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":1399,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":6499,"spinlock_wait_cycles":862545536,"thread_start_us":116065,"threads_started":1,"wal-append.queue_time_us":150118,"wal-append.run_cpu_time_us":1219,"wal-append.run_wall_time_us":1030610}
I20260709 13:01:56.750799  1709 pending_rounds.cc:85] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 11
I20260709 13:01:56.751157  1709 pending_rounds.cc:107] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:01:56.751446  1709 raft_consensus.cc:2889] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:56.748942  1601 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:56.710042  7717 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:56.774865  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.713233  7862 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:01:56.747886  7847 consensus_meta.cc:287] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
I20260709 13:01:56.735076  7820 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:56.782924  1705 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:56.781498  7847 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:56.785149  7877 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:01:56.775113  7270 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:56.801743  7750 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.819353  1705 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 13:01:56.809962  7445 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:01:56.781788  7740 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:01:56.804978  7830 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:56.833943  7270 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:01:56.840729  7885 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.841388  7885 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:56.843726  7885 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:56.845171  7823 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.847762  7823 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:56.848917  2322 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:56.850137  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:01:56.826591  7379 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.006s
I20260709 13:01:56.850844  7379 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.851516  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:56.826339  7750 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:56.853811  7882 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:56.854699  7750 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:56.852716  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:56.867597  7737 raft_consensus.cc:3055] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:56.868144  7737 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:56.874985  7830 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.877375  7830 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:56.884927  2329 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:56.887153  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:56.889721  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:56.892379  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:56.893715  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:56.897538  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:56.898394  1553 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:56.906054  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:56.911347  7682 raft_consensus.cc:3055] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:56.911603  2328 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 16. Preceding OpId from leader: term: 16 index: 16. (term mismatch)
I20260709 13:01:56.912098  2328 pending_rounds.cc:85] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 15
I20260709 13:01:56.912344  2328 pending_rounds.cc:107] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted NO_OP operation due to leader change: 15.16
I20260709 13:01:56.912611  2328 raft_consensus.cc:2889] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:56.912803  1552 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:56.910111  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:56.915648  1707 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:01:56.917039  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:56.917904  1704 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:56.896226  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:56.923391  1627 raft_consensus.cc:1240] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:56.924438  1707 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:56.927664  1552 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:56.931016  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:56.926570  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:56.934201  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:56.934876  1632 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:56.911868  7682 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:56.819057  7862 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:56.939895  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:56.936225  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:56.938199  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:56.948877  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:56.950888  1706 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:56.957053  1707 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:56.959735  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:56.960870  1704 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 19: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:56.961637  1703 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:01:56.963469  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:56.964164  1703 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:56.965015  1523 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:56.967334  1523 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:56.958738  2286 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:56.959142  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:56.959546  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:56.969318  1706 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:56.957783  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:56.972806  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:56.980612  1705 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:56.966538  7862 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:56.965245  7379 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:56.983059  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:56.986435  1523 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:56.972205  7729 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:56.955076  7737 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:56.993922  7726 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:56.993726  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 104085us
I20260709 13:01:56.994395  7866 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:56.995116  7759 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:56.995529  1523 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:56.996731  7794 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:57.001775  7894 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:57.009534  1705 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:56.987722  7885 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:56.963655  7697 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:01:57.017891  1523 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:57.019049  2329 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
W20260709 13:01:57.020552  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.976866  7067 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:57.000202  7790 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.871s	user 0.033s	sys 0.018s
I20260709 13:01:57.000017  7729 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:56.998946  7750 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:56.981048  7719 consensus_queue.cc:1059] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:01:57.016727  7771 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:57.030894  7736 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:57.031472  7771 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:57.032378  7736 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:57.014027  7726 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.034216  7726 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.035920  7717 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.036476  7717 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.038765  7717 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:57.029430  7762 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:57.045607  7843 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.046234  7843 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:57.048954  7729 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:57.051084  7843 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:57.053556  7719 raft_consensus.cc:3055] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:57.054031  7719 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:57.054836  7719 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.056074  7719 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:57.057677  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.033701  7771 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:57.028276  7697 raft_consensus.cc:3055] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:57.015610  7797 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.019593  7753 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:57.061897  1560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2650) took 2556 ms (client timeout 2129 ms). Trace:
W20260709 13:01:57.066958  1560 rpcz_store.cc:269] 0709 13:01:54.505750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.511840 (+  6090us) service_pool.cc:224] Handling call
0709 13:01:57.061690 (+2549850us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54000b7cd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:57.061822 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3014626048}
I20260709 13:01:57.063120  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:57.067836  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:57.060551  1706 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:01:57.068576  1631 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:01:57.064157  1523 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:57.026638  7885 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.072880  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:57.069392  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:57.074326  1560 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:57.074645  7794 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:57.074803  7903 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:57.075436  7903 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:57.074342  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:57.076242  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:57.077677  7903 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:57.078208  7903 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.078681  7903 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:57.029847  7790 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.901s	user 0.033s	sys 0.018s
I20260709 13:01:57.066229  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:57.064664  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:57.070257  7893 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.084064  1630 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:57.085707  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:57.087244  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:57.088060  1632 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:57.092563  1552 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:57.071206  7866 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:57.082540  7885 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:57.066407  7843 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:57.102901  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1196) took 1124 ms. Trace:
I20260709 13:01:57.063411  7697 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:57.084040  7759 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:57.087175  7753 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:57.086694  7737 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:57.107669  1552 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:01:57.105515  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 90708.9us
I20260709 13:01:57.108716  1708 rpcz_store.cc:276] 0709 13:01:55.978845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.979091 (+   246us) service_pool.cc:224] Handling call
0709 13:01:55.988637 (+  9546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.003781 (+ 15144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.003832 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.015512 (+ 11680us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.950107 (+934595us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b18004699c0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:01:57.025458 (+ 75351us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:57.089055 (+ 63597us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.089253 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.089398 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.089435 (+    37us) raft_consensus.cc:1685] finished
0709 13:01:57.102682 (+ 13247us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.102828 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63427,"raft.queue_time_us":17105,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":12957,"spinlock_wait_cycles":85055232,"thread_start_us":75102,"threads_started":1,"wal-append.queue_time_us":1063070}
I20260709 13:01:57.089738  7794 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:57.120576  7794 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.121111  7794 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.097558  7771 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:57.070375  7632 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:01:57.070319  7750 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:01:57.128881  7750 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:57.129448  7750 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:57.131552  7750 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:57.073988  7797 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.133725  7797 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:57.089704  7893 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:57.118353  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:57.138803  7526 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:57.139114  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:57.140866  7790 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:57.141583  7790 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:57.141741  7682 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.143090  7790 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:57.143636  7790 raft_consensus.cc:697] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:57.144646  7780 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:57.149261  1673 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:57.151160  1555 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:57.090305  7717 consensus_queue.cc:1059] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:01:57.181524  7726 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:57.183596  7726 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:57.183463  7879 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.184231  7726 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:57.185796  7879 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:57.186712  7192 raft_consensus.cc:3055] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:57.187135  7192 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:57.132295  7771 raft_consensus.cc:697] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:57.188293  7771 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.189257  7697 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.189589  7772 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:57.190472  7697 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:57.193871  2325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 1458) took 1812 ms (client timeout 1911 ms). Trace:
W20260709 13:01:57.194384  2325 rpcz_store.cc:269] 0709 13:01:55.381289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.408086 (+ 26797us) service_pool.cc:224] Handling call
0709 13:01:57.193565 (+1785479us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b54004f3b54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:57.193746 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2123111680}
I20260709 13:01:57.117210  7753 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:57.197197  7753 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.198860  1633 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:57.112496  7903 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:57.149053  7866 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:57.085448  7762 consensus_queue.cc:1059] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 13:01:57.166309  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.144461  7790 consensus_queue.cc:237] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:57.170568  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:57.173589  7585 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:57.173985  7833 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:57.179327  7285 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:57.180562  7847 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:57.206692  1598 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:57.209255  1701 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:01:57.210057  1675 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:57.211761  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:57.213135  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1364) took 1003 ms. Trace:
I20260709 13:01:57.218364  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:57.220253  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:57.220515  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:57.221205  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:57.222553  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:57.108116  7800 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:01:57.228199  1626 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:01:57.197492  1454 catalog_manager.cc:5697] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 12 to 16, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:57.230235  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 71201.9us
I20260709 13:01:57.245072  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:57.262019  1630 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.262317  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:57.223335  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:57.262802  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:57.263146  1703 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:57.263234  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:57.243805  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:57.243007  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:57.265183  1631 raft_consensus.cc:2410] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:57.259087  1629 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:57.188004  7192 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.258975  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:57.112651  7843 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.159159  7780 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:57.267777  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 61153.3us
I20260709 13:01:57.264396  1708 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
W20260709 13:01:57.239688  7898 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:01:57.180272  7729 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.280529  1559 rpcz_store.cc:276] 0709 13:01:56.211204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.220396 (+  9192us) service_pool.cc:224] Handling call
0709 13:01:56.259768 (+ 39372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.607886 (+348118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.212834 (+604948us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54002292d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:57.213059 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798174592}
I20260709 13:01:57.239715  7866 raft_consensus.cc:3055] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:01:57.297652  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 329770us
W20260709 13:01:57.280637  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 70622.3us
W20260709 13:01:57.302719  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 215514us
I20260709 13:01:57.319233  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:57.296710  1454 catalog_manager.cc:5697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 13 to 17, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:57.157325  7750 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:57.327252  1672 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:57.333653  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:57.335413  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:57.337157  1630 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:57.282933  7585 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:57.291874  7773 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:57.339003  1556 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:57.230820  7903 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 13:01:57.240554  7717 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.083s
I20260709 13:01:57.228943  7894 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:01:57.337157  1703 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:01:57.343093  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3317) took 1411 ms. Trace:
I20260709 13:01:57.343947  7762 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.345811  7908 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:57.349887  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:57.383193  1702 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.350572  2325 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:57.344313  7794 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:57.352597  1629 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:57.230340  7726 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:57.325616  7886 log.cc:927] Time spent T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:57.338757  1454 catalog_manager.cc:5697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 7 to 14. New cstate: current_term: 14 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.361056  1598 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:57.365666  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:57.325450  7905 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:57.379300  1556 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20.
I20260709 13:01:57.333093  7780 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:01:57.385726  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.327939  7866 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:57.427492  1552 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:57.429407  1560 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:57.361068  1558 rpcz_store.cc:276] 0709 13:01:55.932111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.932251 (+   140us) service_pool.cc:224] Handling call
0709 13:01:55.932519 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.932770 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:55.933024 (+   254us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.342666 (+1409642us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b180021bbc0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a8f716 00007f0ed9aa0287
0709 13:01:57.342768 (+   102us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.342813 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:57.342857 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.342927 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.343036 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":108,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":46088,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3851,"spinlock_wait_cycles":11159424,"thread_start_us":56976,"threads_started":1}
I20260709 13:01:57.434058  1454 catalog_manager.cc:5697] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 10 to 12, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.444907  1633 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:57.399792  7740 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:57.339952  7750 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:01:57.380177  7773 raft_consensus.cc:697] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:57.462523  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 135335us
I20260709 13:01:57.466306  1552 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:01:57.405990  7843 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:57.399458  7907 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:57.515350  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:57.516132  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.507946  1454 catalog_manager.cc:5697] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 2 to 12, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 12 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:57.521754  1454 catalog_manager.cc:5697] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 10 to 15, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 15 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:01:57.542948  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 57780.1us
I20260709 13:01:57.502259  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:57.379158  7248 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
I20260709 13:01:57.551853  1552 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:01:57.555403  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:57.556814  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:57.557492  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:01:57.549794  1702 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:01:57.558308  1552 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.558926  1703 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:57.391361  7762 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:57.560613  1554 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:57.573993  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:57.574416  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:57.574146  1454 catalog_manager.cc:5697] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 7 to 11, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.574934  1554 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:01:57.578940  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:57.579988  1554 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:01:57.439560  7905 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:57.585678  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 254696us
I20260709 13:01:57.600421  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:57.625622  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:57.627345  1551 raft_consensus.cc:1275] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:01:57.627992  1551 pending_rounds.cc:85] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 6
I20260709 13:01:57.628274  1551 pending_rounds.cc:107] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:01:57.628613  1551 raft_consensus.cc:2889] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:57.631825  1558 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:57.583768  1454 catalog_manager.cc:5697] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.562877  7843 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.671458  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:57.672510  1630 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:57.672694  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:57.673527  1635 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:57.672837  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:57.674826  1628 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.674659  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:57.674676  1552 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:57.675827  1675 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:57.675367  1454 catalog_manager.cc:5697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 6 to 15. New cstate: current_term: 15 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.679426  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:57.589346  7736 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:57.680248  1630 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:57.626415  7847 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:57.549507  7907 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.684192  1454 catalog_manager.cc:5697] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.563266  7285 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:01:57.698046  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:57.702992  1632 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:57.573813  7753 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:57.715099  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 303777us
I20260709 13:01:57.681926  7632 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:57.716372  1454 catalog_manager.cc:5697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.694900  7771 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:57.749711  1555 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:57.751008  1630 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20.
I20260709 13:01:57.753835  1454 catalog_manager.cc:5697] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.652343  7843 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.564193  7866 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.800559  1454 catalog_manager.cc:5697] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 4 to 13, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:01:57.807673  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 207342us
I20260709 13:01:57.738533  7919 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.697978  7736 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.749661  7780 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:57.842700  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 163662us
I20260709 13:01:57.752647  7726 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:57.705350  7847 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:57.800697  7896 log.cc:927] Time spent T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:01:57.833882  1454 catalog_manager.cc:5697] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:01:57.802954  7719 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.746s	user 0.013s	sys 0.000s
I20260709 13:01:57.800251  7917 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:57.752007  7697 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 13:01:57.757265  7835 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 13:01:57.695043  7773 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:57.753575  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 209609us
I20260709 13:01:57.843201  7866 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:57.866777  1454 catalog_manager.cc:5697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 6 to 7, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.854878  7830 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.919188  1672 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:57.894246  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.757493  7632 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:57.852205  7505 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.831801  7717 consensus_queue.cc:1059] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:01:57.857510  7780 raft_consensus.cc:697] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:57.799980  7771 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:57.929013  1454 catalog_manager.cc:5697] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.904971  7726 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.875977  7750 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:57.949580  7894 raft_consensus.cc:2764] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:01:57.949699  7847 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:57.950851  7905 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:57.952277  7843 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:57.842548  7919 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:57.953217  7914 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:01:57.954957  7819 consensus_queue.cc:1059] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:57.955704  7936 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.043056  7919 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:58.053651  7819 raft_consensus.cc:3055] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:58.053747  7936 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:57.957696  7885 consensus_meta.cc:287] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.000s
I20260709 13:01:58.058092  7885 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.052352  7780 consensus_queue.cc:237] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:57.964870  7911 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.314s	user 0.002s	sys 0.000s
W20260709 13:01:57.967559  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 124107us
I20260709 13:01:58.061527  7885 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.063376  7940 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:58.063163  7192 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:58.080118  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 271493us
I20260709 13:01:57.984195  7505 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:57.923801  7762 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:57.935664  7918 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.016716  7726 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:58.017310  7916 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:01:58.018002  7750 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:58.019279  7933 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:01:58.018401  1454 catalog_manager.cc:5697] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 8 to 11, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:58.020218  7907 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:57.917382  7917 raft_consensus.cc:697] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:57.949703  7736 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.027408  7729 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.118188  7746 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.033808  7771 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:57.935346  7830 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.034885  7905 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.125170  7905 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.126438  7830 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:58.127990  7905 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:01:58.039093  7526 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.900s	user 0.008s	sys 0.007s
I20260709 13:01:58.043749  7928 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:58.129909  7928 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.131219  2323 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:58.043877  7843 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.049361  7925 raft_consensus.cc:3055] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:01:58.039443  7772 consensus_meta.cc:287] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.000s
I20260709 13:01:58.043812  7903 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.143401  7940 consensus_queue.cc:1059] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:58.143934  7903 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.144734  7940 raft_consensus.cc:3055] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:58.144830  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.146297  7903 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:58.054284  7819 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:58.147330  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.147392  7819 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.148445  1703 raft_consensus.cc:2393] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:01:57.971695  1558 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:01:58.149643  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.150426  7771 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.151118  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.151913  1700 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:58.035394  7932 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:58.152961  7932 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.154762  1632 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:58.155166  7526 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:58.155282  7932 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.155720  7526 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.063786  1599 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:58.156962  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 93277.3us
I20260709 13:01:58.158147  7526 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:58.158551  7927 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.159359  7927 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.159755  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.160238  7505 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:58.000084  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.081952  2285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.007s	sys 0.000s
I20260709 13:01:58.081825  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:58.180104  2285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.007s	sys 0.000s
W20260709 13:01:58.180642  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 98900.1us
I20260709 13:01:58.181749  7904 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:58.115216  7917 consensus_queue.cc:237] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.134351  2288 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:58.184907  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 50622.5us
I20260709 13:01:58.182788  7379 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:58.185537  7819 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:58.185907  7379 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.135465  1705 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:58.138557  1454 catalog_manager.cc:5697] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 11 to 13, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 13 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:58.184938  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.137699  7925 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:58.137224  7843 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.145146  7940 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:58.046209  7585 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.691s	user 0.010s	sys 0.003s
I20260709 13:01:57.963358  7759 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:58.158779  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.161669  7903 consensus_queue.cc:1059] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:58.165359  7632 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.167025  7726 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.103205  6989 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.068004  1628 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:58.217866  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.168676  7822 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.151120  7771 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.108142  7918 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.110982  7753 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.066151  1635 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20.
I20260709 13:01:58.158149  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:58.176918  7928 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.179499  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.182184  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:58.240067  1704 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 20.
I20260709 13:01:58.182777  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.183863  7750 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:58.187341  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.241425  2322 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:58.187462  2320 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:01:58.242507  7773 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:58.242637  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 84575.8us
I20260709 13:01:58.244479  1598 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:01:58.246142  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 64019.2us
W20260709 13:01:58.188087  2288 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.622s (SENT)
I20260709 13:01:58.078061  7936 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:58.185118  7862 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:58.244874  2328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:58.248945  7862 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:58.193673  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.250283  2321 raft_consensus.cc:2393] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 19: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:58.193995  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.195120  1601 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:58.194572  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 1199) took 2106 ms (client timeout 2055 ms). Trace:
W20260709 13:01:58.190296  1525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.014s	sys 0.006s
I20260709 13:01:58.197182  7932 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:01:58.198592  1454 catalog_manager.cc:5697] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 9 to 11, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:01:58.253711  1525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.014s	sys 0.007s
W20260709 13:01:58.192564  7926 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:58.200649  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.185140  7743 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.212632  7526 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:58.201516  7931 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:01:58.199401  1559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.005s	sys 0.017s
W20260709 13:01:58.196863  7611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.002s	sys 0.017s
W20260709 13:01:58.221748  1553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.008s	sys 0.013s
W20260709 13:01:58.273819  1553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.008s	sys 0.014s
I20260709 13:01:58.223697  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.197952  7732 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.237089  1630 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:01:58.238062  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.248622  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:58.249508  7862 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:58.253129  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 65074.9us
I20260709 13:01:58.205111  2324 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:01:58.253223  1701 rpcz_store.cc:269] 0709 13:01:56.088550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.088865 (+   315us) service_pool.cc:224] Handling call
0709 13:01:58.194424 (+2105559us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003d9fd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:58.194511 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2465227136}
I20260709 13:01:58.269390  1454 catalog_manager.cc:5697] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 7 to 16. New cstate: current_term: 16 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:58.246912  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:58.253293  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 58257.2us
I20260709 13:01:58.223089  7905 raft_consensus.cc:3055] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:58.259922  1631 raft_consensus.cc:2410] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:01:58.221155  7772 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:58.268193  1700 raft_consensus.cc:2393] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 19: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:01:58.274282  1559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.005s	sys 0.017s
W20260709 13:01:58.286525  7611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.003s	sys 0.017s
I20260709 13:01:58.295022  7585 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:58.296237  7918 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.297410  7843 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.289649  7925 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.253926  7940 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.300105  7893 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:58.254988  7753 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:58.302659  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.303534  7771 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.303908  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1386) took 1039 ms. Trace:
I20260709 13:01:58.304127  7744 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:58.269033  7505 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:58.305505  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.230125  7822 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.308919  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.294440  7743 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.248657  7936 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:58.227443  6989 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:58.220394  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.022s	sys 0.024s
W20260709 13:01:58.388300  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.023s	sys 0.024s
W20260709 13:01:58.391964  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.199967  7904 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.393263  1599 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:58.394955  1599 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:58.318691  7906 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.889s	user 0.004s	sys 0.000s
I20260709 13:01:58.306789  7905 raft_consensus.cc:740] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:58.321470  7379 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:58.322983  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1475) took 1192 ms. Trace:
W20260709 13:01:58.328531  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 81688.5us
I20260709 13:01:58.307746  7526 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.353672  1454 catalog_manager.cc:5697] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 11 to 15, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 15 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:58.311069  2288 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:58.356640  1555 rpcz_store.cc:276] 0709 13:01:57.264984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.265462 (+   478us) service_pool.cc:224] Handling call
0709 13:01:57.265754 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.757365 (+491611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.303675 (+546310us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54000b72d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:58.303851 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1112265472}
I20260709 13:01:58.317839  7585 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:58.415452  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.439541  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 128570us
I20260709 13:01:58.440449  2288 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:58.444058  1628 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:58.444839  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:58.451457  1627 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:58.452173  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:01:58.443148  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 145765us
I20260709 13:01:58.453107  1454 catalog_manager.cc:5697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 9 to 11, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:01:58.444975  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.456224  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.456845  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:58.457125  1700 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:58.353127  7925 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:58.462604  2321 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:58.387105  7936 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:58.418062  2326 rpcz_store.cc:276] 0709 13:01:57.130767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.131015 (+   248us) service_pool.cc:224] Handling call
0709 13:01:57.131390 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.131757 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:01:57.585304 (+453547us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.801492 (+216188us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.814017 (+ 12525us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.814242 (+   225us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:01:57.814296 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.814419 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.322651 (+508232us) raft_consensus.cc:1685] finished
0709 13:01:58.322697 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.322900 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55158,"prepare.queue_time_us":276575,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":4140,"raft.queue_time_us":75743,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":3223,"thread_start_us":631135,"threads_started":2,"wal-append.queue_time_us":469398}
I20260709 13:01:58.410127  1599 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:01:58.466979  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 56959.3us
I20260709 13:01:58.467994  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:58.396849  7753 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.459170  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:58.460047  1454 catalog_manager.cc:5697] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 10 to 12, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:58.334764  7773 consensus_queue.cc:1059] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:01:58.357590  7505 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.314703  7732 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.455199  7750 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:58.451539  7932 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:01:58.469426  7953 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:58.462311  7696 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:58.517370  7696 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:58.518311  7696 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.521907  7822 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:58.522275  1601 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:58.456224  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.437623  7823 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:58.515684  7953 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.523602  1601 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:01:58.523903  1555 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:01:58.523965  1628 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:58.543857  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.340252  7945 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:58.544723  7945 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.491842  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 3082) took 1426 ms. Trace:
I20260709 13:01:58.493067  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.494498  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1213) took 1254 ms. Trace:
I20260709 13:01:58.495510  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 3324) took 1019 ms. Trace:
W20260709 13:01:58.496483  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.526114  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:01:58.505996  1556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 1385) took 1241 ms (client timeout 1581 ms). Trace:
I20260709 13:01:58.507210  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.508608  1631 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:58.508620  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:58.508666  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 49583.4us
I20260709 13:01:58.512534  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3321) took 1073 ms. Trace:
I20260709 13:01:58.427163  7771 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:58.528146  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:01:58.528302  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 67015.4us
I20260709 13:01:58.497485  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 3095) took 1418 ms. Trace:
I20260709 13:01:58.440937  7943 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.437768  7585 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:58.441780  7719 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:58.438143  7893 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.546486  1700 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:58.587158  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.545627  1634 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:01:58.590960  2325 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 12.
W20260709 13:01:58.576555  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 53033.4us
I20260709 13:01:58.545352  1626 rpcz_store.cc:276] 0709 13:01:57.065010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.067141 (+  2131us) service_pool.cc:224] Handling call
0709 13:01:57.067421 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.260893 (+193472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.491614 (+1230721us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400204254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:58.491785 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368872832}
I20260709 13:01:58.593160  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:58.577477  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 109601us
I20260709 13:01:58.545045  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.545958  1707 rpcz_store.cc:276] 0709 13:01:57.240206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.284330 (+ 44124us) service_pool.cc:224] Handling call
0709 13:01:57.327354 (+ 43024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.646009 (+318655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.646036 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.646075 (+    39us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:57.646104 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.494290 (+848186us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b5400397954. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:58.494333 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.494443 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732243200}
I20260709 13:01:58.579159  1701 raft_consensus.cc:2410] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:58.546119  1558 rpcz_store.cc:276] 0709 13:01:57.476458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.501970 (+ 25512us) service_pool.cc:224] Handling call
0709 13:01:58.495316 (+993346us) spinlock_profiling.cc:243] Waited 86.3 ms on lock 0x7b54000569d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:58.495430 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198566144}
I20260709 13:01:58.523618  7843 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:58.469839  7632 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:58.490052  7526 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:58.580153  1560 rpcz_store.cc:276] 0709 13:01:57.439532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.439766 (+   234us) service_pool.cc:224] Handling call
0709 13:01:57.470122 (+ 30356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.551337 (+ 81215us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:57.722891 (+171554us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.221328 (+498437us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.221403 (+    75us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:58.221476 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.512213 (+290737us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b5400026f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:01:58.512261 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.512476 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":288229,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":209208,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":87,"spinlock_wait_cycles":186056960,"thread_start_us":647159,"threads_started":3,"wal-append.queue_time_us":181485}
I20260709 13:01:58.596184  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.611677  1558 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:01:58.612794  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.505218  7505 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.592100  1598 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:58.579535  1556 rpcz_store.cc:269] 0709 13:01:57.264510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.265275 (+   765us) service_pool.cc:224] Handling call
0709 13:01:58.505792 (+1240517us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5400027e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:58.505937 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24591744}
I20260709 13:01:58.631143  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.598698  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.599565  1700 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:58.606352  7192 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.633015  7192 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.633632  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.634266  1702 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:01:58.634537  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.635213  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.635356  7192 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:58.635838  2320 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:01:58.583010  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.512342  7797 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.508900  7879 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:58.469719  7379 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:58.602501  1707 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:58.644227  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.469587  7936 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:58.495036  7743 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:58.511691  7927 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.597121  7897 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:01:58.489341  6989 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:58.575340  1709 rpcz_store.cc:276] 0709 13:01:57.078888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.079012 (+   124us) service_pool.cc:224] Handling call
0709 13:01:57.079433 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.079775 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.079805 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.080244 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.106274 (+ 26030us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:57.106325 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.106408 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.301921 (+1195513us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:01:58.497180 (+195259us) raft_consensus.cc:1685] finished
0709 13:01:58.497203 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.497430 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7271,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":12900,"spinlock_wait_cycles":8854272,"thread_start_us":25668,"threads_started":1,"wal-append.queue_time_us":217906}
I20260709 13:01:58.607266  7893 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:58.615064  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.666683  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.545271  7956 consensus_queue.cc:1059] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.174s
I20260709 13:01:58.541544  7823 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.581256  7744 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:58.572041  7945 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:58.575762  7771 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:58.693782  7771 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:58.678771  6989 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:58.462184  7248 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.141s
I20260709 13:01:58.546108  7918 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.585505  7819 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:58.638511  1553 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:01:58.602043  7843 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.647851  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:58.706758  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.649731  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:01:58.708405  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 58752.3us
I20260709 13:01:58.546382  7753 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.616842  7527 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.653321  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.545984  7820 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.614208  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.598270  7943 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.573352  7750 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:01:58.649264  7797 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.643989  7736 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:01:58.759490  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:58.759799  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:01:58.679039  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 86875.2us
I20260709 13:01:58.670075  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.761487  1555 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:01:58.696342  6989 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.691758  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:01:58.701697  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 108622us
I20260709 13:01:58.671612  7951 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:01:58.685190  7955 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:01:58.710829  1705 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:01:58.713578  2329 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:01:58.714035  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 100528us
I20260709 13:01:58.671542  7424 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:01:58.692365  7823 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:58.738742  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.835932  1558 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:01:58.718410  1672 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:01:58.837675  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 119379us
I20260709 13:01:58.838622  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.839823  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:58.839673  7505 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.840483  1634 raft_consensus.cc:2368] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 19. Current term is 20.
I20260709 13:01:58.658211  7379 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:58.646354  7965 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:58.762214  1560 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:01:58.841629  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.842278  1552 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:01:58.837679  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.843086  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.702190  7248 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.702504  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.716816  7843 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:58.698376  7918 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.769631  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:58.849957  2320 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:58.764994  6989 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:58.765174  7885 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:01:58.755044  7820 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.785615  7797 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:58.785974  7952 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:01:58.741058  7527 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.787074  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.787312  7750 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.787695  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:01:58.865651  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 78167.7us
I20260709 13:01:58.790057  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1387) took 1430 ms. Trace:
I20260709 13:01:58.792857  2327 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:01:58.794946  7943 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:58.801214  7753 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:58.803399  7904 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.808229  7780 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.736016  7897 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:58.818457  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.818914  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.869794  1626 raft_consensus.cc:2393] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 17: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:58.819545  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.868849  1559 rpcz_store.cc:276] 0709 13:01:57.359913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.379067 (+ 19154us) service_pool.cc:224] Handling call
0709 13:01:57.407598 (+ 28531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.313443 (+905845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.313478 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.316144 (+  2666us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.592286 (+276142us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:58.592325 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.592402 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.789280 (+196878us) raft_consensus.cc:1685] finished
0709 13:01:58.789303 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.789589 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":442417,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7204,"thread_start_us":1144567,"threads_started":2,"wal-append.queue_time_us":402108}
I20260709 13:01:58.821341  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.870978  1675 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:58.871544  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.825029  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.825774  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:58.873646  1701 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:58.829595  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:01:58.698804  7862 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.834380  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.846009  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.846565  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.847328  1553 raft_consensus.cc:2393] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:58.789475  7893 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:58.829737  7833 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.828289  7932 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:58.854346  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.850963  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:58.848872  2286 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:58.856357  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:01:58.881435  1560 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 19: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:01:58.845031  7965 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.828516  7759 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:01:58.861743  1704 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:58.819309  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.886369  1702 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:01:58.831233  7726 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:01:58.848078  7958 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:58.841254  7424 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.858513  7885 consensus_queue.cc:1243] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer 8106dfc0bda54df0ae10ba13c28ccc18 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:58.890486  2286 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:58.890998  1553 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:01:58.872530  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:58.892849  1628 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:58.894080  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.897182  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:58.850564  7248 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.902989  2329 raft_consensus.cc:2393] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 19: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:58.972922  7904 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:58.974275  7905 consensus_queue.cc:260] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.975445  7905 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:58.951732  2328 raft_consensus.cc:606] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:58.976948  2328 raft_consensus.cc:614] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:58.953058  1631 raft_consensus.cc:1275] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:58.978358  7819 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:58.978530  1631 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:58.981698  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:58.982843  2321 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:01:58.985662  2327 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:58.986470  2321 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:01:58.987624  7974 log.cc:927] Time spent T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:01:58.890237  7797 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.099s
I20260709 13:01:58.989475  7505 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:58.955667  7526 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:58.956981  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 1351) took 2017 ms. Trace:
I20260709 13:01:58.950263  7697 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:58.993551  7697 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.994037  7697 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:58.954510  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 64108.7us
I20260709 13:01:58.997169  1701 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:01:58.998768  7285 raft_consensus.cc:3055] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:58.999099  1701 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:58.999228  7285 raft_consensus.cc:740] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:58.953469  1632 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:01:58.963647  7972 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:01:58.990998  2323 rpcz_store.cc:276] 0709 13:01:56.939114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.939636 (+   522us) service_pool.cc:224] Handling call
0709 13:01:58.956800 (+2017164us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400104354. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:58.956922 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2736250240}
I20260709 13:01:58.966141  7820 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:58.967434  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.968940  7917 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:59.001220  7917 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.969527  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:59.002887  7830 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:59.003299  7830 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:58.990477  7526 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.003968  7526 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:59.004138  7830 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.005373  7830 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:59.006604  7248 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:59.008409  7726 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:59.009016  7726 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.959187  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:58.971360  7682 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.886639  7903 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:58.890715  7790 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:01:58.897194  7958 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:58.937275  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.990376  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 117937us
I20260709 13:01:59.046573  1675 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:58.885059  7339 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:01:58.857057  7771 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:58.969905  1559 raft_consensus.cc:1275] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:58.954027  1630 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:01:59.049815  1675 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:01:59.016901  1633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.010s	sys 0.013s
I20260709 13:01:59.002928  1700 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
W20260709 13:01:59.050750  1633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.011s	sys 0.013s
I20260709 13:01:58.888528  7965 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:59.040001  7942 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.013s	sys 0.045s
I20260709 13:01:59.052816  7794 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:58.953384  7379 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.054284  1627 raft_consensus.cc:1240] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:59.054903  7908 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:59.057083  7424 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:59.059026  7726 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:58.904246  7932 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.059274  7936 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.041937  7903 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.059592  7526 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.061379  7862 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:59.062244  7527 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:59.065014  7732 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:59.067405  7771 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:59.048956  7958 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:59.118357  7526 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:01:59.076198  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.082137  7790 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:01:59.071853  1672 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:01:59.121778  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 50220us
I20260709 13:01:59.122438  1672 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:58.899271  7956 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:59.123739  7956 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.899713  7753 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.120278  7697 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:58.903128  7953 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:59.059497  7893 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:01:59.083104  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 320452us
I20260709 13:01:59.125234  7893 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.125313  7897 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:59.125722  7893 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:59.125787  7897 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:59.126299  7897 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:59.084656  2320 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
W20260709 13:01:59.087100  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 492138us
I20260709 13:01:59.128983  1599 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:59.124871  7753 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.132030  7753 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.896327  7585 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.134123  1628 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:59.113926  7820 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:01:59.136833  7585 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:59.076512  7942 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.013s	sys 0.045s
I20260709 13:01:59.137884  6989 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.139118  7958 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.140775  7917 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:58.894972  7833 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.145880  7697 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:59.148006  7833 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:59.149333  7958 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:59.151701  2327 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:59.152663  1634 raft_consensus.cc:2368] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13.
I20260709 13:01:59.152275  7823 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.153510  1629 raft_consensus.cc:2393] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 12: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:59.153290  7719 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:59.000244  7285 consensus_queue.cc:260] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.121132  7726 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.889675  7780 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.133035  7915 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:59.124339  7956 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:59.082540  7908 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.107875  7903 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:59.155481  7285 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:59.194388  7925 consensus_meta.cc:287] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.670s	user 0.013s	sys 0.003s
W20260709 13:01:59.219838  7866 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.022s	sys 0.035s
I20260709 13:01:59.181448  7915 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:59.187069  7823 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:59.187877  7908 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:59.107451  7932 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.183982  6989 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:59.246654  2324 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
W20260709 13:01:59.266685  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.244699  7866 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.022s	sys 0.035s
I20260709 13:01:59.228368  7915 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:59.228807  7918 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:59.186700  7726 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.188230  7897 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:59.304967  7975 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:01:59.299166  7958 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.240211  7951 raft_consensus.cc:697] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:01:59.330994  7945 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.637s	user 0.004s	sys 0.013s
W20260709 13:01:59.348634  7982 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:01:59.354434  7904 raft_consensus.cc:3055] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:59.328693  7941 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.358130  7936 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:59.358393  7945 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:59.364509  7979 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 13:01:59.365440  7973 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:01:59.353953  7951 consensus_queue.cc:237] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.328088  7958 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:59.366561  7981 log.cc:927] Time spent T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:01:59.367383  7904 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:59.516095  7893 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.516824  7904 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.519268  7866 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.520653  7866 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.481019  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:59.523536  7505 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:59.525489  7585 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:59.528503  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 1486) took 1223 ms. Trace:
I20260709 13:01:59.456532  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3341) took 1064 ms. Trace:
W20260709 13:01:59.456859  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.005s	sys 0.010s
W20260709 13:01:59.457122  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.007s	sys 0.041s
W20260709 13:01:59.469202  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 345766us
W20260709 13:01:59.473788  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 427536us
I20260709 13:01:59.474365  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1235) took 1210 ms. Trace:
W20260709 13:01:59.474969  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 426914us
W20260709 13:01:59.475086  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 345980us
I20260709 13:01:59.477260  1673 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:59.479635  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:59.481004  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:59.481369  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:59.481760  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:59.481940  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:59.385602  7940 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.590699  1635 rpcz_store.cc:276] 0709 13:01:58.264062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.336306 (+ 72244us) service_pool.cc:224] Handling call
0709 13:01:58.336790 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.337447 (+   657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.337504 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.338299 (+   795us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.856247 (+517948us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:59.039693 (+183446us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.472763 (+433070us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b18004c1f20. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6912c0a 00007f0ee0052219 00007f0ed699aa40 00007f0ed69954e4 00007f0ed6995455 00007f0ed9a7d060 00007f0ed9a8f716 00007f0ed9aa0287 00007f0ed9aa0208
0709 13:01:59.473339 (+   576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.473512 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.473632 (+   120us) raft_consensus.cc:1685] finished
0709 13:01:59.473779 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.474090 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3336,"prepare.queue_time_us":185320,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":482920,"raft.run_cpu_time_us":495,"raft.run_wall_time_us":49099,"spinlock_wait_cycles":4662016,"thread_start_us":409453,"threads_started":1,"wal-append.queue_time_us":748884}
I20260709 13:01:59.406229  7958 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:59.400965  7945 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:59.400264  7984 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:01:59.495151  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:59.496946  7995 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.622247  1700 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:59.622761  7995 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.497998  7996 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:59.624863  7904 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:59.625257  7996 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.502452  7897 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:59.503491  7726 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:59.507897  7986 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.510018  7932 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:59.403132  7965 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.374332  7941 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.636674  1707 raft_consensus.cc:2376] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19. Re-sending same reply.
I20260709 13:01:59.637980  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33322 (request call id 30) took 1423 ms. Trace:
I20260709 13:01:59.638633  7965 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:59.639607  7976 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:59.642406  7995 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:59.592339  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.006s	sys 0.011s
W20260709 13:01:59.598436  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.007s	sys 0.041s
I20260709 13:01:59.529273  2324 rpcz_store.cc:276] 0709 13:01:58.305078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.305230 (+   152us) service_pool.cc:224] Handling call
0709 13:01:59.527963 (+1222733us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54006711d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:59.528235 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2003954432}
W20260709 13:01:59.601866  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 125160us
I20260709 13:01:59.605085  7917 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:59.607055  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:59.634768  7996 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:59.636253  7986 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.638440  2328 rpcz_store.cc:276] 0709 13:01:58.214360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.214570 (+   210us) service_pool.cc:224] Handling call
0709 13:01:59.637521 (+1422951us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b5400431f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a7f853 00007f0edea4d60a 00007f0ed7fd37d4 00007f0ed7fd3762 00007f0ed7fd3691 00007f0ed7fd360c 00007f0ed7fd28c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:59.637698 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1615189888}
I20260709 13:01:59.658908  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:59.660310  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:59.661031  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:59.662113  2324 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
W20260709 13:01:59.663604  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.659077  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:59.664853  7726 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.665843  7726 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.668985  7932 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:59.669860  7932 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:01:59.671802  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.672212  7932 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:59.672406  2322 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:01:59.672842  1702 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:01:59.680081  7726 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:59.552976  7505 raft_consensus.cc:697] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:01:59.682982  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 53691.2us
I20260709 13:01:59.677297  7780 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:59.679616  7893 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:59.691931  7917 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:01:59.700748  7917 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.692306  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1236) took 1364 ms. Trace:
I20260709 13:01:59.704231  1633 rpcz_store.cc:276] 0709 13:01:58.264407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.398203 (+133796us) service_pool.cc:224] Handling call
0709 13:01:58.507811 (+109608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.508227 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.508263 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.508770 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:01:59.051373 (+542603us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:59.466187 (+414814us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.476301 (+ 10114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.476475 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.476571 (+    96us) raft_consensus.cc:1685] finished
0709 13:01:59.476629 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.595247 (+118618us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54000da7d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:01:59.628496 (+ 33249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9221,"prepare.queue_time_us":2325,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":63100,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":282,"spinlock_wait_cycles":251029888,"thread_start_us":956240,"threads_started":2,"wal-append.queue_time_us":701238}
I20260709 13:01:59.703606  7917 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:59.709704  7823 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:59.710600  7823 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.717705  1633 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:01:59.719271  1675 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:59.719655  7823 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:01:59.694571  1599 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:01:59.697028  7936 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:59.530997  1556 rpcz_store.cc:276] 0709 13:01:58.392046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.632814 (+240768us) service_pool.cc:224] Handling call
0709 13:01:58.633163 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.660926 (+ 27763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.660957 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.661409 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.881379 (+219970us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:58.951964 (+ 70585us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.953039 (+  1075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.953108 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.455516 (+502408us) raft_consensus.cc:1685] finished
0709 13:01:59.455613 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.456183 (+   570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27365,"prepare.queue_time_us":55671,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":42723,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":23871,"thread_start_us":209450,"threads_started":1,"wal-append.queue_time_us":514026}
I20260709 13:01:59.698829  2329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "327c042262d94ababf63c12c177e29ed"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:59.721704  2329 raft_consensus.cc:606] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:59.721668  7908 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.723382  7505 consensus_queue.cc:237] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.724354  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:59.726532  1599 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:01:59.727612  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.727694  7936 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:59.722389  2329 raft_consensus.cc:614] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:59.730443  7986 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:01:59.733304  7984 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.063s	user 0.005s	sys 0.000s
W20260709 13:01:59.734066  7843 consensus_meta.cc:287] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.878s	user 0.008s	sys 0.008s
I20260709 13:01:59.734129  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:59.704844  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:59.696750  7976 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:59.737187  7983 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:59.739742  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:01:59.748912  7866 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:59.748759  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:59.759873  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:59.760829  2324 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:01:59.761535  1629 raft_consensus.cc:2393] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 17: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:01:59.761890  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:59.762931  7780 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:59.763391  7780 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:59.763491  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.763813  7780 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:59.750851  7897 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:01:59.681123  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:01:59.730463  7956 consensus_meta.cc:287] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.525s	user 0.013s	sys 0.007s
I20260709 13:01:59.769193  1700 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:59.753902  7936 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:01:59.768801  1703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.066s	sys 0.092s
W20260709 13:01:59.774458  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.768919  2328 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:01:59.780965  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:59.781446  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:59.781790  2327 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:59.783643  1703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.066s	sys 0.092s
I20260709 13:01:59.777328  7936 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:59.795321  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:59.773960  7996 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.779335  7823 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:59.766103  7843 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.815032  7833 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:59.815795  7833 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:01:59.816985  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:59.817466  7843 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:01:59.818392  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:59.770411  7908 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:01:59.813728  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:59.804821  2329 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:01:59.814713  7823 raft_consensus.cc:697] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:01:59.822666  2327 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
W20260709 13:01:59.824838  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 143943us
I20260709 13:01:59.833505  7820 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:01:59.836828  2328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:01:59.837788  2328 raft_consensus.cc:606] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:01:59.837852  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:59.838418  2328 raft_consensus.cc:614] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:59.839677  1704 raft_consensus.cc:2393] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:01:59.833978  7285 consensus_meta.cc:287] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.008s
I20260709 13:01:59.840960  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:59.841810  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:59.843535  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:01:59.842828  7833 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.844671  1634 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:01:59.845453  7823 consensus_queue.cc:237] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.846313  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:01:59.845882  7903 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.631s	user 0.015s	sys 0.001s
I20260709 13:01:59.847231  1630 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:59.860163  1629 raft_consensus.cc:2410] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 16 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:01:59.861025  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:59.863152  7996 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.866128  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:59.795585  7897 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.866833  7905 consensus_queue.cc:1059] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:01:59.787936  7893 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:59.791976  7995 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.865306  7986 raft_consensus.cc:2764] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:01:59.807659  7866 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:01:59.894716  2322 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
W20260709 13:01:59.897011  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 47388.1us
I20260709 13:01:59.776383  7956 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.847622  7903 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.903121  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:01:59.905843  1700 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:01:59.909183  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:01:59.913761  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 62947.5us
I20260709 13:01:59.917356  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:01:59.918859  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:01:59.922335  1635 raft_consensus.cc:1275] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:59.908126  1672 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:01:59.924237  1704 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:01:59.910673  7585 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.945127  7958 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:01:59.945858  7585 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.946516  7958 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:59.946940  7958 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:01:59.953472  2328 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 13: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:01:59.944139  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:01:59.951138  1630 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:01:59.956441  1706 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:01:59.958863  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 58986.4us
W20260709 13:01:59.962627  7915 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.622s	user 0.017s	sys 0.000s
I20260709 13:01:59.962849  7908 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:59.964931  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:01:59.963567  7908 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:01:59.972244  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 245933us
I20260709 13:01:59.973055  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:01:59.943537  7866 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.942399  7995 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:01:59.985378  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 65993.7us
I20260709 13:01:59.987006  1672 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:01:59.990868  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 251366us
I20260709 13:01:59.967815  7843 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.977463  7908 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:59.963351  7915 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:00.021710  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 89442.1us
W20260709 13:02:00.025738  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 43948.6us
I20260709 13:01:59.976251  7893 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:01:59.948122  7958 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:01:59.987098  7904 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:00.032797  2327 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
W20260709 13:02:00.036881  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.033461  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:02:00.040405  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 46308us
I20260709 13:02:00.045164  2326 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:02:00.012634  7750 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:00.058554  7750 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.012871  7988 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:00.065534  7988 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:00.073642  7997 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:02:00.080861  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 44655.8us
I20260709 13:02:00.084921  7932 consensus_queue.cc:1059] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:00.086550  7932 raft_consensus.cc:3055] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:00.087143  7932 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:00.035703  7820 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.088675  1598 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:00.089355  7820 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:00.090018  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 52211.6us
I20260709 13:02:00.051385  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:00.092625  2320 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:00.056900  7951 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:00.093958  7951 raft_consensus.cc:697] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:00.095527  7951 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.057322  7918 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:00.056852  7904 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:00.097994  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50687us
I20260709 13:02:00.032387  7983 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:00.047816  1708 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:02:00.110126  1672 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:00.114295  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:00.103749  1523 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:00.125417  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 3103) took 1257 ms. Trace:
I20260709 13:02:00.105297  1601 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:00.100512  7918 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:00.156240  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49276.7us
I20260709 13:02:00.113657  7983 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.118000  7905 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:00.178072  7726 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:00.178344  7958 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:00.178438  7750 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:00.137022  7866 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:00.199483  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 98343.1us
I20260709 13:02:00.104161  7843 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.151721  7956 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:00.166023  7918 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:00.172011  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 70005.3us
I20260709 13:02:00.180295  7726 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:00.208971  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 178199us
I20260709 13:02:00.183208  7983 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:00.228672  2325 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:00.160207  7917 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.188431  7996 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:00.126101  1703 rpcz_store.cc:276] 0709 13:01:58.855684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.855927 (+   243us) service_pool.cc:224] Handling call
0709 13:01:58.863268 (+  7341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.863667 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:59.246850 (+383183us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.907910 (+661060us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.972486 (+ 64576us) log.cc:844] Serialized 26 byte log entry
0709 13:01:59.972718 (+   232us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:59.972767 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.980058 (+  7291us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.098862 (+118804us) raft_consensus.cc:1685] finished
0709 13:02:00.098892 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.112927 (+ 14035us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4132,"prepare.queue_time_us":116722,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":78517,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":30131,"thread_start_us":919971,"threads_started":2,"wal-append.queue_time_us":622409}
I20260709 13:02:00.097572  7932 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:00.231220  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 132896us
W20260709 13:02:00.239347  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.237707  7750 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:00.249763  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:00.250906  2327 raft_consensus.cc:2410] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 16 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:02:00.252487  1601 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:00.248529  7750 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:02:00.255511  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47900.4us
I20260709 13:02:00.260131  7750 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:00.264807  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 59610.4us
I20260709 13:02:00.266633  7893 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:00.255345  7866 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.268890  7843 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:00.269308  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:00.269905  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.269511  7866 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.256644  7996 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:00.271248  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:00.272526  1560 raft_consensus.cc:2410] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:02:00.270197  1556 raft_consensus.cc:2393] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:00.237609  7927 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:00.244719  7904 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:00.293285  1523 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:00.300390  7904 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:00.311769  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:00.312040  8003 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.000s	sys 0.013s
I20260709 13:02:00.320135  2288 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:02:00.313026  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 79574.8us
I20260709 13:02:00.316704  7339 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:00.318121  1560 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:00.285912  7996 raft_consensus.cc:697] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:00.285588  7897 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:00.327576  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:00.296281  7823 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:00.249603  7780 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:00.301057  7927 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:02:00.325975  8003 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.001s	sys 0.013s
I20260709 13:02:00.307091  7893 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:00.341792  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 56757.6us
I20260709 13:02:00.342423  1556 raft_consensus.cc:2393] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:00.278806  7917 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:00.318557  7843 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:00.346873  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 113135us
I20260709 13:02:00.323817  7988 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:00.332376  7866 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:00.366003  7339 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:00.373780  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 51738.1us
I20260709 13:02:00.367304  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:00.346342  7285 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:00.333338  7915 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:00.371536  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:00.388368  1557 raft_consensus.cc:2410] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:02:00.392694  1552 raft_consensus.cc:2393] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 17: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:00.354866  7995 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:00.371656  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:00.338814  7823 raft_consensus.cc:697] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:00.370908  7943 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.338969  7904 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.376379  7285 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.370852  7944 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:00.406929  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:00.405913  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.397217  7866 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:00.406427  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:00.408434  8004 log.cc:927] Time spent T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:02:00.449416  8005 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:02:00.427876  1560 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:02:00.408420  7830 raft_consensus.cc:3055] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:00.453119  7830 raft_consensus.cc:740] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:00.439935  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:00.431576  7285 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:00.445102  7945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.025s	sys 0.047s
I20260709 13:02:00.410288  7927 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:00.414449  7936 consensus_meta.cc:287] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.003s
I20260709 13:02:00.410890  7932 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:00.454685  1552 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:02:00.427680  7944 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:00.473212  7945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.025s	sys 0.051s
I20260709 13:02:00.529210  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:00.413044  7995 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:00.536566  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 110051us
W20260709 13:02:00.548033  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 284479us
I20260709 13:02:00.400252  7893 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.485857  7905 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:02:00.555022  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 161179us
I20260709 13:02:00.532099  7944 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:00.475986  7936 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:00.558992  1560 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:02:00.561437  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:00.565974  7905 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.408031  7996 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.577033  1601 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:00.477061  7830 consensus_queue.cc:260] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:00.557439  7780 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:00.558177  7726 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:00.528673  7943 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.589828  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:00.559533  7945 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:00.623293  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:00.624001  1556 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:00.593868  7820 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:00.593724  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:00.594655  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:00.595794  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:00.597321  1555 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:02:00.597671  7611 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:00.599035  7339 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:00.527665  7823 consensus_queue.cc:237] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:00.600085  1560 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:00.600571  7904 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:00.601033  7918 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.602711  1552 raft_consensus.cc:2410] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:02:00.602346  1601 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:00.610311  7942 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:00.571803  7951 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:00.615747  7983 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:00.618445  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:00.627650  1554 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:02:00.625994  1557 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:02:00.576771  7995 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.640956  1632 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:00.646452  8016 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:02:00.646996  7750 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.635136  7726 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:00.652710  7726 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:00.655200  7726 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:00.655959  7893 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:00.636402  7945 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.653096  7943 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:00.642050  1553 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:02:00.661787  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:00.633886  7942 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.625844  7866 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:00.677433  1560 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:02:00.679219  2320 consensus_meta.cc:287] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.586s	user 0.014s	sys 0.000s
I20260709 13:02:00.679877  2320 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:02:00.657470  7927 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:00.684778  7927 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:00.685223  7918 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:00.685250  7927 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:00.642243  7951 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.637902  7611 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:00.794986  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.837550  1557 raft_consensus.cc:1240] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:00.668418  7942 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:00.798924  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 140729us
I20260709 13:02:01.022032  1556 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20.
I20260709 13:02:01.154423  1560 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
W20260709 13:02:01.049733  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.811587  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:00.902407  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:00.906124  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:00.810689  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:01.155957  1559 raft_consensus.cc:2410] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 13:02:01.007114  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 161349us
I20260709 13:02:01.080832  1598 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:01.114547  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:01.157357  2320 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:01.159955  1554 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 13: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:02:00.902882  8026 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:02:01.049078  7958 consensus_meta.cc:287] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.818s	user 0.007s	sys 0.008s
W20260709 13:02:01.151804  7908 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.046s	user 0.012s	sys 0.003s
I20260709 13:02:01.164284  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:00.790859  7830 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:01.006822  7750 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:01.166086  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:01.177553  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:01.178763  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1237) took 1157 ms. Trace:
I20260709 13:02:01.178740  1556 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:02:01.179656  1700 rpcz_store.cc:276] 0709 13:02:00.021401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.177862 (+1156461us) service_pool.cc:224] Handling call
0709 13:02:01.178206 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.178392 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.178419 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.178464 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:01.178502 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.178557 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.178669 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.009433  7866 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:00.697441  7917 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:00.898442  7905 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.189090  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:00.901814  8030 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:00.859962  8032 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:00.918727  7936 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:00.901006  7941 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:01.171609  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:01.209487  1557 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:00.904618  7945 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:00.844563  7833 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.172705  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.221896  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:01.173317  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.222954  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.902117  7285 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.175021  7995 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:01.175213  1555 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:02:01.078393  7956 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.186767  1523 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:01.188061  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:01.199893  8039 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:01.192915  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:01.194000  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:00.753350  8024 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:01.197611  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:01.235740  1700 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:01.200040  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:01.202831  8030 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:01.203904  1633 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:02:01.236194  2320 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
W20260709 13:02:01.205313  8033 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:02:01.207120  8032 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.216116  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:01.217638  7917 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:01.114389  8021 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.222587  2321 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:01.153491  7983 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:01.230341  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 43689.4us
W20260709 13:02:01.236485  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 82843.9us
I20260709 13:02:01.191231  7908 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.240545  8039 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:01.248010  8039 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.248960  8032 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:01.227159  7996 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:01.250092  7996 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.250852  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:01.226922  7833 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.261080  1634 pending_rounds.cc:85] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 7
I20260709 13:02:01.252519  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:01.267870  1634 pending_rounds.cc:107] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:02:01.268462  1634 raft_consensus.cc:2889] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:01.269272  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:01.266430  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:01.240912  7956 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.273643  7956 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:01.235615  7945 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:01.274521  7945 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.274989  7945 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:01.275553  7944 consensus_meta.cc:287] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.667s	user 0.007s	sys 0.002s
I20260709 13:02:01.266898  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:01.260938  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:01.282105  1630 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:01.283982  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.264086  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:01.283872  2322 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:01.269395  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:01.195317  7905 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:01.286659  1557 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:02:01.276048  7944 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:01.285111  1523 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:01.257431  1559 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:01.289000  1709 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:01.328256  1708 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:01.333232  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 48183.4us
I20260709 13:02:01.335340  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:01.336678  7750 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:01.252398  7996 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:01.290535  7932 consensus_meta.cc:287] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.804s	user 0.013s	sys 0.000s
I20260709 13:02:01.344022  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:01.347777  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 1378) took 1113 ms. Trace:
I20260709 13:02:01.262140  7285 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:01.364871  1557 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 14: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:01.370647  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:01.370663  1627 raft_consensus.cc:2393] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 18: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:01.378648  1630 raft_consensus.cc:2410] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:02:01.343245  7750 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.364884  2329 rpcz_store.cc:276] 0709 13:02:00.226152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.226352 (+   200us) service_pool.cc:224] Handling call
0709 13:02:00.249464 (+ 23112us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.285471 (+ 36007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.285504 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.332379 (+ 46875us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.537355 (+204976us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:00.537417 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.537517 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.338865 (+801348us) raft_consensus.cc:1685] finished
0709 13:02:01.338891 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.339027 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15614,"raft.queue_time_us":36134,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":22975,"thread_start_us":168901,"threads_started":1,"wal-append.queue_time_us":282483}
I20260709 13:02:01.435463  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:01.442160  1709 raft_consensus.cc:2410] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:02:01.479302  7951 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:01.475422  7823 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:01.435806  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:01.480702  1707 raft_consensus.cc:2393] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 18: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:01.435720  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:01.252719  8024 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.339062  7917 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:01.469835  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:01.437623  7750 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:01.472748  8036 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:02:01.474987  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:01.475399  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:01.477023  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:01.477734  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:01.478305  7940 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:01.478689  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:01.352221  7995 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.284484  8021 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:01.471552  8035 log.cc:927] Time spent T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:02:01.481364  1703 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 8.
I20260709 13:02:01.490918  1700 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:01.469707  7611 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:01.448653  7936 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.528187  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:01.496462  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 188105us
I20260709 13:02:01.500559  1709 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:02:01.529426  1709 pending_rounds.cc:85] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 6
I20260709 13:02:01.529772  1709 pending_rounds.cc:107] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:02:01.530083  1709 raft_consensus.cc:2889] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:01.506493  1633 raft_consensus.cc:3060] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:01.483872  7943 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.515910  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:01.533721  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:01.537724  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:01.480109  7823 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.546062  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:01.550333  8039 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:02:01.557274  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 479845us
I20260709 13:02:01.557483  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:01.567766  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:01.570677  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:01.575536  8042 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:01.585466  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2829) took 1743 ms. Trace:
I20260709 13:02:01.585947  1632 rpcz_store.cc:276] 0709 13:01:59.841908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.872794 (+ 30886us) service_pool.cc:224] Handling call
0709 13:01:59.906119 (+ 33325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.659883 (+753764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.585196 (+925313us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54002d6c54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:01.585396 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570524032}
I20260709 13:02:01.587324  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:01.585485  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1500) took 1724 ms. Trace:
I20260709 13:02:01.589071  2326 rpcz_store.cc:276] 0709 13:01:59.861281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.864808 (+  3527us) service_pool.cc:224] Handling call
0709 13:01:59.893131 (+ 28323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.046382 (+153251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.585035 (+1538653us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b5400566654. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:01.585414 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63785472}
I20260709 13:02:01.589601  7908 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:01.590471  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:01.591632  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:01.597025  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:01.597230  8030 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:01.552902  7936 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.598778  7944 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:01.600067  8037 log.cc:927] Time spent T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:02:01.601640  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:01.661182  1630 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:01.604808  1627 raft_consensus.cc:2393] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:01.555455  7956 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:02:01.607142  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.607820  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.517091  7995 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.536532  7940 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.609689  1526 leader_election.cc:400] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 19. Current term is 20.
I20260709 13:02:01.665865  1526 leader_election.cc:403] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:02:01.610551  8043 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:02:01.615162  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:02:01.657809  8015 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 1.138s	user 0.021s	sys 0.009s
I20260709 13:02:01.616328  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:01.600109  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:01.607831  2329 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:01.588202  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:01.628440  1551 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:02:01.557144  7866 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:01.633551  1708 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:01.634202  1703 raft_consensus.cc:2393] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 18: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:02:01.637280  2286 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.619s (SENT) [suppressed 16 similar messages]
I20260709 13:02:01.538396  7943 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.674170  1635 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20.
I20260709 13:02:01.680528  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:01.685075  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.657445  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:01.658977  1559 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:01.689990  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:01.545760  7942 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:01.666055  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:01.556613  8039 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.615715  1633 raft_consensus.cc:2468] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:02:01.671454  1700 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:01.671525  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:01.692499  1556 raft_consensus.cc:3060] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:01.675437  2320 raft_consensus.cc:2368] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 16. Current term is 17.
I20260709 13:02:01.676401  2328 raft_consensus.cc:2410] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:02:01.676910  1555 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 13: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:01.576516  8042 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:01.705305  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 68175.2us
I20260709 13:02:01.706753  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:02:01.717319  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 81310.5us
I20260709 13:02:01.717520  1559 raft_consensus.cc:2376] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20. Re-sending same reply.
I20260709 13:02:01.720554  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:01.721457  1700 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:01.671217  7908 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:01.669420  7956 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:01.799149  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.736339  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:01.810185  2328 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:01.796701  1631 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:01.848138  2329 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:02:01.735569  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:01.849850  2320 raft_consensus.cc:1813] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Handling vote request from an unknown peer 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:01.850629  2320 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:02:01.850719  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 69844.5us
I20260709 13:02:01.736574  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:01.798995  2326 raft_consensus.cc:2368] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16.
I20260709 13:02:01.852770  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:01.683799  7833 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:01.854341  1560 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:01.855141  7908 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.735659  7944 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 19. Current term is 20.
I20260709 13:02:01.870703  8032 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.870884  7905 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:01.725803  7945 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.871434  8032 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:01.872486  7908 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:01.876389  1554 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:01.872641  8058 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:01.873261  7945 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:01.875000  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 265504us
I20260709 13:02:01.798007  7940 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:01.890372  2320 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:01.894081  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:01.894613  8051 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:02:01.895326  7945 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:01.872503  7285 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.897497  7940 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.897749  8056 consensus_queue.cc:1059] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:01.898079  7940 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:01.897075  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:01.900214  7945 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:01.901916  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:01.902107  6989 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:01.904831  7945 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:01.907217  7750 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.904124  7940 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:01.910168  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 1419) took 1005 ms. Trace:
I20260709 13:02:01.910811  7940 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.911355  7940 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:01.911870  8018 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 1.502s	user 0.001s	sys 0.011s
I20260709 13:02:01.913968  7940 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:01.914278  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1235) took 2158 ms. Trace:
I20260709 13:02:01.914515  7940 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.907194  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:01.914652  1702 rpcz_store.cc:276] 0709 13:01:59.756130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.758142 (+  2012us) service_pool.cc:224] Handling call
0709 13:01:59.760266 (+  2124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.785683 (+ 25417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.785893 (+   210us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.877420 (+ 91527us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.278302 (+400882us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:00.528085 (+249783us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.528318 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.528400 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.911218 (+1382818us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:01.913905 (+  2687us) raft_consensus.cc:1685] finished
0709 13:02:01.914062 (+   157us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.914201 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43034,"prepare.queue_time_us":411631,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":24011,"raft.run_cpu_time_us":496,"raft.run_wall_time_us":53137,"spinlock_wait_cycles":6329216,"thread_start_us":571054,"threads_started":2,"wal-append.queue_time_us":498272}
I20260709 13:02:01.916184  7945 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:01.916903  8058 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.918507  1526 leader_election.cc:400] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13.
I20260709 13:02:01.920073  1526 leader_election.cc:403] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:02:01.922394  7927 consensus_meta.cc:287] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.170s	user 0.012s	sys 0.001s
I20260709 13:02:01.922808  7945 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 12. Current term is 13.
W20260709 13:02:01.922979  8006 log.cc:927] Time spent T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 1.452s	user 0.003s	sys 0.013s
I20260709 13:02:01.920393  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:01.897128  7285 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:01.919704  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:01.910573  1554 rpcz_store.cc:276] 0709 13:02:00.904975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.192523 (+287548us) service_pool.cc:224] Handling call
0709 13:02:01.909971 (+717448us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b540017e8d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:01.910109 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460069120}
I20260709 13:02:01.930298  1556 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:01.776043  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:01.726876  7893 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:01.933336  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 286713us
I20260709 13:02:01.933410  1555 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:02:01.963724  1560 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:02:01.960979  1630 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20.
I20260709 13:02:01.734740  7996 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.190s
I20260709 13:02:01.971769  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:01.972993  1560 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
W20260709 13:02:01.968559  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 155199us
I20260709 13:02:01.966892  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:01.975513  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 57134.5us
I20260709 13:02:01.974500  1555 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:02:01.974809  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:01.980619  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:01.980955  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:01.981089  2328 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:02:01.981592  1556 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:02:01.980266  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1503) took 2071 ms. Trace:
I20260709 13:02:01.926608  7823 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:01.934894  8024 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:01.928198  8032 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:01.987905  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:01.994400  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:01.991675  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 106980us
I20260709 13:02:01.969424  7936 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:01.998956  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:01.977346  7917 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:02.001188  1526 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:01.983520  2323 rpcz_store.cc:276] 0709 13:01:59.862411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.901668 (+ 39257us) service_pool.cc:224] Handling call
0709 13:01:59.902250 (+   582us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.902869 (+   619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.902914 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.903677 (+   763us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.205255 (+301578us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:00.205313 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.205408 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.583756 (+1378348us) spinlock_profiling.cc:243] Waited 91.4 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:01.923900 (+340144us) raft_consensus.cc:1685] finished
0709 13:02:01.923927 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.934169 (+ 10242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2342,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":15086,"spinlock_wait_cycles":210277248,"thread_start_us":294357,"threads_started":1,"wal-append.queue_time_us":542659}
I20260709 13:02:02.003508  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:02.003676  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1418) took 1099 ms. Trace:
I20260709 13:02:02.004434  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1416) took 1100 ms. Trace:
I20260709 13:02:02.005415  7995 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:02.005930  8009 log.cc:927] Time spent T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.560s	user 0.010s	sys 0.016s
I20260709 13:02:01.969120  7940 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:02.008111  8054 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:02:02.009608  7940 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:02.010479  7940 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.010921  8039 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:02.011394  7830 consensus_meta.cc:287] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.817s	user 0.007s	sys 0.006s
I20260709 13:02:02.004146  1556 rpcz_store.cc:276] 0709 13:02:00.904665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.996299 (+1091634us) service_pool.cc:224] Handling call
0709 13:02:02.003136 (+  6837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.003335 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.003358 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.003414 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:02.003444 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.003492 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.003602 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.923099  7927 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:02.012362  1703 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:02.004904  1560 rpcz_store.cc:276] 0709 13:02:00.904042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.996262 (+1092220us) service_pool.cc:224] Handling call
0709 13:02:02.003539 (+  7277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.004037 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.004064 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.004109 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:02.004147 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.004212 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.004344 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.020411  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:02.032042  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:01.990453  8021 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:02.046329  1626 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:02.055433  7285 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:02.056259  8071 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:02.010928  7940 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:02.057161  8071 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:02.018839  8048 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
W20260709 13:02:02.061211  8057 log.cc:927] Time spent T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:02:02.020802  8032 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.071439  2329 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:02:02.078962  7943 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:02.045138  1673 connection.cc:256] RPC call timeout handler was delayed by -1.423293923000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 13:02:02.081332  1673 connection.cc:256] RPC call timeout handler was delayed by -1.3764939229999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
I20260709 13:02:02.081595  8021 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:02:02.081840  1673 connection.cc:256] RPC call timeout handler was delayed by -1.2934433539999759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:02:02.082355  1673 connection.cc:256] RPC call timeout handler was delayed by -1.0335939230000122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23700000000000002s for a response
I20260709 13:02:02.082293  8021 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:02.083290  1673 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:02.083983  8058 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:02.035837  7996 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:02.085054  7996 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:02.085510  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.071739  8042 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:02.303987  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.090121  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.306403  1632 raft_consensus.cc:1240] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:02.208037  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 1359) took 3578 ms. Trace:
I20260709 13:02:02.156076  1705 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:02:02.307731  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 316119us
I20260709 13:02:02.156793  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3350) took 1066 ms. Trace:
I20260709 13:02:02.308254  1630 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 15: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:02:02.147948  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 179907us
W20260709 13:02:02.306267  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.305341  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 270007us
I20260709 13:02:02.189383  1634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:44138
I20260709 13:02:02.085597  8021 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:02.308600  1560 rpcz_store.cc:276] 0709 13:02:01.085574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.023558 (+937984us) service_pool.cc:224] Handling call
0709 13:02:02.053254 (+ 29696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.146161 (+ 92907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.146196 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.146268 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:02.146321 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.146416 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.146598 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.311751  1634 raft_consensus.cc:606] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:02.312361  1634 raft_consensus.cc:614] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:02.309531  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 316599us
I20260709 13:02:02.307106  2325 rpcz_store.cc:276] 0709 13:01:58.629257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.654024 (+ 24767us) service_pool.cc:224] Handling call
0709 13:01:58.654438 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.229577 (+1575139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.207406 (+1977829us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b540052c454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:02.207732 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3618165120}
I20260709 13:02:02.308689  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:02.320006  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 236788us
I20260709 13:02:02.307199  7908 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:02.123649  8051 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:02:02.327394  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:02.327639  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.328786  1627 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:02.206516  7903 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:02.086908  7942 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:02.328171  2320 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:02.288712  7585 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:02.341434  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.339584  2286 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:02.344188  2286 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:02.344683  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:02.345393  1633 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:02:02.346100  8019 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.861s	user 0.009s	sys 0.023s
W20260709 13:02:02.346535  8019 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.893s	user 0.009s	sys 0.023s
I20260709 13:02:02.346311  7285 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:02.347299  7285 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:02.348035  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.323264  8058 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:02:02.350543  1635 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:02:02.348382  7285 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:02.347863  8032 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:02.363425  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:02.364445  7943 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:02.364918  7943 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.365311  7943 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.365679  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 3105) took 3504 ms. Trace:
I20260709 13:02:02.366257  1706 rpcz_store.cc:276] 0709 13:01:58.860976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.973788 (+112812us) service_pool.cc:224] Handling call
0709 13:01:58.974125 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.960503 (+986378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.365347 (+2404844us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b54000a6c54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:02.365616 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2187099392}
I20260709 13:02:02.370019  7940 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:02.344273  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:02.353477  7903 consensus_queue.cc:1059] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:02.354481  7996 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:02.356226  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:02.370385  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1415) took 1466 ms. Trace:
I20260709 13:02:02.349951  1630 raft_consensus.cc:2410] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:02:02.381979  8063 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:02.402719  2320 raft_consensus.cc:2393] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:02.400034  1552 rpcz_store.cc:276] 0709 13:02:00.903773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.376323 (+472550us) service_pool.cc:224] Handling call
0709 13:02:01.435432 (+ 59109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.516092 (+ 80660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.516210 (+   118us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.530335 (+ 14125us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:01.530382 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.370146 (+839764us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b5400160154. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:02.370198 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.370330 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142697728}
I20260709 13:02:02.402904  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:02.403496  1558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2692) took 2136 ms (client timeout 1632 ms). Trace:
I20260709 13:02:02.406680  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:02.406863  1558 rpcz_store.cc:269] 0709 13:02:00.267652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.309748 (+ 42096us) service_pool.cc:224] Handling call
0709 13:02:02.403263 (+2093515us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001aa9d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:02.403381 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2611090304}
I20260709 13:02:02.407660  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:02.409660  1632 raft_consensus.cc:2410] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:02.410282  1635 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:02:02.413239  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.415755  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:02.409667  8063 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:02.419350  1634 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:02.419749  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.420905  8063 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:02.421317  1675 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:02.421986  8076 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:02.422435  8076 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.422761  8076 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:02.420534  1630 raft_consensus.cc:2410] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:02:02.425257  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:02.439338  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.442868  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.457755  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:02.458822  1630 raft_consensus.cc:2376] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17. Re-sending same reply.
I20260709 13:02:02.460908  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:02.461733  1627 raft_consensus.cc:2376] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14. Re-sending same reply.
I20260709 13:02:02.461817  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.462723  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.464020  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.464902  1635 raft_consensus.cc:2376] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20. Re-sending same reply.
I20260709 13:02:02.491712  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.517800  7285 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:02.520315  2288 leader_election.cc:336] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.590s (SENT)
I20260709 13:02:02.441746  7903 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:02.464717  8032 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:02.529601  2288 leader_election.cc:336] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.664s (SENT)
I20260709 13:02:02.552177  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.433579  7996 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:02:02.577000  1629 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:02.586380  1675 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:02.596617  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.597322  1635 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:02.598399  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.599036  1633 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:02:02.604564  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.602265  7903 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:02.609128  1675 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:02.612001  1627 raft_consensus.cc:2410] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:02:02.605612  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 180447us
I20260709 13:02:02.596242  8058 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.617934  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.619027  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:02.620204  1629 raft_consensus.cc:2410] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:02:02.609328  8067 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:02.625144  7285 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:02.625908  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 96348us
W20260709 13:02:02.629837  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 150203us
I20260709 13:02:02.631803  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:02.632771  1629 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:02.629482  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:02.602049  8076 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:02.636234  8048 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.637739  8024 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:02.642668  8024 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:02.643355  8024 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:02.645267  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:02.631554  8032 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:02.646829  8032 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:02.646970  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.647262  8032 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.647835  1628 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:02.645313  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.649158  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.650074  1630 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
W20260709 13:02:02.655768  8012 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 2.203s	user 0.009s	sys 0.012s
I20260709 13:02:02.657048  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1233) took 3184 ms. Trace:
I20260709 13:02:02.657116  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:02.659962  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.660902  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.661701  1628 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:02.647826  8048 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:02.671298  1630 raft_consensus.cc:2393] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 18: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:02.657649  1701 rpcz_store.cc:276] 0709 13:01:59.475811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.526988 (+ 51177us) service_pool.cc:224] Handling call
0709 13:01:59.527446 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.528201 (+   755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.528229 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.588974 (+ 60745us) log.cc:844] Serialized 26 byte log entry
0709 13:01:59.872046 (+283072us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b18000e7460. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:02:00.214009 (+341963us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:00.214238 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.214496 (+   258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.648238 (+2433742us) spinlock_profiling.cc:243] Waited 85.4 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:02.656819 (+  8581us) raft_consensus.cc:1685] finished
0709 13:02:02.656848 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.656983 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52344,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":15275,"spinlock_wait_cycles":206168192,"thread_start_us":331756,"threads_started":1,"wal-append.queue_time_us":863522}
I20260709 13:02:02.675570  7917 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:02.676784  7905 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:02.631745  8058 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:02.652978  7996 raft_consensus.cc:2804] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:02.609269  7903 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:02.691593  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.695269  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:02.697170  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:02.697779  1558 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:02.698244  8076 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:02.699761  7956 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:02.702165  8048 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:02.704345  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 3122) took 1027 ms. Trace:
I20260709 13:02:02.704790  1703 rpcz_store.cc:276] 0709 13:02:01.676558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.710281 (+ 33723us) service_pool.cc:224] Handling call
0709 13:02:02.704180 (+993899us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540012c0d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:02.704285 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365398784}
I20260709 13:02:02.708164  1558 raft_consensus.cc:2410] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:02:02.708904  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 3354) took 1422 ms. Trace:
I20260709 13:02:02.710363  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:02.710937  1559 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.709306  1557 rpcz_store.cc:276] 0709 13:02:01.292113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.334966 (+ 42853us) service_pool.cc:224] Handling call
0709 13:02:02.708687 (+1373721us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b540017f2d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:02.708800 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65592576}
I20260709 13:02:02.711802  2286 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:02.680130  7943 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:02.719404  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:02.722631  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:02.723515  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:02.727334  1556 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:02.731678  1560 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:02.731668  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.731115  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:02.737277  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:02.737344  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.741887  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.744509  7956 consensus_queue.cc:1059] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:02.745919  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:02.746497  7611 raft_consensus.cc:3055] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:02.746749  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:02.747229  7611 raft_consensus.cc:740] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:02.747756  2324 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:02.747805  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:02.748314  7611 consensus_queue.cc:260] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:02.749600  7611 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.749879  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:02.749624  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:02.750804  1553 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:02.751008  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:02.751573  1557 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 19.
I20260709 13:02:02.751631  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:02.754873  2286 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:02.715603  7996 raft_consensus.cc:697] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:02.756011  7750 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:02.753545  8048 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:02.746603  1554 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:02:02.760958  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.762701  1523 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:02.769147  1556 raft_consensus.cc:2468] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20.
I20260709 13:02:02.758108  1553 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:02.782174  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:02.777616  2286 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:02.770561  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.784752  1630 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:02:02.784930  2286 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:02.787931  1559 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
W20260709 13:02:02.783720  2288 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.501s (SENT)
W20260709 13:02:02.791049  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 155741us
I20260709 13:02:02.792033  8048 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:02.793180  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:02.779167  2324 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:02:02.793912  1557 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:02:02.777382  7843 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:02.794973  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:02.779309  7965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.370s	user 0.015s	sys 0.020s
W20260709 13:02:02.797017  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 138572us
I20260709 13:02:02.796288  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:02.794862  7843 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:02.791800  7996 consensus_queue.cc:237] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:02.793442  8048 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:02.799819  1553 raft_consensus.cc:2368] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17.
I20260709 13:02:02.789985  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:02.800967  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.796469  1599 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:02.802790  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:02.820094  1559 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:02.803706  1557 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:02:02.789139  7956 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:02.809571  7833 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:02.810657  7983 raft_consensus.cc:3055] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:02.796670  7943 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:02.811846  8068 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:02.812201  1672 leader_election.cc:400] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 16. Current term is 17.
I20260709 13:02:02.847875  1672 leader_election.cc:403] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:02.819026  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:02:02.796767  7965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.387s	user 0.016s	sys 0.020s
I20260709 13:02:02.821852  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:02.851943  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 194901us
I20260709 13:02:02.852414  1557 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:02.804150  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.822446  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:02:02.851466  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 242379us
I20260709 13:02:02.853257  2324 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:02.826817  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.829973  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:02.799003  8069 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:02.852414  1672 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:02.790498  8067 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:02.862978  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:02.866639  1559 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:02.863616  1557 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:02:02.846166  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:02.788831  7285 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 13:02:02.860059  1633 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 15: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:02.856530  8090 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:02:02.861816  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 76901us
I20260709 13:02:02.857928  1672 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:02.870368  1630 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:02:02.871784  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 88083.3us
W20260709 13:02:02.872936  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 110325us
I20260709 13:02:02.864652  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:02.873642  1523 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:02.881448  1557 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:02.861373  7917 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:02.831496  7833 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:02.847476  8065 raft_consensus.cc:2764] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:02:02.889879  1673 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:02.832294  7983 raft_consensus.cc:740] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:02.899190  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:02.896066  2324 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:02.826218  7750 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:02.900326  1675 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:02.951598  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:02.862098  8069 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.824189  8086 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:02.953315  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:02.960997  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 60775.9us
W20260709 13:02:02.961472  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 103649us
I20260709 13:02:02.962222  1672 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:02.969012  7983 consensus_queue.cc:260] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:02.970338  7983 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:02.889400  7833 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:02.973302  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 176884us
I20260709 13:02:02.975391  1599 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:02.976397  8093 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:02.976795  7905 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:02.977308  7905 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:02.977737  7905 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:02.978188  8021 raft_consensus.cc:3055] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:02.978600  8021 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:02.979504  8021 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:02.980547  8021 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.981750  8087 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:02.982616  8087 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.982952  8087 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.985011  8067 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:02.989712  8013 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 2.542s	user 0.006s	sys 0.013s
I20260709 13:02:02.990715  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:02.991369  1703 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:02:02.992834  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:02.994233  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:02.995035  1706 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:02.961971  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:02.997526  8058 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:02.999575  7903 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:03.000237  7903 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.000613  7903 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.002315  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2834) took 1527 ms. Trace:
I20260709 13:02:03.002723  1626 rpcz_store.cc:276] 0709 13:02:01.474838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.475032 (+   194us) service_pool.cc:224] Handling call
0709 13:02:03.002067 (+1527035us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b5400247054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:03.002223 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253439744}
I20260709 13:02:03.004959  1634 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:03.006071  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:03.010123  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 126453us
I20260709 13:02:03.013772  8088 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:02.871038  8068 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:03.015440  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:03.015733  1705 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:03.016211  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 3121) took 1342 ms. Trace:
I20260709 13:02:02.959914  7917 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:03.016801  1700 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:02:03.017756  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3311) took 1158 ms. Trace:
W20260709 13:02:03.018719  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2835) took 1543 ms (client timeout 1936 ms). Trace:
I20260709 13:02:03.018957  8024 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:02.960230  8069 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:03.020187  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:03.021136  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 58994.7us
I20260709 13:02:03.022239  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:02.959264  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:03.023185  1709 rpcz_store.cc:276] 0709 13:02:01.673761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.988489 (+1314728us) service_pool.cc:224] Handling call
0709 13:02:03.016157 (+ 27668us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14080}
I20260709 13:02:03.011161  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:02.887197  7943 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:03.018965  1598 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:03.023319  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:03.051420  1523 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:02.997741  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:03.039091  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:03.036019  1599 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:03.066979  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:03.056864  1630 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:02:03.000478  8095 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:03.036223  1708 rpcz_store.cc:276] 0709 13:02:01.859706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.197478 (+337772us) service_pool.cc:224] Handling call
0709 13:02:02.197900 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.327839 (+129939us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:02.340995 (+ 13156us) log.cc:844] Serialized 14 byte log entry
0709 13:02:02.413145 (+ 72150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.413198 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:02.413240 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.017268 (+604028us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002567d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:03.017322 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.017609 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7192,"prepare.queue_time_us":12945,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":23950,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":7816,"spinlock_wait_cycles":319291648,"thread_start_us":65412,"threads_started":1,"wal-append.queue_time_us":116088}
I20260709 13:02:03.058100  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:03.059341  1706 raft_consensus.cc:2410] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 14 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:03.062273  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:03.022419  8086 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:02:03.036734  1631 rpcz_store.cc:269] 0709 13:02:01.475196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.478316 (+  3120us) service_pool.cc:224] Handling call
0709 13:02:03.018422 (+1540106us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54002c88d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:03.018660 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547105664}
I20260709 13:02:03.063752  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:03.088696  1633 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:03.076030  1630 raft_consensus.cc:1240] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:03.062948  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.031962  7995 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:03.035684  7917 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:03.089178  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58642.7us
W20260709 13:02:03.083644  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 199711us
I20260709 13:02:03.110442  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:03.112970  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:03.022159  7750 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:03.106652  1627 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:02:03.081246  8076 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:03.081534  8058 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:03.080864  8056 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:03.092334  8086 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:03.085469  7956 raft_consensus.cc:697] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:03.112812  7917 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:03.117717  2286 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:03.133008  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:03.135553  7750 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:03.137003  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:03.150914  1706 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:03.138670  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:03.151816  1705 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:03.140228  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:03.137014  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:03.154054  1701 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
W20260709 13:02:03.156131  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 145132us
I20260709 13:02:03.157172  1673 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:03.106178  1633 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:03.125801  8076 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:03.127970  8058 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:02:03.172413  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 59444.2us
I20260709 13:02:03.130407  8019 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:02:03.187000  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 69360us
I20260709 13:02:03.151589  7833 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:03.185546  1599 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:03.129674  7995 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:02:03.180886  8076 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:03.200902  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 119611us
I20260709 13:02:03.183741  8058 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:03.203601  1672 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:03.179987  8068 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:03.210947  1705 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
W20260709 13:02:03.204020  8097 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:02:03.204223  7285 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:03.206517  7996 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:03.089911  8089 consensus_queue.cc:1059] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:02:03.148270  8038 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
W20260709 13:02:03.228330  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 176387us
I20260709 13:02:03.219074  8021 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.218914  7750 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:02:03.236889  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 51451.3us
I20260709 13:02:03.213019  7843 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:03.234439  1523 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:02:03.241185  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 352807us
I20260709 13:02:03.246874  1599 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:02:03.235986  8032 consensus_meta.cc:287] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.588s	user 0.015s	sys 0.000s
I20260709 13:02:03.252947  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:03.230721  8019 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:03.221902  7903 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:03.262145  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:03.245843  8021 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:03.265791  8099 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 13:02:03.267055  8021 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:03.229259  7956 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:03.279232  7927 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:03.283663  8084 log.cc:927] Time spent T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.675s	user 0.002s	sys 0.010s
W20260709 13:02:03.288113  2327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 1382) took 2100 ms (client timeout 1513 ms). Trace:
W20260709 13:02:03.288637  2327 rpcz_store.cc:269] 0709 13:02:01.187971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.287870 (+2099899us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:03.288016 (+   146us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:02:03.290014  2326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 1390) took 1698 ms (client timeout 1587 ms). Trace:
W20260709 13:02:03.290465  2326 rpcz_store.cc:269] 0709 13:02:01.591186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.591393 (+   207us) service_pool.cc:224] Handling call
0709 13:02:03.289783 (+1698390us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400104354. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:03.289942 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270541184}
I20260709 13:02:03.293403  8071 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:03.293730  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 46939.8us
I20260709 13:02:03.245779  8068 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:03.253808  8024 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:03.323035  2325 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:02:03.253925  7750 raft_consensus.cc:697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:03.250231  7996 raft_consensus.cc:3055] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:03.299849  1672 leader_election.cc:400] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16.
I20260709 13:02:03.394712  1672 leader_election.cc:403] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:02:03.395330  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 100873us
I20260709 13:02:03.390928  1703 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 16: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:03.415544  2327 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:02:03.417917  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 123530us
I20260709 13:02:03.418990  1599 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:03.295109  7843 raft_consensus.cc:2804] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:03.435086  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:03.442399  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:03.442885  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:03.256621  8032 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:03.448108  1599 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:03.443449  2321 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:02:03.450389  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:03.453824  2322 raft_consensus.cc:2368] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17.
I20260709 13:02:03.456357  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:03.461541  2327 raft_consensus.cc:1240] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:02:03.398387  7996 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:03.416968  8106 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16.
I20260709 13:02:03.474485  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:03.457420  8024 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:03.455258  8071 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:03.481804  2320 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:03.483739  1706 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:03.485298  2327 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:02:03.467717  8028 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:03.470901  7988 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.064s	user 0.045s	sys 0.046s
W20260709 13:02:03.472857  8094 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:02:03.467964  7843 raft_consensus.cc:697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:03.500864  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:03.496070  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 261672us
I20260709 13:02:03.502668  2286 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:03.501598  2328 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:02:03.506237  2286 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:02:03.506076  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 348902us
I20260709 13:02:03.509249  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:02:03.492981  7988 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.086s	user 0.045s	sys 0.047s
I20260709 13:02:03.519583  8048 raft_consensus.cc:2804] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:03.520349  8048 raft_consensus.cc:697] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:03.521554  8048 consensus_queue.cc:237] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:03.524513  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:03.525350  1552 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:03.525229  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:03.526012  8071 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:02:03.526772  7905 consensus_meta.cc:287] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.002s
I20260709 13:02:03.516615  7996 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:03.527401  7905 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:03.532002  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:03.532778  1556 raft_consensus.cc:2368] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20.
I20260709 13:02:03.528025  1598 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:03.496274  8024 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:03.516727  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:03.540196  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1254) took 1130 ms. Trace:
I20260709 13:02:03.539428  1708 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 18: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:03.537248  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:03.539837  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:03.538765  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:03.543756  1559 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:02:03.544694  1557 raft_consensus.cc:2410] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:02:03.544920  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:03.542966  1634 rpcz_store.cc:276] 0709 13:02:02.410083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.420361 (+ 10278us) service_pool.cc:224] Handling call
0709 13:02:03.004684 (+584323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.005404 (+   720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.540006 (+534602us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b5400247050. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:03.540136 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342911232}
I20260709 13:02:03.542351  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:03.557593  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:03.557896  1598 leader_election.cc:400] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17.
I20260709 13:02:03.558354  1598 leader_election.cc:403] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:02:03.567840  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 88424.8us
W20260709 13:02:03.547768  8107 log.cc:927] Time spent T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:02:03.539045  7996 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.571851  8065 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17.
I20260709 13:02:03.527895  8109 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:03.573750  1553 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:03.569319  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:03.579334  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 99932.5us
I20260709 13:02:03.538825  7905 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:03.565460  7965 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:03.591470  2328 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:03.581471  8105 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:03.628650  1551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 1407) took 3037 ms (client timeout 1997 ms). Trace:
W20260709 13:02:03.632109  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 123189us
W20260709 13:02:03.634440  1551 rpcz_store.cc:269] 0709 13:02:00.591440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.593314 (+  1874us) service_pool.cc:224] Handling call
0709 13:02:03.626251 (+3032937us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b5400050ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:03.628551 (+  2300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712972032}
I20260709 13:02:03.635088  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:03.587174  8109 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:03.636781  8109 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:03.637446  8089 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:03.638327  8108 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:02:03.586274  8067 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:03.639611  8067 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:03.640048  8067 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:03.638300  8089 consensus_queue.cc:1059] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:02:03.642822  8089 raft_consensus.cc:3055] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:03.643218  8089 raft_consensus.cc:740] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:03.499362  7750 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:03.627364  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:03.652957  1673 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:03.654685  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 114618us
I20260709 13:02:03.660349  1673 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:03.668195  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.673265  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 77124.1us
W20260709 13:02:03.653136  7983 consensus_meta.cc:287] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.003s
I20260709 13:02:03.627645  7965 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.644058  8042 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:02:03.683949  1599 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:03.765983  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 95745.5us
I20260709 13:02:03.774307  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:03.666421  8087 consensus_meta.cc:287] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.683s	user 0.013s	sys 0.000s
I20260709 13:02:03.538304  7843 consensus_queue.cc:237] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:03.782753  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 111471us
I20260709 13:02:03.783932  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:03.669382  8102 log.cc:927] Time spent T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.370s	user 0.000s	sys 0.001s
I20260709 13:02:03.776505  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:03.775669  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:03.587818  8069 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:03.789564  1707 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:03.655376  7903 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:03.789441  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:03.790256  2288 leader_election.cc:336] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.127s (SENT)
I20260709 13:02:03.670454  7905 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:03.798676  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:03.791589  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 107750us
I20260709 13:02:03.799203  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:03.799842  1706 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:02:03.800180  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:03.644086  8089 consensus_queue.cc:260] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:03.791860  1705 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:02:03.766044  8056 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:03.805675  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:03.805871  1599 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:03.808159  1706 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:03.646925  8065 consensus_queue.cc:1059] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.145s
I20260709 13:02:03.780992  8088 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:03.796499  8076 consensus_meta.cc:287] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.000s
I20260709 13:02:03.809459  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2854) took 1370 ms. Trace:
I20260709 13:02:03.791119  7983 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.674602  8112 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:03.778852  7965 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.810489  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:03.857136  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:03.770828  7927 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:02:03.795378  8032 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:03.808871  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1256) took 1283 ms. Trace:
I20260709 13:02:03.794028  8093 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.809768  8056 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.858263  7988 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.870357  1706 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:02:03.882766  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:03.883682  1706 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
W20260709 13:02:03.885808  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.661244  8105 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:03.772979  8024 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:03.877206  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 86967.1us
W20260709 13:02:03.892346  2288 leader_election.cc:336] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.146s (SENT)
I20260709 13:02:03.869356  8125 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:03.846967  8039 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:02:03.896606  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 86167.3us
I20260709 13:02:03.802903  7905 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:03.860214  8089 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:03.874632  1631 rpcz_store.cc:276] 0709 13:02:02.525210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.093307 (+568097us) service_pool.cc:224] Handling call
0709 13:02:03.106719 (+ 13412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.107018 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:03.497003 (+389985us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.808535 (+311532us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.808600 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:03.808640 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.808699 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.808816 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1713,"prepare.queue_time_us":478142,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":1881,"raft.queue_time_us":3601,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":19381,"thread_start_us":664120,"threads_started":2}
I20260709 13:02:03.861888  1626 rpcz_store.cc:276] 0709 13:02:02.439170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.060995 (+621825us) service_pool.cc:224] Handling call
0709 13:02:03.061375 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.061785 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:03.061826 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.093273 (+ 31447us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.222323 (+129050us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:03.222383 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.223459 (+  1076us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.809218 (+585759us) raft_consensus.cc:1685] finished
0709 13:02:03.809248 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.809409 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4314,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":9398,"thread_start_us":112098,"threads_started":1,"wal-append.queue_time_us":151520}
I20260709 13:02:03.793514  8087 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:03.864394  8132 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.895546  7988 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:03.943784  7988 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:03.899887  8090 consensus_meta.cc:287] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.944s	user 0.012s	sys 0.000s
I20260709 13:02:03.904764  8133 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:02:03.905201  8117 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 13:02:03.870501  7983 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:03.906970  8115 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 13:02:03.908046  8101 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:03.966470  8121 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:02:03.909722  8113 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
W20260709 13:02:03.968719  8122 log.cc:927] Time spent T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:02:03.912093  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:03.973524  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:03.914232  8116 consensus_queue.cc:1059] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:02:03.880810  8056 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:03.921300  8129 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:02:03.896955  8039 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:02:03.931078  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.904292  8127 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:02:03.935267  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:03.913582  8120 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 13:02:03.853094  8088 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:03.945127  1700 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:03.857764  8076 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:03.944639  8090 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 16. Current term is 17.
I20260709 13:02:03.939312  7905 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:03.985872  8039 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:03.938339  8125 raft_consensus.cc:697] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:02:03.960294  8086 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.772s	user 0.008s	sys 0.003s
I20260709 13:02:03.959406  7988 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.987036  1706 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:03.988462  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.991766  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 54570.7us
W20260709 13:02:03.963094  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 157275us
I20260709 13:02:04.008843  1599 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:04.009840  8042 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:04.010069  1599 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:04.010371  8042 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:04.010773  6989 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:04.002002  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:04.010993  1599 leader_election.cc:400] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17.
I20260709 13:02:04.021759  1705 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:04.019747  2286 leader_election.cc:336] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.619s (SENT)
I20260709 13:02:03.951189  8132 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:03.979904  8067 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:03.962013  8133 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:04.034444  2286 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:04.035035  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:04.040946  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:04.104806  1702 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:04.099475  1706 raft_consensus.cc:2410] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:02:04.039366  1555 raft_consensus.cc:2376] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13. Re-sending same reply.
I20260709 13:02:04.010828  8042 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:04.109473  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 75441.9us
I20260709 13:02:04.110108  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:04.112501  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.112856  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:04.036775  8130 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:02:04.052563  8032 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:04.011588  8019 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.043370  8105 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.034723  7750 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.114941  1599 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:04.042328  7983 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.129843  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:04.123221  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:04.041101  8087 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.124792  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:04.034806  6989 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:04.135211  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 115504us
I20260709 13:02:04.021986  8086 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.112462  7823 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:04.140815  8138 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:04.039089  7965 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.119808  8032 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:02:04.128960  7917 consensus_meta.cc:287] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.955s	user 0.008s	sys 0.005s
I20260709 13:02:04.144820  8098 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:04.147035  8093 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:04.119733  8116 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:04.147651  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:04.181871  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:04.049661  8109 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.150508  7833 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:04.150597  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:04.154460  1706 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:04.189209  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64472.1us
I20260709 13:02:04.117231  8069 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:04.172775  8038 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:02:04.194259  1629 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:04.194965  8092 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:04.196327  8056 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.196833  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:04.197683  1628 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:04.198580  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:04.199783  8133 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:04.143985  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 3321) took 1011 ms. Trace:
I20260709 13:02:04.200742  1708 rpcz_store.cc:276] 0709 13:02:03.132432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.132728 (+   296us) service_pool.cc:224] Handling call
0709 13:02:04.143739 (+1011011us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400397e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:04.143895 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893805440}
I20260709 13:02:04.161417  7965 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.201449  2288 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:04.204377  7927 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.175855  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:04.205549  1633 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:04.205304  7927 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.178207  1627 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:04.205935  8132 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:04.180451  1560 raft_consensus.cc:1813] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Handling vote request from an unknown peer 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:04.207492  1560 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:04.182548  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:04.208077  7927 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.208313  1632 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:04.208823  8076 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.121323  7988 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:04.223976  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.172159  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1204146200000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
W20260709 13:02:04.224833  1673 connection.cc:256] RPC call timeout handler was delayed by -1.0916146200000298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
I20260709 13:02:04.225611  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 13:02:04.226336  1627 raft_consensus.cc:606] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:04.226805  1627 raft_consensus.cc:614] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:04.225332  1673 connection.cc:256] RPC call timeout handler was delayed by -1.0538146200000256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 13:02:04.154882  1701 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:04.186254  1559 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:04.190035  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:04.187889  1630 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:04.177088  8093 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:04.194162  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:04.162230  1709 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:04.204576  8045 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:04.161417  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:04.151892  7908 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:04.211208  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:04.140252  6989 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:04.224481  1601 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:02:04.239883  8134 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.191s	user 0.001s	sys 0.001s
I20260709 13:02:04.240162  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:04.240640  7965 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:04.241025  8123 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:02:04.241463  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:04.241835  8123 consensus_queue.cc:1243] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:02:04.119467  8141 consensus_queue.cc:1059] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.124s
I20260709 13:02:04.242625  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:04.242925  8141 raft_consensus.cc:3055] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:04.243431  8141 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:04.243705  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:04.244355  8141 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:04.245014  8058 consensus_meta.cc:287] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.024s	user 0.010s	sys 0.002s
I20260709 13:02:04.245473  8058 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.245766  8141 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:04.223804  8056 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.223382  8132 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:04.247702  8132 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:04.248914  7833 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:04.249231  8058 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.249421  7833 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:04.250368  8038 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:04.250530  7833 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.234953  8069 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:02:04.252846  8069 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:04.253225  8069 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:04.254232  8069 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.255620  8069 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:04.238337  8093 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:04.259989  8032 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:04.261169  8032 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:04.261315  8088 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:04.135867  7750 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.265975  1628 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:02:04.234252  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:02:04.266585  8095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.009s	sys 0.029s
W20260709 13:02:04.267328  8095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.009s	sys 0.029s
I20260709 13:02:04.267581  8095 raft_consensus.cc:697] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:04.236943  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:04.268558  8095 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.178231  8138 raft_consensus.cc:697] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:02:04.273658  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49250.5us
W20260709 13:02:04.275074  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 72275us
I20260709 13:02:04.275246  1601 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:04.276028  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:04.191754  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:04.278512  1557 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:04.279174  8058 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:04.238829  8098 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:04.286787  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 95236.7us
I20260709 13:02:04.287634  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:04.124076  8019 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.179029  7917 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.290012  1601 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:04.291946  1553 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:04.284000  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:04.292131  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:04.295689  8133 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:04.302424  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:04.305909  1633 raft_consensus.cc:1275] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:02:04.306308  1633 pending_rounds.cc:85] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 7
I20260709 13:02:04.306550  1633 pending_rounds.cc:107] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:02:04.306775  1633 raft_consensus.cc:2889] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.307775  7585 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:04.308333  7585 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.308897  7585 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:04.311160  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:04.313630  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:04.317726  8028 raft_consensus.cc:3055] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:04.318218  8028 raft_consensus.cc:740] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:04.319147  8028 consensus_queue.cc:260] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.320290  8028 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:04.145764  8125 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:04.286003  8101 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:04.289566  8098 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:04.329136  1526 connection.cc:256] RPC call timeout handler was delayed by -1.4642130080000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
I20260709 13:02:04.290975  8038 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:04.331637  1631 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:04.333284  1526 connection.cc:256] RPC call timeout handler was delayed by -1.2878130080000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
I20260709 13:02:04.292879  7988 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:04.292168  8024 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:04.364817  1631 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 21.
W20260709 13:02:04.335794  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1744130079999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
I20260709 13:02:04.374831  1701 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:04.372697  7908 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:02:04.378129  7908 raft_consensus.cc:3055] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:04.378698  7908 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:04.382870  1560 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:04.384229  1560 raft_consensus.cc:1240] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:02:04.384938  1556 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:04.388962  8138 consensus_queue.cc:237] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:04.330170  8101 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.340243   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:04.341517  7750 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.342468  8132 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:04.344544  7917 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.345928  8086 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.338461  7988 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:02:04.417125  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 133161us
I20260709 13:02:04.354365  8019 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:04.356000  7996 consensus_meta.cc:287] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.771s	user 0.010s	sys 0.001s
I20260709 13:02:04.357707  7833 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:04.361162  1632 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:04.455227  1707 raft_consensus.cc:2410] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:02:04.455479  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:04.456979  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:04.457897  1629 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:04.329656  8067 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:04.404824  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:04.484427  1701 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:02:04.334893  8098 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:04.353586  6989 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:04.392773  7611 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:04.412631  8101 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:04.379904  7908 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:04.398111  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.342456  1552 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:04.455133  8092 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.337213  1601 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:04.486696  2288 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:04.488644  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:04.446247  7988 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:04.448436  8024 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.312079  1553 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
W20260709 13:02:04.500842  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 163721us
I20260709 13:02:04.454795  8105 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:04.507833  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:04.502561  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:04.517865  1633 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:02:04.516512  1675 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:04.498713  8145 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.493448  8086 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:02:04.508412  7945 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:04.508246  8019 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:04.545524  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:04.550575  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:04.522204  7611 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:04.526983  7908 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:04.517870  8087 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:04.578420  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.578155  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:04.582794  1552 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:04.580847  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 70211.2us
W20260709 13:02:04.585345  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 45973.1us
I20260709 13:02:04.585790  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:04.587613  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:04.588058  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:04.534669  8090 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:04.539875  8109 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:04.595295  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:04.596196  1633 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 19: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:04.594204  8132 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:04.596865  8132 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:04.597219  8132 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:04.597915  8093 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.601091  8155 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:04.601596  8155 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:04.601958  8155 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:04.519912  8105 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.604893  8105 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.506371  8092 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.605875  6989 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:04.607225  8092 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.515762  8024 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.609952  8024 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.611129  8042 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:04.613477  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:04.547693  8145 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.616345  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:04.616385  8132 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.617353  8145 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:04.618026  7956 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:04.612522  8155 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.618541  8145 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:04.521932  7917 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 13:02:04.623409   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:04.625440  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:04.626183  8128 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.592s	user 0.003s	sys 0.000s
I20260709 13:02:04.626881  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:04.628226  8024 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:04.629184  8024 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:02:04.629448  8144 log.cc:927] Time spent T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:02:04.629802  8024 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:04.630328  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3319) took 1505 ms. Trace:
I20260709 13:02:04.520573  8088 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:02:04.630682  1702 rpcz_store.cc:276] 0709 13:02:03.125403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.125522 (+   119us) service_pool.cc:224] Handling call
0709 13:02:03.149651 (+ 24129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.105774 (+956123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.630095 (+524321us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b5400265554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:04.630270 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2195417344}
I20260709 13:02:04.530407  7996 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:02:04.649365  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:02:04.617010  1703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 3318) took 1531 ms (client timeout 2028 ms). Trace:
I20260709 13:02:04.632458  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:04.638047  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:04.644510  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:04.651000  2324 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:04.651114  2327 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:04.555009  8133 raft_consensus.cc:2764] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:02:04.650138  1703 rpcz_store.cc:269] 0709 13:02:03.085330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.085485 (+   155us) service_pool.cc:224] Handling call
0709 13:02:04.616803 (+1531318us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54002cc254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:04.616930 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635622144}
W20260709 13:02:04.644851  1555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 1426) took 1941 ms (client timeout 1619 ms). Trace:
I20260709 13:02:04.652897  1552 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:02:04.653517  1526 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:04.656837  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:04.656878  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:04.658731  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:02:04.652518  1555 rpcz_store.cc:269] 0709 13:02:02.703705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.716473 (+ 12768us) service_pool.cc:224] Handling call
0709 13:02:04.644676 (+1928203us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002283d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:04.644786 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2992104192}
I20260709 13:02:04.664537  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:04.665035  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:04.584327  8019 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:04.666077  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:04.669380  2323 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:04.666290  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:04.657155  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:04.670598  1557 raft_consensus.cc:2376] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14. Re-sending same reply.
I20260709 13:02:04.671478  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:04.672696  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:04.673393  2327 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 17: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:02:04.668967  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 128372us
I20260709 13:02:04.674202  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:04.666642  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:04.666015  2325 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:04.666644  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:04.676422  2321 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:02:04.665700  1559 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:02:04.677672  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:04.678973  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:04.679442  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:04.679687  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:04.554225  8116 consensus_queue.cc:1059] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:02:04.680466  2322 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:04.613626  8042 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:04.679704  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:04.696135  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 304247us
I20260709 13:02:04.680876  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:04.640697  8155 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:04.693944  2324 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:02:04.694205  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:04.689929  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.698798  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:04.701400  1560 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:02:04.699525  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:04.702288  1632 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 12.
I20260709 13:02:04.702440  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:04.612846  8109 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.072s
W20260709 13:02:04.703624  8148 log.cc:927] Time spent T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:02:04.703677  1552 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:04.705658  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.706228  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.709169  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:04.709878  2324 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:02:04.715741  1673 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:04.685624  8105 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:04.686003  8092 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:04.723546  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:04.725137  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:04.729409  1560 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:04.732002  1555 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:04.732324  2322 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
W20260709 13:02:04.695724  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.680327  7750 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:02:04.742798  1559 raft_consensus.cc:1275] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:04.722123  8067 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:04.706827  8090 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:04.723754  8093 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.784721  1634 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:04.784914  2320 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:02:04.785349  2320 pending_rounds.cc:85] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 15
I20260709 13:02:04.785590  2320 pending_rounds.cc:107] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:02:04.785828  2320 raft_consensus.cc:2889] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.782310  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:04.795589  1700 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
W20260709 13:02:04.801211  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.768244  8132 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:04.815420  1707 raft_consensus.cc:1275] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:04.817139  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:04.818555  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:04.822927  1701 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:04.818867  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:04.831449  1700 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:04.833724  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:04.828274  1709 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
I20260709 13:02:04.835068  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:04.836076  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:04.836714  1703 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:04.840157  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:04.840540  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:04.846513  2321 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:02:04.847267  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:04.848009  1708 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:02:04.850023  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 106311us
I20260709 13:02:04.850646  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:04.851650  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:04.853051  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:04.856348  1709 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:04.858074  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1247) took 1053 ms. Trace:
I20260709 13:02:04.863368  1673 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:04.864974  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:04.866009  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:04.866652  2324 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:02:04.858436  1705 rpcz_store.cc:276] 0709 13:02:03.804619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.817235 (+ 12616us) service_pool.cc:224] Handling call
0709 13:02:03.817688 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.033777 (+216089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.857832 (+824055us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54002530d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:04.858003 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468739968}
I20260709 13:02:04.868124  1700 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:04.837051  8157 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.872244  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:04.887743  2321 raft_consensus.cc:2368] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14.
W20260709 13:02:04.873072  8159 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:02:04.886745  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:04.895462  1702 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:04.888576  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:04.897044  2321 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 16: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:04.898001  1673 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:04.916127  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:04.872313  8150 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:02:04.917732  1598 leader_election.cc:400] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14.
I20260709 13:02:04.929473  1598 leader_election.cc:403] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:02:04.918596  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:04.828049  7936 consensus_queue.cc:1059] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:02:04.932170  2329 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:04.870612  8067 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:04.926836  2321 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:04.931375  1709 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 19: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:04.922837  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:04.870352  8162 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:04.916951  8155 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:04.857039  8058 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
W20260709 13:02:04.967013  8089 consensus_meta.cc:287] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.026s	user 0.004s	sys 0.008s
I20260709 13:02:04.803072  8019 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.957126  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:04.979070  2320 raft_consensus.cc:2410] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
W20260709 13:02:04.955294  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58164.3us
I20260709 13:02:04.963444  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:04.953799  8153 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:02:04.963933  1627 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 20. Current term is 21. Ops: [19.14-20.15]
I20260709 13:02:04.982045  1702 raft_consensus.cc:2393] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 10: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:04.964406  8093 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:04.963358  1700 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
I20260709 13:02:04.956455  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:04.962594  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 71087.6us
I20260709 13:02:04.931804  8087 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:04.979494  1708 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:02:04.980533  1707 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 16: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:04.979955  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:05.000144  1709 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 19: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:04.848920  8090 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.954905  7996 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:04.981367  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:04.913390  8157 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:04.987074  1598 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:05.079802  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 92848.2us
I20260709 13:02:04.957371  8067 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:05.001859  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:04.928669  8156 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:02:05.124492  1555 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:02:05.033671  7750 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.979007  8168 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:02:04.977999  7936 consensus_queue.cc:1243] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:02:05.076040  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 234195us
I20260709 13:02:05.045984  2286 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:05.082491  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 101206us
I20260709 13:02:05.094187  1700 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
W20260709 13:02:05.224565  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 98691.1us
I20260709 13:02:05.268019  1673 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:05.119293  7585 consensus_meta.cc:287] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.810s	user 0.008s	sys 0.004s
I20260709 13:02:05.240410  8179 consensus_queue.cc:1059] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:02:05.241341  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.124998  8087 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:05.125445  8067 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:05.166500  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.202442  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.252322  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.226437  7843 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:05.266490  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:05.262164  7905 consensus_meta.cc:287] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.160s	user 0.018s	sys 0.000s
I20260709 13:02:05.276674  1631 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:05.277210  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 231333us
I20260709 13:02:05.285436  2286 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:05.288172  1703 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 9.
I20260709 13:02:05.278211  2288 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:05.280819  1673 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:05.314829  1626 raft_consensus.cc:3055] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:05.316272  1626 raft_consensus.cc:740] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:05.291051  1707 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 21: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:02:05.329988  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 49288.8us
I20260709 13:02:05.332151  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:05.334666  2288 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:05.285403  7996 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:05.289556  7843 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.339377  1626 consensus_queue.cc:260] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.319000  8166 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:05.320083  7611 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:05.350535  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:05.354211  1707 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:05.355934  1626 raft_consensus.cc:3060] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:05.284807  8169 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:02:05.285684  8109 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:05.301487  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:05.271421  7936 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.348846  8139 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 1.291s	user 0.002s	sys 0.017s
I20260709 13:02:05.341583  8162 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:05.359524  8099 consensus_queue.cc:1059] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:02:05.314807  7905 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:05.344901  7843 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:05.354347  8123 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:05.353935  7611 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.341867  8087 consensus_queue.cc:1048] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:02:05.376830  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:05.377586  1555 raft_consensus.cc:2368] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20.
I20260709 13:02:05.377457  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:05.377856  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:05.373611  8162 raft_consensus.cc:697] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:05.378618  1559 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:05.379380  8162 consensus_queue.cc:237] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:05.383333  8157 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:05.390144  8105 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:05.390817  8105 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:05.395200  8141 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.149s	user 0.014s	sys 0.000s
I20260709 13:02:05.396405  1551 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:02:05.396796  1551 pending_rounds.cc:85] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 8
I20260709 13:02:05.397123  1551 pending_rounds.cc:107] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:02:05.397418  1551 raft_consensus.cc:2889] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:05.401743  8101 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.902s	user 0.013s	sys 0.000s
I20260709 13:02:05.402245  8101 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:05.403833  8039 consensus_meta.cc:287] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 1.382s	user 0.004s	sys 0.007s
I20260709 13:02:05.379321  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:05.376529  7611 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:05.409236  2322 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: [15.15-15.15]
I20260709 13:02:05.410930  1706 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:05.412607  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 1279) took 1184 ms. Trace:
I20260709 13:02:05.413030  1628 rpcz_store.cc:276] 0709 13:02:04.227758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.243472 (+ 15714us) service_pool.cc:224] Handling call
0709 13:02:05.412420 (+1168948us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b5400125554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:05.412523 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49442688}
W20260709 13:02:05.408308  8098 consensus_meta.cc:287] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.914s	user 0.006s	sys 0.003s
I20260709 13:02:05.363765  8166 raft_consensus.cc:697] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:05.416294  8155 raft_consensus.cc:3055] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:05.416733  8155 raft_consensus.cc:740] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:05.280771  7585 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:05.418267  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:05.419023  1706 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 16: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:05.424827  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:05.429883  1558 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:05.374480  8123 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.279819  7750 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.432365  8123 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:05.434556  7750 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:05.436859  7585 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:05.437456  8099 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:05.374348  7936 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:05.438174  8099 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.439515  7936 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:05.440455  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2861) took 1266 ms. Trace:
I20260709 13:02:05.441761  1634 rpcz_store.cc:276] 0709 13:02:04.173821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.176077 (+  2256us) service_pool.cc:224] Handling call
0709 13:02:04.192975 (+ 16898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.785209 (+592234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.440225 (+655016us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b54002d6c54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:05.440393 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1360280320}
I20260709 13:02:05.450923  1601 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:05.459955  1628 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:05.415853  8166 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.498395  1701 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:05.461483  1707 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:02:05.465230  1601 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:05.500808  1701 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:02:05.501174  1701 pending_rounds.cc:85] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 12
I20260709 13:02:05.501396  1701 pending_rounds.cc:107] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:02:05.501610  1701 raft_consensus.cc:2889] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:05.504433  1551 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:05.505179  1703 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:05.509907  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:05.510411  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:05.378266  8109 raft_consensus.cc:697] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:05.513953  1708 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:05.507727  7908 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:05.461228  8157 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.404356  8039 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.518662  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:05.520713  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:05.450882  8169 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:02:05.497144  7936 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:05.524140  8155 consensus_queue.cc:260] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.525146  7995 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:05.527347  8088 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:05.414667  8098 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.532411  1701 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:02:05.497077  8173 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.459s	user 0.012s	sys 0.009s
I20260709 13:02:05.440402  8099 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:05.539281  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:05.583050  1703 raft_consensus.cc:2410] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:02:05.583209  1633 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:05.511480  8124 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.515141  8125 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.057s
W20260709 13:02:05.562287  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 51950.2us
I20260709 13:02:05.519129  8019 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:05.531476  8141 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:05.512154  1628 raft_consensus.cc:2376] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 21. Re-sending same reply.
W20260709 13:02:05.555977  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.586272  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:05.567510  8028 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:05.588692  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:05.606437  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:05.607510  1707 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:02:05.571861  8101 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:05.604429  8199 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:05.609761  8199 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:05.610172  8199 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:05.610653  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:05.611337  1632 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:02:05.531832  8170 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
W20260709 13:02:05.613415  8188 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:02:05.613864  1704 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:05.592253  1601 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:05.608290  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:05.615954  1707 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:05.616133  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:05.617715  2323 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:05.588680  7988 consensus_meta.cc:287] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.073s	user 0.013s	sys 0.000s
I20260709 13:02:05.596639  1701 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:02:05.631922  1701 pending_rounds.cc:85] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 10
I20260709 13:02:05.632164  1701 pending_rounds.cc:107] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:02:05.632579  1701 raft_consensus.cc:2889] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:05.601881  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:02:05.591390  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 73806.3us
W20260709 13:02:05.579723  8093 consensus_meta.cc:287] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.002s
I20260709 13:02:05.589272  8187 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.632097  1675 leader_election.cc:336] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.936s (SENT)
I20260709 13:02:05.593497  8019 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:05.640873  2327 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:05.585382  8090 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.612388  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:05.585178  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:05.618501  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:05.622246  8099 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:02:05.604386  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 85807.5us
I20260709 13:02:05.623332  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:05.625118  1707 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
W20260709 13:02:05.627756  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2862) took 1453 ms (client timeout 1936 ms). Trace:
I20260709 13:02:05.628461  1523 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:05.550931  8067 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.608505  1673 leader_election.cc:400] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20.
I20260709 13:02:05.572697  7908 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:05.645576  1632 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:02:05.653162  1632 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:02:05.647536  1635 rpcz_store.cc:269] 0709 13:02:04.174320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.174502 (+   182us) service_pool.cc:224] Handling call
0709 13:02:05.627490 (+1452988us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54002c88d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:05.627683 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1175671680}
I20260709 13:02:05.571547  8157 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.648571  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:05.756904  1601 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:05.643694  1672 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:05.760095  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 116521us
I20260709 13:02:05.764740  6989 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:05.648272  1673 leader_election.cc:403] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:02:05.649777  2326 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:05.582587  7995 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.640756  8155 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:05.790876  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1275) took 1564 ms. Trace:
I20260709 13:02:05.791332  1627 rpcz_store.cc:276] 0709 13:02:04.226824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.259221 (+ 32397us) service_pool.cc:224] Handling call
0709 13:02:04.963685 (+704464us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:04.982188 (+ 18503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.790614 (+808426us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b5400204750. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:05.790818 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619152768}
I20260709 13:02:05.644017  8019 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:05.793211  7917 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:05.637495  8185 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:05.587052  8088 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:05.640841  8093 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14.
I20260709 13:02:05.637113  7996 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.789614  8076 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:05.839303  1628 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:02:05.594117  8124 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:05.634419  8141 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.869946  1634 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
W20260709 13:02:05.873103  1626 consensus_meta.cc:287] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.517s	user 0.005s	sys 0.006s
I20260709 13:02:05.640576  7988 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.796762  8157 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:05.878232  1626 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:05.689970  8099 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.887674  8176 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:02:05.874146  8190 consensus_queue.cc:1059] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:02:05.890264  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.646066  8187 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:05.844525  7585 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:05.651304  8195 consensus_queue.cc:1059] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.227s
I20260709 13:02:05.909418  1556 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:05.656869  8090 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:05.876896  7996 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:05.904493  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 257612us
I20260709 13:02:05.929320  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:05.689096  8109 consensus_queue.cc:237] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.904702  8207 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.898495  8024 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:05.898224  8125 raft_consensus.cc:3055] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:05.931610  7843 consensus_meta.cc:287] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.001s
I20260709 13:02:05.903398  8099 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:05.934234  8176 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:02:05.953459  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 345060us
I20260709 13:02:05.948531  1700 raft_consensus.cc:1240] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:05.926014  7585 raft_consensus.cc:697] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:05.895853  8086 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:02:05.940949  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:05.954464  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:05.969790  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:05.970240  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:05.943889  8024 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.975665  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:05.980851  8172 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.902s	user 0.005s	sys 0.000s
W20260709 13:02:05.984084  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.007354  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.990999  8133 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:05.991909  2288 leader_election.cc:336] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 2.010s (SENT)
W20260709 13:02:06.050755  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 58918.8us
I20260709 13:02:05.996457  8032 raft_consensus.cc:3055] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:05.968776  8162 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.950335  7843 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:05.945253  8125 raft_consensus.cc:740] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:06.104883  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:06.056020  1558 raft_consensus.cc:1240] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:06.057845  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:06.106297  1555 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:05.996660  1557 raft_consensus.cc:2468] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:05.969133  8039 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:05.999648  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:06.006944  8024 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:06.073123  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 97555.7us
I20260709 13:02:06.104285  2329 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:06.104947  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:06.117326  2329 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:05.953305  8195 raft_consensus.cc:3055] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:06.066701  8133 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.120002  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1273) took 1893 ms. Trace:
I20260709 13:02:06.121408  1634 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:06.062422  8203 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:06.108294  2320 raft_consensus.cc:2376] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16. Re-sending same reply.
W20260709 13:02:06.112370  8193 log.cc:927] Time spent T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:02:06.134855  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.125373  1555 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:02:06.062570  8032 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:06.129305  2329 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.126842  1629 rpcz_store.cc:276] 0709 13:02:04.226265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.226370 (+   105us) service_pool.cc:224] Handling call
0709 13:02:04.457683 (+231313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.458454 (+   771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.119808 (+1661354us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54000da7d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:06.119945 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501546880}
I20260709 13:02:06.067271  8076 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:06.128737  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:06.108289  8175 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:06.112821  8067 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.157537  2329 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:05.944972  8207 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.120555  8195 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:06.129436  8133 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:06.170730  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2724) took 1496 ms. Trace:
I20260709 13:02:06.104557  8162 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.220408  1552 rpcz_store.cc:276] 0709 13:02:04.658059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.705599 (+ 47540us) service_pool.cc:224] Handling call
0709 13:02:04.734148 (+ 28549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:04.734479 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.734508 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:04.737839 (+  3331us) log.cc:844] Serialized 26 byte log entry
0709 13:02:04.954651 (+216812us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:04.954694 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.954751 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.980047 (+1025296us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:06.142144 (+162097us) raft_consensus.cc:1685] finished
0709 13:02:06.142182 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.154383 (+ 12201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":949,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":20240,"spinlock_wait_cycles":332817792,"thread_start_us":216437,"threads_started":1,"wal-append.queue_time_us":268243}
I20260709 13:02:05.969369  8176 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.217519  8039 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:06.156117  7917 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20.
I20260709 13:02:06.205565  8086 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:06.269122  1672 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:06.271680  8202 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:06.272248  8202 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:06.273123  8202 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.129918  8206 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 13:02:06.234524  7988 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.291863  8125 consensus_queue.cc:260] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.293669  8125 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:06.297335  8209 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:02:06.301187  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 3147) took 1429 ms. Trace:
W20260709 13:02:06.301431  8212 log.cc:927] Time spent T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:02:06.301663  1702 rpcz_store.cc:276] 0709 13:02:04.896759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.918104 (+ 21345us) service_pool.cc:224] Handling call
0709 13:02:06.300963 (+1382859us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b54002530d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:06.301118 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114273152}
W20260709 13:02:06.304141  8019 consensus_meta.cc:287] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.000s
I20260709 13:02:06.303813  8032 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.305365  8032 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.311367  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:06.311816  1701 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:06.312057  1703 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:06.314484  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:06.315455  1708 raft_consensus.cc:2410] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:02:06.315442  8019 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.320077  1703 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:02:06.325030  1631 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:06.326658  1703 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:06.329274  1703 raft_consensus.cc:1275] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:02:06.244596  8218 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:06.133009  7585 consensus_queue.cc:237] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.401301  8214 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:06.332248  8076 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.334615  8207 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:06.168038  8175 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.338547  8176 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.260159  8039 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:06.396564  8199 consensus_meta.cc:287] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.786s	user 0.012s	sys 0.000s
I20260709 13:02:06.279114  8124 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:06.411206  8155 consensus_meta.cc:287] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.005s
I20260709 13:02:06.444687  1701 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: [14.14-15.15]
W20260709 13:02:06.413239  8105 consensus_meta.cc:287] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 1.022s	user 0.013s	sys 0.000s
W20260709 13:02:06.461593  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.470064  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.429626  1601 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:06.474707  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.487589  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.448630  8187 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:06.438686  8045 consensus_queue.cc:1059] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:02:06.429806  8214 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.531347  1701 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:06.473423  8124 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:06.519802  8176 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:06.442217  8199 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.544541  8199 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.534678  2324 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 10.
I20260709 13:02:06.463759  8105 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.522243  8213 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:02:06.553793  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:06.556056  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1286) took 1281 ms. Trace:
I20260709 13:02:06.560751  1633 rpcz_store.cc:276] 0709 13:02:05.275108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.275262 (+   154us) service_pool.cc:224] Handling call
0709 13:02:05.275645 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.585072 (+309427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.555733 (+970661us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54002c7ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:06.555975 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":706806016}
I20260709 13:02:06.548130  8098 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:06.567945  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:06.559785  1701 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 21.
I20260709 13:02:06.544463  8175 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:06.573441  1559 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:06.552281  8176 raft_consensus.cc:697] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:06.563925  7843 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:06.579792  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.009s	sys 0.015s
W20260709 13:02:06.593400  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.010s	sys 0.015s
I20260709 13:02:06.577662  8162 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.541251  8124 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.606841  2329 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:02:06.594007  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 624089us
W20260709 13:02:06.617594  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.016s	sys 0.012s
W20260709 13:02:06.618120  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.016s	sys 0.012s
W20260709 13:02:06.618818  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 990772us
I20260709 13:02:06.612226  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:06.632746  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:06.621467  1523 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:06.635987  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:06.637145  1632 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.001s	sys 0.032s
W20260709 13:02:06.638459  1632 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.002s	sys 0.032s
I20260709 13:02:06.638927  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:06.605347  7611 consensus_meta.cc:287] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.194s	user 0.012s	sys 0.002s
I20260709 13:02:06.603876  8019 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:06.603143  7843 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:06.637883  1523 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:06.638351  8143 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:06.641573  8187 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:06.640374  8205 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:06.670595  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 145044us
I20260709 13:02:06.641896  7988 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:06.670971  7956 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:02:06.640671  8199 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:02:06.653319  8132 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:06.671348  8221 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:06.666188  8143 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:06.669391  8187 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:06.678776  7988 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.650722  7611 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:06.676630  8123 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.242s	user 0.015s	sys 0.000s
I20260709 13:02:06.664155  8086 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:02:06.709582  8217 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:06.685153  8155 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.693300  8221 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.681319  8039 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.661041  7843 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.697773  8143 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:06.706944  8123 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.670441  8176 consensus_queue.cc:237] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:06.691085  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 218130us
I20260709 13:02:06.700654  8187 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:06.695250  8141 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.703249  7988 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:06.729920  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:06.737761  1555 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:06.740437  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:06.741420  1555 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 20: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:06.721004  8045 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.703905  8132 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:02:06.746400  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:06.747915  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:06.721688  8221 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:06.749433  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:02:06.750914  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 94413.6us
I20260709 13:02:06.752851  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:06.753211  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:06.728272  8105 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.756392  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:06.757416  1552 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:06.758586  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:06.737787  8223 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.760270  8214 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:06.761837  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:06.721412  8224 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:02:06.762553  1552 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:02:06.763530  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:06.764272  1552 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:06.764847  8105 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:06.760308  8199 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:06.765450  8105 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.766794  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:06.767864  8105 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:06.768496  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:06.768873  8239 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:06.769577  8239 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.771871  8239 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:06.765738  8199 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:06.773600  1552 raft_consensus.cc:2410] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:02:06.774231  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.722453  8155 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.745607  8109 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.776834  1552 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:06.739372  8213 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:02:06.768420  8105 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:06.784709  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:06.792351  1628 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 20: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:06.786458  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:06.792991  1633 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:06.788044  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:06.791522  1554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33810 (request call id 1433) took 3282 ms (client timeout 2203 ms). Trace:
W20260709 13:02:06.794231  1554 rpcz_store.cc:269] 0709 13:02:03.508746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.508900 (+   154us) service_pool.cc:224] Handling call
0709 13:02:06.791308 (+3282408us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54000578d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:06.791451 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3020353792}
I20260709 13:02:06.795825  1673 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:06.796906  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:06.797448  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:06.798040  1628 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:02:06.797578  1554 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:02:06.771895  7843 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.800971  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:06.772514  8086 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:02:06.804898  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:06.805042  8237 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:02:06.761112  8205 raft_consensus.cc:697] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:06.817662  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:06.809535  1629 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:06.810671  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:06.755887  8045 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.815546  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:06.808565  8076 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:06.777088  8223 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.819063  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:06.791147  8124 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.829595  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:06.777773  8199 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.831722  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:06.780180  8109 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.801438  8105 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.835105  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:06.838614  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:06.841399  1555 raft_consensus.cc:2410] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:02:06.842097  8202 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:06.842901  8162 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:06.844362  8241 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:06.844906  8241 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:06.846485  8032 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.000s
I20260709 13:02:06.847301  8241 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:06.848973  8246 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.867992  8032 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.868440  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1529) took 2036 ms. Trace:
I20260709 13:02:06.868276  8246 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.869055  2322 rpcz_store.cc:276] 0709 13:02:04.832048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.832180 (+   132us) service_pool.cc:224] Handling call
0709 13:02:04.839122 (+  6942us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.411835 (+572713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.868170 (+1456335us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54008291d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:06.868380 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299972864}
I20260709 13:02:06.869879  8155 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:06.870740  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1379) took 2229 ms. Trace:
I20260709 13:02:06.870811  8246 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:06.849201  8225 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:06.871230  2323 rpcz_store.cc:276] 0709 13:02:04.641659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.703502 (+ 61843us) service_pool.cc:224] Handling call
0709 13:02:04.703825 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.618124 (+914299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.870513 (+1252389us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b5400783a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:06.870682 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2100968192}
I20260709 13:02:06.871868  8123 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:06.853374  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:06.873919  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:06.854537  8205 consensus_queue.cc:237] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:06.875978  8201 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 1.223s	user 0.002s	sys 0.009s
I20260709 13:02:06.858340  8187 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.861191  8223 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:06.862505  8161 raft_consensus.cc:3055] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:06.879207  8161 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:06.879362  8143 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:06.880353  8161 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:06.865691  8133 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.001s
I20260709 13:02:06.882481  8133 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.884056  1556 raft_consensus.cc:1240] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:02:06.884680  8199 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.885373  8133 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.825451  8076 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:06.886209  8076 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.886355  8246 raft_consensus.cc:2764] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:02:06.886209  8241 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:06.889488  8199 consensus_queue.cc:1059] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:02:06.840641  8024 consensus_meta.cc:287] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.712s	user 0.014s	sys 0.000s
I20260709 13:02:06.890754  8024 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.891196  8199 raft_consensus.cc:3055] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:06.891732  8199 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:06.866912  7611 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:06.872598  8071 raft_consensus.cc:3055] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:06.892936  1560 raft_consensus.cc:2368] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16.
I20260709 13:02:06.893186  8071 raft_consensus.cc:740] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:06.881901  8109 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:06.881903  8105 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:06.866251  8243 consensus_queue.cc:1059] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:06.895138  8187 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.895406  8243 raft_consensus.cc:3055] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:06.895857  8243 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:06.896826  8243 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.897289  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:06.898195  8243 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:06.898778  8246 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:06.899489  8246 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:06.899971  8246 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:06.902355  8214 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.903074  8214 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.902051  8187 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:06.905771  8214 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:06.907460  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.912179  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.889364  8241 raft_consensus.cc:697] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:06.908682  7988 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.910175  1673 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:02:06.916855  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 172151us
I20260709 13:02:06.917943  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2880) took 1073 ms. Trace:
I20260709 13:02:06.881971  8161 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:06.923190  1673 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:06.918442  1632 rpcz_store.cc:276] 0709 13:02:05.845083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.845430 (+   347us) service_pool.cc:224] Handling call
0709 13:02:05.884922 (+ 39492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.885173 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:02:06.644450 (+759277us) log.cc:844] Serialized 14 byte log entry
0709 13:02:06.916002 (+271552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:06.916078 (+    76us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:06.917608 (+  1530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.917718 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.917875 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14343,"prepare.queue_time_us":802622,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":39502,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4213,"spinlock_wait_cycles":14609408,"thread_start_us":972855,"threads_started":3,"wal-append.queue_time_us":131860}
I20260709 13:02:06.868567  8032 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.892367  8221 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.929621  8024 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.934973  8241 consensus_queue.cc:237] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:06.935947  7988 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:06.924263  8214 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:06.929526  8202 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:06.896831  8199 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.955844  8143 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:06.961186  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:06.963886  1552 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:02:06.965448  1551 raft_consensus.cc:1275] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:02:06.980413  8076 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.952450  7988 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.983071  8076 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:06.982944  7988 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:06.949230  8214 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.984891  8214 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.993194  8141 raft_consensus.cc:3055] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:06.993894  8141 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:06.994514  8199 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:06.995097  8141 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:06.961890  1557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2732) took 2301 ms (client timeout 1896 ms). Trace:
W20260709 13:02:06.998934  1557 rpcz_store.cc:269] 0709 13:02:04.660127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.679220 (+ 19093us) service_pool.cc:224] Handling call
0709 13:02:06.961621 (+2282401us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001d74d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:06.961813 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3027666176}
I20260709 13:02:07.001112  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 1411) took 1054 ms. Trace:
W20260709 13:02:07.004072  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.001596  2327 rpcz_store.cc:276] 0709 13:02:05.946819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.946953 (+   134us) service_pool.cc:224] Handling call
0709 13:02:05.947285 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.246744 (+299459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.246788 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.247700 (+   912us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.604153 (+356453us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:06.645729 (+ 41576us) log.cc:844] Serialized 14 byte log entry
0709 13:02:06.651978 (+  6249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.998116 (+346138us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54001a22d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:06.998197 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.998270 (+    73us) raft_consensus.cc:1685] finished
0709 13:02:07.000876 (+  2606us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.001047 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36221,"prepare.run_wall_time_us":68,"raft.queue_time_us":21438,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":30351,"spinlock_wait_cycles":702789760,"thread_start_us":356013,"threads_started":1,"wal-append.queue_time_us":494607}
I20260709 13:02:07.007347  1552 raft_consensus.cc:1275] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:07.007583  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:07.010871  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:07.011950  1552 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:07.012130  8076 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:07.022197  7908 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:07.029882  8205 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:07.025121  8076 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.034174  8076 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.034267  8205 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.037619  7995 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:07.031965  8242 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:02:07.041627  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:07.046255  1552 raft_consensus.cc:2468] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:07.048130  1673 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:07.070178  7995 raft_consensus.cc:2804] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:07.031064  8241 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.075824  1554 raft_consensus.cc:1240] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:07.039536  8205 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:07.082434  8253 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:02:07.083920  8246 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.076814  8241 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:07.092001  8246 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:07.093619  8241 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:07.075968  7995 raft_consensus.cc:697] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:07.113548  7995 consensus_queue.cc:237] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:07.126891  8195 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.140185  8195 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:07.145999  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:07.137009  8178 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 1.886s	user 0.018s	sys 0.005s
I20260709 13:02:07.118090  8214 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:07.137660  7996 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:07.138511  8076 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:07.148507  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.150246  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.152763  1701 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:07.157310  8214 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:07.153054  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:07.158601  1702 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:07.161878  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:07.161257  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:07.164904  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:07.161429  8069 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.170069  8069 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.171339  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 3146) took 2302 ms. Trace:
I20260709 13:02:07.171214  7908 consensus_queue.cc:1059] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:07.166138  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:07.173580  2288 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:07.171862  1705 rpcz_store.cc:276] 0709 13:02:04.868770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.868958 (+   188us) service_pool.cc:224] Handling call
0709 13:02:04.869505 (+   547us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:04.933450 (+ 63945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.933494 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:04.954936 (+ 21442us) log.cc:844] Serialized 52 byte log entry
0709 13:02:05.044124 (+ 89188us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:05.244364 (+200240us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.244686 (+   322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.244880 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.136345 (+1891465us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:07.170994 (+ 34649us) raft_consensus.cc:1685] finished
0709 13:02:07.171113 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.171274 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26546,"prepare.queue_time_us":278645,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":68741,"raft.run_cpu_time_us":1833,"raft.run_wall_time_us":24552,"spinlock_wait_cycles":14763392,"thread_start_us":237042,"threads_started":2,"wal-append.queue_time_us":276685}
I20260709 13:02:07.179118  8109 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:02:07.180951  8196 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:02:07.181483  8231 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.465s	user 0.002s	sys 0.000s
I20260709 13:02:07.166456  8202 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.184336  7611 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:02:07.186482  8123 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:07.186803  8042 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:02:07.186967  8123 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.187553  8123 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:07.187740  8175 raft_consensus.cc:3055] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:07.188175  8175 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:07.166124  8161 consensus_queue.cc:1059] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:02:07.189107  8175 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:07.189800  8161 raft_consensus.cc:3055] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:07.189989  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:07.190263  8161 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:07.190387  8175 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.190721  1554 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:07.191291  8161 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.161535  8087 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:07.193308  8032 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:07.193060  8087 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:07.195246  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3348) took 1777 ms. Trace:
I20260709 13:02:07.195447  8087 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:07.195688  1700 rpcz_store.cc:276] 0709 13:02:05.417346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.417471 (+   125us) service_pool.cc:224] Handling call
0709 13:02:05.417775 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.955859 (+538084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.194973 (+1239114us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b540002c6d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:07.195178 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213920640}
I20260709 13:02:07.186120  8202 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.199393  1554 raft_consensus.cc:2468] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:07.161645  8171 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:07.175806  8214 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:07.200727  8171 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.201408  8214 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:07.202925  8214 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:07.217525  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.218268  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.218942  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.163424  7996 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.221966  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:07.211165  2286 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:07.223767  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:07.224370  2327 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.225862  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:07.174782  8069 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:07.238142  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:07.197943  8161 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:07.289000  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 77939.3us
I20260709 13:02:07.278694  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:07.289680  8155 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:02:07.293588  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:07.293764  8155 consensus_queue.cc:1048] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:07.296800  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:07.220912  7611 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.300441  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:07.240211  8109 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:07.281744  8156 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:07.323925  1702 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:02:07.281594  7833 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:07.345819  8202 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:07.346416  7833 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:07.300395  8076 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:07.302690  8157 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:07.227528  7996 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:07.350241  7996 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:07.304447  8166 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:07.348416  8157 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.334553  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1454) took 1904 ms. Trace:
I20260709 13:02:07.337787  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:07.354179  1557 raft_consensus.cc:2393] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:02:07.339417  2324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 1385) took 1716 ms (client timeout 2096 ms). Trace:
I20260709 13:02:07.352825  1559 rpcz_store.cc:276] 0709 13:02:05.429730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.429842 (+   112us) service_pool.cc:224] Handling call
0709 13:02:05.430093 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.579262 (+1149169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.334314 (+755052us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400160154. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:07.334495 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2629561600}
I20260709 13:02:07.342021  7943 consensus_queue.cc:1059] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:07.342803  8087 raft_consensus.cc:3055] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:02:07.354759  2324 rpcz_store.cc:269] 0709 13:02:05.622905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.623067 (+   162us) service_pool.cc:224] Handling call
0709 13:02:07.339211 (+1716144us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b5400529254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:07.339353 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1858546432}
I20260709 13:02:07.339700  8171 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:07.363170  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 202419us
I20260709 13:02:07.356060  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:07.357496  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:07.358361  2327 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:07.351455  8157 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:07.327862  8089 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:07.314541  7611 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.379191  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:07.333990  8262 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.382783  1559 raft_consensus.cc:2410] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:02:07.368175  1673 leader_election.cc:336] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.967s (SENT)
I20260709 13:02:07.383615  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:07.378362  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 83915.3us
I20260709 13:02:07.385869  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:07.388844  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:07.394914  1557 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.390870  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:07.347501  7833 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.359206  8087 raft_consensus.cc:740] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:07.392928  7905 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:07.398132  1673 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:07.381482  8069 consensus_queue.cc:1059] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:02:07.404011  2288 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:07.407330  1557 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:02:07.411026  1673 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:07.416663  7611 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:07.418707  8069 raft_consensus.cc:3055] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:07.419224  8069 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:07.420763  7905 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:07.423688  8123 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.387552  8262 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.425107  8087 consensus_queue.cc:260] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:07.426456  8087 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:07.426676  8262 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:07.420281  8069 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.433723  8069 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:07.434803  8123 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:07.436432  8177 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
W20260709 13:02:07.437136  8171 consensus_queue.cc:1175] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" responder_term: 14 status { last_received { term: 13 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:02:07.440256  8258 log.cc:927] Time spent T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:02:07.441576  8256 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:02:07.445154  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.447085  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3400) took 1388 ms. Trace:
I20260709 13:02:07.447607  1551 rpcz_store.cc:276] 0709 13:02:06.059205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.122231 (+ 63026us) service_pool.cc:224] Handling call
0709 13:02:06.961790 (+839559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.965968 (+  4178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.446789 (+480821us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54001d74d0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:07.447005 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874799360}
I20260709 13:02:07.411566  8264 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:07.407989  8259 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.453186  8259 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:07.454116  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:07.455453  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:07.410130  8265 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:07.457512  8265 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.459209  7988 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:07.460268  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.464222  7905 raft_consensus.cc:697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:07.465462  7905 consensus_queue.cc:237] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.471024  8221 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:07.471398  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 550037us
I20260709 13:02:07.476289  8125 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:07.476996  8088 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:07.476895  8125 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:07.477366  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.478719  8169 raft_consensus.cc:3055] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:07.478863  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:07.479089  8125 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:07.479179  8169 raft_consensus.cc:740] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:07.479409  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.480232  1559 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:07.480914  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.481630  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:07.487973  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.489348  1633 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.480350  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.491791  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3339) took 2456 ms. Trace:
I20260709 13:02:07.492679  8045 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:07.400856  8266 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.482336  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:07.482581  8141 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.483023  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.483505  7936 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.502390  1555 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:07.501901  7936 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.502928  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.503556  1627 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
I20260709 13:02:07.505164  1626 raft_consensus.cc:2410] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:02:07.483711  8179 consensus_queue.cc:1059] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:07.506098  8179 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:07.506714  8179 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:07.507211  8207 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:07.507589  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:07.507608  8207 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:07.504415  7936 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:07.507700  8179 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.484720  1598 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:07.478605  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.511327  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:07.511770  1628 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 21.
I20260709 13:02:07.487107  7843 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:07.505264  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:07.511894  1627 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.516536  1558 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:07.492199  1709 rpcz_store.cc:276] 0709 13:02:05.035015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.035234 (+   219us) service_pool.cc:224] Handling call
0709 13:02:05.035553 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.035925 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.035952 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.189667 (+2153715us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b2c000f3418. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2
0709 13:02:07.190092 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.326660 (+136568us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:07.326695 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.326850 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.491504 (+164654us) raft_consensus.cc:1685] finished
0709 13:02:07.491523 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.491732 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":374,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2471,"spinlock_wait_cycles":90982144,"thread_start_us":136214,"threads_started":1,"wal-append.queue_time_us":202194}
I20260709 13:02:07.486963  8090 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:07.487975  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 75321us
I20260709 13:02:07.443491  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:07.519728  6989 consensus_queue.cc:1059] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:07.523161  1628 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:07.520921  2288 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:07.455559  8259 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:07.514240  1523 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:39387 timed out after 2.096s (SENT) [suppressed 32 similar messages]
W20260709 13:02:07.514631  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.516494  1633 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:02:07.516876  1635 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:07.414739  8076 raft_consensus.cc:2804] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:07.518929  1599 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:07.513212  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.541599  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:07.544828  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:07.536435  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.546506  1634 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:07.509421  8207 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.565173  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:07.566679  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:07.566905  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:07.567287  1700 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:07.568336  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:07.568898  6989 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:07.568948  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 84383us
I20260709 13:02:07.569891  1701 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:02:07.568246  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 49455.4us
I20260709 13:02:07.517055  8202 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.575083  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:07.577702  1701 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:07.576129  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:07.593843  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:07.522162  7936 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:07.582846  1598 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:07.596379  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:07.539417  8145 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:07.599488  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:07.550067  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:07.565634  8179 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:07.616412  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:07.619676  1707 raft_consensus.cc:2393] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:07.521574  8263 consensus_queue.cc:1059] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:02:07.621975  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:07.617024  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:07.573122  8265 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:07.656199  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:07.521855  7843 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.575044  8125 raft_consensus.cc:3055] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:07.611253  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:07.622901  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:07.668076  2322 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:02:07.656947  1706 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
W20260709 13:02:07.612823  8250 log.cc:927] Time spent T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:07.658535  2323 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:07.713408  1635 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:07.610847  8045 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:07.665176  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:07.715078  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:07.715756  1704 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.575604  8019 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:02:07.666787  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 55787.6us
I20260709 13:02:07.620486  1557 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:07.667367  1707 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:07.718086  1526 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:07.718394  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:07.719157  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:07.719558  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:07.720149  8086 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:07.720762  8187 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:07.720841  8095 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:07.721372  8095 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.722229  8095 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:07.669567  1701 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:02:07.480252  8169 consensus_queue.cc:260] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.602705  8076 raft_consensus.cc:697] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:07.724411  1701 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:07.721366  8187 raft_consensus.cc:697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:07.724413  8076 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:07.725761  8187 consensus_queue.cc:237] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.727512  1707 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:02:07.670253  1700 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
I20260709 13:02:07.662340  8195 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.670645  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:07.729110  8195 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.621500  8249 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:07.673301  8211 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:07.731153  8195 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:07.731218  8211 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.731796  8211 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:07.733712  7843 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:07.734339  1629 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:02:07.652930  8145 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:07.734759  8095 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:07.735878  8145 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.677266  8175 consensus_queue.cc:1059] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:07.679462  8236 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:07.680143  8264 raft_consensus.cc:3055] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:07.652552  8247 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:07.661187  7917 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.681782  8155 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.681586  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:07.621995  8207 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:07.688050  8174 log.cc:927] Time spent T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 2.455s	user 0.007s	sys 0.018s
I20260709 13:02:07.611716  8042 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:02:07.658474  7936 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:02:07.615015  7908 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 13:02:07.621124  7750 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:07.697713  8232 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:07.614445  8239 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:07.704720  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.606081  8176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.007s	sys 0.006s
I20260709 13:02:07.740360  1627 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:02:07.790045  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:07.743017  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.745502  1557 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:07.747761  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:07.604719  8202 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.773739  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:07.666169  8125 raft_consensus.cc:740] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:07.777693  1704 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
W20260709 13:02:07.781590  1554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.013s	sys 0.030s
W20260709 13:02:07.805253  1554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.013s	sys 0.030s
I20260709 13:02:07.744760  8264 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:07.792141  2327 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:07.793763  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:07.075623   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:07.811386  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:07.757355  8101 consensus_queue.cc:1175] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" responder_term: 19 status { last_received { term: 19 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 19 index: 14 } }
I20260709 13:02:07.812275  1701 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:02:07.819484  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:07.744006  8045 consensus_queue.cc:1059] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:02:07.814639  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:07.821373  1556 raft_consensus.cc:2410] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:02:07.822340  2323 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:07.825243  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:07.797381  8176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.008s	sys 0.012s
I20260709 13:02:07.823200  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:07.857662  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:02:07.825054  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 349317us
I20260709 13:02:07.774156  8247 raft_consensus.cc:697] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:07.785620  8095 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:07.783469  7750 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:07.797891  8161 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.800029  7843 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:07.775486  7917 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:07.865962  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:07.866595  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 352527us
I20260709 13:02:07.776834  8155 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.872540  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:07.876834  1627 raft_consensus.cc:2393] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 21: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:07.874769  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:07.820649  8089 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.878767  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.879287  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.880122  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.882266  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:07.813308  7996 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:02:07.804337  8239 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.907845  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.888020  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:07.893712  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 275996us
I20260709 13:02:07.868556  8045 consensus_queue.cc:1243] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:02:07.901674  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.910876  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2723) took 3229 ms. Trace:
I20260709 13:02:07.872287  7750 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:07.920239  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:07.913424  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:07.914629  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:07.923381  2323 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:07.925285  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:07.877427  8267 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:07.916793  1553 rpcz_store.cc:276] 0709 13:02:04.657783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.704117 (+ 46334us) service_pool.cc:224] Handling call
0709 13:02:04.704450 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:04.722133 (+ 17683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.722166 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:04.736150 (+ 13984us) log.cc:844] Serialized 52 byte log entry
0709 13:02:04.926033 (+189883us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:04.926083 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.927368 (+  1285us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.579058 (+2651690us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:07.881997 (+302939us) raft_consensus.cc:1685] finished
0709 13:02:07.882024 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.886644 (+  4620us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":139,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":16450,"spinlock_wait_cycles":36195072,"thread_start_us":121472,"threads_started":1,"wal-append.queue_time_us":288340}
I20260709 13:02:07.877861  8266 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:07.932245  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:07.942921  2327 raft_consensus.cc:2393] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 13: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:07.886399  8089 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:07.945255  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.914865  8086 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.947719  2329 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:02:07.956035  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.958264  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.958860  1705 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:02:07.880435  8161 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.919198  8224 consensus_queue.cc:1059] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:02:07.943464  7995 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:07.961062  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:07.964047  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.880648  7843 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.969146  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:07.962121  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 418747us
I20260709 13:02:07.983300  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.984405  1628 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 9.
I20260709 13:02:07.907274  8157 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:07.987747  1627 raft_consensus.cc:2410] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:02:07.988139  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.988013  1599 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:07.989928  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:07.990407  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:07.992589  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:07.912410  8125 consensus_queue.cc:260] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:07.998921  1700 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: []
W20260709 13:02:08.011018  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.993430  1706 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:02:08.001317  1631 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:08.007499  8211 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:08.007961  1635 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:02:08.009130  8199 raft_consensus.cc:3055] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:02:08.015089  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.015412  2323 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:07.949385  8267 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:08.026672  1675 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:08.030771  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:07.916085  8264 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:08.031857  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 75413.7us
I20260709 13:02:07.962037  8056 consensus_queue.cc:1048] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:02:08.027051  2288 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:08.036557  1700 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:02:08.038012  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:07.963443  8086 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:07.968120  7995 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:08.024435  8199 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:08.074751  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:08.046831  1675 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:08.040951  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.077180  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:08.077705  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:08.077947  1627 raft_consensus.cc:2393] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:02:08.026630  8272 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:02:07.958657  8247 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.020121  8028 consensus_queue.cc:1059] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:02:08.039752  8019 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:08.082617  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:08.096040  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:08.096648  2329 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:08.096766  1707 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:08.053356  8266 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:08.088357  2321 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:02:08.094388  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47697.3us
I20260709 13:02:08.101171  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.105530  1675 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:08.105912  1627 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 21.
W20260709 13:02:08.082456  8274 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:02:08.111977  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.113335  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:08.115299  2321 raft_consensus.cc:2410] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:02:08.080757  8155 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:08.071010  8263 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:08.095048  8214 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:08.118598  2321 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:08.123644  2320 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:08.107445  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.092883  8202 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:08.095491  8076 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:08.129973  2328 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:08.128131  1675 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:08.134199  2329 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:08.135663  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:08.138219  2321 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:02:08.138463  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.136461  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:08.142887  8087 consensus_meta.cc:287] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.000s
I20260709 13:02:08.115849  8089 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:08.144171  8214 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.146854  8214 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:08.147055  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.147641  8239 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:08.147835  1627 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:02:08.148939  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.149525  1627 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:02:08.152755  8214 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:08.153957  7843 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:08.154175  8275 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:02:08.156229  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3363) took 1839 ms. Trace:
I20260709 13:02:08.156610  1703 rpcz_store.cc:276] 0709 13:02:06.317283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.362232 (+ 44949us) service_pool.cc:224] Handling call
0709 13:02:06.436254 (+ 74022us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.441551 (+  5297us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:07.468435 (+1026884us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b180021ca60. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0edd47d3c7 00007f0ed9a8f9a7 00007f0ed9a9f0bf
0709 13:02:07.468625 (+   190us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.621193 (+152568us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.657491 (+ 36298us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.657657 (+   166us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:07.657703 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.657794 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.155960 (+498166us) raft_consensus.cc:1685] finished
0709 13:02:08.156052 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.156175 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13480,"prepare.queue_time_us":264002,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":48396,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":17924,"spinlock_wait_cycles":7743872,"thread_start_us":400389,"threads_started":2,"wal-append.queue_time_us":344172}
I20260709 13:02:08.125178  8196 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:08.161854  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2751) took 1233 ms. Trace:
I20260709 13:02:08.113071  8028 consensus_queue.cc:1243] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:02:08.122701  8273 log.cc:927] Time spent T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:02:08.162251  1554 rpcz_store.cc:276] 0709 13:02:06.928193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.208809 (+280616us) service_pool.cc:224] Handling call
0709 13:02:07.209186 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.209561 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.209592 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.210226 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.805677 (+595451us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:07.805718 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.805802 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.161640 (+355838us) raft_consensus.cc:1685] finished
0709 13:02:08.161663 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.161794 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":595128,"threads_started":1,"wal-append.queue_time_us":666547}
I20260709 13:02:08.186672  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:08.188746  1704 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:02:08.184418  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:08.163805  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:08.195386  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.196725  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.153594  1675 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:08.222680  1632 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:02:08.169970  2329 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:08.197963  8157 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:08.200081  8086 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:08.203758  8284 log.cc:927] Time spent T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:02:08.202906  1451 catalog_manager.cc:5697] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.204792  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:08.249405  1634 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:08.205451  1703 raft_consensus.cc:1275] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:08.205580  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:08.206218  8071 consensus_queue.cc:260] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.206931  1708 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:02:08.207845  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:08.210187  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:08.251659  8086 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:08.251947  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:08.252431  8086 raft_consensus.cc:697] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:08.252908  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:08.253582  2329 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:08.254907  8155 consensus_queue.cc:1059] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:08.256034  8071 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:08.256145  8155 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:08.257602  8265 consensus_queue.cc:1059] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:08.257800  8155 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:08.258806  8265 raft_consensus.cc:3055] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:08.259147  8155 raft_consensus.cc:3055] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:08.259598  8155 raft_consensus.cc:740] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:08.260946  1632 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:08.261184  8267 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:02:08.262193  1632 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:08.195784  2328 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:08.192116  8263 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:08.193145  2321 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 20.
I20260709 13:02:08.252084  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:02:08.265663  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 112222us
I20260709 13:02:08.267097  1675 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:08.238498  2322 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
I20260709 13:02:08.239467  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.268131  1627 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:08.127508  7917 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:08.246647  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:08.274453  1632 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:08.274888  1702 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 17: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:08.161171  8092 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.273993  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:08.265565  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:08.276619  2324 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:02:08.279452  8263 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.260401  8211 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:08.285161  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:08.285902  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:08.286173  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:08.289063  1675 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:08.266260  8145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.008s	sys 0.012s
I20260709 13:02:08.294082  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:08.299422  2329 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:02:08.302250  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:08.304371  8145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.009s	sys 0.013s
I20260709 13:02:08.259197  8265 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:08.292904  8267 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:08.303984  8187 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:08.394126  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 105109us
I20260709 13:02:08.285046  8032 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:08.296257  8224 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:08.428126  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:08.428917  2320 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:02:08.429793  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:08.249272  7908 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:08.428339  8224 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:08.430982  8224 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:08.421703  8056 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:08.433390  8056 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:08.433753  8056 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:08.434988  8032 raft_consensus.cc:697] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:08.411469  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:08.260442  8155 consensus_queue.cc:260] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.436496  8032 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.437831  8155 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:08.402201  2328 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:08.443567  8224 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.353426  7995 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:08.293355  8092 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:08.420871  1523 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:08.398051  8087 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:08.423897  8161 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:08.486935  8087 raft_consensus.cc:697] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:08.488073  8056 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:08.425450  8179 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.771s	user 0.014s	sys 0.004s
I20260709 13:02:08.426924  1672 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:08.497653  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 70887.6us
I20260709 13:02:08.499547  1672 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:08.424901  8278 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.438s	user 0.003s	sys 0.000s
I20260709 13:02:08.501173  8262 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:08.502381  7995 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:08.504278  7995 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:08.429661  8265 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.430526  7908 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.506323  1672 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:08.506987  1630 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:08.507616  7917 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:08.509645  1672 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:08.253590  8086 consensus_queue.cc:237] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.514503  1704 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:02:08.461545  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:02:08.516119  8285 log.cc:927] Time spent T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.436s	user 0.003s	sys 0.000s
I20260709 13:02:08.516471  2328 raft_consensus.cc:2368] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:02:08.518023  7917 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:08.518057  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1476) took 1182 ms. Trace:
W20260709 13:02:08.520678  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 99950.2us
W20260709 13:02:08.521174  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.522541  1672 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:08.452428  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:08.465415  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:08.524044  1709 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:08.474001  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:08.525199  1703 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:02:08.526536  1628 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:08.475483  7750 consensus_meta.cc:287] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.001s
I20260709 13:02:08.448499  8266 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:02:08.488442  8087 consensus_queue.cc:237] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:08.449962  8125 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:08.500491  1631 raft_consensus.cc:2410] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 17 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:02:08.135600  8199 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.506785  7908 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:08.413934  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 120012us
W20260709 13:02:08.547190  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.510452  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 3148) took 1036 ms. Trace:
I20260709 13:02:08.512060  1633 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:08.513064  8076 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:08.408960  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 123800us
I20260709 13:02:08.519296  1555 rpcz_store.cc:276] 0709 13:02:07.336071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.503183 (+167112us) service_pool.cc:224] Handling call
0709 13:02:07.503479 (+   296us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:07.503825 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.503854 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:07.504390 (+   536us) log.cc:844] Serialized 52 byte log entry
0709 13:02:07.894515 (+390125us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:07.894560 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.894635 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.515517 (+620882us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:08.517781 (+  2264us) raft_consensus.cc:1685] finished
0709 13:02:08.517803 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.517999 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8937,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5080,"spinlock_wait_cycles":93803776,"thread_start_us":380466,"threads_started":1,"wal-append.queue_time_us":495215}
I20260709 13:02:08.532563  1523 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:08.418928  8187 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.562075  1523 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:08.559816  1630 rpcz_store.cc:276] 0709 13:02:07.474105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.479139 (+  5034us) service_pool.cc:224] Handling call
0709 13:02:08.510175 (+1031036us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000c8ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:08.510365 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2362881280}
I20260709 13:02:08.573838  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:08.576114  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.578251  1634 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
W20260709 13:02:08.580483  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.582341  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.583063  1703 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:08.545010  7996 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:08.572314  1672 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:08.529389  8221 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:08.596062  1628 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 22.
I20260709 13:02:08.608930  1672 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:08.615749  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.574667  8187 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.539389  7750 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.638015  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:08.539939  8095 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:02:08.607163  8199 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.645882  1630 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:08.650107  1635 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:08.606724  7996 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.615566  8076 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:08.659690  1703 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 22.
I20260709 13:02:08.615097  8221 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:08.672956  8221 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:08.614293  8262 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:02:08.674985  1560 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:08.680325  8265 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:08.680862  8302 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:08.681646  8302 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:08.682026  8056 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:08.684217  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:08.692449  8095 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:08.693444  8095 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:08.675052  7750 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:08.701836  7750 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.702404  7750 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:08.670064  7996 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:08.713336  1635 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 15. (term mismatch)
I20260709 13:02:08.713788  1635 pending_rounds.cc:85] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 14
I20260709 13:02:08.714006  1635 pending_rounds.cc:107] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 15.15
I20260709 13:02:08.714223  1635 raft_consensus.cc:2889] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.714619  7750 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:08.628684  8202 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 13:02:08.715560  8202 consensus_queue.cc:1243] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:02:08.716073  8202 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.696336  8095 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:08.716426  8088 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:08.716907  8088 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:08.717988  8224 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:08.717846  8088 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.719110  8088 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:08.624642  8267 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:02:08.723631  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 163298us
I20260709 13:02:08.728121  1709 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:08.667763  8124 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:08.662374  7917 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:08.727451  8267 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.716552  8202 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.749936  8267 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:08.747484  7917 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.770614  8232 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:08.771054  1630 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22.
I20260709 13:02:08.784614  8124 raft_consensus.cc:697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:08.801342  8124 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.791217  8092 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:08.772558  7908 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:08.807576  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.809049  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.811590  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.813810  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 1390) took 1025 ms. Trace:
I20260709 13:02:08.814338  2322 rpcz_store.cc:276] 0709 13:02:07.788891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.789052 (+   161us) service_pool.cc:224] Handling call
0709 13:02:08.813594 (+1024542us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b5400729054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:08.813729 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825955712}
I20260709 13:02:08.821151  7908 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:08.799453  8232 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.822705  1634 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:08.789942  8221 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.825358  2329 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:02:08.837440  1629 raft_consensus.cc:1275] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:02:08.841076  8297 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:02:08.842634  7996 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:08.849555  1635 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:02:08.845980  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 257444us
I20260709 13:02:08.850437  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:08.851066  1628 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:08.847996  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:08.853538  1627 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:08.848631  1631 raft_consensus.cc:3055] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:08.855350  1631 raft_consensus.cc:740] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:08.849889  1601 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:08.859643  1628 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 10.
I20260709 13:02:08.851336  1523 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:08.864372  1523 leader_election.cc:400] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:02:08.864817  1523 leader_election.cc:403] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:08.866298  1601 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:08.868850  1523 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:08.870834  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:08.872658  1633 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:08.865957  1631 consensus_queue.cc:260] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:08.886646  1631 raft_consensus.cc:3060] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:08.892886  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:08.869078  8264 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:08.864892  8125 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:08.874387  8092 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:08.908928  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.874817  8071 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:08.912966  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:08.913195  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:08.946758  1555 raft_consensus.cc:2393] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 19: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:08.889068  8179 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:08.876395  7750 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 10. Current term is 11.
I20260709 13:02:08.943785  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:08.942713  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:08.908636  8239 raft_consensus.cc:2764] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:02:08.882884  8032 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.879528  8169 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:08.944195  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:08.882723  8303 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:02:08.950836  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.899112  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:08.957031  1631 raft_consensus.cc:1275] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:08.958956  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:08.986143  1556 raft_consensus.cc:1240] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:08.986320  8305 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:08.963161  1555 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:02:08.943629  1558 raft_consensus.cc:1275] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:08.909770  8125 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:02:08.989629  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 90792.4us
I20260709 13:02:08.994065  1558 raft_consensus.cc:1275] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:02:08.994472  1558 pending_rounds.cc:85] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 7
I20260709 13:02:08.994711  1558 pending_rounds.cc:107] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:02:08.994958  1558 raft_consensus.cc:2889] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.946789  8071 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:02:08.998993  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.997423  1526 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:08.973068  8092 raft_consensus.cc:697] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:08.973376  8279 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:02:08.912304  8187 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:08.988397  8125 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:08.990159  8202 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:09.012801  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 141734us
I20260709 13:02:08.998358  8199 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:09.015499  1555 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:09.025461  1555 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:09.025516  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:09.018900  1556 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:09.020483  1559 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:09.001973  8071 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:09.031935  7833 consensus_queue.cc:1059] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:09.036453  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:09.008890  8303 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:09.039435  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:09.054869  2328 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 19: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:09.040771  7996 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:09.053486  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:09.040925  8286 log.cc:927] Time spent T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.962s	user 0.005s	sys 0.000s
W20260709 13:02:09.041620  8310 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:09.041980  8315 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:09.046206  8322 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:02:09.034196  8317 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:09.046754  8202 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:09.013988  7917 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:08.991618  8032 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.053354  1551 raft_consensus.cc:2368] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18.
I20260709 13:02:09.026485  1555 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.113660  1555 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:09.033476  7750 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.086261  8239 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:09.082139  8309 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:02:09.096827  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 203120us
I20260709 13:02:09.056710  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:09.066084  8199 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:09.038029  8232 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:09.035868  8267 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.064445  8086 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:09.123090  1556 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:09.101039  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:09.122189  8309 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:09.127420  8335 raft_consensus.cc:3055] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:02:09.133174  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 76610.3us
I20260709 13:02:09.156895  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:02:09.143256  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 113191us
W20260709 13:02:09.158993  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58113.9us
I20260709 13:02:09.159942  1599 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:09.163228  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:09.185458  2325 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:09.203104  1599 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:09.200312  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:09.151170  8124 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:09.111003  8202 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.122675  7750 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:09.151034  8199 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.162468  8232 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:09.159335  8335 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:02:09.224718  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 62780.4us
I20260709 13:02:09.197189  8224 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:09.156108  8086 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:09.206503  8124 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:09.152062  8326 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
W20260709 13:02:09.253130  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50196.7us
I20260709 13:02:09.222862  8247 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:09.279850  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:09.282027  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:09.282658  1706 raft_consensus.cc:2376] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15. Re-sending same reply.
I20260709 13:02:09.285280  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:09.286113  1701 raft_consensus.cc:2368] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 19. Current term is 20.
I20260709 13:02:09.287591  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:09.288645  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:09.227874  8265 consensus_meta.cc:287] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.000s
I20260709 13:02:09.126164  8092 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.229434  7917 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:09.296463  8086 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:09.297328  8086 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:09.297012  7917 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.216940  8019 consensus_queue.cc:1059] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:02:09.122092  8303 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.299444  7917 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:09.267403  8176 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:09.300714  8176 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:02:09.301048  8324 log.cc:927] Time spent T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:02:09.302657  2320 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:02:09.305081  1675 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:09.266021  8328 log.cc:927] Time spent T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:02:09.251981  8179 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.327064  1601 leader_election.cc:400] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 19. Current term is 20.
W20260709 13:02:09.330464  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 130313us
I20260709 13:02:09.330660  1601 leader_election.cc:403] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:09.310025  1553 raft_consensus.cc:1240] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:09.332558  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:09.338660  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:09.267961  8124 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:09.329397  8306 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.320s	user 0.002s	sys 0.000s
I20260709 13:02:09.263336  8318 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:09.290834  8336 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:02:09.351876  8333 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:02:09.352087  8342 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:09.356156  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.361913  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:09.392910  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.362668  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:09.396636  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.366777  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.398020  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:02:09.361399  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 45949.3us
I20260709 13:02:09.369565  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:09.370484  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:09.371187  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:09.400707  1707 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:09.292029  8224 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:02:09.374202  8199 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:09.408584  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 127279us
I20260709 13:02:09.339547  7995 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:09.376840  7750 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:09.341922  8088 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:02:09.393652  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:09.425443  1702 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 16: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:09.312572  7908 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:09.311152  8232 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:02:09.312150  8187 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:09.418097  1553 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:09.419548  2288 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:09.451145  1707 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
W20260709 13:02:09.452170  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 116785us
I20260709 13:02:09.329394  8196 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 13:02:09.338299  8179 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.356212  8202 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:09.412359  8337 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:09.416114  8019 consensus_queue.cc:1243] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:02:09.465041  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:09.446359  8306 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:02:09.429366  8199 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:09.468228  2321 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:09.473168  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:09.446795  7995 raft_consensus.cc:697] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:09.458190  8342 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.461755  8145 raft_consensus.cc:2764] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:02:09.482331  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:09.426651  7996 consensus_queue.cc:1048] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:02:09.451731  8032 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:09.357599  8335 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.466204  8056 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:02:09.488572  8345 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:09.480237  8088 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.499333  8224 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:09.500910  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:09.502444  8309 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:09.471390  8267 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:09.508487  8342 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:09.489931  8340 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:09.570580  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:09.593277  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 183591us
I20260709 13:02:09.579053  8239 raft_consensus.cc:3055] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:09.594357  8239 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:09.510244  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:09.513126  7995 consensus_queue.cc:237] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:09.595777  1553 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:02:09.465200  8337 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:09.446369  8344 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:02:09.598734  8337 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:09.492437  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:09.470678  8039 consensus_queue.cc:1059] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:02:09.524874  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:09.522089  8345 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:09.603191  8345 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:09.554558  2320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 1432) took 1136 ms. Trace:
I20260709 13:02:09.603718  1557 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:09.582154  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2897) took 1586 ms. Trace:
I20260709 13:02:09.604188  2320 rpcz_store.cc:276] 0709 13:02:08.418347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.429545 (+ 11198us) service_pool.cc:224] Handling call
0709 13:02:09.554257 (+1124712us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b5400671e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:09.554469 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006778112}
I20260709 13:02:09.604832  1626 rpcz_store.cc:276] 0709 13:02:07.966811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.967225 (+   414us) service_pool.cc:224] Handling call
0709 13:02:07.970339 (+  3114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.970579 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:07.992543 (+ 21964us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.695425 (+702882us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b18002b5940. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed962523a 00007f0ed9a8fa2a
0709 13:02:09.551446 (+856021us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b18002b5940. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0edd47d3c7 00007f0ed9a8f9a7 00007f0ed9a9f0bf
0709 13:02:09.551800 (+   354us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.552083 (+   283us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.552153 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:09.552223 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.552325 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.552499 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38247,"prepare.queue_time_us":310976,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":6251,"raft.queue_time_us":29418,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":26851,"spinlock_wait_cycles":58266496,"thread_start_us":578038,"threads_started":2,"wal-append.queue_time_us":1062606}
I20260709 13:02:09.607887  8362 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:09.612321  8362 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.620821  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:02:09.617074  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 124826us
I20260709 13:02:09.481787  8155 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:02:09.621969  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:09.622268  2288 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:09.496254  8199 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:09.518858  8319 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:09.618954  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1483) took 1341 ms. Trace:
I20260709 13:02:09.495466  8207 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:09.626650  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:09.634218  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:09.636548  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:09.629237  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:09.632478  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:09.640921  1632 raft_consensus.cc:2393] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:09.630927  1554 rpcz_store.cc:276] 0709 13:02:08.277597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.277785 (+   188us) service_pool.cc:224] Handling call
0709 13:02:08.278065 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.303514 (+ 25449us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:08.353131 (+ 49617us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.843705 (+490574us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.867122 (+ 23417us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.867310 (+   188us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:08.867360 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.867458 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.618745 (+751287us) raft_consensus.cc:1685] finished
0709 13:02:09.618767 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.618890 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37844,"prepare.queue_time_us":106735,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":14517,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":7814,"thread_start_us":417397,"threads_started":1,"wal-append.queue_time_us":553686}
I20260709 13:02:09.599285  8302 raft_consensus.cc:3055] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:09.541111  8335 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:09.635632  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:09.548995  8221 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:09.649380  1627 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
W20260709 13:02:09.674103  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 262349us
I20260709 13:02:09.853479  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:09.854002  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:09.854808  1700 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:02:09.727200  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 82291.7us
I20260709 13:02:09.857769  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:09.863749  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:09.642508  1557 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 20: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:09.866387  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:09.867708  1557 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 21: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:09.857829  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:09.869738  1557 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:09.846372  1551 raft_consensus.cc:2393] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 19: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:09.847790  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:09.675233  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:09.879256  2323 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:02:09.879989  1555 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:09.879237  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:09.676123  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:09.882203  1633 raft_consensus.cc:2376] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22. Re-sending same reply.
I20260709 13:02:09.851424  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:09.883826  1558 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:02:09.884140  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:09.851161  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:09.887841  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:09.846288  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:09.910058  1554 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:09.912658  7995 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:09.913821  7995 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.915587  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:09.757897  8125 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.729s	user 0.013s	sys 0.000s
I20260709 13:02:09.924687  8125 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:09.681753  8071 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.001s
I20260709 13:02:09.936182  8071 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:09.939253  8071 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:09.541373  8088 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:09.641258  8045 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.941361  8045 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.946030  8045 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:09.929502  8125 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:09.739609  8155 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:09.950465  8155 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:02:09.951112  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 98102.1us
I20260709 13:02:09.932034  8196 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:09.953320  7843 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:09.953125  8196 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:09.953730  8232 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:09.954383  7843 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.956221  8196 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:09.757153  8179 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:09.736735  8199 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:09.960229  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 44950.5us
I20260709 13:02:09.962499  8089 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:09.963176  8089 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.963838  8089 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:09.934715  8214 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:09.965802  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:09.966355  8214 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:09.966625  2328 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:09.540846  8224 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:09.971529  8224 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:09.642206  8207 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.972888  8207 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:09.956938  8019 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.977276  8019 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.979285  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:09.979959  8019 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:09.944169  8088 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:09.985143  2321 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:02:09.957749  8155 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:09.989177  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:09.990059  2324 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 20.
I20260709 13:02:09.990257  8155 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:09.990899  8155 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:09.992331  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:09.541417  8247 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.125s
W20260709 13:02:09.742846  8264 consensus_meta.cc:287] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.829s	user 0.009s	sys 0.004s
I20260709 13:02:09.644739  8302 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:09.765481  8318 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:10.034415  8318 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:10.035300  8302 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:09.642604  8340 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:10.038992  8340 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.039574  8340 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:09.734719  8342 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:09.731925  8343 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:09.681931  8348 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:10.045881  8348 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:09.772626  8362 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:10.021042  7995 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:10.052868  8263 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.053618  8263 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.061208  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:10.062206  1708 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:02:10.067056  8350 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:10.025751  1554 raft_consensus.cc:2410] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:02:09.979993  7843 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:09.992516  8155 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.049435  8362 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:10.023252  2328 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 21.
I20260709 13:02:09.791414  8337 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.081322  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:10.081005  8362 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.083525  8348 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:10.083981  8362 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:10.104120  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:10.109124  2327 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
W20260709 13:02:10.111142  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 67197.7us
I20260709 13:02:10.108668  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:10.122730  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 110455us
I20260709 13:02:10.128425  1700 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:02:10.120966  1703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 3175) took 1541 ms (client timeout 1898 ms). Trace:
I20260709 13:02:10.134516  1707 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:10.138324  2320 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:10.139518  8265 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.146322  8265 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:10.147806  8169 consensus_meta.cc:287] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.159s	user 0.014s	sys 0.012s
I20260709 13:02:10.137614  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:10.127219  8125 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:10.133374  1703 rpcz_store.cc:269] 0709 13:02:08.573300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.573455 (+   155us) service_pool.cc:224] Handling call
0709 13:02:10.113041 (+1539586us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b54002f1a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:10.114803 (+  1762us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19576576}
I20260709 13:02:10.153224  8125 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.155746  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:10.156457  8125 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:10.152971  8302 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:10.136494  8263 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:10.155821  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:10.159396  1626 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:02:10.192677  7843 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:10.180759  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:10.196564  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:10.197628  1633 raft_consensus.cc:2393] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:10.152619  8207 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:10.202373  8124 consensus_meta.cc:287] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.824s	user 0.007s	sys 0.014s
I20260709 13:02:10.202859  8207 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:10.203423  8337 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:10.203910  1700 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
W20260709 13:02:10.207464  8339 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.849s	user 0.004s	sys 0.007s
W20260709 13:02:10.185624  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 322649us
I20260709 13:02:10.203038  8124 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:10.218792  2324 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 18: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:10.164749  8089 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:10.226357  1707 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:02:10.232959  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:10.234990  2326 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
I20260709 13:02:10.235896  8334 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.222016  7843 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:10.239653  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:10.237241  8334 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.244391  7843 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:10.248710  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 81351.6us
W20260709 13:02:10.256686  8377 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.165s	user 0.000s	sys 0.002s
I20260709 13:02:10.273836  8089 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:10.323881  1702 raft_consensus.cc:1240] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:10.329128  8039 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.329358  8348 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.329958  8039 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:10.333738  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 91770.6us
I20260709 13:02:10.334631  1601 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:10.336983  8176 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:10.330142  8348 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:10.337443  8176 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.337843  8176 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:10.344271  1598 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:10.348699  8087 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.349712  8087 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.352808  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3427) took 1328 ms. Trace:
I20260709 13:02:10.356459  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:10.361442  1556 rpcz_store.cc:276] 0709 13:02:09.024460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.054569 (+ 30109us) service_pool.cc:224] Handling call
0709 13:02:09.093174 (+ 38605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.151266 (+ 58092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.352150 (+1200884us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b5400026f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:10.352596 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68356352}
I20260709 13:02:10.387619  8207 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:10.401443  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 57362.7us
W20260709 13:02:10.403676  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 69210.5us
W20260709 13:02:10.407719  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 155276us
I20260709 13:02:10.401837  8247 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:10.419142  8045 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:10.420322  8045 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.421490  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1480) took 2233 ms. Trace:
I20260709 13:02:10.421942  1560 rpcz_store.cc:276] 0709 13:02:08.187984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.189619 (+  1635us) service_pool.cc:224] Handling call
0709 13:02:08.189933 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.675622 (+485689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.420897 (+1745275us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b5400027e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:10.421272 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1115490560}
W20260709 13:02:10.423390  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 2904) took 1684 ms (client timeout 1697 ms). Trace:
W20260709 13:02:10.423834  1634 rpcz_store.cc:269] 0709 13:02:08.730476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.807220 (+ 76744us) service_pool.cc:224] Handling call
0709 13:02:10.402065 (+1594845us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b54000f55d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:10.415069 (+ 13004us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28339072}
I20260709 13:02:10.411614  8247 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:10.426904  8247 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:10.428422  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1393) took 2628 ms. Trace:
I20260709 13:02:10.429193  8207 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:10.429898  8207 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.424060  8045 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:10.428894  2325 rpcz_store.cc:276] 0709 13:02:07.799794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.799963 (+   169us) service_pool.cc:224] Handling call
0709 13:02:07.823080 (+ 23117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.201948 (+1378868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.427880 (+1225932us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400104354. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:10.428200 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3134277504}
W20260709 13:02:10.434055  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.444497  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:10.455559  8342 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:10.456475  8342 raft_consensus.cc:697] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:10.434314  8337 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.434937  8169 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.436029  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:10.436749  8207 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:10.437230  8124 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:10.437557  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:10.438766  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:10.441062  7917 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:02:10.443845  8056 consensus_meta.cc:287] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.924s	user 0.015s	sys 0.015s
I20260709 13:02:10.460161  2320 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
W20260709 13:02:10.461194  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 50961us
I20260709 13:02:10.462555  7917 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:10.463984  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:10.464756  2329 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:10.458509  8337 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.464545  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:10.477995  8169 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.478878  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.469429  8056 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 19. Current term is 20.
I20260709 13:02:10.473850  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.478363  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:10.480794  2321 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:10.484158  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:10.485378  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:10.484719  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.458302  8340 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:10.486373  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 259182us
I20260709 13:02:10.469096  8348 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:10.491348  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:10.469800  8039 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:10.495473  8368 consensus_queue.cc:1059] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:02:10.480399  8169 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:10.505199  2325 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:10.464412  7917 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.506560  2328 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:02:10.507835  2321 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:02:10.458244  8342 consensus_queue.cc:237] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:10.487784  8224 consensus_queue.cc:1059] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:02:10.519542  8337 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:10.509048  8199 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:10.509706  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:10.521644  2320 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:10.523952  8125 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.524911  2322 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:02:10.525174  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.526216  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:10.532475  8224 consensus_queue.cc:1243] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:10.533491  8224 raft_consensus.cc:3055] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:10.533941  8224 raft_consensus.cc:740] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:02:10.534873  2326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 1399) took 2660 ms (client timeout 1662 ms). Trace:
I20260709 13:02:10.535038  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:10.535306  2326 rpcz_store.cc:269] 0709 13:02:07.874832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.882004 (+  7172us) service_pool.cc:224] Handling call
0709 13:02:10.534603 (+2652599us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b54005474d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:10.534779 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5212906240}
I20260709 13:02:10.536676  2288 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:10.536774  8302 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:10.539355  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:10.540648  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:10.540052  1705 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:10.542057  8337 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:10.543078  1673 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:10.543401  8056 consensus_queue.cc:1059] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:10.544063  1673 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:10.544951  8262 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:10.546329  8202 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:10.546779  8202 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:10.547183  8202 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:10.540619  8302 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.552661  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:10.555651  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.560110  2326 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 21.
I20260709 13:02:10.562292  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:10.542174  7917 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:10.565569  1705 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:10.566669  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:10.568821  2329 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:10.569624  1707 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:10.570171  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:10.571290  8088 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:10.571713  8088 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:10.572106  8088 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:10.577205  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:10.583411  1705 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:10.585186  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.585876  1558 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:10.587106  1558 raft_consensus.cc:1240] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:02:10.588127  8056 consensus_queue.cc:1243] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:02:10.588483  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49083.1us
I20260709 13:02:10.589967  1601 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:10.590703  8239 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:10.591842  8232 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:10.592144  8239 raft_consensus.cc:3060] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:10.592466  8232 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:10.593547  8232 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:10.594468  8169 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:10.563128  8302 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:10.596993  8087 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:10.593688  8088 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:10.599473  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:10.600658  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:10.562559  8318 consensus_meta.cc:287] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.007s
I20260709 13:02:10.603400  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.604480  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.600083  2329 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:10.607533  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.608129  2328 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:10.616554  1707 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:10.620972  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:10.625013  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.625778  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.626880  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:10.561663  8124 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:10.632810  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 2886) took 2762 ms. Trace:
I20260709 13:02:10.632722  8124 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.633216  1629 rpcz_store.cc:276] 0709 13:02:07.869986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.870157 (+   171us) service_pool.cc:224] Handling call
0709 13:02:07.870451 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.837996 (+967545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.608006 (+1770010us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b5400327dd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:10.632610 (+ 24604us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2223868288}
I20260709 13:02:10.635048  8124 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:10.636799  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 158057us
I20260709 13:02:10.638669  8087 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.639262  8087 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.640527  8350 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:02:10.624437  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:10.640770  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:10.604038  8340 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:10.662807  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:10.665087  2325 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20.
I20260709 13:02:10.667543  1552 raft_consensus.cc:2393] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 21: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:10.639297  8357 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.534894  8224 consensus_queue.cc:260] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:10.679664  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:10.647912  8302 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:10.675096  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:10.641873  8087 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:10.616490  8318 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:10.666572  8348 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.685930  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 45292.2us
I20260709 13:02:10.686704  2320 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:10.653396  8247 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.679793  7843 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.683635  1672 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:10.698632  2325 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:02:10.688139  8155 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:10.673870  8176 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.684490  8199 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:10.696943  8088 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:10.718837  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:10.727633  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:10.728256  2320 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:10.729547  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.732264  8347 consensus_queue.cc:1059] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:02:10.709143  8155 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:10.684223  8357 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.708978  8125 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:10.748628  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:10.751567  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 61118.5us
W20260709 13:02:10.759886  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 84881.6us
I20260709 13:02:10.742909  8155 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:10.765204  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 65004.4us
W20260709 13:02:10.764038  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 82570.5us
I20260709 13:02:10.727734  8348 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:10.767417  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.770727  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.774168  1555 raft_consensus.cc:2410] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:02:10.801148  2325 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:10.803092  2325 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:10.803213  8388 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:10.804781  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:10.807253  1523 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:10.809022  8145 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.809165  8357 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:10.738102  7843 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.810309  8318 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:10.832849  2327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58628 (request call id 1404) took 2842 ms (client timeout 1914 ms). Trace:
I20260709 13:02:10.817831  8247 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:10.818538  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.805290  8302 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:10.833402  2327 rpcz_store.cc:269] 0709 13:02:07.989978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.990177 (+   199us) service_pool.cc:224] Handling call
0709 13:02:10.774025 (+2783848us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54004551d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:10.832760 (+ 58735us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4705717632}
I20260709 13:02:10.829516  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:10.842110  1672 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:10.834805  1599 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:10.766017  7996 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:10.843291  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.842905  2329 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:10.847172  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:02:10.845649  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 86812.7us
I20260709 13:02:10.851502  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.853674  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:10.850885  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:10.854452  1700 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:10.855573  1556 raft_consensus.cc:2368] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15.
I20260709 13:02:10.856189  1709 raft_consensus.cc:1275] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:10.859463  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:10.816098  8202 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.818881  8391 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:02:10.863312  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:10.859387  1552 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:02:10.850884  8340 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.870167  2325 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:02:10.858501  8357 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:10.871579  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 64556.3us
W20260709 13:02:10.872421  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 52933us
I20260709 13:02:10.871472  8390 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:10.845959  8145 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.876669  8124 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:10.874933  8357 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:10.892520  8357 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:10.892812  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:10.893445  1707 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:10.877821  8393 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:10.878397  1523 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:10.879179  1672 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:10.879994  8348 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:10.880821  8302 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:10.875062  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1406) took 2802 ms. Trace:
I20260709 13:02:10.829077  8199 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:10.891510  8318 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:10.891737  8124 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:10.862404  8176 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:10.933321  7843 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:10.909339  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 203492us
I20260709 13:02:10.885427  1553 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:02:10.916534  2323 rpcz_store.cc:276] 0709 13:02:08.072955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.073102 (+   147us) service_pool.cc:224] Handling call
0709 13:02:08.079538 (+  6436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.880027 (+1800489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.866764 (+986737us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b5400107554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:10.875003 (+  8239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4138871168}
W20260709 13:02:10.932468  8392 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:02:10.941547  1554 raft_consensus.cc:2410] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:02:10.911053  8393 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.943248  2320 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 21.
I20260709 13:02:10.920091  8214 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:10.942363  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 65905.6us
I20260709 13:02:10.950953  1707 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:02:10.953241  2324 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:10.889782  8340 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:10.966104  1673 leader_election.cc:400] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15.
I20260709 13:02:10.966688  1673 leader_election.cc:403] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:02:10.948555  8393 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:10.951557  8214 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:02:10.979533  8389 log.cc:927] Time spent T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:02:10.980844  8397 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.981168  1672 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:10.981817  8397 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:10.984833  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 106578us
W20260709 13:02:11.009114  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 111099us
I20260709 13:02:11.006546  1673 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:11.018522  1634 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 13:02:11.019423  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:11.020332  1630 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:11.020491  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:10.980757  8214 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:10.989370  8407 raft_consensus.cc:3055] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:10.975482  8368 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.974882  8145 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:11.034772  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:10.984406  8397 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:11.024066  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:10.984985  8089 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:11.014530  8318 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:10.985608  8176 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.021787  8247 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.052314  1701 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:10.984763  8087 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.051s
I20260709 13:02:11.035363  8262 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:11.034159  8407 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:10.988479  8357 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:11.053646  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49447.1us
I20260709 13:02:11.055914  8262 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.047649  8089 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:11.050942  7917 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.066057  8262 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:11.069339  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:11.077988  2286 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:11.079110  8397 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.081195  8397 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.061280  8247 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:11.083767  8247 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:11.084849  7917 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.089049  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:11.084141  8397 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:11.104430  1700 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:11.079409  8089 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:11.101898  1598 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.115345  1599 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.117012  1703 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:02:11.115032  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:11.092489  8202 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:11.119565  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:11.126251  1601 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:11.136956  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 59029.4us
W20260709 13:02:11.138654  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 67277.6us
I20260709 13:02:11.139174  8417 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:11.139696  8417 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.140053  8417 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:11.067912  8155 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.144156  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:11.158644  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:11.127914  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.071488  8176 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.109016  8088 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15.
I20260709 13:02:11.072966  8368 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.173732  1599 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.180773  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:11.181715  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:11.164388  8348 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:11.182363  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:11.165573  8071 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:11.188256  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:11.192629  8403 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:11.193454  8405 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:02:11.193920  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.194093  8405 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.197069  8279 consensus_queue.cc:1059] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 13:02:11.197530  8410 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.083s
I20260709 13:02:11.198436  8279 raft_consensus.cc:3055] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:11.198885  8279 raft_consensus.cc:740] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:11.199294  8092 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.199836  8092 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.192787  1626 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:11.200964  1553 pending_rounds.cc:85] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 13
I20260709 13:02:11.200681  1631 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:02:11.181140  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:11.222170  1553 pending_rounds.cc:107] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:02:11.287948  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:11.255189  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:11.237160  1628 raft_consensus.cc:1240] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:11.257783  1635 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:02:11.264544  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.247035  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:02:11.278409  8380 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.866s	user 0.005s	sys 0.002s
I20260709 13:02:11.285859  8262 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:11.225075  8145 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:11.200342  8279 consensus_queue.cc:260] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:11.193702  8403 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.342497  8214 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.258351  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:11.343807  1551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2770) took 1846 ms (client timeout 2147 ms). Trace:
W20260709 13:02:11.344739  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 177750us
I20260709 13:02:11.267159  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:11.338424  1553 raft_consensus.cc:2889] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:11.380712  1599 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.380561  1701 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:02:11.382488  1703 raft_consensus.cc:2393] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
W20260709 13:02:11.279845  8398 log.cc:927] Time spent T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.388s	user 0.001s	sys 0.000s
I20260709 13:02:11.249141  1560 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:11.339954  1632 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:02:11.383041  1556 pending_rounds.cc:85] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 12
I20260709 13:02:11.383606  1556 pending_rounds.cc:107] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:02:11.383984  1556 raft_consensus.cc:2889] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:11.347535  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:11.179761  8397 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:11.177248  8302 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:11.183326  8340 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:11.287369  8366 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:11.275898  8411 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:02:11.277715  8406 log.cc:927] Time spent T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 13:02:11.276669  8404 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:02:11.378963  1630 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:02:11.376159  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:11.352308  1523 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:11.198936  8410 consensus_queue.cc:1059] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.183s
I20260709 13:02:11.269778  8405 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:11.282059  8357 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:11.379829  1551 rpcz_store.cc:269] 0709 13:02:09.497256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.570244 (+ 72988us) service_pool.cc:224] Handling call
0709 13:02:11.343462 (+1773218us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54001d79d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:11.343709 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578162560}
I20260709 13:02:11.273061  8401 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:11.392963  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.419287  1706 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:11.423537  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:11.424976  8388 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:11.364316  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:11.395915  1704 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17. Ops: [14.14-16.15]
I20260709 13:02:11.184168  8394 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.431170  1706 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 16: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:11.431804  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:11.283923  7996 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:11.398283  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:11.226305  8348 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:11.242157  8071 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:11.383076  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:11.401549  2329 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:11.344450  8265 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:11.197124  8395 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:11.387243  1626 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:02:11.408437  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:11.415865  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:11.411754  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:11.403234  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:11.448342  1630 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:11.326649  8199 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.402117  8247 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:11.416867  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:11.441722  1560 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:11.457355  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:11.465304  8262 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:11.465027  8199 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:11.457774  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:11.416778  8423 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.417438  8056 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:11.470289  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 223458us
I20260709 13:02:11.285835  8407 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:11.480163  1556 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:11.475256  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:11.482808  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.438421  8279 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:11.413375  8302 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.490177  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:11.493225  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:11.501282  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:11.501646  8092 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:11.502084  1635 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:11.502246  8092 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:11.502775  8092 raft_consensus.cc:697] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:11.437068  8405 consensus_queue.cc:1059] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:02:11.504727  1630 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:11.506790  1705 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:02:11.513259  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:11.514492  1631 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:11.476989  8214 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:11.504040  8092 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.517369  8419 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:11.517875  8419 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:11.496879  8265 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:11.525396  1635 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20.
I20260709 13:02:11.531358  1704 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:02:11.533824  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:11.534523  2328 raft_consensus.cc:2376] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14. Re-sending same reply.
I20260709 13:02:11.537480  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:11.487311  8410 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:02:11.548301  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:11.553131  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:11.533529  8039 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.016s	sys 0.032s
I20260709 13:02:11.554311  2288 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.556250  1704 raft_consensus.cc:2410] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:02:11.515362  8176 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:11.557420  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:11.558669  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:11.521577  8407 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:11.533664  8207 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:11.574227  2288 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.572181  1630 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 13.
I20260709 13:02:11.572548  1627 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:02:11.502264  8247 consensus_queue.cc:1048] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:02:11.488991  8394 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:11.538161  8155 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:11.579133  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:11.559877  8039 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.016s	sys 0.032s
I20260709 13:02:11.553956  8340 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:11.581799  1628 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:02:11.594460  2288 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.487557  8423 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:11.594944  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 183297us
I20260709 13:02:11.579263  8402 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:11.604878  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:11.603619  1672 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:11.606555  2328 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:02:11.606745  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 254685us
I20260709 13:02:11.608482  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1411) took 1144 ms. Trace:
I20260709 13:02:11.608901  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:11.576972  8414 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:11.616861  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:11.533830  8395 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.623262  1672 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:11.580730  8368 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:11.626781  2323 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:02:11.636994  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:11.578902  8408 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:02:11.630206  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:11.602213  8340 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:02:11.648205  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.619462  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:11.651654  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 57288.8us
I20260709 13:02:11.653492  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:11.655334  1672 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.655157  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:11.602782  8155 consensus_queue.cc:1059] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:02:11.622488  8402 raft_consensus.cc:697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:11.672714  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:11.573092  8348 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.666663  1626 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.675488  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:11.676524  1672 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.624891  2326 rpcz_store.cc:276] 0709 13:02:10.463975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.597790 (+133815us) service_pool.cc:224] Handling call
0709 13:02:10.598134 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.598553 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:10.598848 (+   295us) log.cc:844] Serialized 14 byte log entry
0709 13:02:10.820951 (+222103us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:10.860327 (+ 39376us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.860473 (+   146us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:10.864317 (+  3844us) log.cc:844] Serialized 14 byte log entry
0709 13:02:10.864540 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.864643 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.279013 (+414370us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:11.608179 (+329166us) raft_consensus.cc:1685] finished
0709 13:02:11.608218 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.608403 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8009,"prepare.queue_time_us":240,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":3005,"raft.queue_time_us":3455,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":33604,"spinlock_wait_cycles":47076992,"thread_start_us":221561,"threads_started":1,"wal-append.queue_time_us":292653}
I20260709 13:02:11.644133  8415 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:11.681839  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:11.683811  1673 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:11.684149  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:11.657131  8087 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:11.688621  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:11.689440  8092 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:11.690203  8448 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:11.676224  1634 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:11.692036  8390 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:11.694612  8395 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:11.599189  8071 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:11.753865  8089 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.002s
I20260709 13:02:11.708974  2329 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:02:11.663480  8403 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:11.744596  8390 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.747045  8425 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:11.747715  8092 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:11.749994  1632 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:11.685550  7996 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:11.736644  8199 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:11.757004  8402 consensus_queue.cc:237] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:11.824193  1627 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:02:11.762388  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:11.761602  8423 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:11.760349  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:11.775719  8214 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:11.765754  8426 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:11.737857  8087 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:11.788533  1451 catalog_manager.cc:5697] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.789584  8340 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:11.839816  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 144781us
I20260709 13:02:11.743295  8155 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:11.758349  8394 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:11.755098  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:11.840855  8207 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:11.841526  1634 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 14: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:11.631300  8417 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.758315  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:11.842284  8207 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.843371  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:11.843972  8417 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:11.844162  1701 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:11.816314  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:11.757421  8262 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:02:11.759948  8429 log.cc:927] Time spent T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:02:11.785496  8436 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:11.824489  1631 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:02:11.828634  1630 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:02:11.766743  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:02:11.815102  8393 consensus_meta.cc:287] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.801s	user 0.006s	sys 0.004s
I20260709 13:02:11.826851  1627 pending_rounds.cc:85] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting all ops after (but not including) 10
I20260709 13:02:11.743896  8302 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:11.836777  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:11.813999  8366 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:11.813364  8388 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:11.812883  8124 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:11.756425  8395 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:11.844996  2326 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:11.769271  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:11.846191  2323 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:02:11.766710  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 90355.8us
I20260709 13:02:11.845970  8087 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:11.848423  8426 raft_consensus.cc:697] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:11.822386  8089 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.848814  8423 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.845937  8425 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:11.860154  1627 pending_rounds.cc:107] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:02:11.879531  1627 raft_consensus.cc:2889] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:11.863906  1701 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:02:11.863926  2329 raft_consensus.cc:2393] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 14: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:11.870275  8436 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:11.855688  1626 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:11.873425  1672 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:11.887323  8436 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:11.879545  1523 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:11.889289  2326 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:02:11.890286  1635 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:11.839816  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 186775us
I20260709 13:02:11.892522  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.930891  8214 raft_consensus.cc:697] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:11.932304  8214 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.939687  2329 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:11.941286  2288 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.948161  8214 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:02:11.965850  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 86426.2us
I20260709 13:02:11.969195  1635 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:11.960470  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:11.872574  8395 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:11.970443  1631 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:02:11.980000  2288 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:11.895972  8405 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:11.855778  8262 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:11.895917  8438 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.896062  8394 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.878487  8423 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:11.880254  8124 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:11.870198  8199 consensus_queue.cc:1059] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.108s
I20260709 13:02:11.891052  8092 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:02:11.864409  8393 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:11.998003  8394 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:11.996572  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 123290us
I20260709 13:02:12.000380  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.004763  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:11.994181  8403 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:11.989079  8460 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.991689  8410 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:12.024418  8410 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.021406  8460 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.024732  8456 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:12.025200  8410 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:12.026558  8451 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:12.027010  8460 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:12.032262  1706 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:12.033418  8262 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:12.034065  8426 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:11.996136  8366 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:12.037467  8446 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:02:12.038609  8464 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.039371  8464 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.041002  8457 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:02:12.044373  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:12.045755  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2790) took 1230 ms. Trace:
I20260709 13:02:11.996080  7996 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:12.037065  8366 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.046162  1558 rpcz_store.cc:276] 0709 13:02:10.815254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.873004 (+ 57750us) service_pool.cc:224] Handling call
0709 13:02:10.895388 (+ 22384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.951732 (+ 56344us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:11.115501 (+163769us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.458648 (+343147us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.534261 (+ 75613us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.544562 (+ 10301us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:11.544633 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.544726 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.045545 (+500819us) raft_consensus.cc:1685] finished
0709 13:02:12.045564 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.045703 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":145884,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":22133,"raft.queue_time_us":139914,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":11094,"thread_start_us":430884,"threads_started":3,"wal-append.queue_time_us":420983}
I20260709 13:02:12.050032  1628 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:11.981925  8417 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:02:11.994503  8427 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:12.067041  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.067674  1631 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 22.
I20260709 13:02:12.068559  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.069840  8124 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:12.069886  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:12.071106  1627 raft_consensus.cc:2410] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:02:12.071993  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:02:12.072233  1675 connection.cc:256] RPC call timeout handler was delayed by -1.7417637299999456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
I20260709 13:02:12.071990  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1423) took 1512 ms. Trace:
I20260709 13:02:12.073809  2324 rpcz_store.cc:276] 0709 13:02:10.559528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.928916 (+369388us) service_pool.cc:224] Handling call
0709 13:02:10.953108 (+ 24192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.958581 (+  5473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.071775 (+1113194us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b5400729050. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a848ad 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:12.071909 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9254656}
I20260709 13:02:12.078491  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:12.079355  1626 raft_consensus.cc:2393] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 14: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:12.081279  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:12.081890  1631 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:12.051237  7996 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:12.095750  8124 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:12.066383  8417 consensus_queue.cc:1243] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:02:12.065119  8460 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:11.996568  8438 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.096906  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.099202  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:12.074766  8403 raft_consensus.cc:697] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:12.111186  1558 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:12.121382  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:12.122539  1627 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:12.206139  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:02:12.222541  8450 log.cc:927] Time spent T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:02:12.223937  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.175624  8350 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.225067  8350 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:12.225550  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:12.226215  1635 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:12.218017  8414 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.016s
W20260709 13:02:12.227033  8455 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.104s	user 0.000s	sys 0.003s
I20260709 13:02:12.228441  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 1449) took 1242 ms. Trace:
I20260709 13:02:12.228850  2325 rpcz_store.cc:276] 0709 13:02:10.985762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.361687 (+375925us) service_pool.cc:224] Handling call
0709 13:02:11.401147 (+ 39460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.515356 (+114209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.515388 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.545449 (+ 30061us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.886179 (+340730us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:11.886222 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.886719 (+   497us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.226330 (+339611us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:12.227913 (+  1583us) raft_consensus.cc:1685] finished
0709 13:02:12.228112 (+   199us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.228373 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22605,"raft.queue_time_us":34648,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":19418,"spinlock_wait_cycles":192303488,"thread_start_us":289558,"threads_started":1,"wal-append.queue_time_us":467274}
W20260709 13:02:12.231777  8453 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:02:12.232824  8405 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:12.233031  1598 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:12.233409  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 3195) took 1242 ms. Trace:
I20260709 13:02:12.076869  8427 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:12.120923  8214 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:12.072988  8425 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.245554  8039 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:12.246106  8039 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.246528  8039 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:12.233793  1707 rpcz_store.cc:276] 0709 13:02:10.991393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.010937 (+ 19544us) service_pool.cc:224] Handling call
0709 13:02:11.011301 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:11.446670 (+435369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.446699 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:11.468949 (+ 22250us) log.cc:844] Serialized 52 byte log entry
0709 13:02:11.831832 (+362883us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:11.831883 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.833666 (+  1783us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.233141 (+399475us) raft_consensus.cc:1685] finished
0709 13:02:12.233161 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.233318 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4301,"raft.queue_time_us":54937,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10784,"thread_start_us":746673,"threads_started":2,"wal-append.queue_time_us":480741}
I20260709 13:02:12.245788  8347 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:12.244998  8366 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:12.240741  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 123245us
I20260709 13:02:12.207028  8395 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:12.308758  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.233453  8405 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:12.236725  8089 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:12.175752  8124 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:12.114985  8460 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.365991  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.366938  1626 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 13.
I20260709 13:02:12.317854  8423 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:12.372525  1635 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:02:12.389428  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.306465  8401 consensus_queue.cc:1059] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.119s
I20260709 13:02:12.397203  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:12.233659  8419 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.403673  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:02:12.394230  8465 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:02:12.412554  1707 raft_consensus.cc:1240] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:02:12.387342  8464 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:12.426939  8423 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:12.428203  8089 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:12.435976  8089 raft_consensus.cc:3055] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:12.429450  8466 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:12.436506  8089 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:12.431748  8467 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:12.437536  8089 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.439667  8089 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:12.444043  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:12.445612  8427 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:12.446311  8402 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:12.446861  8402 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:12.420390  1627 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:12.386494  8403 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.441601  1675 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:12.450770  1675 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:12.452379  8423 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:12.452839  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:12.453254  8423 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:12.453884  8423 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:12.454237  8423 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.454561  8423 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:12.457664  8460 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:12.461659  8469 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:12.462201  8214 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:12.462968  8214 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:12.463625  1632 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:12.466223  8419 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:12.467095  8124 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:12.468233  8438 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:12.470007  8468 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:02:12.471710  8407 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.897s	user 0.009s	sys 0.000s
I20260709 13:02:12.472718  1704 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17. Ops: [14.14-16.15]
I20260709 13:02:12.433306  8350 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:12.436829  8430 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.401717  8393 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:12.479218  1631 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
W20260709 13:02:12.452361  8087 consensus_meta.cc:287] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.002s
I20260709 13:02:12.480517  8430 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.536306  8430 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:12.474633  8390 consensus_meta.cc:287] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.640s	user 0.012s	sys 0.001s
I20260709 13:02:12.482952  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:12.517244  8348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.034s	sys 0.049s
I20260709 13:02:12.544512  1632 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:12.523617  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 128694us
I20260709 13:02:12.533253  8087 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.482308  8417 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:12.524202  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 270880us
I20260709 13:02:12.538713  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.548144  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.549664  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 1439) took 2111 ms. Trace:
I20260709 13:02:12.552520  2322 rpcz_store.cc:276] 0709 13:02:10.438634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.444096 (+  5462us) service_pool.cc:224] Handling call
0709 13:02:10.444547 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.530986 (+ 86439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.548063 (+2017077us) spinlock_profiling.cc:243] Waited 65 ms on lock 0x7b540077e554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:12.549597 (+  1534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149426048}
W20260709 13:02:12.551167  1599 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.562s (SENT) [suppressed 27 similar messages]
W20260709 13:02:12.547451  8348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.034s	sys 0.049s
I20260709 13:02:12.554867  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:12.547447  8390 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:12.558327  8088 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:12.558665  1675 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:12.559602  8390 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:12.559870  8427 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:12.560443  8427 raft_consensus.cc:697] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:12.556007  8402 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:12.561234  1630 raft_consensus.cc:1240] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:12.561436  8427 consensus_queue.cc:237] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:12.563387  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:12.563968  1630 raft_consensus.cc:2376] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14. Re-sending same reply.
I20260709 13:02:12.564713  1556 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:12.568217  8420 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:12.568724  8420 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:12.569056  8405 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.570108  8420 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.571184  8420 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:12.572355  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.575064  1631 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:02:12.565775  8039 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.577461  8405 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:12.566164  8302 raft_consensus.cc:3055] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:12.580646  8302 raft_consensus.cc:740] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:12.581190  8039 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:12.553570  8417 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.557570   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:12.585898  1634 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:12.587524  1705 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:12.590375  1556 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
W20260709 13:02:12.567974  8410 consensus_meta.cc:287] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.004s
I20260709 13:02:12.553321  8430 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.581835  8302 consensus_queue.cc:260] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.597115  8334 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:12.599303  8417 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:12.592788  8348 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:12.607613  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.551180  8423 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.612100  1631 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 22.
I20260709 13:02:12.608976  8430 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:12.617405  8423 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:12.618086  8348 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.626514  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.627746  1675 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:12.606765  8410 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.657323  8087 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:12.634114  8302 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:12.637363  8423 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:12.614795  8214 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.662681  8423 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.663269  8423 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:12.636745  8425 consensus_queue.cc:1059] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:02:12.672365  8214 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:12.671345  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.671657  8391 raft_consensus.cc:3055] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:12.674513  8391 raft_consensus.cc:740] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:12.672756  8350 raft_consensus.cc:3055] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:12.677381  8350 raft_consensus.cc:740] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:12.678519  8350 consensus_queue.cc:260] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:12.675714  8391 consensus_queue.cc:260] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.681741  8403 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.682258  8410 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:12.682576  8403 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.683424  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:12.699393  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:12.701081  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:12.701476  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1500) took 1539 ms. Trace:
I20260709 13:02:12.702124  1553 rpcz_store.cc:276] 0709 13:02:11.162274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.162532 (+   258us) service_pool.cc:224] Handling call
0709 13:02:11.174805 (+ 12273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.388751 (+213946us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.388788 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.389325 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.887734 (+498409us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:11.890063 (+  2329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.701035 (+810972us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b54001aa9d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:12.701093 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.701149 (+    56us) raft_consensus.cc:1685] finished
0709 13:02:12.701164 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.701399 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59684608,"thread_start_us":497718,"threads_started":1,"wal-append.queue_time_us":617732}
I20260709 13:02:12.705423  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:12.706557  2324 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:12.700367  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1502) took 1363 ms. Trace:
I20260709 13:02:12.707665  1554 rpcz_store.cc:276] 0709 13:02:11.337342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.337553 (+   211us) service_pool.cc:224] Handling call
0709 13:02:11.337852 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.539024 (+201172us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:11.574074 (+ 35050us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.681562 (+107488us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.681635 (+    73us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:11.681702 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.700076 (+1018374us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54000b72d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:12.700134 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.700300 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4660,"prepare.queue_time_us":42858,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":11189,"raft.queue_time_us":80330,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":409538816,"thread_start_us":65687,"threads_started":1,"wal-append.queue_time_us":276475}
I20260709 13:02:12.713016  1628 raft_consensus.cc:1240] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:12.718689  1627 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:12.682194  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.700385  2322 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 20.
I20260709 13:02:12.732856  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 3200) took 1049 ms. Trace:
I20260709 13:02:12.733448  1705 rpcz_store.cc:276] 0709 13:02:11.683739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.683903 (+   164us) service_pool.cc:224] Handling call
0709 13:02:12.732480 (+1048577us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b5400396f54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:12.732717 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2066318080}
I20260709 13:02:12.734419  2322 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
I20260709 13:02:12.734952  2322 pending_rounds.cc:85] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 14
I20260709 13:02:12.735301  2322 pending_rounds.cc:107] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 13:02:12.735600  2322 raft_consensus.cc:2889] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:12.736433  1451 catalog_manager.cc:5697] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.738989  7917 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:12.680312  8350 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:12.745501  1598 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:12.744452  8391 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:12.741226  8403 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:12.749933  8019 raft_consensus.cc:3055] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:12.784714  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.770887  8481 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:12.785130  8019 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:12.790619  8481 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.781426  8397 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:02:12.797832  8481 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:12.809681  8019 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.811410  8019 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:12.817523  2324 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:12.818962  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.819748  1598 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:12.795019  8423 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:12.837019  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.838032  1631 raft_consensus.cc:2410] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:02:12.817263  8427 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:12.839495  1627 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:12.843281  8423 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:12.845564  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2801) took 1079 ms. Trace:
I20260709 13:02:12.846346  1556 rpcz_store.cc:276] 0709 13:02:11.766289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.766444 (+   155us) service_pool.cc:224] Handling call
0709 13:02:12.845344 (+1078900us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54001c89d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:12.845497 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1626617600}
I20260709 13:02:12.821628  8397 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:12.826885  1635 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 20. Current term is 21. Ops: []
W20260709 13:02:12.831468  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.839564  8427 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:12.851132  8427 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
W20260709 13:02:12.854218  8433 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.166s	user 0.000s	sys 0.007s
I20260709 13:02:12.854538  8463 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:12.855108  8214 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:02:12.855888  8214 consensus_queue.cc:1243] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer 8106dfc0bda54df0ae10ba13c28ccc18 log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:02:12.856561  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1319) took 1839 ms. Trace:
I20260709 13:02:12.857026  1629 rpcz_store.cc:276] 0709 13:02:11.017140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.019007 (+  1867us) service_pool.cc:224] Handling call
0709 13:02:11.019379 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.090044 (+ 70665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.090084 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.101820 (+ 11736us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.417139 (+315319us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:11.811365 (+394226us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18002ad060. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed962d4bc 00007f0ed697b48b 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6995455 00007f0edd47d3c7 00007f0ed9a8f9a7 00007f0ed9a9f0bf
0709 13:02:11.811521 (+   156us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.811772 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.811856 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.853636 (+1041780us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:12.856323 (+  2687us) raft_consensus.cc:1685] finished
0709 13:02:12.856346 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.856479 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74214,"prepare.queue_time_us":202673,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":9823,"raft.queue_time_us":73954,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":25631,"spinlock_wait_cycles":38639872,"thread_start_us":404265,"threads_started":2,"wal-append.queue_time_us":444085}
I20260709 13:02:12.861791  8394 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:12.863620  8348 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:12.869031  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:12.871312  1558 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:12.872385  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 1586) took 1234 ms. Trace:
I20260709 13:02:12.872809  2328 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:12.873164  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:12.873845  1554 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20.
I20260709 13:02:12.874856  1560 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:12.874889  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:12.860140  1700 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:12.878460  1700 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:12.879333  1700 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.859988  8481 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.883729  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3433) took 1110 ms. Trace:
I20260709 13:02:12.883709  8427 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:12.872833  2323 rpcz_store.cc:276] 0709 13:02:11.638118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.653673 (+ 15555us) service_pool.cc:224] Handling call
0709 13:02:12.872143 (+1218470us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400078d54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:12.872293 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397206400}
I20260709 13:02:12.888695  1672 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:12.884351  2286 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:12.884407  1709 rpcz_store.cc:276] 0709 13:02:11.773721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.065757 (+292036us) service_pool.cc:224] Handling call
0709 13:02:12.066569 (+   812us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.082924 (+ 16355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.082954 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.122131 (+ 39177us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.475105 (+352974us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:12.521267 (+ 46162us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.521571 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.521647 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.878548 (+356901us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b18000a5760. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:02:12.883453 (+  4905us) raft_consensus.cc:1685] finished
0709 13:02:12.883547 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.883674 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12546,"prepare.queue_time_us":47135,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":3377,"raft.queue_time_us":20355,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7335,"spinlock_wait_cycles":18267776,"thread_start_us":169127,"threads_started":1,"wal-append.queue_time_us":293670}
I20260709 13:02:12.904162  1672 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:12.886698  8427 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:12.905704  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:12.906157  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.906396  8397 raft_consensus.cc:697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:12.906968  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:12.907238  8427 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:12.907577  2321 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:12.907618  8397 consensus_queue.cc:237] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.908555  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:12.909698  2329 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:02:12.915585  1700 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:12.919261  2328 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:02:12.909570  1523 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:12.920928  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:12.922418  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:12.921846  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2794) took 2105 ms. Trace:
I20260709 13:02:12.927019  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:12.927520  1632 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:12.928825  2321 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:12.924862  8095 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:12.933548  8095 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.934237  8095 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:12.925504  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:12.909684  8350 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:12.935891  2329 raft_consensus.cc:2410] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
W20260709 13:02:12.936532  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.941661  1523 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:12.943010  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:12.911377  8481 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:12.941841  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:12.945670  2328 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:12.937929  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:12.923288  8155 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:12.923462  8427 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:12.952836  1523 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:12.932713  8145 consensus_queue.cc:1059] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:02:12.955533  8481 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:12.956436  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:12.956661  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:12.925917  1552 rpcz_store.cc:276] 0709 13:02:10.816232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.893297 (+ 77065us) service_pool.cc:224] Handling call
0709 13:02:10.893623 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.894001 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:10.894029 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:10.894572 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.957871 (+ 63299us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:10.957920 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.958001 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.909703 (+1951702us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b2400129518. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed681e9c4 00007f0ed681cacb 00007f0ed69d7dc9 00007f0ed69d7a55 00007f0ed69d6fb0 00007f0ed964d488 00007f0ed964dbe8 00007f0ed9625398 00007f0ed962076a 00007f0ed961fbb6
0709 13:02:12.913097 (+  3394us) raft_consensus.cc:1685] finished
0709 13:02:12.913118 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.921782 (+  8664us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10976,"raft.queue_time_us":76396,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":9573,"spinlock_wait_cycles":42331392,"thread_start_us":57773,"threads_started":1,"wal-append.queue_time_us":129685}
I20260709 13:02:12.954510  1700 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:02:12.960740  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:12.967602  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:12.950026  8432 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:12.968255  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:12.978168  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3429) took 1762 ms. Trace:
I20260709 13:02:12.939960  8419 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.980423  1700 rpcz_store.cc:276] 0709 13:02:11.215799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.215941 (+   142us) service_pool.cc:224] Handling call
0709 13:02:11.216345 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.860042 (+1643697us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54004a22a0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed99fcdc0 00007f0ed9a871c0 00007f0ed9a88231 00007f0ed9a84d8f 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c
0709 13:02:12.977911 (+117869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.978115 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914486528}
I20260709 13:02:12.926652  8199 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:02:12.982556  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:12.954484  8155 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.988278  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:12.992163  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:12.995237  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:12.976776  8302 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:13.001525  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:13.002190  1558 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:12.997627  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:12.976670  8481 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.983096  8207 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:02:12.986696  8202 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:02:12.981894  8427 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:13.008878  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:13.008991  8388 consensus_queue.cc:1059] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:13.011366  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35632 (request call id 1301) took 1044 ms. Trace:
I20260709 13:02:13.035553  1707 rpcz_store.cc:276] 0709 13:02:11.967390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.432619 (+465229us) service_pool.cc:224] Handling call
0709 13:02:12.433071 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.433445 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.433470 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.858110 (+424640us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b2c000f3418. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2
0709 13:02:12.858533 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.966810 (+108277us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:12.966847 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.976117 (+  9270us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.011074 (+ 34957us) raft_consensus.cc:1685] finished
0709 13:02:13.011092 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.011300 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":106,"spinlock_wait_cycles":91937536,"thread_start_us":107906,"threads_started":1,"wal-append.queue_time_us":150280}
I20260709 13:02:13.013561  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:12.953583  8318 consensus_queue.cc:1059] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:02:13.040190  8302 raft_consensus.cc:3055] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:12.982558  8432 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.040640  8302 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:13.041016  8432 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:12.962293  8403 consensus_queue.cc:1059] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:02:13.050311  8318 raft_consensus.cc:3055] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:13.050773  8318 raft_consensus.cc:740] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:13.051803  8318 consensus_queue.cc:260] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:12.991707  8155 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:13.065145  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:12.989332  8405 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:02:12.988708  8419 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.014756  8402 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:13.040483  2327 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:13.048695  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:13.028249  8224 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:13.079752  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:13.027925  8481 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:13.092865  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.154376  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.027654  8207 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:13.152796  1632 raft_consensus.cc:2468] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 23.
I20260709 13:02:13.034494  8427 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.154584  8318 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.182899  1675 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:13.151062  8402 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:02:13.230078  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.227135  1553 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:13.042093  8302 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.037741  8394 consensus_queue.cc:1059] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.151s
I20260709 13:02:13.162386  8479 raft_consensus.cc:3055] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:02:13.190004  8448 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.437s	user 0.003s	sys 0.037s
I20260709 13:02:13.161644  8395 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.181766  8427 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:13.181483  8403 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:13.223961  8199 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:13.263681  8419 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:13.234627  8423 raft_consensus.cc:2804] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:13.244951  8479 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:13.256012  8395 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:13.277448  8402 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.257283  8403 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:13.282241  8207 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:13.247725  8448 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.494s	user 0.003s	sys 0.038s
I20260709 13:02:13.288230  1552 raft_consensus.cc:2410] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:02:13.289495  8318 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.287202  8302 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:13.301865  1599 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:13.288805  8405 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:13.304788  1599 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:13.293650  8423 raft_consensus.cc:697] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:13.307791  1599 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:13.311988  1599 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:13.316068  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:13.289575  8199 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:13.307288  8402 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:13.305409  8394 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:13.328495  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:13.324476  7843 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:13.331743  7843 consensus_queue.cc:1059] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:13.335673  8395 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:13.314817  8479 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:13.339314  8479 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.349496  8095 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.350672  8423 consensus_queue.cc:237] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:13.322657  8400 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:13.355297  8403 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:13.300128  8318 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.313313  8039 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:13.320403  8388 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:13.373169  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:13.356873  8430 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:13.373867  2324 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:13.362648  8262 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:13.323007  8405 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:13.381070  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.393738  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 71778.3us
W20260709 13:02:13.402652  8439 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.636s	user 0.004s	sys 0.009s
W20260709 13:02:13.405633  8441 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 1.640s	user 0.004s	sys 0.026s
I20260709 13:02:13.406165  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1321) took 2388 ms. Trace:
I20260709 13:02:13.406561  1633 rpcz_store.cc:276] 0709 13:02:11.017943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.018242 (+   299us) service_pool.cc:224] Handling call
0709 13:02:11.018938 (+   696us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.061875 (+ 42937us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:11.471291 (+409416us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.595954 (+124663us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.618436 (+ 22482us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.618609 (+   173us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:11.618657 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.618748 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.401739 (+1782991us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:13.405865 (+  4126us) raft_consensus.cc:1685] finished
0709 13:02:13.405966 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.406107 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56332,"prepare.queue_time_us":531891,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":7330,"raft.queue_time_us":51386,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":35914,"spinlock_wait_cycles":126810368,"thread_start_us":433775,"threads_started":2,"wal-append.queue_time_us":260981}
I20260709 13:02:13.409034  8089 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:13.381978  8262 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:13.425688  8262 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:13.429208  1555 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:02:13.429963  1555 pending_rounds.cc:85] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 7
I20260709 13:02:13.430328  1555 pending_rounds.cc:107] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:02:13.430567  1555 raft_consensus.cc:2889] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:13.422714  8432 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.431407  8391 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.431991  8391 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:13.382565  8388 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:13.454334  2324 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
I20260709 13:02:13.456981  8155 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.461061  8155 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:13.409699  8089 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.476358  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2803) took 1709 ms. Trace:
I20260709 13:02:13.476610  2324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:02:13.477692  2324 raft_consensus.cc:606] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:13.476886  1559 rpcz_store.cc:276] 0709 13:02:11.766910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.849187 (+ 82277us) service_pool.cc:224] Handling call
0709 13:02:11.862450 (+ 13263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.019765 (+157315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.019802 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:12.019853 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:12.019895 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.476144 (+1456249us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400229cd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:13.476190 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.476303 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359822208}
W20260709 13:02:13.478868  8444 log.cc:927] Time spent T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 1.714s	user 0.000s	sys 0.019s
I20260709 13:02:13.478269  2324 raft_consensus.cc:614] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:13.480970  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3423) took 2472 ms. Trace:
I20260709 13:02:13.472796  8366 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.476969  8125 raft_consensus.cc:3055] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:13.481346  1708 rpcz_store.cc:276] 0709 13:02:11.008236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.022193 (+ 13957us) service_pool.cc:224] Handling call
0709 13:02:11.043207 (+ 21014us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.475288 (+432081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.475406 (+   118us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.507991 (+ 32585us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.615110 (+107119us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:11.875990 (+260880us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.876806 (+   816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.876918 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.421692 (+1544774us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:13.480658 (+ 58966us) raft_consensus.cc:1685] finished
0709 13:02:13.480761 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.480886 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":343604,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2907,"raft.queue_time_us":271348,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":30393,"spinlock_wait_cycles":152387328,"thread_start_us":666747,"threads_started":3,"wal-append.queue_time_us":112037}
W20260709 13:02:13.495121  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 98856.3us
I20260709 13:02:13.460932  8388 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:13.502928  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.485908  8155 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:13.510921  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:13.511618  1626 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:02:13.516278  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:02:13.517118  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.496744  8125 raft_consensus.cc:740] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:13.519554  1629 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 13:02:13.522655  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:13.526101  1626 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:02:13.524221  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:13.527874  1627 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 21: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:13.508291  8418 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:13.527645  1675 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:13.514179  8199 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:13.495548  8366 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.538269  2288 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:13.519912  8448 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.524127  8318 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:13.548151  1631 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:13.544775  1598 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:13.550182  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:13.550827  2324 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:13.536949  8419 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.537446  8145 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:13.555502  8145 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.547530  8405 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:13.527127  8432 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:13.558739  8419 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.561383  8232 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:13.562068  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1422) took 3005 ms. Trace:
I20260709 13:02:13.562492  8125 consensus_queue.cc:260] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:13.562611  2327 rpcz_store.cc:276] 0709 13:02:10.556511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.853385 (+296874us) service_pool.cc:224] Handling call
0709 13:02:10.860923 (+  7538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.145716 (+2284793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.561831 (+416115us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b5400529ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:13.562005 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5014160128}
I20260709 13:02:13.564016  8388 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:13.565670  8095 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:13.515090  8155 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.575006  1635 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:13.576423  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:13.577272  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1498) took 2419 ms. Trace:
I20260709 13:02:13.577540  2321 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:13.577777  1557 rpcz_store.cc:276] 0709 13:02:11.157670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.158435 (+   765us) service_pool.cc:224] Handling call
0709 13:02:11.158899 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.413683 (+254784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.413719 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.420975 (+  7256us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:11.421043 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.576969 (+2155926us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54001aa4d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:13.577031 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.577203 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561865088}
I20260709 13:02:13.587438  2324 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 21.
I20260709 13:02:13.590162  8155 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:13.592087  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 3185) took 1746 ms. Trace:
I20260709 13:02:13.608153  1634 rpcz_store.cc:276] 0709 13:02:11.845318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.845691 (+   373us) service_pool.cc:224] Handling call
0709 13:02:11.859548 (+ 13857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.592650 (+733102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.591791 (+999141us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54002c7ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:13.592010 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662373120}
I20260709 13:02:13.594187  8145 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:13.596073  8419 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:13.596314  8366 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:13.596789  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 69259.4us
I20260709 13:02:13.597920  8214 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:02:13.602546  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.606463  1598 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:13.613315  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:13.537343  8418 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.625902  2324 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 14: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:02:13.635586  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.635566  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 97426.5us
I20260709 13:02:13.633351  8214 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:13.637338  8427 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.639742  8427 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:13.640275  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:13.640717  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:13.641360  1556 raft_consensus.cc:2410] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:02:13.641649  1553 raft_consensus.cc:2410] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:02:13.642326  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:13.642532  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:13.645723  8388 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:13.646968  8388 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:13.647498  1451 catalog_manager.cc:5697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:13.610986  8445 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:13.649413  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:13.648074  8388 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.649307  1451 catalog_manager.cc:5697] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 5 to 9, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 9 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:13.642482  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:13.643777  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:13.653774  1559 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:13.654721  1556 raft_consensus.cc:2410] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:02:13.656356  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:13.658408  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3430) took 1885 ms. Trace:
I20260709 13:02:13.657342  1628 raft_consensus.cc:2376] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15. Re-sending same reply.
I20260709 13:02:13.662799  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:13.659585  1706 rpcz_store.cc:276] 0709 13:02:11.772781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.958728 (+185947us) service_pool.cc:224] Handling call
0709 13:02:11.983559 (+ 24831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.032797 (+ 49238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.653105 (+1620308us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b54003ec6d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:13.658345 (+  5240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63937408}
I20260709 13:02:13.665177  1635 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 14.
I20260709 13:02:13.601807  8481 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.575740  8448 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.637357  8214 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:13.669139  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:13.672612  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:13.672966  1556 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:13.676966  1553 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:02:13.645800  8089 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:13.683277  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:13.683979  8418 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:13.687608  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:13.688931  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:13.689685  2322 raft_consensus.cc:2368] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20.
I20260709 13:02:13.689620  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:13.690932  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:13.691500  2326 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:13.693028  1559 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:13.697186  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:13.698048  1631 raft_consensus.cc:2368] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15.
I20260709 13:02:13.678544  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:13.651734  1451 catalog_manager.cc:5697] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:13.699401  1627 raft_consensus.cc:2376] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18. Re-sending same reply.
I20260709 13:02:13.701261  2324 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20. Ops: []
W20260709 13:02:13.704100  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.702020  1634 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 20: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:13.665886  8445 raft_consensus.cc:697] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:13.710191  1672 leader_election.cc:400] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20.
I20260709 13:02:13.713142  1672 leader_election.cc:403] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:02:13.715052  1631 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:13.699689  8423 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:13.717614  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:13.720654  2324 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:02:13.680325  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:13.712795  8202 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.730914  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:13.741587  1454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57414 (request call id 193) took 43224 ms (client timeout 15000 ms). Trace:
I20260709 13:02:13.743604  8357 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:13.726220  8423 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:13.755102  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.711222  1451 catalog_manager.cc:5697] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:13.763881  1526 connection.cc:256] RPC call timeout handler was delayed by -1.5019331280000188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 13:02:13.764863  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.765556  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.766010  1526 connection.cc:256] RPC call timeout handler was delayed by -1.4362331280000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:02:13.767068  1526 connection.cc:256] RPC call timeout handler was delayed by -1.3957331280000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260709 13:02:13.768049  8095 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.768332  8481 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:13.768649  8095 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:13.769229  1451 catalog_manager.cc:5697] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 9 to 13, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:13.770217  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:13.713626  8445 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.761202  8202 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.773685  8095 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:13.767546  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1663968090000481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 13:02:13.714990  8366 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
I20260709 13:02:13.781543  2328 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 20. Current term is 21. Ops: []
W20260709 13:02:13.786569  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 71970.4us
I20260709 13:02:13.790277  2324 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20.
I20260709 13:02:13.772020  1451 catalog_manager.cc:5697] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:13.761096  8479 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:02:13.800737  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:13.806401  1628 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:02:13.805600  8436 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:02:13.810025  1526 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:13.813020  8518 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:02:13.793679  8202 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:13.847129  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:13.847234  8524 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.854894  8357 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20.
W20260709 13:02:13.848925  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.850061  8448 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:13.790333  8400 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.850395  8421 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:13.851142  8423 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:13.874094  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:13.876109  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:13.877723  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:13.878720  1702 raft_consensus.cc:2410] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:02:13.795037  8095 consensus_queue.cc:1059] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:02:13.854966  8524 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.868409  8400 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.867149  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:13.889994  1706 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:02:13.890563  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 182734us
I20260709 13:02:13.891288  1672 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:13.868104  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:13.873900  8403 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:13.880911  1707 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 20: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:13.847790  1451 catalog_manager.cc:5697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:13.882048  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:13.847265  8391 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:13.883644  1705 raft_consensus.cc:1240] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:13.899665  1630 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:02:13.902174  1627 raft_consensus.cc:1813] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Handling vote request from an unknown peer 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:13.902843  1627 raft_consensus.cc:2368] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18.
I20260709 13:02:13.903268  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:13.867913  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.880133  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:13.867679  8510 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:13.879315  8436 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:13.895835  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:13.916177  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:13.918223  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:13.881363  8214 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:13.921218  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:13.922791  8214 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:13.922950  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:13.930697  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:13.932658  8400 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:13.896677  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:13.898010  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:13.742105  1454 rpcz_store.cc:269] 0709 13:01:30.478478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.478824 (+   346us) service_pool.cc:224] Handling call
0709 13:02:13.681456 (+43202632us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:58.991253 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:58.992049 (+   796us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:58.992117 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:01:58.992147 (+    30us) tablet.cc:662] Decoding operations
0709 13:01:58.994369 (+  2222us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:58.994494 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:58.994524 (+    30us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:01:59.049808 (+ 55284us) tablet.cc:701] Row locks acquired
0709 13:01:59.084457 (+ 34649us) write_op.cc:260] PREPARE: finished
0709 13:01:59.167847 (+ 83390us) write_op.cc:270] Start()
0709 13:01:59.209584 (+ 41737us) write_op.cc:276] Timestamp: P: 1783602119106897 usec, L: 0
0709 13:01:59.221363 (+ 11779us) op_driver.cc:348] REPLICATION: starting
0709 13:01:59.343721 (+122358us) log.cc:844] Serialized 9026 byte log entry
0709 13:01:59.605794 (+262073us) op_driver.cc:464] REPLICATION: finished
0709 13:01:59.902574 (+296780us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed697b0ac 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0edd4bbef0
0709 13:02:00.448635 (+546061us) write_op.cc:301] APPLY: starting
0709 13:02:00.448970 (+   335us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:00.927594 (+478624us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:00.927653 (+    59us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:01.204663 (+277010us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540029f754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a8232a 00007f0ed9a07f14 00007f0ed9a07ec3 00007f0ed9a07e38 00007f0ed9a07df3 00007f0ed9a070dc 00007f0ed9a30e16 00007f0ed9a18cbb 00007f0ed9a0339d 00007f0ed9a06d75
0709 13:02:02.089742 (+885079us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:02.150260 (+ 60518us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:02:02.150355 (+    95us) write_op.cc:312] APPLY: finished
0709 13:02:02.151317 (+   962us) log.cc:844] Serialized 204 byte log entry
0709 13:02:02.409841 (+258524us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:02.515213 (+105372us) write_op.cc:454] Released schema lock
0709 13:02:02.515304 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:02.515928 (+   624us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:02.515956 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":47621,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":842336,"apply.run_cpu_time_us":80340,"apply.run_wall_time_us":2067298,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100129,"num_ops":23,"prepare.queue_time_us":467562,"prepare.run_cpu_time_us":28097,"prepare.run_wall_time_us":515908,"raft.queue_time_us":7111,"raft.run_cpu_time_us":32139,"raft.run_wall_time_us":1784440,"replication_time_us":384042,"spinlock_wait_cycles":371570304,"thread_start_us":1498863,"threads_started":5,"wal-append.queue_time_us":403864,"wal-append.run_cpu_time_us":12289,"wal-append.run_wall_time_us":2339695}]]}
I20260709 13:02:13.869262  8089 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:02:13.889595  8302 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:13.906772  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:13.907810  1705 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 20: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:13.897006  8357 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:13.905025  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:13.934645  1702 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:13.908831  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:13.905233  8202 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:02:13.910590  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:13.949594  1706 raft_consensus.cc:2393] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 20: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:13.898797  8403 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.913125  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:13.913115  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:13.951354  2320 raft_consensus.cc:1813] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Handling vote request from an unknown peer 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:13.952108  2320 raft_consensus.cc:2368] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18.
I20260709 13:02:13.914574  8350 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:13.914330  8510 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:13.933539  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:13.920135  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:13.945915  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 49377us
I20260709 13:02:13.957916  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:13.946666  1631 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:13.948383  8436 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:13.950714  1709 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:13.955735  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:13.965818  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:13.968551  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:13.969566  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:13.969818  1708 raft_consensus.cc:2410] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:02:13.975523  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:13.977659  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:13.971678  8095 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:13.978825  8510 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:13.979498  8095 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:13.952767  8391 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:02:13.983862  8499 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.682s	user 0.005s	sys 0.001s
I20260709 13:02:13.981276  8436 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:13.985546  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:13.991101  1706 raft_consensus.cc:1275] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:14.004617  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:13.966970  8350 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:13.973500  8512 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:02:13.991817  8436 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:14.014513  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:14.015141  2329 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:14.017940  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:13.992446  8391 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.011112  1451 catalog_manager.cc:5697] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.025879  8403 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:14.027791  8207 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:14.032800  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.045325  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.052923  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1433) took 1167 ms. Trace:
I20260709 13:02:14.053467  2325 rpcz_store.cc:276] 0709 13:02:12.885915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.887309 (+  1394us) service_pool.cc:224] Handling call
0709 13:02:12.910071 (+ 22762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.923756 (+ 13685us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:12.936840 (+ 13084us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.043696 (+106856us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:13.186143 (+142447us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.186322 (+   179us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:13.186352 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.186419 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.591033 (+404614us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b18002ab080. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:02:13.967030 (+375997us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:14.052646 (+ 85616us) raft_consensus.cc:1685] finished
0709 13:02:14.052686 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.052843 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38849,"prepare.queue_time_us":13027,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":19257,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":5968,"spinlock_wait_cycles":24735872,"thread_start_us":85874,"threads_started":1,"wal-append.queue_time_us":296402}
I20260709 13:02:14.045698  1705 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
I20260709 13:02:14.013965  8436 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:14.047525  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.060141  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.050818  8524 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:14.050917  8028 raft_consensus.cc:3055] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:14.012542  8302 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:02:14.081561  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 63741.3us
I20260709 13:02:14.081761  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:14.082460  2328 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 21.
I20260709 13:02:14.082398  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:14.057006  1703 raft_consensus.cc:2393] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:02:14.057705  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.016757  8512 consensus_queue.cc:1243] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer 6b9e73092f6146639bf310a3d18cfe37 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:02:14.079710  1598 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:14.094801  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:14.095234  8125 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:14.095597  1631 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:14.098412  1628 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:02:14.099699  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:14.100265  8421 raft_consensus.cc:3055] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:14.101053  8421 raft_consensus.cc:740] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:14.101778  8350 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:14.102372  8421 consensus_queue.cc:260] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.103789  8421 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:14.111788  8426 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:14.080945  8028 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:14.116868  1675 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:14.077708  8045 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.087075  2325 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:14.077565  8445 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.032204  8095 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:02:14.058638  8402 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:14.122028  1598 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:14.122071  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:14.053435  1706 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:02:14.117421  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:14.120142  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:14.116159  8403 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:14.114735  1709 raft_consensus.cc:3055] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:14.127414  1709 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:14.126879  8523 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:14.128963  8523 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:14.129055  8510 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:14.129395  8523 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:14.130914  8403 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:14.131963  8357 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:14.132299  8028 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:14.104001  8391 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:14.133710  8028 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:14.134558  8095 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.118011  8426 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.135090  8095 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.133625  8391 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.153805  1675 leader_election.cc:400] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18.
I20260709 13:02:14.154361  1675 leader_election.cc:403] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:14.158149  1672 leader_election.cc:400] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18.
I20260709 13:02:14.160566  8391 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.161932  8095 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:14.162971  8391 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:14.165830  8426 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:14.126011  8232 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:14.169546  8232 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.169941  8232 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:14.170570  1631 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20.
I20260709 13:02:14.173872  2325 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:14.175173  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:14.127377  8513 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:02:14.182150  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.176538  8501 log.cc:927] Time spent T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.705s	user 0.002s	sys 0.000s
I20260709 13:02:14.124553  8045 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.127183  8445 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:14.181028  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 57445.3us
W20260709 13:02:14.191407  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 73738us
I20260709 13:02:14.275260  2324 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:14.297988  1599 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:14.319427  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.179548  8529 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:02:14.306706  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:14.364151  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.309056  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2792) took 3493 ms. Trace:
I20260709 13:02:14.372083  1706 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 22. Current term is 23. Ops: [20.15-22.16]
I20260709 13:02:14.363917  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:14.330808  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.246256  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:14.274489  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.366035  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.373967  1554 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
W20260709 13:02:14.374992  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.375049  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.370731  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.372110  1555 rpcz_store.cc:276] 0709 13:02:10.815723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.890549 (+ 74826us) service_pool.cc:224] Handling call
0709 13:02:10.940093 (+ 49544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.431040 (+2490947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.308741 (+877701us) spinlock_profiling.cc:243] Waited 2.49 s on lock 0x7b5400028354. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:14.308978 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5725444864}
I20260709 13:02:14.286582  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47910 (request call id 3463) took 1327 ms. Trace:
W20260709 13:02:14.367141  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 69266.6us
I20260709 13:02:14.241752  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:14.230614  2288 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:14.234148  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.378484  1599 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:14.235157  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:14.236271  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.370960  1558 raft_consensus.cc:1240] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:14.365082  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.378525  1631 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 18: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:14.378034  1552 rpcz_store.cc:276] 0709 13:02:12.959608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.064735 (+105127us) service_pool.cc:224] Handling call
0709 13:02:14.281119 (+1216384us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54002283d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:14.286508 (+  5389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387992832}
I20260709 13:02:14.220278  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:14.380167  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:14.190619  8350 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:02:14.375788  1554 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 21.
I20260709 13:02:14.381001  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:14.381439  1601 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:14.384459  1523 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:14.387235  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:14.386018  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 155581us
I20260709 13:02:14.387688  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.389384  1701 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 21.
I20260709 13:02:14.390017  1556 raft_consensus.cc:2410] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:02:14.390758  2321 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:14.176961  8442 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.197s
I20260709 13:02:14.272547  8214 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.393664  2288 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:14.403618  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.393780  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.370635  8366 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:14.394937  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:14.249063  8423 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.249305  8528 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:14.205713  8169 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:14.399887  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:14.220468  8045 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:14.190577  8357 consensus_queue.cc:1059] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.212s
I20260709 13:02:14.407707  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:14.396059  8479 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:14.406432  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:14.177690  8510 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:14.398384  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:14.436519  2328 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:14.409559  1601 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:14.409943  1599 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:14.410887  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:14.411374  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.183688  8513 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.387235  8419 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:14.422025  1702 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:02:14.404768  1560 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:14.444413  1702 pending_rounds.cc:85] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 12
I20260709 13:02:14.445029  1702 pending_rounds.cc:107] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:02:14.445328  1702 raft_consensus.cc:2889] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:14.424060  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44013.1us
I20260709 13:02:14.393373  8397 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:14.426184  1552 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:02:14.446343  1552 pending_rounds.cc:85] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 13
I20260709 13:02:14.446797  1526 leader_election.cc:400] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15.
I20260709 13:02:14.428647  2326 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:14.447177  1526 leader_election.cc:403] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:02:14.408776  2329 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:14.211408  8436 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:14.426268  8169 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.433416  8318 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:14.431833  2323 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:14.220005  8523 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:14.425969  8279 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:14.412276  8519 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:14.401875  8448 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:02:14.426184  2327 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:02:14.425891  8442 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:02:14.419512  8432 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:14.408568  8415 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.456885  8510 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.449827  8419 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:14.457690  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:14.476734  1560 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:14.444108  8513 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:14.446681  1552 pending_rounds.cc:107] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 20.14
W20260709 13:02:14.465441  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 77802.5us
I20260709 13:02:14.424683  8540 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:14.458055  8169 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:14.411422  8214 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.450438  8199 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15.
I20260709 13:02:14.450008  8207 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:14.420643  8423 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:14.481268  1552 raft_consensus.cc:2889] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:14.211804  1451 catalog_manager.cc:5697] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.483604  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.484424  1552 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 21.
I20260709 13:02:14.477877  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:14.485800  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.486469  1552 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 21.
I20260709 13:02:14.487290  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.489575  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3450) took 3020 ms. Trace:
I20260709 13:02:14.488296  1552 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:14.484717  1523 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:14.493953  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.489388  2288 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:14.495849  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.497298  1708 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20.
I20260709 13:02:14.473213  8545 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:14.425068  8528 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:14.501183  1704 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 17: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:14.506464  1560 raft_consensus.cc:2468] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 21.
I20260709 13:02:14.453894  8232 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.479866  8419 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:14.510703  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.490011  1551 rpcz_store.cc:276] 0709 13:02:11.486484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.960725 (+1474241us) service_pool.cc:224] Handling call
0709 13:02:12.961382 (+   657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.961849 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:12.964377 (+  2528us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.371816 (+1407439us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b1800206860. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed962523a 00007f0ed9a8fa2a
0709 13:02:14.489229 (+117413us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:14.489282 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:14.489330 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.489413 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.489521 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1377,"prepare.queue_time_us":203,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":3696,"spinlock_wait_cycles":21213568,"thread_start_us":115772,"threads_started":1}
I20260709 13:02:14.527107  1552 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:02:14.528424  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.529289  1552 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:14.492273  8391 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:14.513003  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:14.482111  8415 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.495944  8540 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:14.517674  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:14.519126  1451 catalog_manager.cc:5697] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.519850  7996 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.524034  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.515551  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.525158  8432 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:14.479588  8421 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:02:14.536777  2286 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:14.494128  8207 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.550652  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.542752  1560 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 11.
I20260709 13:02:14.543424  1559 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 21: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:14.552438  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.533222  8391 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:14.545555  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:14.548628  2286 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:14.547238  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.557762  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:14.513399  8145 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:02:14.554149  1560 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:14.560241  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.535171  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.548092  8432 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.565372  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.565551  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:14.553224  7996 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:14.567098  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.560992  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.569995  1559 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:14.570401  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.526036  8545 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.617790  1558 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:14.618494  8545 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:14.619266  1558 raft_consensus.cc:1275] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:14.620373  1558 raft_consensus.cc:3055] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:14.620702  1558 raft_consensus.cc:740] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:14.623778  8350 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18.
I20260709 13:02:14.558979  8445 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:14.627449  8207 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:14.628820  8366 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:14.631639  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 192903us
I20260709 13:02:14.632751  8400 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.633103  1601 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:14.633316  8400 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.633992  1601 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:14.635460  8400 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:14.635878  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:14.636555  2322 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:14.628412  8532 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:14.638053  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:14.563057  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:14.644337  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:14.647013  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.568440  8169 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:14.562922  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.567904  8145 consensus_queue.cc:1243] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:02:14.557314  8391 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:14.572574  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.573099  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.575126  1560 raft_consensus.cc:3055] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:14.698990  1560 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:02:14.555401  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 66145.2us
I20260709 13:02:14.702404  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:14.576993  8541 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:02:14.577841  8527 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:14.579641  8528 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:14.586582  8423 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:14.587275  8540 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.588992  1451 catalog_manager.cc:5697] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 7 to 13, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 13 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:14.590440  8523 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:14.566179  8432 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:14.569312  8546 raft_consensus.cc:2804] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:14.591523  8415 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:14.593549  8232 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:14.597985  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.600245  1553 raft_consensus.cc:1240] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:14.600626  2321 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:14.600898  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.601684  8214 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:14.602542  8436 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:14.603503  8542 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.106s	user 0.005s	sys 0.000s
W20260709 13:02:14.610247  8543 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
I20260709 13:02:14.552210  8519 raft_consensus.cc:697] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:14.732781  8519 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.727712  1704 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:14.615629  8513 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.736019  8513 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:14.539117  8155 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:14.670066  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:14.739899  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 135124us
I20260709 13:02:14.740181  1555 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:02:14.641741  2286 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:02:14.741256  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 99670.9us
I20260709 13:02:14.644110  1558 consensus_queue.cc:260] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:14.645738  1709 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.697790  1557 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:02:14.742534  1558 raft_consensus.cc:3060] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:14.699926  1560 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.743405  1560 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:14.716085  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:14.694557  8169 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:14.720875  8546 raft_consensus.cc:697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 21 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:14.765602  8169 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:14.766278  8546 consensus_queue.cc:237] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.721803  8548 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:14.768793  8548 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:14.723701  1523 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:14.724974  1672 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:14.737037  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:14.770377  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 46832.7us
I20260709 13:02:14.709048  8524 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:14.771041  1523 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:14.708461  8348 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:14.737810  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:14.710402  8445 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:14.669586  8239 consensus_queue.cc:1059] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 16.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.048s
I20260709 13:02:14.742547  1709 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:14.746412  1630 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 19. Current term is 20. Ops: [16.10-19.11]
I20260709 13:02:14.746762  1635 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:14.747448  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 105772us
I20260709 13:02:14.808736  1558 raft_consensus.cc:1275] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 13:02:14.809175  1558 pending_rounds.cc:85] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 11
I20260709 13:02:14.809418  1558 pending_rounds.cc:107] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:02:14.809737  1558 raft_consensus.cc:2889] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:14.809543  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:14.811129  2325 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:14.748095  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:14.751108  1627 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:14.751646  1629 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:14.751840  8507 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:14.806844  8527 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.812229  2286 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:14.798861  8524 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.809587  8512 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:14.805670  8402 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:14.746073  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 307318us
I20260709 13:02:14.753574  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:14.754019  8415 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:14.739827  8155 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:14.748410  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 105151us
I20260709 13:02:14.704677  8479 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:02:14.859514  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.798106  2322 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 19.
I20260709 13:02:14.799407  1626 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:02:14.799897  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.800520  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 75667.3us
I20260709 13:02:14.817183  8239 raft_consensus.cc:3055] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:02:14.817807  8552 log.cc:927] Time spent T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:02:14.799111  8436 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:14.752254  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:14.822348  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 118585us
I20260709 13:02:14.822489  1633 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 19: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:14.862010  1598 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:14.841076  1560 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:02:14.875874  1560 pending_rounds.cc:85] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 12
I20260709 13:02:14.876132  1560 pending_rounds.cc:107] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:02:14.876374  1560 raft_consensus.cc:2889] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:14.805684  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 63127.2us
I20260709 13:02:14.831718  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:14.862675  1672 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:14.884501  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:14.886160  1675 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:14.887358  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 55796us
I20260709 13:02:14.895383  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.878086  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:14.897768  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.825652  8524 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:14.830299  8400 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.928668  8426 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:14.929075  8400 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:14.930020  8418 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:14.931558  8400 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:14.825122  8527 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.753119  1451 catalog_manager.cc:5697] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.934475  8527 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:14.833357  8415 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:14.937204  8415 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:14.899292  8523 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:14.899371  8421 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:14.870893  8239 raft_consensus.cc:740] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:14.948689  1705 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:14.950269  8239 consensus_queue.cc:260] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 16.16, Last appended by leader: 16, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:14.951206  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.829371  8445 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:14.953361  8445 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:14.953933  8445 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:14.951767  8145 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:14.829041  8402 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.957068  8402 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:14.899353  1708 raft_consensus.cc:2393] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:02:14.963511  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 100935us
I20260709 13:02:14.871806  8155 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:14.898099  7843 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:14.892014  8207 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:02:14.873288  8214 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.923369  8448 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:14.900369  8513 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:14.905213  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.890722  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:14.968274  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:14.971138  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:14.978643  2325 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 22.
I20260709 13:02:14.981521  1709 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:02:14.769809  8548 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.004411  1709 pending_rounds.cc:85] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 15
I20260709 13:02:15.004261  1526 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:14.879726  8436 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.017571  1598 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:14.998785  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:15.004973  1709 pending_rounds.cc:107] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:02:15.019906  1709 raft_consensus.cc:2889] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:15.020015  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:14.820530  8419 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:15.006493  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 116233us
I20260709 13:02:15.024756  1599 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:15.015744  1626 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:02:14.991585  7843 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:14.990360  8425 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:15.028415  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.043678  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:14.935858  1451 catalog_manager.cc:5697] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.990617  8426 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:15.056196  1632 raft_consensus.cc:1275] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:15.066743  8421 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:15.067569  8421 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:15.067970  8421 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:15.070488  2328 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:15.022957  8199 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:15.017094  8507 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:15.079650  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:15.045228  8089 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:02:15.024549  8436 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.078258  2325 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:15.045578  7843 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.040017  8302 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:15.091449  1632 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:15.029397  8513 raft_consensus.cc:697] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:15.045086  8357 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.091467  1626 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:15.003068  8214 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.045730  8425 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:15.070050  8510 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.108201  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:15.105549  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 179333us
W20260709 13:02:15.109426  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.023881  8350 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:02:15.083963  8532 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:15.121733  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:15.122682  1631 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:02:15.090549  8442 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:15.135766  1632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
 from {username='slave'} at 127.0.0.1:44138
I20260709 13:02:15.090548  8039 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:15.121317  8357 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:15.168957  1626 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:15.170336  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:15.167798  8546 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:15.166863  8039 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.171756  1632 raft_consensus.cc:606] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Received request to transfer leadership to TS 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:15.172114  1632 raft_consensus.cc:614] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:15.173053  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:15.176510  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:15.177385  1635 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:02:15.178232  8039 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:15.179523  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:15.116859  8512 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:15.184698  8400 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.189978  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:15.192145  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:15.094002  8019 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:02:15.122057  8425 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:15.205569  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:15.211241  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:15.211977  1703 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:15.182508  8442 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:15.217507  1704 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
W20260709 13:02:15.229583  8554 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:02:15.230775  8432 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.232218  1552 raft_consensus.cc:1813] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Handling vote request from an unknown peer 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:15.232852  1552 raft_consensus.cc:2368] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 19.
I20260709 13:02:15.239837  1631 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:02:15.243208  1601 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:15.164356  8125 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.080s
W20260709 13:02:15.222832  8391 consensus_meta.cc:287] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
I20260709 13:02:15.202098  8262 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:15.272921  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:15.136061  8510 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.253643  8405 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:15.204665  8400 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:15.277989  8169 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.005s
I20260709 13:02:15.306272  1700 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
W20260709 13:02:15.289028  8550 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.376s	user 0.002s	sys 0.000s
I20260709 13:02:15.274214  8397 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:15.310690  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 202654us
I20260709 13:02:15.196027  8426 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:15.278923  8391 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:15.286657  8262 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.346743  8432 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:15.273566  8513 consensus_queue.cc:237] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.344667  8419 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:15.374207  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 330711us
I20260709 13:02:15.368671  8562 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
W20260709 13:02:15.361097  8555 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:02:15.356422  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:15.386535  8562 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:15.387959  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:15.378659  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:15.391403  8432 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:15.391872  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:15.392246  8510 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:15.392710  8432 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:15.394037  8405 consensus_queue.cc:1048] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:15.394176  1526 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:15.464607  8405 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:15.465081  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 71010.9us
I20260709 13:02:15.395535  8214 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:15.466387  8357 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:15.403136  2288 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:15.467554  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64545us
I20260709 13:02:15.470280  8546 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:15.472842  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:15.473629  1556 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 19: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:15.426893  8391 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:15.352916  8442 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:15.438791  8524 consensus_meta.cc:287] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.000s
I20260709 13:02:15.313390  8169 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.399437  8562 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:15.476568  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:15.476836  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:15.478004  8207 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.478763  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:15.506124  1553 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:15.480397  1634 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:15.482573  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:15.483984  8400 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:15.511523  1555 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:02:15.512118  1555 pending_rounds.cc:85] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 10
I20260709 13:02:15.512542  1555 pending_rounds.cc:107] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:02:15.512871  1555 raft_consensus.cc:2889] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:15.484972  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:15.496445  1554 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:15.505080  1631 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:15.510476  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 43595.3us
I20260709 13:02:15.516960  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:02:15.509799  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 253377us
I20260709 13:02:15.517488  1675 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:15.520032  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:15.525676  1675 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:15.535063  8421 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:15.536667  8202 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:15.541599  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:15.544257  1631 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:02:15.510118  8562 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.561914  1673 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:15.566699  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:15.505328  8423 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:15.523969  8538 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:15.611205  8572 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.544661  8391 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:15.559993  8402 consensus_meta.cc:287] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.602s	user 0.013s	sys 0.000s
W20260709 13:02:15.614212  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 52494us
I20260709 13:02:15.555053  8405 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:15.548871  8350 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:15.622412  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:15.492508  8524 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:15.546443  8528 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:15.553591  8432 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.546831  8527 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:15.615239  1558 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
W20260709 13:02:15.620529  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.613016  8445 consensus_meta.cc:287] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.659s	user 0.013s	sys 0.000s
I20260709 13:02:15.629906  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:15.633220  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:15.631100  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:15.616026  8538 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:15.528448  8207 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.613651  8562 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:15.632706  8528 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.614465  8510 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:15.612003  7996 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:02:15.632405  8527 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:15.639139  1705 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:15.658643  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:15.638507  1709 raft_consensus.cc:1240] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:15.643245  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:15.660727  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:15.614773  8523 consensus_queue.cc:1048] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:02:15.651443  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:15.657485  2328 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:02:15.647078  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:15.663942  1706 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:15.675478  2320 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:15.634292  8214 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:15.615406  8423 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:15.655437  8415 consensus_meta.cc:287] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.718s	user 0.012s	sys 0.000s
I20260709 13:02:15.692045  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:02:15.651571  8574 log.cc:927] Time spent T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:02:15.690461  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:15.650982  8403 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:15.646981  8350 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:15.624768  8402 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.658087  8538 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:15.654276  8448 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:15.657086  8528 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.654151  8302 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:02:15.705152  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:15.701421  8524 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:15.654280  8095 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:02:15.705729  8540 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.695865  8028 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.666827  8527 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:15.712651  8415 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.699323  8405 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:15.717881  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 199721us
I20260709 13:02:15.651898  8460 consensus_queue.cc:1048] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:02:15.747027  1601 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:15.651588  8391 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:02:15.652598  8169 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:15.653221  8421 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:15.653095  8207 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:15.720574  2320 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 19: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:15.688861  7996 consensus_queue.cc:1243] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:02:15.619765  8572 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.635864  8445 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.730340  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:02:15.729722  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 92242.1us
I20260709 13:02:15.742039  1703 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:15.648547  8432 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:15.781687  1559 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.782009  2322 raft_consensus.cc:1240] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:15.629277  8357 consensus_queue.cc:1059] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:02:15.751821  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:15.727566  8448 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:15.755939  1557 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:15.720422  8350 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:02:15.765898  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 47024.3us
I20260709 13:02:15.782608  1673 leader_election.cc:400] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 19.
I20260709 13:02:15.748795  8199 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:15.789287  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:15.790045  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 62464.9us
I20260709 13:02:15.790442  1599 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:15.796375  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:15.798331  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:15.799600  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:15.800484  1632 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20.
I20260709 13:02:15.792043  8350 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:15.804461  1630 raft_consensus.cc:2393] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 18: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
W20260709 13:02:15.808352  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 67236us
I20260709 13:02:15.828239  8391 consensus_queue.cc:1059] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:15.803772  2288 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:15.777376  8395 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:15.830906  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:15.832396  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:15.833602  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:15.794716  8155 consensus_meta.cc:287] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.797s	user 0.013s	sys 0.000s
I20260709 13:02:15.834800  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:15.849448  1552 raft_consensus.cc:2393] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 21: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:15.849515  1706 raft_consensus.cc:3060] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:15.749651  8028 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:15.852834  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:15.853264  8583 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:02:15.853591  1557 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:15.854115  8028 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:02:15.854463  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:15.849013  8405 raft_consensus.cc:3055] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:15.856988  8405 raft_consensus.cc:740] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:15.857030  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:15.857939  8405 consensus_queue.cc:260] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.859148  8405 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:15.861721  8415 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:15.861888  8445 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:15.862447  8415 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:15.863222  8415 raft_consensus.cc:697] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:15.865094  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:15.865980  1552 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:15.866811  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:15.867527  1552 raft_consensus.cc:2393] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 21: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:15.869937  8432 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:15.873628  8402 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:15.868309  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:15.873894  8397 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:15.874466  8397 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.874909  8397 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:15.876461  8155 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:15.877556  8436 consensus_meta.cc:287] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.761s	user 0.010s	sys 0.001s
I20260709 13:02:15.873930  1559 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:02:15.788113  8581 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:15.885989  1706 raft_consensus.cc:1275] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:15.886140  1553 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 22.
I20260709 13:02:15.887452  1557 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:15.893291  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:15.803805  8580 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.749811  8562 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.797699  8510 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:15.899791  2320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "327c042262d94ababf63c12c177e29ed"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:02:15.904486  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39868 (request call id 3459) took 1037 ms. Trace:
I20260709 13:02:15.787899  8403 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.097s
I20260709 13:02:15.907142  2320 raft_consensus.cc:606] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:15.913030  2320 raft_consensus.cc:614] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:15.907081  1704 rpcz_store.cc:276] 0709 13:02:14.858269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.859239 (+   970us) service_pool.cc:224] Handling call
0709 13:02:15.895274 (+1036035us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b5400265554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:15.895378 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822098176}
I20260709 13:02:15.914151  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:15.915490  1553 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:02:15.914067  1599 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:15.796661  8481 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.099s
I20260709 13:02:15.878001  8436 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:15.937923  7843 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.818s	user 0.010s	sys 0.000s
I20260709 13:02:15.938863  8436 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:15.938586  7843 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:15.940011  8584 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:15.864212  8415 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:15.941872  8425 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.706s	user 0.005s	sys 0.006s
I20260709 13:02:15.942334  8425 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.935495  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58616 (request call id 1479) took 1304 ms. Trace:
I20260709 13:02:15.898797  8125 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.943856  2323 rpcz_store.cc:276] 0709 13:02:14.630966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.637810 (+  6844us) service_pool.cc:224] Handling call
0709 13:02:15.935070 (+1297260us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54005474d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:15.935429 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217243904}
I20260709 13:02:15.850210  8207 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:02:15.954557  1599 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:02:15.957772  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 147729us
I20260709 13:02:15.944523  8576 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:15.967104  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 163563us
I20260709 13:02:15.971953  1632 raft_consensus.cc:1217] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Deduplicated request from leader. Original: 19.10->[20.11-22.12]   Dedup: 20.11->[22.12-22.12]
I20260709 13:02:15.972607  1632 raft_consensus.cc:1240] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 22. Current term is 23. Ops: [20.11-22.12]
I20260709 13:02:15.957410  8572 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:15.912806  8510 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:15.960916  8479 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:15.982487  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:16.003827  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:16.007634  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:16.008209  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:16.008884  1631 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:16.009240  1634 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:02:16.009078  1673 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:15.909489  8580 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.016252  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:15.899101  8581 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.021564  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:16.031293  1627 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
W20260709 13:02:16.022527  8579 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:02:15.958546  8125 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:15.977954  7996 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.004215  8479 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.057248  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:15.980321  8576 raft_consensus.cc:697] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:16.008376  8155 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:16.060766  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 51812.1us
I20260709 13:02:16.067909  1673 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:16.113016  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:16.069578  1673 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:16.081682  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:16.087162  2320 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:02:16.144932  1558 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:16.155864  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:02:16.158885  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 410607us
I20260709 13:02:16.163090  1601 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:16.062515  8089 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:16.164381  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:02:16.113929  8593 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:02:16.117681  8592 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:02:16.062512  8479 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:16.163642  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:02:16.070896  8588 log.cc:927] Time spent T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:02:16.073499  7843 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:16.067204  8425 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:16.168419  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.081477  8562 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:16.168294  8388 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:16.117856  8523 raft_consensus.cc:3055] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:02:16.171003  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 101554us
I20260709 13:02:16.519212  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:16.169025  8436 consensus_queue.cc:1059] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:16.113663  8125 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:16.172690  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:16.294844  8405 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:16.474538  8391 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:16.475425  8089 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:16.145901  8528 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:16.477424  8513 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:16.074810  8397 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.527920  8602 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:16.529217  8397 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:16.529946  8528 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:16.531708  1702 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:16.478350  8540 consensus_meta.cc:287] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.713s	user 0.000s	sys 0.014s
I20260709 13:02:16.166292  8403 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:16.287891  8576 consensus_queue.cc:237] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:16.480033  8262 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:16.481469  8613 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:16.517906  8523 raft_consensus.cc:740] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:16.551615  8523 consensus_queue.cc:260] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:16.525216  8405 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.552982  8405 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:16.553082  8523 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:16.539294  8403 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.554437  8403 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:16.554744  8562 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:16.555331  8562 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.557703  8562 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:16.481036  8581 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:16.064643  7996 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.294474  8448 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.073805  8460 consensus_queue.cc:1059] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.102s
I20260709 13:02:16.116412  8350 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.485428  1554 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:16.144716  8527 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:16.493362  1558 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
W20260709 13:02:16.494613  8606 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.146s	user 0.005s	sys 0.001s
I20260709 13:02:16.501304  8479 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:16.581925  8479 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
W20260709 13:02:16.502139  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 563097us
W20260709 13:02:16.502858  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 530603us
I20260709 13:02:16.583019  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:16.151777  8586 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:16.561484  8600 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:02:16.270504  8302 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.477461  8580 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:16.523087  1673 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:16.520998  8125 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:16.538654  1556 pending_rounds.cc:85] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Aborting all ops after (but not including) 10
I20260709 13:02:16.514376  8388 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:16.542994  8513 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:16.532765  8604 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:16.542883  8545 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.543404  8540 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:16.560359  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:02:16.520361  8538 consensus_meta.cc:287] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.778s	user 0.016s	sys 0.001s
I20260709 13:02:16.585835  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:16.543686  8391 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.071439  8423 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:16.613785  2325 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:16.614866  1556 pending_rounds.cc:107] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:02:16.648725  1556 raft_consensus.cc:2889] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:16.625280  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 102360us
I20260709 13:02:16.650382  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:16.635393  2320 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 21.
I20260709 13:02:16.588125  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:16.651942  1558 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:16.639540  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:16.641089  1675 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:16.653483  2321 raft_consensus.cc:3060] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:16.655870  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.611231  8581 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:16.623463  8388 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:16.682078  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 60090.6us
I20260709 13:02:16.624617  8563 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:16.682137  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 54094us
W20260709 13:02:16.641108  8610 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.153s	user 0.002s	sys 0.000s
I20260709 13:02:16.680348  1675 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:16.626418  8586 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:16.690623  1673 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:16.686455  1552 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:02:16.701289  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:16.710072  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:16.711517  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:16.712291  1631 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:16.614403  8302 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.623395  8125 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:16.692745  8582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.006s	sys 0.044s
I20260709 13:02:16.681753  8028 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:16.703462  8423 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:16.681293  8430 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:16.786309  8423 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:16.786464  8430 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:16.787168  8423 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:16.778240  8600 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:02:16.790724  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 1487) took 1161 ms. Trace:
I20260709 13:02:16.714704  8262 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:16.636783  8169 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
W20260709 13:02:16.740955  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.770319  8611 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:02:16.702346  8562 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.702553  8460 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:16.642307  8545 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.551143  8613 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.644951  8538 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:16.717733  8395 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.087s
I20260709 13:02:16.691681  8563 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:16.794394  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 76230us
W20260709 13:02:16.765380  8582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.007s	sys 0.044s
I20260709 13:02:16.691788  8581 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.711562  8614 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:16.818698  8562 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.791431  2329 rpcz_store.cc:276] 0709 13:02:15.628979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.629099 (+   120us) service_pool.cc:224] Handling call
0709 13:02:15.656981 (+ 27882us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:15.657405 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:15.819386 (+161981us) log.cc:844] Serialized 14 byte log entry
0709 13:02:15.901904 (+ 82518us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:15.923384 (+ 21480us) log.cc:844] Serialized 52 byte log entry
0709 13:02:15.923549 (+   165us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:15.923770 (+   221us) log.cc:844] Serialized 14 byte log entry
0709 13:02:15.927035 (+  3265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.927704 (+   669us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.501776 (+574072us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b18004a0860. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed6912c0a 00007f0ee0052219 00007f0edd95958f 00007f0ed6998571 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd
0709 13:02:16.790472 (+288696us) raft_consensus.cc:1685] finished
0709 13:02:16.790499 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.790660 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":577397,"prepare.queue_time_us":232311,"prepare.run_cpu_time_us":153,"prepare.run_wall_time_us":153,"raft.queue_time_us":6570,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":15962,"spinlock_wait_cycles":10286976,"thread_start_us":241883,"threads_started":2,"wal-append.queue_time_us":356409}
I20260709 13:02:16.710062  8519 consensus_queue.cc:1048] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.087s
I20260709 13:02:16.817442  2321 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 19.
W20260709 13:02:16.793606  1553 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.042s	sys 0.084s
W20260709 13:02:16.862848  1553 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.043s	sys 0.085s
I20260709 13:02:16.826396  8388 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.827435  8423 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:16.830783  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 1485) took 1205 ms. Trace:
I20260709 13:02:16.814777  8479 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:16.833627  8318 raft_consensus.cc:3055] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:16.834335  8302 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:16.834573  8421 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:16.812144  1631 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:02:16.910475  2320 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:02:16.793630  8028 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:16.854859  8145 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:02:16.870287  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.842526  8563 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:16.924679  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:16.872844  2328 rpcz_store.cc:276] 0709 13:02:15.625226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.625424 (+   198us) service_pool.cc:224] Handling call
0709 13:02:15.625722 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.668612 (+ 42890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.830444 (+1161832us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b540076fcd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:16.830700 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72262912}
I20260709 13:02:16.880861  8620 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:16.845605  8262 raft_consensus.cc:697] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:16.912637  1632 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:16.912024  8611 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:02:16.924520  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:16.903487  8318 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:16.949939  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:16.950836  1703 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:16.904606  8624 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:16.923296  8418 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.954130  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:16.956677  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:16.911931  8421 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:16.925926  8448 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:16.923202  7996 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:16.919929  8578 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.967875  1709 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20.
I20260709 13:02:16.969336  1708 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:16.972028  8635 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:16.981338  8590 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.945602  8620 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.928969  8145 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.982126  8318 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.958904  8391 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:16.968902  8418 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:16.982162  8388 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:17.030494  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3506) took 1085 ms. Trace:
I20260709 13:02:17.030987  1556 rpcz_store.cc:276] 0709 13:02:15.945326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.533270 (+587944us) service_pool.cc:224] Handling call
0709 13:02:16.538354 (+  5084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:16.688656 (+150302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.688692 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:16.700210 (+ 11518us) log.cc:844] Serialized 26 byte log entry
0709 13:02:16.945648 (+245438us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:16.945805 (+   157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.945901 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.030238 (+ 84337us) raft_consensus.cc:1685] finished
0709 13:02:17.030258 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.030411 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":169681,"threads_started":1,"wal-append.queue_time_us":306717}
I20260709 13:02:16.984795  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2851) took 1019 ms. Trace:
I20260709 13:02:17.007165  8635 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:17.032728  1559 rpcz_store.cc:276] 0709 13:02:15.965660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.557766 (+592106us) service_pool.cc:224] Handling call
0709 13:02:16.558132 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:16.558552 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.558581 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:16.559037 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:02:16.864360 (+305323us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:16.864431 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.864537 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.984521 (+119984us) raft_consensus.cc:1685] finished
0709 13:02:16.984559 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.984738 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":242,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":305005,"threads_started":1,"wal-append.queue_time_us":369962}
I20260709 13:02:17.034912  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:17.035496  1559 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:17.036922  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2850) took 1225 ms. Trace:
W20260709 13:02:17.039266  8616 log.cc:927] Time spent T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 13:02:17.038029  1553 rpcz_store.cc:276] 0709 13:02:15.811145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.970635 (+159490us) service_pool.cc:224] Handling call
0709 13:02:15.970922 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:16.006402 (+ 35480us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:16.863410 (+857008us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.985906 (+122496us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.986502 (+   596us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:16.986980 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:02:16.987099 (+   119us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:16.987140 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.987204 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.036400 (+ 49196us) raft_consensus.cc:1685] finished
0709 13:02:17.036428 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.036832 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11077,"prepare.queue_time_us":906207,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":2703,"raft.queue_time_us":34652,"raft.run_cpu_time_us":489,"raft.run_wall_time_us":33296,"thread_start_us":828838,"threads_started":2,"wal-append.queue_time_us":46449}
I20260709 13:02:16.984318  8405 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:16.993023  2323 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:17.041962  8262 consensus_queue.cc:237] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:17.048949  1553 raft_consensus.cc:1240] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:02:17.011909  8620 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:16.964895  8624 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:17.018209  8617 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:02:17.016063  8421 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:17.024570  8481 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:17.031781  8145 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.042563  8405 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:16.909271  8479 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.012346  8590 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:17.051542  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2852) took 1084 ms. Trace:
I20260709 13:02:17.074195  8479 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:17.074121  1553 rpcz_store.cc:276] 0709 13:02:15.966793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.040153 (+1073360us) service_pool.cc:224] Handling call
0709 13:02:17.048711 (+  8558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.051234 (+  2523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.051480 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.076081  1553 raft_consensus.cc:1275] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:02:17.078262  1553 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:02:17.079453  1553 raft_consensus.cc:1240] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:17.081399  8318 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:17.069866  8481 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:17.085131  8403 consensus_meta.cc:287] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 13:02:17.085567  8403 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.087477  8421 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:17.055769  1559 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:02:17.087605  8403 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:17.100310  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:17.103226  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:02:17.104023  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 94170.4us
I20260709 13:02:17.004233  8578 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.108420  2326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38"
dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33322
I20260709 13:02:17.109899  2326 raft_consensus.cc:606] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:17.111047  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:17.121610  8581 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.121757  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.122556  1709 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:02:17.123672  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.100871  8405 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.124899  8405 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.127568  8405 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:17.128500  1559 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:17.133904  8624 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:17.134625  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:17.100104  8391 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:17.142823  8578 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:17.112867  8538 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.143426  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:17.146317  8547 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:17.155704  8350 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:17.156386  1704 raft_consensus.cc:2393] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 15: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:17.159139  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.160122  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.160807  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.177341  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:17.162068  8527 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:17.162719  8510 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:17.162786  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 3232) took 1519 ms. Trace:
I20260709 13:02:17.179091  1705 rpcz_store.cc:276] 0709 13:02:15.643663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.662878 (+ 19215us) service_pool.cc:224] Handling call
0709 13:02:15.663212 (+   334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:15.708694 (+ 45482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.708733 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:15.709336 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 13:02:15.911545 (+202209us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:16.137506 (+225961us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.621055 (+483549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.162330 (+541275us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b54000a6c54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:17.162393 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.162460 (+    67us) raft_consensus.cc:1685] finished
0709 13:02:17.162561 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.162730 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69928,"prepare.queue_time_us":381284,"prepare.run_cpu_time_us":5556,"prepare.run_wall_time_us":129974,"raft.queue_time_us":354834,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":189,"spinlock_wait_cycles":71421184,"thread_start_us":836980,"threads_started":3,"wal-append.queue_time_us":260009}
I20260709 13:02:17.163828  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:17.124300  1709 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 21.
W20260709 13:02:17.173565  1558 consensus_meta.cc:287] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
I20260709 13:02:17.161607  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.185416  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:17.187122  1558 raft_consensus.cc:2468] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 19.
I20260709 13:02:17.183916  1672 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:17.187994  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:17.188846  1558 raft_consensus.cc:2368] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18.
I20260709 13:02:17.187543  1632 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:02:17.195104  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:17.196880  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.197937  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:17.201499  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:17.202895  1627 raft_consensus.cc:2410] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:02:17.201545  1632 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:17.176429  8391 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:17.204890  8548 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:17.205752  8481 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.207021  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:17.207513  8391 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.208070  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.190052  8510 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:02:17.197714  8350 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:17.209038  2326 raft_consensus.cc:2410] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:02:17.209177  8350 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:17.176009  8547 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.210180  8350 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.211201  8547 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:17.184862  8620 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:17.213605  8430 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.219491  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:17.221263  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.221385  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.228320  1708 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:02:17.231832  1703 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22.
I20260709 13:02:17.237880  1523 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:17.238631  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:17.225417  1598 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:17.232100  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47910 (request call id 3508) took 1147 ms. Trace:
I20260709 13:02:17.240854  1556 rpcz_store.cc:276] 0709 13:02:16.085109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.047286 (+962177us) service_pool.cc:224] Handling call
0709 13:02:17.047754 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.047977 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:17.048305 (+   328us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.231628 (+183323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:17.231706 (+    78us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:17.231782 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.231875 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.232030 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":571,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":2568,"thread_start_us":182523,"threads_started":1}
I20260709 13:02:17.246788  1632 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:02:17.252172  2322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 1486) took 1625 ms. Trace:
I20260709 13:02:17.252863  2322 rpcz_store.cc:276] 0709 13:02:15.626477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.626591 (+   114us) service_pool.cc:224] Handling call
0709 13:02:15.626854 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.782409 (+155555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.251932 (+1469523us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400529254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:17.252116 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356612352}
I20260709 13:02:17.254544  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:17.250541  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2847) took 1511 ms. Trace:
I20260709 13:02:17.255187  1708 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:17.255425  1554 rpcz_store.cc:276] 0709 13:02:15.738762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.856771 (+118009us) service_pool.cc:224] Handling call
0709 13:02:17.250369 (+1393598us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400050ad4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:17.250475 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725967104}
W20260709 13:02:17.257371  1526 leader_election.cc:336] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.533s (SENT)
I20260709 13:02:17.257467  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:17.257973  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:17.258400  1554 raft_consensus.cc:2368] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19.
I20260709 13:02:17.263103  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.262936  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:17.264038  1708 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:02:17.265753  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:17.266918  1708 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.269131  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:17.239612  8481 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:17.275158  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:17.259181  8391 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:17.275888  1558 raft_consensus.cc:2368] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 15. Current term is 16.
I20260709 13:02:17.237720  8538 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:02:17.275466  1627 raft_consensus.cc:1240] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:17.274937  8481 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.246256  8625 raft_consensus.cc:2804] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:17.292055  1627 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:17.243268  8419 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:17.296195  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47912 (request call id 2849) took 1556 ms. Trace:
I20260709 13:02:17.297596  1552 rpcz_store.cc:276] 0709 13:02:15.739533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.868044 (+128511us) service_pool.cc:224] Handling call
0709 13:02:17.296020 (+1427976us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b5400056ed4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:17.296140 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1858889984}
I20260709 13:02:17.260865  8510 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.279778  8318 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:17.309353  1708 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:17.304347  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:17.279978  8460 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:17.305162  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:17.310694  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:17.280675  8581 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:17.295288  8590 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.282253  8403 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:02:17.327060  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.307111  8089 raft_consensus.cc:3055] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:17.349284  8481 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:17.350852  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:17.351326  8563 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.353500  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39878 (request call id 3227) took 1717 ms. Trace:
I20260709 13:02:17.353943  1702 rpcz_store.cc:276] 0709 13:02:15.635559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.639122 (+  3563us) service_pool.cc:224] Handling call
0709 13:02:15.666932 (+ 27810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.532214 (+865282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.353219 (+821005us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54002f2954. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:17.353430 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1989284096}
I20260709 13:02:17.355093  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:17.356770  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:02:17.357259  1673 leader_election.cc:336] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.035s (SENT)
I20260709 13:02:17.281733  8262 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:17.325773  1701 raft_consensus.cc:2368] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16.
I20260709 13:02:17.285571  8523 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:17.312217  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:17.360124  1552 raft_consensus.cc:3060] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:17.328685  8604 consensus_meta.cc:287] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.694s	user 0.003s	sys 0.007s
I20260709 13:02:17.361267  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.340224  8581 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.310802  8510 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.342850  8528 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:17.343362  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:17.343886  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:17.356850  2324 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:02:17.357741  1673 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:17.366582  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:17.366637  8403 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:17.367900  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.358063  2288 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:17.370251  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:17.370519  8155 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:17.370926  8155 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.371218  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:17.371868  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.372135  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:17.310993  8625 raft_consensus.cc:697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:02:17.362740  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 3231) took 1726 ms (client timeout 1861 ms). Trace:
I20260709 13:02:17.365237  8528 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:17.369056  8425 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:17.368959  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.372277  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.380123  1673 leader_election.cc:400] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18.
I20260709 13:02:17.340040  8460 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:17.314236  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.382318  1708 raft_consensus.cc:2393] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 19: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:02:17.374758  1701 rpcz_store.cc:269] 0709 13:02:15.643283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.654396 (+ 11113us) service_pool.cc:224] Handling call
0709 13:02:17.310554 (+1656158us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b5800011798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 13:02:17.362674 (+ 52120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9375616}
I20260709 13:02:17.305650  8419 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.376616  2288 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:17.378402  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:17.385993  2329 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:17.347203  8089 raft_consensus.cc:740] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:17.380574  1673 leader_election.cc:403] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:02:17.371428  8155 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:17.380874  8519 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:17.387652  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:17.362761  8622 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:17.388986  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:17.389508  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.392985  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.390751  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.394179  1708 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 23: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:17.397332  1702 raft_consensus.cc:2393] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 17: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:17.398734  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.399091  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.400122  2322 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:17.400297  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.403198  1708 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 12.
I20260709 13:02:17.371744  8523 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:17.404534  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.406095  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.380978  8415 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:17.362434  8262 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:17.388742  8604 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:17.381057  8202 consensus_queue.cc:1059] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:02:17.385716  8405 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.409062  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.384325  8448 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:17.392378  8519 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:17.417862  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.409864  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:17.396719  8169 raft_consensus.cc:2804] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:17.421288  1702 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 17: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:17.468739  1703 raft_consensus.cc:2468] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:02:17.444149  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:17.471359  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.403549  8622 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:17.482484  2328 raft_consensus.cc:2410] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:02:17.484155  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:17.485076  1552 raft_consensus.cc:2468] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22.
I20260709 13:02:17.485330  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:17.486012  1557 raft_consensus.cc:2393] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:17.487144  2329 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:17.487907  1557 raft_consensus.cc:1240] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:17.446638  8519 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.445863  1673 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:17.416069  8425 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.493307  8563 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:17.495270  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 331358us
I20260709 13:02:17.495836  8604 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:17.496459  8604 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.496969  8604 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:17.499177  1557 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:17.457551  8510 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:17.458359  8262 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:17.458567  8460 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:17.409473  8415 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:17.459607  8528 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:17.460161  8089 consensus_queue.cc:260] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.461472  8523 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:17.459649  8448 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:17.462159  8039 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:02:17.462409  8650 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:02:17.463630  8625 consensus_queue.cc:237] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.422058  8350 consensus_queue.cc:1059] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:02:17.448320  8405 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:17.465415  8202 consensus_queue.cc:1243] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer e4c78b411eb34b3d92183a86d34a81f1 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:02:17.466804  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.466989  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3463) took 2600 ms. Trace:
I20260709 13:02:17.488276  8207 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.491387  1552 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:02:17.492118  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:02:17.492290  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 46557.1us
I20260709 13:02:17.477921  8169 raft_consensus.cc:697] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:17.519687  8448 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.520448  8169 consensus_queue.cc:237] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.525023  8405 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.525470  8538 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:17.525813  8207 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.526301  8538 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.529009  8538 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:17.500542  1557 raft_consensus.cc:1240] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:02:17.503217  8415 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:17.528400  1523 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:17.520301  8419 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:17.539252  8538 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:17.541118  8538 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.541674  8538 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:17.514176  8039 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.547119  8039 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:17.509339  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 94780.5us
I20260709 13:02:17.513692  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:17.554636  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:17.517349  1551 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:17.508865  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2846) took 1770 ms. Trace:
I20260709 13:02:17.525614  8405 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:17.557791  8405 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:17.536648  1523 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:17.516315  1707 rpcz_store.cc:276] 0709 13:02:14.866144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.867432 (+  1288us) service_pool.cc:224] Handling call
0709 13:02:14.893402 (+ 25970us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:15.550433 (+657031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.550464 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:15.618551 (+ 68087us) log.cc:844] Serialized 52 byte log entry
0709 13:02:15.726371 (+107820us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:15.988919 (+262548us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.157950 (+169031us) log.cc:844] Serialized 14 byte log entry
0709 13:02:16.637701 (+479751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.080329 (+442628us) spinlock_profiling.cc:243] Waited 7.51 ms on lock 0x7b180039e020. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:02:17.274094 (+193765us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b180039e020. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed69983f3 00007f0ed699a7c1 00007f0ed699a779 00007f0ed699a709 00007f0ed699a6d1 00007f0ed69999cd 000000000038f354 000000000038f199 00007f0ed697b83a
0709 13:02:17.466685 (+192591us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400396554. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:17.466727 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.466775 (+    48us) raft_consensus.cc:1685] finished
0709 13:02:17.466787 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.466936 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38465,"prepare.queue_time_us":765669,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":4000,"raft.queue_time_us":340627,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":18717,"spinlock_wait_cycles":707551744,"thread_start_us":1259094,"threads_started":5,"wal-append.queue_time_us":281414,"wal-append.run_cpu_time_us":19757,"wal-append.run_wall_time_us":1569335}
W20260709 13:02:17.691262  1526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:42699 timed out after 1.861s (SENT) [suppressed 19 similar messages]
W20260709 13:02:17.690850  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 136545us
I20260709 13:02:17.702843  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:17.703395  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 167104us
I20260709 13:02:17.705466  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:17.707180  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.710556  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.711421  1673 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:17.714334  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:17.716075  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.719247  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:17.623579  8652 log.cc:927] Time spent T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:02:17.557521  1555 rpcz_store.cc:276] 0709 13:02:15.738463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.941272 (+202809us) service_pool.cc:224] Handling call
0709 13:02:15.941598 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.952624 (+ 11026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.952661 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.310313 (+1357652us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b2c00000658. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2
0709 13:02:17.316767 (+  6454us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.397827 (+ 81060us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:17.416768 (+ 18941us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.417050 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.417147 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.502553 (+ 85406us) raft_consensus.cc:1685] finished
0709 13:02:17.508408 (+  5855us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.508765 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20735,"prepare.queue_time_us":18360,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":19078,"raft.queue_time_us":17907,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":33436,"spinlock_wait_cycles":5435392,"thread_start_us":53306,"threads_started":1,"wal-append.queue_time_us":154153}
I20260709 13:02:17.724506  1709 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:17.727416  1675 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:17.730808  8318 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:17.728539  8510 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:17.731433  8318 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:17.701133  8207 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.713768  8202 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:17.724202  8528 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:17.717598  8421 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:17.737711  8578 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:17.684382  8538 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.745914  8155 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.747103  2329 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:02:17.618800  8635 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.748524  8562 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:17.622804  8622 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.624625  8513 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.738910  8604 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:17.747848  8538 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:17.757217  8425 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18.
I20260709 13:02:17.757998  1702 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:17.761288  8415 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.762563  8604 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:17.766940  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:17.739419  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:17.763834  1708 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:17.764055  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:17.743592  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.774858  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 46008us
I20260709 13:02:17.758307  1601 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:17.623958  8125 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.766824  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:17.781040  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:17.767066  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:17.767460  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:17.782903  1555 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
I20260709 13:02:17.768184  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:17.771059  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.786044  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:17.751999  8523 raft_consensus.cc:3055] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:17.770646  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:17.769022  2329 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:17.762439  8405 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.561691  8357 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:17.771786  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:17.777381  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:02:17.796005  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 68738.7us
I20260709 13:02:17.796262  2328 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:17.738940  8421 raft_consensus.cc:697] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:17.778421  1557 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 19: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:17.779389  1601 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:17.774287  8512 raft_consensus.cc:3055] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:17.801424  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:17.791888  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:17.778839  8403 consensus_queue.cc:1059] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:02:17.792927  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:17.790232  1552 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:02:17.794680  1705 raft_consensus.cc:2368] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16.
I20260709 13:02:17.796947  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:17.797915  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:17.799131  8578 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:17.789492  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:17.807601  8403 raft_consensus.cc:3055] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:17.789762  8202 consensus_queue.cc:1059] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:02:17.809413  8415 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.809654  8350 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:02:17.810452  8663 log.cc:927] Time spent T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.101s	user 0.004s	sys 0.000s
I20260709 13:02:17.810565  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:17.734063  8318 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.785455  7843 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:17.773077  1551 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22.
I20260709 13:02:17.794194  8523 raft_consensus.cc:740] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:17.799906  8538 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:17.788075  8624 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:02:17.779953  8635 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:02:17.801826  8512 raft_consensus.cc:740] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:17.791005  8302 consensus_queue.cc:1059] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:02:17.831473  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:17.803634  8348 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:17.836251  2328 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:17.823087  8576 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:17.813349  8604 consensus_queue.cc:1059] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:02:17.808508  8403 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:17.869110  1631 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
W20260709 13:02:17.880501  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 49145.3us
I20260709 13:02:17.885591  1675 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:17.864478  1523 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:17.863159  8425 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:17.890427  8405 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:17.901536  8405 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 19 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:17.903373  8405 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.892935  8421 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.891498  8628 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:17.894785  8604 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:17.864127  8612 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:02:17.908228  8659 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:02:17.909379  8039 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:02:17.910496  8348 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:17.910882  8348 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:17.911732  8348 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.913363  8348 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:17.916054  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:17.916790  1631 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:17.908044  8612 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:17.871728  8391 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:17.831339  8519 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:17.923979  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 150647us
I20260709 13:02:17.926899  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:17.935216  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:17.943946  1631 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:17.942648  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1368) took 1236 ms. Trace:
I20260709 13:02:17.948664  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:17.950309  2328 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:17.922468  8615 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:17.951031  1627 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:17.934044  8532 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:17.943053  8302 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:17.894014  8523 consensus_queue.cc:260] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.926316  8391 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.955658  8155 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:17.925345  8512 consensus_queue.cc:260] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.975857  8619 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:02:17.958945  8615 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:17.960878  8357 consensus_queue.cc:1059] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:02:17.950662  8403 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:18.025408  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 76884.4us
W20260709 13:02:18.029819  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.032336  1526 leader_election.cc:400] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16.
I20260709 13:02:18.032982  1526 leader_election.cc:403] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:02:17.956496  8612 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.008574  8302 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:18.002007  8510 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:17.986876  8214 consensus_queue.cc:1059] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
W20260709 13:02:18.045281  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 68974.8us
W20260709 13:02:18.048081  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.053483  8671 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:18.055588  8391 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:18.056298  8391 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.056937  8391 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.058214  8538 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:18.060884  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:18.034756  8670 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:18.043346  8513 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:18.059466  8661 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:02:18.069156  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 3226) took 2098 ms. Trace:
I20260709 13:02:18.071798  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:18.074331  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:18.047133  8425 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:18.073163  1627 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 19. Current term is 20. Ops: [16.10-19.11]
I20260709 13:02:18.073925  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:18.047354  8302 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:18.062175  8405 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 15. Current term is 16.
I20260709 13:02:18.063717  8403 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:18.075109  1634 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:18.074450  1633 rpcz_store.cc:276] 0709 13:02:15.970970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.971080 (+   110us) service_pool.cc:224] Handling call
0709 13:02:15.980425 (+  9345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.980903 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.980945 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.773775 (+1792830us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b2c000f1738. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed837ea11 00007f0ed838e372 00007f0ed9ac0a01 00007f0ed9a8543a 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2
0709 13:02:17.785660 (+ 11885us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.927400 (+141740us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:17.927439 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.927529 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.060014 (+132485us) raft_consensus.cc:1685] finished
0709 13:02:18.060041 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.069074 (+  9033us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94465,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":8444672,"thread_start_us":124480,"threads_started":1,"wal-append.queue_time_us":160639}
I20260709 13:02:18.086920  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:18.070134  8612 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:18.071070  8635 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.089269  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:18.091060  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:18.094223  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:18.077548  8425 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:18.098353  8425 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.078557  8302 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:18.100205  8425 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:18.102451  8669 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:02:18.102778  8666 log.cc:927] Time spent T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:02:18.084825  8519 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:18.104933  8613 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:18.114596  8662 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:02:18.105814  8357 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:18.081632  8578 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:02:18.108503  1634 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:18.138162  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:18.114802  8676 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:18.118602  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:18.099071  8391 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:18.116155  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:18.145344  1673 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:18.077045  8513 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:18.112380  8673 log.cc:927] Time spent T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:18.126828  8615 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:18.138926  1634 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 14.
I20260709 13:02:18.153474  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:18.116240  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:18.127203  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:18.150661  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:18.158542  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.111281  8635 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.160220  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.167654  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.161378  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.161782  1552 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 19 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:18.158448  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:18.169333  1631 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:18.162761  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.169968  1559 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:18.170439  1557 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:02:18.164505  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.171005  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.164520  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:18.168728  1560 raft_consensus.cc:2393] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 17: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:18.167012  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:18.172508  1558 raft_consensus.cc:3060] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:18.171655  1700 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:18.174396  1706 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 17: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:18.176241  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:18.173314  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.177167  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.152460  8510 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:18.181365  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:18.181602  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 90658.9us
I20260709 13:02:18.184195  1557 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:18.185921  1675 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:18.187795  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.188912  1559 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22.
I20260709 13:02:18.192550  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.192771  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.193665  1559 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:02:18.193688  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:18.160017  8391 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:18.185688  1707 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:02:18.216110  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.221086  1559 raft_consensus.cc:2410] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 20 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:02:18.217706  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.219451  1556 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:02:18.222963  1557 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:18.228461  1558 raft_consensus.cc:2468] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:18.230449  8683 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:18.218637  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:18.232954  8426 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:18.233551  8426 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:18.233964  8426 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:18.174108  8676 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:18.238125  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 52311.1us
I20260709 13:02:18.183650  8604 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:18.237134  2286 leader_election.cc:400] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19.
I20260709 13:02:18.244308  2286 leader_election.cc:403] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:02:18.244479  1601 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:18.185392  8510 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:18.210769  8538 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:18.258379  2286 leader_election.cc:400] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 15. Current term is 16.
I20260709 13:02:18.258931  2286 leader_election.cc:403] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:02:18.236553  8576 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:18.264518  8448 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 15. Current term is 16.
I20260709 13:02:18.256383  8538 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:18.280601  8538 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:18.282379  8513 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:18.255803  8510 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.284952  8357 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.285794  8357 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.260815  8155 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19.
I20260709 13:02:18.243320  8604 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:18.294480  8604 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:18.297361  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:18.298030  8635 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:18.298310  2329 raft_consensus.cc:1813] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Handling vote request from an unknown peer 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:18.299410  2329 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 19: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:18.302172  8357 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:17.948302  1628 rpcz_store.cc:276] 0709 13:02:16.705895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.706261 (+   366us) service_pool.cc:224] Handling call
0709 13:02:17.095042 (+388781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.095261 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:02:17.114835 (+ 19574us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.779466 (+664631us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b180044d760. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed962523a 00007f0ed9a8fa2a
0709 13:02:17.941219 (+161753us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.942276 (+  1057us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:17.942329 (+    53us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:17.942383 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.942462 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.942584 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":761,"prepare.queue_time_us":19569,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":1101,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":3753,"spinlock_wait_cycles":28361216,"thread_start_us":154807,"threads_started":1}
I20260709 13:02:18.322130  8418 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:18.326538  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 3234) took 1048 ms. Trace:
I20260709 13:02:18.327018  1708 rpcz_store.cc:276] 0709 13:02:17.278258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.417389 (+139131us) service_pool.cc:224] Handling call
0709 13:02:18.326316 (+908927us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54002f2454. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:18.326463 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733677952}
I20260709 13:02:18.200242  8679 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:02:18.256470  8613 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:18.263491  2286 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:18.345098  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.346149  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.346966  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.348817  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.349694  1554 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 14: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:18.350764  1553 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:18.352543  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 89211.5us
I20260709 13:02:18.359230  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.365554  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.366400  1556 raft_consensus.cc:2393] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 17: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:18.367693  8538 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.368867  8581 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:18.371160  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.341236  8613 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:18.376833  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.383630  8581 consensus_queue.cc:1059] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:18.384020  8302 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:18.385601  8581 raft_consensus.cc:3055] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:18.386343  8581 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:18.387230  8302 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:18.382632  8426 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.391372  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.392156  1556 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 10.
I20260709 13:02:18.394948  8523 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:18.395869  1554 raft_consensus.cc:1240] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:18.396675  8426 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:18.397332  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.398172  8581 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.398948  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:18.404390  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.364832  8601 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:18.377733  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:02:18.436354  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58738.1us
I20260709 13:02:18.436965  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:18.407794  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 151436us
I20260709 13:02:18.408456  1560 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:18.437597  2286 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:18.399659  8545 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:18.400735  8613 raft_consensus.cc:3060] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.437970  1675 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:18.437644  1555 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:02:18.447623  1599 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:18.449044  1628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80"
dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
mode: GRACEFUL
new_leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:44138
I20260709 13:02:18.450178  1628 raft_consensus.cc:606] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Received request to transfer leadership to TS e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:18.450852  1628 raft_consensus.cc:614] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:18.493755  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 46250.1us
I20260709 13:02:18.526191  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.526187  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:18.527422  1553 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:18.527690  1555 raft_consensus.cc:2410] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:02:18.525156  8581 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:18.454825  8019 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:18.547252  8019 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.493381  8612 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:18.549226  8612 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:18.551925  8612 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:18.445564  8448 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:18.554178  8448 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:18.555563  8448 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.496542  7843 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:18.498560  8426 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:02:18.557103  8538 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:18.490756  8601 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:18.496618  8682 raft_consensus.cc:2804] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:18.568282  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:18.573357  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.679991  8686 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:02:18.684638  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.503108  8547 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:18.748337  8415 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:18.776252  8415 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.790980  8682 raft_consensus.cc:697] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:02:18.808316  8510 consensus_meta.cc:287] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.000s
I20260709 13:02:18.811115  8510 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:18.813216  8415 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:18.794234  8538 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:18.745817  8686 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:18.822026  8664 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 1.109s	user 0.006s	sys 0.011s
I20260709 13:02:18.823057  8686 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:18.826927  1626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60052 (request call id 3229) took 2819 ms (client timeout 1861 ms). Trace:
W20260709 13:02:18.827709  1626 rpcz_store.cc:269] 0709 13:02:16.006980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.007093 (+   113us) service_pool.cc:224] Handling call
0709 13:02:18.826574 (+2819481us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400204c54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:18.826797 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3805473152}
I20260709 13:02:18.829349  8682 consensus_queue.cc:237] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:18.820168  8538 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.835626  8538 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:18.749048  8547 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.838801  8547 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:18.844038  8510 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:18.845433  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:18.850670  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:18.851188  8612 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:18.851735  8612 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.853018  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:18.853892  1701 raft_consensus.cc:2393] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 20: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:18.853948  8612 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:18.855113  8612 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:18.855831  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.855999  8612 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.859289  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:18.861726  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:18.806401  8425 consensus_meta.cc:287] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.001s
I20260709 13:02:18.862422  8612 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:18.863170  8676 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.004s
I20260709 13:02:18.881034  8676 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:18.881220  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:18.869103  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:18.884163  8532 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:18.884752  8532 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:18.798745  8028 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:18.884963  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:18.886948  8538 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:18.888005  8601 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:18.888613  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:18.891419  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:18.870712  8604 consensus_meta.cc:287] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.000s
I20260709 13:02:18.893277  8604 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:18.894771  1706 raft_consensus.cc:1275] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:02:18.896209  8350 raft_consensus.cc:3055] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:18.896667  8350 raft_consensus.cc:740] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:18.897641  8350 consensus_queue.cc:260] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.874635  8239 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:18.876937  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.901019  1701 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 23.
I20260709 13:02:18.902339  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:18.882139  1633 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:18.903446  1707 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:18.903620  8019 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:18.904922  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.908565  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.908857  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.909433  1700 raft_consensus.cc:2393] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 16: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:18.909616  1703 raft_consensus.cc:2410] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:02:18.910219  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.910349  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.911530  1700 raft_consensus.cc:1240] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:18.912559  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.912403  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58616 (request call id 1502) took 1682 ms. Trace:
I20260709 13:02:18.912981  1675 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:18.914577  8676 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:18.916139  1708 raft_consensus.cc:1240] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:18.908653  1706 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:18.913391  2324 rpcz_store.cc:276] 0709 13:02:17.229830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.244886 (+ 15056us) service_pool.cc:224] Handling call
0709 13:02:17.271447 (+ 26561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.366265 (+ 94818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.912130 (+1545865us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b540076fcd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:18.912340 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195628288}
I20260709 13:02:18.919107  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:18.927129  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.927500  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:18.956507  8089 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:18.963706  8318 raft_consensus.cc:3055] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:18.964375  8318 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:18.965554  8318 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:18.967012  8318 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:18.976817  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 51731.2us
W20260709 13:02:18.977906  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 58923.3us
I20260709 13:02:18.980137  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:18.981895  1701 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:18.993392  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:19.021019  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:18.879915  8613 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:18.977860  8538 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:18.981411  8547 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:02:19.026364  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.983306  8686 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:19.030001  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:18.982427  8690 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:18.985167  8604 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:18.977368  8532 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:19.035441  1634 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.050s	sys 0.090s
W20260709 13:02:19.046589  1634 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.050s	sys 0.090s
W20260709 13:02:19.035319  2286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.028s	sys 0.056s
I20260709 13:02:18.977775  8581 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:19.015061  8615 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:02:19.047145  2286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.028s	sys 0.057s
W20260709 13:02:19.053856  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 616592us
I20260709 13:02:18.999521  8633 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:02:19.040818  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:19.054930  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:19.059993  2324 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:19.047178  8538 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:19.039112  8686 raft_consensus.cc:697] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:19.065197  8601 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.008s
W20260709 13:02:19.075600  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.084214  8612 consensus_queue.cc:1059] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:19.085374  8028 raft_consensus.cc:3055] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:19.085703  8580 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:19.085888  8028 raft_consensus.cc:740] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:19.086647  8580 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.087281  8580 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:19.087411  8028 consensus_queue.cc:260] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:19.036264  8415 consensus_queue.cc:1059] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:02:19.089736  8028 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:19.060555  8155 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:02:19.094344  8155 raft_consensus.cc:3055] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:19.094887  8155 raft_consensus.cc:740] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:19.096812  8689 consensus_queue.cc:1059] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:02:19.034076  8547 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.098466  8612 raft_consensus.cc:3055] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:19.098906  8612 raft_consensus.cc:740] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:02:19.099655  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.100147  8612 consensus_queue.cc:260] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:19.101836  8613 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:19.102487  8612 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:19.106815  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:19.121337  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 141380us
I20260709 13:02:19.123286  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:19.129194  8425 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.130015  8425 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.133554  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:19.100100  8547 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:19.133715  8425 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.055738  8581 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.067803  8538 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:19.056948  8615 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:19.056329  8019 consensus_queue.cc:1059] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:02:19.046538  8690 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:19.118705  8523 consensus_meta.cc:287] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.691s	user 0.012s	sys 0.000s
I20260709 13:02:19.148813  1705 raft_consensus.cc:2468] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:02:19.095881  8155 consensus_queue.cc:260] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.153434  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:19.158973  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.157400  1601 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:19.163816  8155 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:19.165199  8395 raft_consensus.cc:3055] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:19.165635  8395 raft_consensus.cc:740] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:19.166285  8581 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:19.166883  8532 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:19.166431  8395 consensus_queue.cc:260] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:19.167896  8395 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:19.168936  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 128293us
I20260709 13:02:19.169466  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:19.171008  2325 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
W20260709 13:02:19.172961  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 118154us
I20260709 13:02:19.173236  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:19.174861  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:19.150772  8538 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:19.174042  2286 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:19.182653  2286 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:19.185165  2323 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:19.184363  2288 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:19.154999  8425 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.214939  1598 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:19.227828  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 104624us
I20260709 13:02:19.229369  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:02:19.232132  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.226495  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:19.183821  8019 raft_consensus.cc:2804] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:19.183986  8547 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:19.226049  8613 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:19.239394  8318 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:19.252988  8400 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:19.219499  8425 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:19.284755  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.265040  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 80813us
I20260709 13:02:19.215119  8687 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.085s
W20260709 13:02:19.283136  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.290048  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.290340  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:19.290587  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.263453  8019 raft_consensus.cc:697] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:19.284071  8523 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.254359  8547 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:19.295501  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:19.184232  8686 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:19.247439  8045 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:02:19.248844  8448 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:02:19.225826  8688 consensus_queue.cc:1059] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:02:19.266551  8415 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:19.268275  8418 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:19.308890  8699 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:02:19.268410  8697 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:19.311296  8545 raft_consensus.cc:993] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: : Instructing follower e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 13:02:19.269192  8613 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:19.265795  8581 consensus_queue.cc:1048] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:02:19.317952  8523 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.350224  1702 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:02:19.353132  8682 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.353672  8615 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:19.353993  8707 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:19.354522  8707 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.354945  8707 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:19.355293  8681 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.986s	user 0.004s	sys 0.011s
I20260709 13:02:19.355612  8425 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.356544  8690 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:19.356956  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:19.357616  1627 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:02:19.358911  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:19.359138  8614 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.359761  8614 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.325945  8708 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.360468  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47912 (request call id 2874) took 1201 ms. Trace:
I20260709 13:02:19.360570  8512 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:19.360965  8708 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.361938  8614 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.360930  1551 rpcz_store.cc:276] 0709 13:02:18.159462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.159893 (+   431us) service_pool.cc:224] Handling call
0709 13:02:18.164243 (+  4350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.164620 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.164648 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.165089 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.370548 (+205459us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:18.370607 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.370704 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.354699 (+983995us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:19.360192 (+  5493us) raft_consensus.cc:1685] finished
0709 13:02:19.360220 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.360414 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2471,"raft.queue_time_us":1604,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5236,"spinlock_wait_cycles":10037504,"thread_start_us":205116,"threads_started":1,"wal-append.queue_time_us":203126}
I20260709 13:02:19.363271  8697 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.311610  8318 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:19.370817  8318 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:19.311427  8547 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:19.377907  8705 log.cc:927] Time spent T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:02:19.383498  8573 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.386296  1634 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:19.384119  8573 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.368247  8676 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:19.390167  8573 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.393482  8418 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:02:19.396260  1629 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:02:19.396443  8581 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:19.407317  8513 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.407841  8513 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.411672  8513 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.412791  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:19.413447  2326 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:02:19.413749  8633 raft_consensus.cc:3055] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:19.414126  8633 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:19.414796  1598 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:19.414915  8633 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.415637  8239 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:19.416078  8239 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.416195  8633 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:19.396948  8690 raft_consensus.cc:1081] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Signalling peer e4c78b411eb34b3d92183a86d34a81f1 to start an election
I20260709 13:02:19.416523  8239 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:19.430702  8415 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:19.431264  8415 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:19.446664  8415 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:19.419569  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.018s	sys 0.062s
W20260709 13:02:19.463330  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.019s	sys 0.063s
W20260709 13:02:19.463743  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 963743us
I20260709 13:02:19.422812  8620 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:19.464999  8620 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:19.470220  1599 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:19.473105  8531 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:02:19.475159  8531 consensus_queue.cc:1059] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:19.476286  8688 raft_consensus.cc:2804] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:19.476688  8531 raft_consensus.cc:3055] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:19.476966  8688 raft_consensus.cc:697] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:19.477236  8531 raft_consensus.cc:740] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:19.477936  8688 consensus_queue.cc:237] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:19.479782  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:19.480484  1708 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:02:19.480999  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:19.483500  1700 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:19.449405  8460 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.452041  8578 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:02:19.453264  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.418283  8580 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.460839  8707 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:19.471721  8625 consensus_queue.cc:1048] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:19.478065  8531 consensus_queue.cc:260] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:19.353699  8682 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.587532  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:19.402513  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:19.589411  2323 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:19.502295  1675 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:19.515002  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.573796  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:19.575237  2325 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
W20260709 13:02:19.592006  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 89887.4us
I20260709 13:02:19.593011  2328 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:02:19.336265  8613 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:19.618580  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:19.619606  2324 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 12.
I20260709 13:02:19.585354  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:19.565243  8677 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.564962  8573 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.578274  8460 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:19.637440  1672 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:19.647828  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:19.655563  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:19.629186  8578 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:19.662688  2323 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:19.656760  2326 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:19.658285  1672 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:19.632318  8425 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.650358  8426 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.579888  8239 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.634619  8523 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.581507  8620 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.584472  8395 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:02:19.644698  8262 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.682200  8426 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:19.694602  8460 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:02:19.695804  8426 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:19.667384  8676 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:19.640731  8214 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:02:19.584280  8513 consensus_queue.cc:1175] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" responder_term: 17 status { last_received { term: 17 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 17 index: 10 } }
I20260709 13:02:19.699978  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:19.700181  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:19.701785  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.640538  8677 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.666791  8578 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:19.704499  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.578931  8019 consensus_queue.cc:237] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:19.640861  8573 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:19.702466  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 520127us
I20260709 13:02:19.714226  1704 raft_consensus.cc:2410] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260709 13:02:19.717844  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 488809us
I20260709 13:02:19.706626  8523 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:19.707535  8676 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.732422  8689 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.680787  8425 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.749716  1599 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:19.716944  8578 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:19.724002  8619 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.702528  8262 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.755419  1599 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:19.740051  8523 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.745431  8676 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:19.716970  8538 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.767473  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:19.769295  1599 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:19.772984  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.746078  8713 consensus_queue.cc:1059] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:02:19.772159  8395 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:19.762418  8523 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:19.761283  8625 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:19.782425  2323 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:19.752535  8689 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.773917  8547 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.800137  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39878 (request call id 3251) took 1627 ms. Trace:
I20260709 13:02:19.800534  1704 rpcz_store.cc:276] 0709 13:02:18.172943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.173063 (+   120us) service_pool.cc:224] Handling call
0709 13:02:19.799896 (+1626833us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54003ec1d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:19.800067 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3531175680}
I20260709 13:02:19.801102  8547 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:19.801812  2329 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:19.795147  8350 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:19.803663  8318 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:19.805503  8510 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:19.805922  8510 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:19.806732  8510 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.809559  8262 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.810472  8697 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.811643  8697 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:19.812004  1707 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:02:19.773669  8612 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:19.761811  8619 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.816057  8689 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.791157  8239 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.792737  8415 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:19.789485  8677 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.797127  8425 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.817512  8677 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:19.798319  8573 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.818028  8677 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:19.819667  8531 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:19.819911  8677 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:19.790843  8538 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.824096  8676 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.825582  1709 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 18: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:19.789630  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 3013) took 1295 ms. Trace:
W20260709 13:02:19.813421  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 1350) took 4647 ms (client timeout 1992 ms). Trace:
W20260709 13:02:19.829528  1629 rpcz_store.cc:269] 0709 13:02:15.165612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.172725 (+  7113us) service_pool.cc:224] Handling call
0709 13:02:19.813142 (+4640417us) spinlock_profiling.cc:243] Waited 4.22 s on lock 0x7b54000e6854. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:19.813294 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9715506560}
W20260709 13:02:19.839273  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 57101.6us
I20260709 13:02:19.840539  1599 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:19.827603  1631 rpcz_store.cc:276] 0709 13:02:18.494161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.494325 (+   164us) service_pool.cc:224] Handling call
0709 13:02:18.536977 (+ 42652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.685782 (+148805us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:18.686057 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.686249 (+   192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.686293 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:18.686346 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.789374 (+1103028us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54000d9dd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:19.789430 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.789548 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":695,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":883,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":341689728}
I20260709 13:02:19.804265  8318 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.788875  8707 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:19.790223  8580 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:19.900775  1525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.004s	sys 0.024s
W20260709 13:02:19.901304  1525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.004s	sys 0.024s
I20260709 13:02:19.847077  8318 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:19.907627  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.901855  8620 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.949931  8613 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.914427  8714 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.953095  8714 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.955852  8714 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.958097  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 1347) took 1053 ms. Trace:
I20260709 13:02:19.958981  1707 rpcz_store.cc:276] 0709 13:02:18.904541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.904667 (+   126us) service_pool.cc:224] Handling call
0709 13:02:19.957883 (+1053216us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b5400265a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:19.958026 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2085563776}
I20260709 13:02:19.962989  8708 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.966153  8442 raft_consensus.cc:3055] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:19.966689  8442 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:19.952464  8613 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:19.967756  8442 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:19.981947  8682 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:19.998306  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 340279us
I20260709 13:02:19.983691  8619 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:20.003335  2288 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.008s	sys 0.016s
W20260709 13:02:20.003842  2288 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.008s	sys 0.016s
W20260709 13:02:20.004271  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 707939us
I20260709 13:02:20.005303  1672 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:20.010813  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.011505  2329 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
W20260709 13:02:20.012261  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 289988us
I20260709 13:02:20.001276  8318 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:20.020514  2288 leader_election.cc:336] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.992s (SENT)
I20260709 13:02:20.022095  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.022701  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:20.027624  1707 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:20.027441  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:20.028707  1702 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 22.
I20260709 13:02:20.003921  8676 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.023582  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.032766  2321 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:20.024531  8622 consensus_queue.cc:1059] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 13:02:20.025082  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.025542  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.035279  2323 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:02:20.026145  8442 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:20.026507  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.026649  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.038054  2320 raft_consensus.cc:3060] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:02:20.036986  1526 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:20.040251  8318 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:20.040784  8318 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:20.028192  2329 raft_consensus.cc:2393] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 22: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:02:20.023186  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 238247us
I20260709 13:02:20.023028  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:20.030947  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.028640  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:20.035823  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 195495us
I20260709 13:02:20.046435  2322 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:20.047129  1599 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:20.048151  8635 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:20.016706  8722 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:20.036211  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.035701  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 320479us
I20260709 13:02:20.041342  8318 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:20.048350  1599 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:20.053277  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.053311  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:20.062844  1558 raft_consensus.cc:1813] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Handling vote request from an unknown peer 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:20.063489  1558 raft_consensus.cc:2393] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 19: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:20.053870  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.055430  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:20.065186  1557 raft_consensus.cc:2393] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 20: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:20.054085  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.054785  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.069938  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.048177  2288 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:20.071754  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.055894  1552 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:02:20.057880  1707 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 24.
I20260709 13:02:20.058776  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.059971  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.072554  2329 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:20.073091  2323 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 22.
I20260709 13:02:20.075591  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.079345  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:20.079982  1557 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:20.079799  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:20.080715  1558 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:20.076750  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:20.084946  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:20.085822  1554 raft_consensus.cc:2393] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:20.085906  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:20.086843  1556 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 19: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:20.085839  2320 raft_consensus.cc:2468] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:20.087800  1599 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:20.088011  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:20.091001  1552 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:20.088521  1555 raft_consensus.cc:1240] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:20.092623  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:20.099599  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:20.049974  8688 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:20.104532  1632 raft_consensus.cc:2393] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:20.062287  8722 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.110819  1598 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:20.115810  1554 raft_consensus.cc:1240] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:20.117360  1557 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 14.
I20260709 13:02:20.084899  8686 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:20.120725  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:20.121474  1554 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:20.120205  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:20.123670  1672 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:20.090490  8718 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:20.087759  8713 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:20.088320  8714 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.130326  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:20.131091  1554 raft_consensus.cc:1275] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:20.132947  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:20.100126  8622 raft_consensus.cc:3055] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:02:20.139109  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.142772  1555 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 11.
I20260709 13:02:20.103735  8395 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:20.174089  8395 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.174499  8395 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:20.142204  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:20.154592  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.178520  8697 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.178954  1557 raft_consensus.cc:2410] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:02:20.155702  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1652) took 1180 ms. Trace:
I20260709 13:02:20.179333  8697 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.179370  2327 rpcz_store.cc:276] 0709 13:02:18.975815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.975996 (+   181us) service_pool.cc:224] Handling call
0709 13:02:18.976376 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:18.982087 (+  5711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.982117 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:18.982837 (+   720us) log.cc:844] Serialized 52 byte log entry
0709 13:02:19.790199 (+807362us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b18000b7400. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:02:20.001054 (+210855us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:20.001097 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.001174 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.155367 (+154193us) raft_consensus.cc:1685] finished
0709 13:02:20.155390 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.155635 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5257,"raft.queue_time_us":8562,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":28005,"spinlock_wait_cycles":3454848,"thread_start_us":210653,"threads_started":1,"wal-append.queue_time_us":1131079}
I20260709 13:02:20.181706  8426 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:02:20.182382  8723 log.cc:927] Time spent T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:02:20.086869  8028 consensus_queue.cc:1059] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:02:20.182509  8426 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.166536  8578 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.121323  8423 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:20.184691  1709 raft_consensus.cc:3060] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:20.183997  8423 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.168411  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:20.185940  1551 raft_consensus.cc:2393] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 17: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:20.186123  1701 raft_consensus.cc:1240] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:02:20.170362  8619 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:20.124976  8350 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.185216  8578 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.187450  8350 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.109579  8239 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:20.190316  8538 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:20.190970  8538 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.191356  8714 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.192107  8279 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:20.192481  8576 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.193008  8576 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.194324  8028 raft_consensus.cc:3055] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:20.194960  8028 raft_consensus.cc:740] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:20.195981  8279 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:20.196607  1557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38"
dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
 from {username='slave'} at 127.0.0.1:33810
I20260709 13:02:20.125878  8019 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:20.173465  8622 raft_consensus.cc:740] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:20.182240  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:20.203007  1554 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:20.186841  8619 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.197412  1557 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:20.207547  1557 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:20.169616  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 46081.9us
I20260709 13:02:20.208739  1672 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:20.196636  8279 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.114137  8715 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:20.218148  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:20.218838  1551 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:20.159606  8523 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:20.210753  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 77922.5us
I20260709 13:02:20.224422  1599 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:20.121673  8722 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:20.214241  1672 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:20.140229  8045 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:20.257030  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:20.229250  8682 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:20.231109  1672 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:20.132138  8718 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:20.233251  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:20.238828  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:20.382318  1555 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:20.240798  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:20.236522  2321 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:20.251554  8620 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:20.252197  8580 consensus_queue.cc:1059] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:20.387946  8580 raft_consensus.cc:3055] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:20.388443  8580 raft_consensus.cc:740] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:20.389109  8510 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:20.389410  8580 consensus_queue.cc:260] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.390717  8580 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:20.385402  8718 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:20.252978  8711 raft_consensus.cc:3055] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:20.253051  8426 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:20.253715  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:20.393350  8711 raft_consensus.cc:740] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:20.254185  1708 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:20.258633  1709 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:20.394558  8711 consensus_queue.cc:260] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.259639  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.395671  1630 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
W20260709 13:02:20.395968  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 128265us
I20260709 13:02:20.396747  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.260644  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:20.266172  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.397406  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:20.213284  8619 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:20.369727  8523 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.317536  8714 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.196341  8028 consensus_queue.cc:260] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.297857  8682 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.270267  8715 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:20.258049  1702 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:20.207165  8019 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:20.413216  8019 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:20.410899  8578 consensus_queue.cc:1059] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:02:20.415683  8576 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.136879  8686 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.239662  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:20.417001  1704 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:02:20.411954  8622 consensus_queue.cc:260] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.418216  8686 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.383466  1700 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:20.387166  8620 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.419428  8620 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:20.407327  8214 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:20.373198  8707 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.374150  8538 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.382091  8688 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.385707  8239 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:20.421491  8279 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:20.428166  8707 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.404201  8528 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:20.410776  8682 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:20.436374  8528 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.444626  8528 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:20.447121  8697 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:20.451399  8707 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.426657  8715 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.277622  1557 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:20.500073  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.272717  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:20.503456  1551 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:02:20.503995  1557 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:20.383186  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 158889us
I20260709 13:02:20.401029  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.506129  1626 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:20.506525  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:20.506310  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:20.508395  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.356980  1554 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:02:20.397413  1630 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:20.342998  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.510421  1599 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:20.511619  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:20.264798  1558 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:02:20.512044  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.513579  1599 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:20.258790  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:20.514045  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:20.397955  1633 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 15.
I20260709 13:02:20.385563  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:20.398969  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 168002us
I20260709 13:02:20.526420  1672 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:20.526979  1557 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:02:20.529224  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 119240us
I20260709 13:02:20.533113  1558 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:20.509646  1626 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 22.
I20260709 13:02:20.534937  1673 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:20.537945  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:20.508271  1551 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:20.547931  2286 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:20.559605  1551 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:20.561236  2286 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:20.572965  8279 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:20.573136  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.573899  2323 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:20.574261  8279 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:20.574875  8279 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:20.575479  8279 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:20.575615  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.575836  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.406251  8350 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:20.586180  1555 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 23.
I20260709 13:02:20.434719  8028 raft_consensus.cc:3060] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:20.587767  8400 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:20.589489  8531 consensus_queue.cc:1059] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:20.583425  8545 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:20.592499  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.593071  8045 raft_consensus.cc:3055] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:20.593602  8045 raft_consensus.cc:740] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:20.594914  8214 raft_consensus.cc:2804] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:20.573613  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.435421  8239 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:20.426100  8688 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.598829  8697 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:20.600075  8547 raft_consensus.cc:2804] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:20.599895  8697 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.600796  8547 raft_consensus.cc:697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:20.602452  8547 consensus_queue.cc:237] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.603658  8697 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:20.603557  8687 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:20.612282  2326 raft_consensus.cc:2393] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 21: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:20.614770  8620 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.595198  8045 consensus_queue.cc:260] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.411727  8423 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.626492  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.621642  8697 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.642114  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 71084.1us
W20260709 13:02:20.645879  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 89742.9us
I20260709 13:02:20.654192  8239 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:20.654309  8615 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:20.655351  8615 raft_consensus.cc:697] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:20.656736  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.657119  8426 consensus_queue.cc:1048] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:20.658033  2321 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:20.659318  8426 raft_consensus.cc:3055] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:20.659077  8395 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.659809  8426 raft_consensus.cc:740] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:20.660670  1629 raft_consensus.cc:2368] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 22. Current term is 23.
I20260709 13:02:20.660732  8578 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:20.662117  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.661933  8578 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.667299  8619 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.669011  8718 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.464150  8722 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.672231  8688 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:20.652429  2329 raft_consensus.cc:3055] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:20.675657  2329 raft_consensus.cc:740] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:20.676728  1630 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:20.656870  8350 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:20.679371  8350 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:20.679854  8350 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:20.680550  8707 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:20.682948  8620 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.685531  8711 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:20.685657  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.690274  8722 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.691876  8400 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:20.692749  8400 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.695046  8622 raft_consensus.cc:3060] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:20.695295  8400 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:20.698132  8718 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:20.700923  8707 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.656823  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:20.704808  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.705240  8045 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:20.705840  2325 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:20.704176  8707 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.710326  8707 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.712044  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.712775  8741 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:20.713181  2322 raft_consensus.cc:2410] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:02:20.712975  8415 consensus_queue.cc:1059] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:20.713636  8741 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.714404  8415 raft_consensus.cc:3055] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:20.714812  8415 raft_consensus.cc:740] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:20.716220  8741 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.650068  8214 raft_consensus.cc:697] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:20.723341  2325 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:20.726953  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.677599  8395 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.733091  2322 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:20.733161  1701 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 19. Current term is 20. Ops: []
W20260709 13:02:20.740978  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.735445  1672 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:20.741015  8707 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.745965  8707 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.761211  8741 raft_consensus.cc:2804] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:20.761986  8707 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.716444  8415 consensus_queue.cc:260] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.763748  8415 raft_consensus.cc:3060] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:20.765832  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.734472  8697 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.769626  8697 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:20.770128  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.770912  8741 raft_consensus.cc:697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:02:20.771060  8318 consensus_meta.cc:287] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.683s	user 0.007s	sys 0.016s
I20260709 13:02:20.771615  8318 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:20.773033  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.772223  8741 consensus_queue.cc:237] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.794407  8676 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.795203  8676 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.725855  8615 consensus_queue.cc:237] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.797093  1559 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:20.742502  2329 consensus_queue.cc:260] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.801116  2329 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:20.804906  2325 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 21.
I20260709 13:02:20.725688  8426 consensus_queue.cc:260] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:20.818872  8739 log.cc:927] Time spent T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.391s	user 0.002s	sys 0.000s
I20260709 13:02:20.822489  8676 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:20.823508  8019 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:20.832250  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 74985.6us
W20260709 13:02:20.806718  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 135905us
I20260709 13:02:20.840394  1633 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22.
I20260709 13:02:20.847251  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.847586  1523 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:20.853125  8239 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.862668  8677 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:20.863354  8677 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.863795  8019 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:20.863830  8677 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:20.865023  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.857709  1634 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:02:20.870018  8426 raft_consensus.cc:3060] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:20.876678  8578 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:20.886024  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.888902  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.889568  8619 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:20.890184  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.889855  8677 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.891749  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.899987  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:20.901525  1559 raft_consensus.cc:2393] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 19: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:20.889926  2322 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:20.917896  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.919241  1631 raft_consensus.cc:2368] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 17. Current term is 18.
I20260709 13:02:20.919811  8677 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.922410  8279 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.925197  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.926133  2320 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:20.932205  8686 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.933275  8686 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.938344  8028 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.938995  8395 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:20.939210  8028 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.939709  8395 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.941326  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:20.941839  1675 leader_election.cc:400] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 22. Current term is 23.
I20260709 13:02:20.942260  1675 leader_election.cc:403] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:02:20.942392  1701 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 24: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:20.943743  8510 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:20.943991  1598 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:20.944411  8510 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.946817  8510 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.947343  8028 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:20.948040  8578 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:20.949589  8697 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:20.949914  8578 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.950438  8318 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.950330  8697 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.951341  8395 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:20.948266  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.948909  8523 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:20.952356  8578 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.952560  8697 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:20.958138  8697 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.958889  8697 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.936501  8686 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:20.961079  8214 consensus_queue.cc:237] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 16.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:20.962002  8528 consensus_meta.cc:287] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.009s
I20260709 13:02:20.962857  8528 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:20.966090  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 263534us
I20260709 13:02:20.967247  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:20.967460  8350 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:20.968205  8578 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:20.969731  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:20.972398  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.974861  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.975090  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.975754  1631 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:20.976763  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:20.977159  8523 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 22. Current term is 23.
I20260709 13:02:20.977757  1628 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 15: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:20.978667  8239 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.980932  8395 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:20.981325  1629 raft_consensus.cc:1240] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:20.956823  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:20.986821  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:20.987192  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:20.988071  1700 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:20.988205  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.956907  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.988862  2325 raft_consensus.cc:3060] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:20.989497  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:20.955129  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:20.992197  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:20.981551  8395 raft_consensus.cc:697] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:21.001924  8350 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:21.002517  8395 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.982816  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:21.009114  8350 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:20.981398  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.985880  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:20.977082  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.993767  8686 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:20.985944  1631 raft_consensus.cc:2368] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 22. Current term is 23.
I20260709 13:02:21.021643  2321 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
W20260709 13:02:20.954643  8682 consensus_meta.cc:287] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.002s
I20260709 13:02:20.993040  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:20.995438  1630 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:20.996701  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:20.997422  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.024570  1626 raft_consensus.cc:2410] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 23 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 13:02:21.026255  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:21.027766  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:20.998427  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.029654  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:20.998487  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:20.999162  1628 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:20.999270  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.032130  8682 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:20.999799  8528 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:20.982911  8697 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:21.000490  2286 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:21.012997  2329 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:21.039705  2322 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 23.
I20260709 13:02:21.040894  2323 raft_consensus.cc:2468] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:21.046777  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:21.046286  1523 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:21.036842  8545 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:21.044487  2325 raft_consensus.cc:2468] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:21.050580  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:02:21.050580  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50225.4us
I20260709 13:02:21.053021  1672 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:02:21.056934  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.057030  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:21.058007  1628 raft_consensus.cc:3060] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:21.058231  8687 raft_consensus.cc:2804] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:21.058859  8687 raft_consensus.cc:697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 23 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:21.059902  8687 consensus_queue.cc:237] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:21.067622  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:21.062716  1634 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 23.
I20260709 13:02:21.070392  1704 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 23.
I20260709 13:02:21.079628  2321 raft_consensus.cc:3060] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:21.085528  2328 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:21.082839  1598 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:21.047571  8682 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:21.092656  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:21.093796  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 44804.6us
I20260709 13:02:21.092872  1629 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:02:21.096778  1672 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:21.068944  8697 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:02:21.101776  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.103402  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:21.090114  8318 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:21.089857  8622 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:21.107515  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.104401  1634 raft_consensus.cc:2376] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22. Re-sending same reply.
I20260709 13:02:21.119653  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1569) took 1010 ms. Trace:
I20260709 13:02:21.120247  1556 rpcz_store.cc:276] 0709 13:02:20.108894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.112757 (+  3863us) service_pool.cc:224] Handling call
0709 13:02:20.113154 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.116117 (+  2963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.116145 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.117137 (+   992us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.815812 (+698675us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b18004c2520. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:02:21.082512 (+266700us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:21.082577 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.097486 (+ 14909us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.118903 (+ 21417us) raft_consensus.cc:1685] finished
0709 13:02:21.118922 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.119480 (+   558us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2560,"raft.queue_time_us":3269,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":10164,"spinlock_wait_cycles":14131072,"thread_start_us":206616,"threads_started":1,"wal-append.queue_time_us":998893}
I20260709 13:02:21.112754  8350 raft_consensus.cc:2804] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:21.103152  8239 raft_consensus.cc:2804] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:21.126238  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.104429  8279 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:21.138456  1631 raft_consensus.cc:2468] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 23.
I20260709 13:02:21.130465  2321 raft_consensus.cc:2468] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20.
I20260709 13:02:21.143188  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.146030  2328 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:21.144196  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.126001  8318 raft_consensus.cc:697] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:21.127378  8622 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:21.126256  8682 raft_consensus.cc:2804] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:02:21.146906  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 154088us
I20260709 13:02:21.133733  8350 raft_consensus.cc:697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:21.151813  1630 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 19: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:21.154620  8523 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:21.157852  2320 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 22.
I20260709 13:02:21.135273  8615 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.150213  1672 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:21.138837  8239 raft_consensus.cc:697] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:21.137956  8547 consensus_queue.cc:1059] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:02:21.168826  1523 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:21.198347  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.060969  1449 catalog_manager.cc:5697] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 10 to 14, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:21.207978  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.210489  1630 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
W20260709 13:02:21.213079  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 64684.4us
I20260709 13:02:21.215241  1631 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:02:21.215164  8580 consensus_meta.cc:287] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.716s	user 0.019s	sys 0.005s
I20260709 13:02:21.218932  1634 raft_consensus.cc:1240] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:21.218150  1672 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:21.220300  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:21.198303  8682 raft_consensus.cc:697] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:21.208055  8711 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.166452  8318 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:21.183549  8528 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:21.212157  8677 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:21.227082  2324 raft_consensus.cc:2410] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:02:21.217587  8578 raft_consensus.cc:2804] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:21.232941  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.235445  8578 raft_consensus.cc:697] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:21.236788  8578 consensus_queue.cc:237] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:21.239405  1628 raft_consensus.cc:2468] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20.
I20260709 13:02:21.235498  1634 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 23.
I20260709 13:02:21.234777  8750 raft_consensus.cc:2804] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:21.233440  8682 consensus_queue.cc:237] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:21.248822  8622 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:21.249742  8752 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:02:21.252702  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.256186  8239 consensus_queue.cc:237] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:21.257011  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:21.181097  8615 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:21.258750  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.259436  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.281749  1631 raft_consensus.cc:2393] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:21.240291  8697 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:21.215749  8523 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:21.295550  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.263991  8677 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:21.303680  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.275147  8750 raft_consensus.cc:697] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:21.336548  1702 raft_consensus.cc:1240] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:21.335716  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
W20260709 13:02:21.349225  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 138917us
I20260709 13:02:21.274219  8528 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:21.265918  8711 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:21.339819  8756 log.cc:927] Time spent T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:02:21.376981  1626 raft_consensus.cc:2468] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:02:21.374553  1631 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:02:21.379859  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.396386  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.390676  1559 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:21.400795  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:21.401787  1634 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:21.408814  1628 raft_consensus.cc:1240] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:21.388005  8523 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:21.387993  8745 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.428121  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.429023  1626 raft_consensus.cc:2376] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 23. Re-sending same reply.
I20260709 13:02:21.345487  8350 consensus_queue.cc:237] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:21.440191  8711 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:21.446149  8677 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:21.451395  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.453950  1526 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:02:21.455287  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 43898.5us
I20260709 13:02:21.456867  8707 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:21.457578  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:21.458951  1634 raft_consensus.cc:1275] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:21.459209  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.460968  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.462643   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:21.469030  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:21.469746  1631 raft_consensus.cc:2376] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18. Re-sending same reply.
I20260709 13:02:21.470554  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.471197  1628 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
W20260709 13:02:21.478296  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 223191us
I20260709 13:02:21.489974  1635 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:02:21.499341  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.505966  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 55239.4us
I20260709 13:02:21.511852  2288 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:21.538093  1702 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:02:21.539958  2324 raft_consensus.cc:1275] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:21.540653  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:21.541908  1701 raft_consensus.cc:2410] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:02:21.542209  8531 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:21.436735  8687 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:02:21.538165  1601 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:21.550480  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:21.555857  1601 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:21.552572  8523 consensus_queue.cc:1048] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
W20260709 13:02:21.560123  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.563331  8028 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:21.563858  8028 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.564245  8028 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:21.540225  8758 log.cc:927] Time spent T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:02:21.477686  8745 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:21.584882  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 73182us
I20260709 13:02:21.540256  8528 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:21.593472  1635 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:02:21.549081  8619 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.530689  8707 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:02:21.477908  8750 consensus_queue.cc:237] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:21.591362  8755 log.cc:927] Time spent T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:02:21.599359  8748 raft_consensus.cc:3055] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:21.596222  8395 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:21.595866  8615 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:21.621193  8748 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:21.661129  1449 catalog_manager.cc:5697] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 16 to 18, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:21.664685   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:02:21.669231  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.676043  1451 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41160 (request call id 299) took 45593 ms (client timeout 15000 ms). Trace:
W20260709 13:02:21.678522  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 59805.1us
W20260709 13:02:21.683300  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 147100us
I20260709 13:02:21.620163  8619 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:21.651481  8239 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:21.683329  8780 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:21.704391  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1568) took 1482 ms. Trace:
I20260709 13:02:21.707549  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:02:21.713380  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.678881  8545 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:02:21.701833  8749 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:21.701619  8682 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:02:21.730762  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 169278us
I20260709 13:02:21.707001  8707 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:21.754283  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:21.755549  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:21.727777  8545 consensus_queue.cc:1243] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:02:21.757622  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:21.752892  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:21.707405  1552 rpcz_store.cc:276] 0709 13:02:20.103565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.115786 (+ 12221us) service_pool.cc:224] Handling call
0709 13:02:20.116207 (+   421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:20.116556 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.116604 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:20.153354 (+ 36750us) log.cc:844] Serialized 52 byte log entry
0709 13:02:20.826857 (+673503us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b18002ed440. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:02:21.109969 (+283112us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:21.264627 (+154658us) log.cc:844] Serialized 14 byte log entry
0709 13:02:21.509818 (+245191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.531094 (+ 21276us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.531173 (+    79us) raft_consensus.cc:1685] finished
0709 13:02:21.548806 (+ 17633us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.586017 (+ 37211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3942,"prepare.queue_time_us":286297,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":29776,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":29897,"spinlock_wait_cycles":100513152,"thread_start_us":624578,"threads_started":3,"wal-append.queue_time_us":998284}
I20260709 13:02:21.764411  1559 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:21.710712  8239 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:21.765910  2327 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 16 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 13:02:21.766472  2324 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 21.
I20260709 13:02:21.769547  8682 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:21.770889  8770 log.cc:927] Time spent T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:02:21.771816  8782 log.cc:927] Time spent T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:02:21.772464  8772 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:02:21.773126  8748 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:21.707696  1449 catalog_manager.cc:5697] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 5 to 9, term changed from 7 to 16, VOTER 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) evicted. New cstate: current_term: 16 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:21.775468  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:21.754122  8318 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:21.792860  8318 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.793490  8318 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:21.798305  1675 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:21.798151  1449 catalog_manager.cc:5697] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:21.799916  1675 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:21.801011  8214 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:21.800843  8028 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:21.801417  8528 consensus_queue.cc:1059] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:21.801928  8748 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:21.802456  8578 raft_consensus.cc:3055] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:21.802913  8578 raft_consensus.cc:740] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:21.758256  8510 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:21.804427  8578 consensus_queue.cc:260] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:21.805163  8239 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:21.804991  8510 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:21.806963  8028 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:21.801504  8214 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.805739  8578 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:21.807813  8214 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:21.774582  8707 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:21.809497  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:21.790210  8619 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:21.812871  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 109007us
I20260709 13:02:21.815349  8707 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:21.815486  8745 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:21.758059  8780 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:21.816816  8766 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:02:21.816291  8510 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:21.829460  1675 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:21.852850  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 118375us
I20260709 13:02:21.816300  8707 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:21.856468  1700 raft_consensus.cc:2468] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
W20260709 13:02:21.862157  2288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.823318  8780 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:21.864838  8790 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.050s	user 0.001s	sys 0.001s
I20260709 13:02:21.854928  8619 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:21.855228  8350 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:21.837819  8798 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:21.875129  1700 pending_rounds.cc:85] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 14
I20260709 13:02:21.864951  1449 catalog_manager.cc:5697] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:21.880048  8682 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:21.856274  8615 raft_consensus.cc:2804] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:21.858692  8799 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:21.911139  2288 leader_election.cc:336] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.590s (SENT)
I20260709 13:02:21.921139  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:21.917174  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:21.894877  1700 pending_rounds.cc:107] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:02:21.946280  1700 raft_consensus.cc:2889] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:21.928825  8798 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:21.676999  1451 rpcz_store.cc:269] 0709 13:01:36.089981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.183826 (+ 93845us) service_pool.cc:224] Handling call
0709 13:01:37.255633 (+1071807us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b5400230690. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960e9c 00007f0ed69610f6 00007f0edf8daa89 00007f0edf872da6 00007f0edf844088 00007f0edf94237e 00007f0edde032a4 00007f0edde03232 00007f0edde03161 00007f0edde030dc
0709 13:02:21.672259 (+44416626us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:15.870690 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:15.908411 (+ 37721us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:15.928498 (+ 20087us) write_op.cc:435] Acquired schema lock
0709 13:02:15.944467 (+ 15969us) tablet.cc:662] Decoding operations
0709 13:02:16.139246 (+194779us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:16.139389 (+   143us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:16.139640 (+   251us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:02:16.141295 (+  1655us) tablet.cc:701] Row locks acquired
0709 13:02:16.141350 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:02:16.141559 (+   209us) write_op.cc:270] Start()
0709 13:02:16.141733 (+   174us) write_op.cc:276] Timestamp: P: 1783602136141478 usec, L: 0
0709 13:02:16.141780 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:02:16.142736 (+   956us) log.cc:844] Serialized 6344 byte log entry
0709 13:02:17.248132 (+1105396us) op_driver.cc:464] REPLICATION: finished
0709 13:02:17.295135 (+ 47003us) write_op.cc:301] APPLY: starting
0709 13:02:17.307700 (+ 12565us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:17.754442 (+446742us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:17.754604 (+   162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:18.868151 (+1113547us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:18.913306 (+ 45155us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:02:18.913369 (+    63us) write_op.cc:312] APPLY: finished
0709 13:02:18.913939 (+   570us) log.cc:844] Serialized 148 byte log entry
0709 13:02:19.219806 (+305867us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:19.244010 (+ 24204us) write_op.cc:454] Released schema lock
0709 13:02:19.267268 (+ 23258us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:19.333424 (+ 66156us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:19.336705 (+  3281us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5660946,"reported_tablets":48,"spinlock_wait_cycles":5841792,"child_traces":[["op",{"apply.queue_time_us":1527,"apply.run_cpu_time_us":56977,"apply.run_wall_time_us":2061116,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70911,"num_ops":16,"prepare.queue_time_us":337962,"prepare.run_cpu_time_us":60181,"prepare.run_wall_time_us":1037486,"raft.queue_time_us":133678,"raft.run_cpu_time_us":1160,"raft.run_wall_time_us":1908,"replication_time_us":1106178,"spinlock_wait_cycles":18176,"thread_start_us":1248823,"threads_started":5,"wal-append.queue_time_us":1181758,"wal-append.run_cpu_time_us":22008,"wal-append.run_wall_time_us":2336982}]]}
W20260709 13:02:21.941393  8795 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:02:21.965548  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:21.966396  1628 raft_consensus.cc:1275] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 16 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 13:02:21.966601  2325 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:21.941159  8615 raft_consensus.cc:697] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:21.912346  8707 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:21.877491  8794 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:21.943923  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 67077.4us
I20260709 13:02:21.877743  8350 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:21.950084  8769 log.cc:927] Time spent T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.349s	user 0.000s	sys 0.004s
I20260709 13:02:21.951146  1449 catalog_manager.cc:5697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:21.952323  8780 consensus_queue.cc:1059] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:21.957306  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:21.958645  8547 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:21.958710  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:21.960330  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:21.961969  2327 raft_consensus.cc:1275] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:21.962255  1635 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:21.968678  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:21.916270  8799 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:21.970261  1675 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:21.975675  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.002630  1626 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20.
I20260709 13:02:22.000550  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:21.965011  8797 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.972754  8578 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:21.975556  8350 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:21.976358  8687 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.975299  8794 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.004920  8780 consensus_queue.cc:1243] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:02:22.003837  8528 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:22.022781  1627 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
W20260709 13:02:22.047672  8791 log.cc:927] Time spent T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:02:22.048723  8578 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:22.049198  8578 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:22.049611  8578 raft_consensus.cc:3060] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:22.052953  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 174710us
W20260709 13:02:22.053896  2288 leader_election.cc:336] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.602s (SENT)
W20260709 13:02:22.054926  2288 leader_election.cc:336] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Timed out: RequestConsensusVote RPC to 127.0.107.194:43887 timed out after 1.648s (SENT)
I20260709 13:02:22.004798  8510 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.052s
I20260709 13:02:22.056901  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.057477  8798 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:22.057745  1626 raft_consensus.cc:2393] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 16: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:22.045585  8528 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.058329  8528 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:22.060477  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:22.060914  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.062429  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:22.062657  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.063665  1628 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:22.063783  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:22.064832  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.065263  1601 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:22.069132  1556 raft_consensus.cc:1275] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:02:22.071564  8770 log.cc:927] Time spent T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.261s	user 0.006s	sys 0.000s
W20260709 13:02:22.075052  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.004403  8799 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:22.090328  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.096192  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:22.096910  1629 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:22.025437  8794 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:22.131018  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.130784  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:22.134334  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:22.135308  1551 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:22.138078  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:22.138126  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:22.060693  8239 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.140285  1559 raft_consensus.cc:1275] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:02:22.095717  8800 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:02:22.133586  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:02:22.143966  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 173845us
W20260709 13:02:22.139688  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 157446us
I20260709 13:02:22.148897  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:22.148034  1672 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:22.037766  8687 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:22.142755  8619 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:22.161744  1552 raft_consensus.cc:1240] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 22. Current term is 23. Ops: [22.18-22.18]
I20260709 13:02:22.042323  8797 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:22.169809  1558 raft_consensus.cc:2393] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 14: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:22.169713  1629 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
W20260709 13:02:22.170855  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.158710  8045 raft_consensus.cc:2804] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:22.179179  1675 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:22.142496  8214 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:22.150846  8239 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:22.200075  2327 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:22.143378  8318 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:22.208256  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 113053us
W20260709 13:02:22.207602  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 45975.4us
I20260709 13:02:22.212023  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.214092  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.214876  1629 raft_consensus.cc:2393] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 19: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:22.218170  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.219461  1707 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 19: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:22.242131  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.245182  1556 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:22.245431  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:22.204218  8619 consensus_queue.cc:1048] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.044s
I20260709 13:02:22.255638  2327 raft_consensus.cc:1275] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:02:22.171303  8615 consensus_queue.cc:237] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:22.254801  8804 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:22.257855  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:22.251323  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:22.261199  1557 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:22.262458  8823 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 13:02:22.263721  8814 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:02:22.272825  8318 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:22.274173  8815 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:02:22.254973  8820 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:22.293218  8820 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:22.302587  8820 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:22.290149  8807 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:02:22.294310  8686 raft_consensus.cc:3055] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:22.304085  8686 raft_consensus.cc:740] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:22.306489  2324 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 21: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:22.306416  8686 consensus_queue.cc:260] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:22.307945  8686 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:22.309604  8578 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:22.312817  8825 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:22.313019  8523 consensus_queue.cc:1048] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:22.313643  8825 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:22.314092  8745 consensus_queue.cc:1048] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:22.315011  8622 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:22.301105  1704 raft_consensus.cc:1275] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:02:22.291429  8818 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:02:22.324887  8711 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:22.260172  8707 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:22.330056  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:22.213891  1449 catalog_manager.cc:5697] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:22.340754  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 101344us
W20260709 13:02:22.342856  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.343194  8528 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:22.344723  1703 raft_consensus.cc:2368] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 21. Current term is 22.
I20260709 13:02:22.344957  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:22.346263  1559 raft_consensus.cc:1275] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:22.346014  1552 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:22.356071  2328 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:22.358650  2329 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:22.349252  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:22.363247  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:22.379400  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:22.383740  1703 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:22.390090  1601 leader_election.cc:400] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 21. Current term is 22.
I20260709 13:02:22.391059  1601 leader_election.cc:403] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:22.353819  8547 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:22.397399  1556 raft_consensus.cc:1275] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:22.403304  2326 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:22.398474  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.398502  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.377983  8825 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:22.397507  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:22.414757  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:22.415843  2324 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:02:22.418769  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.421198  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.419552  1598 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:22.422886  1704 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:02:22.436748  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:22.403074  8750 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:22.445304  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:22.445304  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:22.442143  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:22.410400  8019 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:02:22.439163  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:22.447974  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:22.448026  1635 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:22.451804  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 128372us
I20260709 13:02:22.454145  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:22.453681  1703 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
I20260709 13:02:22.456933  1552 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:02:22.459975  1702 raft_consensus.cc:2368] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19.
I20260709 13:02:22.439055  8045 raft_consensus.cc:697] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:02:22.469087  8830 log.cc:927] Time spent T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:02:22.472000  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:22.472693  1559 raft_consensus.cc:3060] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:22.410681  8821 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:02:22.453030  8797 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:22.421345  8825 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:02:22.485083  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:22.487319  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 67886.3us
I20260709 13:02:22.466270  8811 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.487758  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:22.485486  8528 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:22.517071  1707 raft_consensus.cc:2468] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:22.520938  8318 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.521546  8318 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:22.523733  8318 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:22.525916  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:22.526454  1559 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 11.
I20260709 13:02:22.528513  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:22.530372  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:22.530431  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:22.531571  1703 raft_consensus.cc:2468] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 11.
I20260709 13:02:22.531826  1551 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:22.532759  8813 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:22.533074  1526 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:22.536010  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:22.499347  1635 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:22.501031  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:22.543663  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:22.505419  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:22.506090  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:22.506213  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:22.507380  1626 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:02:22.508934  1449 catalog_manager.cc:5697] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 15 to 18, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:22.548677  8622 consensus_queue.cc:1048] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:22.545936  8028 raft_consensus.cc:2764] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:02:22.545794  8823 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:22.550581  8019 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 21. Current term is 22.
I20260709 13:02:22.550664  8823 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:22.512152  2288 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:22.512805  8547 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:22.552855  8547 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:22.551802  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:22.543592  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:22.501458  2327 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:22.544656  1557 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 20.
I20260709 13:02:22.547227  8828 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:02:22.543152  8811 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:22.558957  1552 raft_consensus.cc:2393] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 16: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:22.582897  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.588918  1554 raft_consensus.cc:2393] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 15: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:22.536152  8318 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:22.577149  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 132680us
I20260709 13:02:22.590902  1635 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:22.590677  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.535969  8707 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.592309  1628 raft_consensus.cc:2393] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 11: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:22.593813  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:22.594221  1599 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:22.535375  8239 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:22.590714  1556 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:02:22.600756  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.600756  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.604239  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:22.605188  2322 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:22.608408  8689 consensus_queue.cc:1048] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:02:22.609050  1707 raft_consensus.cc:1275] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:22.610132  8510 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.610603  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:22.611897  1628 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:22.553687  8578 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:22.617180  1559 raft_consensus.cc:2393] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 16: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:22.614825  1703 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:22.533280  8350 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:22.622705  1551 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:22.596371  8318 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:22.625926  2323 raft_consensus.cc:1275] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:22.637924  8318 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:22.638161  8214 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:22.606168  8677 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:22.627974  8028 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:22.639993  8028 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:22.641111  8811 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:22.642385  8028 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:22.606353  8780 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:22.643512  8780 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:22.622495  8045 consensus_queue.cc:237] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:22.642590  8750 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:22.646162  8750 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:22.629292  1601 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:22.629480  8689 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:02:22.630291  8824 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:22.631003  8808 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
W20260709 13:02:22.631819  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 85224us
I20260709 13:02:22.614619  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:22.658715  1705 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:02:22.632375  8622 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:22.627900  8510 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:22.632920  8748 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:22.633906  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:22.635694  8816 log.cc:927] Time spent T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.457s	user 0.000s	sys 0.003s
I20260709 13:02:22.591490  8547 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:02:22.649044  1557 raft_consensus.cc:1275] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:02:22.627441  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 91724us
I20260709 13:02:22.663789  8823 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:22.533383  8813 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:22.666085  2322 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 22.
I20260709 13:02:22.675710  1601 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:22.697201  1708 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 20: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:22.686100  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:22.682578  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 43570us
I20260709 13:02:22.699189  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:22.658999  8804 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:22.698978  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 65206.1us
I20260709 13:02:22.641108  8794 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:22.698506   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:22.702440  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:22.614398  8707 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:22.686082  8841 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:22.713233  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:22.713405  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:22.728006  1555 raft_consensus.cc:2368] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17.
I20260709 13:02:22.699384  8686 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:22.733932  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.735280  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:22.738137  8834 consensus_queue.cc:1048] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:02:22.743343  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1583) took 1003 ms. Trace:
I20260709 13:02:22.743983  1560 rpcz_store.cc:276] 0709 13:02:21.749632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.752721 (+  3089us) service_pool.cc:224] Handling call
0709 13:02:21.765536 (+ 12815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:21.852445 (+ 86909us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:21.863702 (+ 11257us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.012750 (+149048us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.041175 (+ 28425us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.041379 (+   204us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:22.041428 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.041531 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.634910 (+593379us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed962086e 00007f0ed961fbb6 00007f0ed961f7d8 00007f0ed9629221 00007f0ed96291d9 00007f0ed9629169
0709 13:02:22.742758 (+107848us) raft_consensus.cc:1685] finished
0709 13:02:22.742913 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.743117 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59273,"prepare.queue_time_us":10487,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":41,"raft.queue_time_us":117081,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":26994,"spinlock_wait_cycles":13069184,"thread_start_us":213573,"threads_started":2,"wal-append.queue_time_us":253871}
I20260709 13:02:22.714182  8780 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:22.748932  1558 raft_consensus.cc:1240] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:22.749516  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 91167.3us
I20260709 13:02:22.750283  8687 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:22.702139  8415 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:22.752254  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:22.717643  8799 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.582s	user 0.000s	sys 0.010s
I20260709 13:02:22.691458  8622 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:02:22.549142  1449 catalog_manager.cc:5697] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 7 to 14, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.718451  8823 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:02:22.769416  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64552.1us
I20260709 13:02:22.729718  8828 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:22.757272  8677 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:22.779745  8839 raft_consensus.cc:3055] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:22.780215  8839 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:22.711030  8804 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:22.781883  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:22.790829  8817 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.540s	user 0.002s	sys 0.000s
I20260709 13:02:22.793859  2326 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:02:22.801712  1449 catalog_manager.cc:5697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.772441  8828 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.814033  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:22.815507  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 63693.5us
I20260709 13:02:22.761080  8686 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:22.781821  8824 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:22.781654  8823 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:22.767429  8799 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:22.803987  1449 catalog_manager.cc:5697] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:22.851241  8844 log.cc:927] Time spent T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:02:22.849923  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:22.853956  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39868 (request call id 3543) took 1072 ms. Trace:
I20260709 13:02:22.839847  8811 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:22.838562  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:22.899386  1555 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20.
I20260709 13:02:22.839286  8831 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:22.848178  8707 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:22.861917  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:22.778558  8318 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:22.841305  8510 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:22.806427  8748 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:22.931357  2326 raft_consensus.cc:1275] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:22.862514  8622 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:22.843632  8820 consensus_meta.cc:287] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.001s
W20260709 13:02:22.882166  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.857981  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 72045.5us
I20260709 13:02:22.828047  8828 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:22.838029  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 56274.6us
I20260709 13:02:22.894387  1705 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 22.
I20260709 13:02:22.905298  8279 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:22.906217  1449 catalog_manager.cc:5697] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 10 to 15, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.926321  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:22.837955  8350 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:22.947978  1673 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.534s (SENT) [suppressed 24 similar messages]
I20260709 13:02:22.930531  1553 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:22.858095  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 155799us
I20260709 13:02:22.938958  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:22.940690  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:22.957415  1626 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 19: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:22.923489  8677 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.929500  8689 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.922070  2286 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:22.932627  8824 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:22.959789  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:22.893443  1709 rpcz_store.cc:276] 0709 13:02:21.781861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.792914 (+ 11053us) service_pool.cc:224] Handling call
0709 13:02:21.793524 (+   610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.838175 (+ 44651us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:21.860626 (+ 22451us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.203669 (+343043us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.385591 (+181922us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:22.385658 (+    67us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:22.385711 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.853564 (+467853us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b54002cc254. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:22.853621 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.853764 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53272,"prepare.queue_time_us":37261,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":104854,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":33644,"spinlock_wait_cycles":57941248,"thread_start_us":460634,"threads_started":4,"wal-append.queue_time_us":266731}
I20260709 13:02:22.951593  1526 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:02:22.984757  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 148897us
I20260709 13:02:22.987860  2326 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:02:22.988320  2326 pending_rounds.cc:85] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 14
I20260709 13:02:22.988567  2326 pending_rounds.cc:107] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:02:22.988967  2326 raft_consensus.cc:2889] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:22.994915  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 43502.5us
I20260709 13:02:22.995472  1555 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:22.956097  8831 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:02:22.998648  8849 log.cc:927] Time spent T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.182s	user 0.004s	sys 0.000s
I20260709 13:02:22.999470  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:22.999845  8687 consensus_queue.cc:1059] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:23.000779  8687 raft_consensus.cc:3055] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:22.985096  8808 raft_consensus.cc:2764] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:02:23.001129  8687 raft_consensus.cc:740] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:23.002010  8687 consensus_queue.cc:260] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:23.003816  8812 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:23.004211  8687 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:22.973631  8279 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:23.004894  8812 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:22.954447  8811 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:22.971716  8028 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:22.978140  8805 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:23.023456  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:23.027014  1675 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:23.041383  1631 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 22.
W20260709 13:02:23.053342  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.948081  8820 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:23.061816  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:23.070081  1630 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:22.956120  8622 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:23.073307  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 73963.3us
I20260709 13:02:23.073499  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:23.076319  1631 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:02:22.982102  8578 consensus_queue.cc:1048] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:02:23.022439  8812 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:23.021257  8045 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:23.021512  8813 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:23.080143  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 55023.7us
I20260709 13:02:22.977886  8689 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:23.067772  8805 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.145900  1627 raft_consensus.cc:2468] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
W20260709 13:02:23.147111  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 59083.7us
I20260709 13:02:23.090346  8750 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:23.072729  8745 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:23.098503  8797 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.155400  1449 catalog_manager.cc:5697] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.103547  8239 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:23.156250  8780 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:23.158357  1449 catalog_manager.cc:5697] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 11 to 14, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:23.107525  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:23.160967  8799 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:23.148821  1675 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:23.102350  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 116818us
I20260709 13:02:23.163359  8619 raft_consensus.cc:2804] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:02:23.163493  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 148521us
I20260709 13:02:23.164095  8619 raft_consensus.cc:697] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:23.055860  8811 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:23.165015  8619 consensus_queue.cc:237] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:22.992924  8823 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:23.167243  8687 consensus_queue.cc:1048] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:23.149238  8805 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:23.139451  8045 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:23.110781  8279 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:23.113438  8794 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:23.123778  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:23.174541  1554 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 15.
I20260709 13:02:23.130990  2327 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:23.111886  1704 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
W20260709 13:02:23.134241  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 48567.2us
I20260709 13:02:23.178287  1630 raft_consensus.cc:2468] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20.
I20260709 13:02:23.185672  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:23.132337  8318 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:22.971823  8839 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:23.155539  8797 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:22.994292  8677 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:23.193389  2286 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:23.138252  1626 raft_consensus.cc:1275] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:02:23.209295  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 46158.9us
I20260709 13:02:23.210137  1599 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:23.216717  8686 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:23.217221  8797 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:23.220743  8677 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:23.225262  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:23.227141  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:23.228009  8686 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:23.212383  8745 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
W20260709 13:02:23.231552  8850 log.cc:927] Time spent T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:02:23.234786  8840 consensus_queue.cc:1048] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:23.067255  8028 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:23.142568  8804 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:23.247290  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 54023.2us
I20260709 13:02:23.247784  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:23.228474  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:23.070276  8831 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:23.251029  2324 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:02:23.214461  8836 log.cc:927] Time spent T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.094s	user 0.000s	sys 0.003s
W20260709 13:02:23.246302  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 97148.6us
I20260709 13:02:23.167284  8811 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:23.252343  8855 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.159s	user 0.000s	sys 0.003s
I20260709 13:02:23.291271  1675 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:23.286629  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:23.294721  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:23.295874  1704 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:23.247424  8580 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:23.299638  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:23.302062  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:23.303026  2325 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
W20260709 13:02:23.303933  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 93934.9us
W20260709 13:02:23.307855  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 79494.8us
I20260709 13:02:23.309548  1599 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:23.309775  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:23.311340  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:23.308442  1598 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:23.313966  8829 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:23.314479  8829 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:23.314842  8829 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:23.316682  8528 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:23.317466  8214 consensus_queue.cc:1048] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:02:23.318143  8857 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:02:23.321936  8831 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:23.323392  8395 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:23.323980  8395 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.324461  8395 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:23.330974  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:23.287117  8687 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:23.342805  8528 raft_consensus.cc:697] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:23.343379  8794 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:23.343917  8528 consensus_queue.cc:237] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:23.346088  8019 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:23.346565  8019 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:23.346967  8019 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:23.283773  8677 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:23.347366  8622 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:23.316510  8797 consensus_queue.cc:1048] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:23.335842  1702 raft_consensus.cc:1275] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:02:23.337028  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.340171  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:23.296097  8415 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:23.335811  8615 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:23.286397  8318 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:23.342350  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 128045us
W20260709 13:02:23.357542  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47899.6us
I20260709 13:02:23.357970  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:23.358290  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:23.342887  8687 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:23.159971  1449 catalog_manager.cc:5697] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 13 to 16, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.368664  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:23.358371  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:23.337550  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:23.279870  8812 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:23.306653  8839 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:23.370168  1673 leader_election.cc:336] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.593s (SENT)
I20260709 13:02:23.297842  8745 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.306313  8689 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:23.330765  8820 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:23.367146  8687 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:23.405412  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 47564.6us
I20260709 13:02:23.408116  1555 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:23.371359  8045 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:23.422597  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64384.8us
I20260709 13:02:23.424604  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:23.396772  8580 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:23.398778  8813 raft_consensus.cc:2804] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:23.401752  8794 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:23.437561  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 67466.3us
I20260709 13:02:23.438431  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:23.403610  8028 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:23.427922  1526 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:23.431833  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:23.434584  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:23.374694  8615 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:23.461577  1635 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20.
I20260709 13:02:23.398869  8745 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:23.466359  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.466681  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:23.471571  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:23.472754  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 81665.4us
W20260709 13:02:23.476011  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.435578  8813 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.425995  8711 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 13:02:23.441653  8318 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:23.441998  8580 raft_consensus.cc:697] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:02:23.484767  8828 consensus_meta.cc:287] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
W20260709 13:02:23.514976  1673 leader_election.cc:336] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.551s (SENT)
I20260709 13:02:23.515688  1673 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:23.499007  1705 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20.
W20260709 13:02:23.489699  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 61898.2us
I20260709 13:02:23.517436  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:23.509663  1675 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:23.522147  1626 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:23.488046  8813 raft_consensus.cc:3060] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:23.527122  1675 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:23.532897  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 201432us
I20260709 13:02:23.535167  1599 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:23.537778  2327 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
W20260709 13:02:23.538882  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.499598  8214 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:23.540633  1523 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:23.542646  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
W20260709 13:02:23.553431  8862 log.cc:927] Time spent T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:02:23.558452  8580 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:23.563213  8812 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:23.564949  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:23.565791  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:23.566365  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:23.568828  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
I20260709 13:02:23.577104  1449 catalog_manager.cc:5697] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.542402  8686 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:23.657254  8686 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:23.657585  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 142718us
I20260709 13:02:23.658396  8510 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:23.484185  8045 consensus_queue.cc:1048] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:02:23.601498  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:23.519606  8794 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:23.654500  1554 raft_consensus.cc:3060] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.654749  1557 raft_consensus.cc:3060] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:23.655344  1559 raft_consensus.cc:3060] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:23.657815  8686 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:23.597637  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 57189.1us
I20260709 13:02:23.672258  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:02:23.662781  8864 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:02:23.606487  8239 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:23.606500  8780 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:23.535512  8750 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:23.594841  8350 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:23.678561  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 114889us
W20260709 13:02:23.684022  8863 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:02:23.695026  1557 raft_consensus.cc:2468] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:23.530547  8748 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:02:23.593083  8531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.016s
I20260709 13:02:23.529188  8828 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:23.717141  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 272996us
I20260709 13:02:23.607786  8848 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:23.595985  8811 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 13:02:23.740471  1559 raft_consensus.cc:2468] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:02:23.750174  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:23.604431  8214 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:23.701593  8682 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.753712  1558 raft_consensus.cc:1275] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:02:23.679678  8794 raft_consensus.cc:697] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:02:23.760102  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 225141us
I20260709 13:02:23.717614  8799 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.719198  8350 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
W20260709 13:02:23.740697  8531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.009s	sys 0.016s
I20260709 13:02:23.811905  8350 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:23.739693  8780 raft_consensus.cc:697] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:23.816310  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1"
W20260709 13:02:23.804961  8864 log.cc:927] Time spent T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:02:23.800966  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 13:02:23.810456  8622 raft_consensus.cc:2804] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:23.751471  8748 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:23.810316  8799 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:23.825770  8860 log.cc:927] Time spent T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:02:23.839635  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e4c78b411eb34b3d92183a86d34a81f1" is_pre_election: true
I20260709 13:02:23.842111   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:02:23.822733  8824 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.805020  8682 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:23.847668  1556 raft_consensus.cc:2393] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 13: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:23.858170  1558 raft_consensus.cc:2410] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:02:23.902381  1554 raft_consensus.cc:2468] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 13.
W20260709 13:02:23.866345  8619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.070s	sys 0.086s
W20260709 13:02:23.974027  1673 leader_election.cc:336] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 2.195s (SENT)
I20260709 13:02:23.861907  8622 raft_consensus.cc:697] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:23.975095  1673 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:23.979071  8874 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 13:02:23.972782  8619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.070s	sys 0.086s
I20260709 13:02:23.853441  8824 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:23.862252  8415 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.114s
I20260709 13:02:23.967118  8745 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:23.981174  8828 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:23.832453  1449 catalog_manager.cc:5697] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 14 to 18, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 18 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:24.005138  8829 consensus_meta.cc:287] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.690s	user 0.013s	sys 0.001s
W20260709 13:02:24.001873  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 206309us
W20260709 13:02:24.036338  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 62403.7us
W20260709 13:02:24.022456  8395 consensus_meta.cc:287] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.002s
W20260709 13:02:24.035956  8019 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.688s	user 0.014s	sys 0.000s
I20260709 13:02:24.038446  8214 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:24.002496  8823 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:24.025068  8622 consensus_queue.cc:237] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:23.950433  8794 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:24.069597  2329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.007s	sys 0.013s
W20260709 13:02:24.101856  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.137363  2329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.008s	sys 0.014s
W20260709 13:02:24.138079  1673 leader_election.cc:336] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.533s (SENT)
W20260709 13:02:24.105676  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 295951us
I20260709 13:02:24.108438  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33810 (request call id 1594) took 1099 ms. Trace:
I20260709 13:02:23.958578  8780 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:24.136649  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.144536  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.032572  8829 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.143115  1555 rpcz_store.cc:276] 0709 13:02:23.009482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.009646 (+   164us) service_pool.cc:224] Handling call
0709 13:02:23.064470 (+ 54824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.412666 (+348196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.071875 (+659209us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54001d83d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:24.108373 (+ 36498us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790290304}
I20260709 13:02:24.165469  1626 raft_consensus.cc:1240] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:24.152951  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 431993us
I20260709 13:02:24.168063  8682 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:24.174624  8686 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.165148  8799 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:24.154613  8875 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:24.119295  8019 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.116647  8395 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.195465  1631 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:24.221774  1701 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:24.203200  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:24.220832  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 421345us
W20260709 13:02:24.198676  8839 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.814s	user 0.015s	sys 0.001s
W20260709 13:02:24.266685  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 469589us
I20260709 13:02:24.274483  1599 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:24.221928  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.276449  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:02:24.191352  8813 consensus_meta.cc:287] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.003s
W20260709 13:02:24.176522  8805 consensus_meta.cc:287] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 1.007s	user 0.017s	sys 0.000s
I20260709 13:02:24.196516  8019 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:24.267902  8876 log.cc:927] Time spent T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.097s	user 0.001s	sys 0.001s
I20260709 13:02:24.384056  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:24.395857  1704 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:24.212337  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 53191.9us
I20260709 13:02:24.200531  8395 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:24.196954  8883 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:24.219630  8687 consensus_meta.cc:287] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.782s	user 0.012s	sys 0.001s
I20260709 13:02:24.191879  8686 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:24.275770  8510 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.005s
I20260709 13:02:24.378260  8812 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:24.217489  8619 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:24.202715  8824 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:24.236167  8848 raft_consensus.cc:697] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:02:24.405624  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 184194us
I20260709 13:02:24.435109  1672 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:24.377884  8799 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:24.190263  8829 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:24.434015  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 282584us
W20260709 13:02:24.415715  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 141377us
I20260709 13:02:24.275702  8822 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.434931  1628 raft_consensus.cc:1275] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:24.442621  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:24.443239  1702 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:24.418500  8510 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:24.444847  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:24.378082  8350 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.441280  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:24.410413  8531 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.453539  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:24.387926  8813 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.457336  1701 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:24.457319  1700 raft_consensus.cc:1217] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Deduplicated request from leader. Original: 14.13->[17.14-19.15]   Dedup: 17.14->[19.15-19.15]
I20260709 13:02:24.458457  1700 raft_consensus.cc:1240] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 19. Current term is 20. Ops: [17.14-19.15]
I20260709 13:02:24.460368  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:24.460983  1628 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:24.430584  8872 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:24.461979  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:24.463128  1627 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:24.462992  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:24.464093  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:24.400930  8805 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.182718  8875 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.474308  1599 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:24.475541  8875 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:24.476040  1599 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:24.478222  8887 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:24.479779  8887 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:24.480216  8887 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:24.480381  8797 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:24.480834  8686 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.481237  8797 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:24.481627  8887 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:24.481441  8686 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.435252  8523 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.484755  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:24.492066  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:24.495631  1704 raft_consensus.cc:2468] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:02:24.469748  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:24.502504  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:24.497275  1599 leader_election.cc:400] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17.
I20260709 13:02:24.503438  1599 leader_election.cc:403] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:24.481736  8797 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:24.504535  1557 raft_consensus.cc:2393] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 20: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:24.421290  8687 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.505947  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:24.514431  1633 raft_consensus.cc:2410] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 24 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 13:02:24.506915  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:24.417223  8883 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.465067  8853 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:24.515420  1701 raft_consensus.cc:2410] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:02:24.507361  8686 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:24.518036  8848 consensus_queue.cc:237] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.488744  8822 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.518473  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:24.520926  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:24.521507  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 3089) took 1086 ms. Trace:
I20260709 13:02:24.522002  1630 rpcz_store.cc:276] 0709 13:02:23.430088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.430390 (+   302us) service_pool.cc:224] Handling call
0709 13:02:23.430773 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.439528 (+  8755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.439561 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:23.463159 (+ 23598us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.967100 (+503941us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:23.967141 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.967215 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.516701 (+549486us) raft_consensus.cc:1685] finished
0709 13:02:24.516727 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.516854 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33807,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":11476,"thread_start_us":468709,"threads_started":1,"wal-append.queue_time_us":687493}
I20260709 13:02:24.523892  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:24.524518  1630 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:24.471598  8531 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.192054  1449 catalog_manager.cc:5697] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:24.521574  1633 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:24.529829  8531 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:24.529491  1449 catalog_manager.cc:5697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 8 to 10, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:02:24.531246  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 44091.2us
I20260709 13:02:24.466333  8812 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.538393  1630 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:24.538571  8812 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:24.539347  8686 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.475581  8805 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:24.540411  8350 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:24.540962  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:24.542039  8813 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:24.542363  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:24.560093  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:24.560873  1627 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:24.563225  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:24.564260  2321 raft_consensus.cc:2393] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 21: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:24.494091  8677 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:24.543541  1633 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 23.
I20260709 13:02:24.544809  1629 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 24.
I20260709 13:02:24.568554  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:24.539654  1628 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:02:24.570988  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:24.571626  1628 raft_consensus.cc:2376] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 23. Re-sending same reply.
W20260709 13:02:24.554602  1526 connection.cc:256] RPC call timeout handler was delayed by -1.5789063349999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:02:24.549738  1634 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
W20260709 13:02:24.573315  1526 connection.cc:256] RPC call timeout handler was delayed by -1.054669481000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 13:02:24.552008  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:24.554900  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:24.436429  8619 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.449750  8799 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.575556  8805 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:24.575445  8890 consensus_queue.cc:1048] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:24.576227  8805 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.577212  8812 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.577726  8812 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.558032  1704 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:02:24.565697  2325 raft_consensus.cc:1240] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:24.565951  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 114922us
I20260709 13:02:24.579771  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:24.584661  8812 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:24.585187  8799 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:24.501377  8886 consensus_queue.cc:1048] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:02:24.587890  8677 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.588338  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 3094) took 1059 ms. Trace:
I20260709 13:02:24.589735  8894 consensus_queue.cc:1048] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.011s
I20260709 13:02:24.559708  8895 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:24.592033  1630 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:24.605379  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:24.599638  1627 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:24.602051  1702 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:02:24.594818  1626 rpcz_store.cc:276] 0709 13:02:23.528891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.537047 (+  8156us) service_pool.cc:224] Handling call
0709 13:02:23.673788 (+136741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.165919 (+492131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.588072 (+422153us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54000d9dd4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:24.588275 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130838272}
I20260709 13:02:24.591293  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60066 (request call id 3092) took 1160 ms. Trace:
I20260709 13:02:24.514653  8523 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.608368  1634 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:02:24.608299  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:24.613672  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:24.615619  1627 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:02:24.573216  8839 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439) with higher term. Message: Invalid argument: T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 16. Current term is 17.
I20260709 13:02:24.609459  1631 rpcz_store.cc:276] 0709 13:02:23.430945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.433738 (+  2793us) service_pool.cc:224] Handling call
0709 13:02:23.434139 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.223654 (+789515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.591022 (+367368us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b5400206054. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:24.591212 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1751325568}
I20260709 13:02:24.620563  1700 raft_consensus.cc:2393] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 18: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:24.624033  8805 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:24.626045  8619 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:24.626253  8677 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:24.628904  8523 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:24.629657  1701 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:24.645638  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:24.646394  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:24.647099  1704 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
I20260709 13:02:24.647606  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:24.653751  1660 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:44807 (4 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:44807 timed out after 15.000s (SENT)
I20260709 13:02:24.618330  8895 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.670109  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:24.671442  8895 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:24.672919  8748 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:24.655012  8687 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:24.657922  8822 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:24.675088  8883 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:24.661381  8893 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
I20260709 13:02:24.665962  8615 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:24.666610  8045 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:24.572471  8686 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.531390  1449 catalog_manager.cc:5697] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 13 to 15, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:24.681823  1601 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:24.683581  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:24.683769  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:24.699584  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:24.684296  1633 raft_consensus.cc:1240] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 15. Current term is 16. Ops: [14.12-15.13]
I20260709 13:02:24.685534  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:24.686401  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:24.686810  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:24.703047  1703 raft_consensus.cc:2410] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:02:24.699681  2328 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 23.
W20260709 13:02:24.705971  1673 leader_election.cc:336] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.543s (SENT)
I20260709 13:02:24.706272  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:24.706570  1673 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:24.706934  1702 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:24.692752  1701 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
W20260709 13:02:24.710861  1673 leader_election.cc:336] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.561s (SENT)
I20260709 13:02:24.711655  1673 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:24.713354  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:24.714095  1708 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:24.708839  1601 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:24.628324  8797 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.712913  8531 raft_consensus.cc:2804] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:24.709374  8872 raft_consensus.cc:3055] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:02:24.717804  1673 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.621s (SENT)
I20260709 13:02:24.728730  1673 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:24.722309  8619 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:24.720738  8820 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:02:24.738380  1673 leader_election.cc:336] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Timed out: RequestConsensusVote RPC to 127.0.107.193:43439 timed out after 1.642s (SENT)
I20260709 13:02:24.746404  8214 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:24.746637  8890 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.727799  8822 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:24.747485  8890 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.747515  8822 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.750344  8822 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:24.757326  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.728431  8872 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:24.765146  1707 raft_consensus.cc:1240] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:24.731817  8531 raft_consensus.cc:697] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:24.769402  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:24.770206  1709 raft_consensus.cc:2393] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 20: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:24.770675  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:24.771504  2328 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
W20260709 13:02:24.774551  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 200395us
I20260709 13:02:24.777385  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:24.780352  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:24.781738  1526 leader_election.cc:400] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19.
I20260709 13:02:24.782778  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:24.812117  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.817672  1708 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 19.
I20260709 13:02:24.818823  1707 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:24.819515  1601 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:24.821832  8350 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:24.825888  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58640 (request call id 1717) took 1459 ms. Trace:
I20260709 13:02:24.825920  8350 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.826363  2325 rpcz_store.cc:276] 0709 13:02:23.366159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.382088 (+ 15929us) service_pool.cc:224] Handling call
0709 13:02:23.382537 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.582007 (+1199470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.825608 (+243601us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54004551d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:24.825802 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2721917312}
I20260709 13:02:24.827428  8887 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.827906  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:24.828307  8350 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:24.828549  1706 raft_consensus.cc:3060] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:24.801011  8890 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:24.843575  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:24.844556  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:24.846457  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 276609us
W20260709 13:02:24.832401  2286 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:24.819940  8780 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:24.842078  8870 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.018s	sys 0.031s
W20260709 13:02:24.876350  8903 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:02:24.848213  8840 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.897946  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:24.883579  8870 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.021s	sys 0.033s
W20260709 13:02:24.903033  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 291415us
I20260709 13:02:24.899013  2328 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:24.907267  1708 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:24.833407  8841 consensus_queue.cc:1059] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.060s
W20260709 13:02:24.911266  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 128626us
I20260709 13:02:24.914062  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:24.830013  8828 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:24.915452  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:24.834980  8884 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 13:02:24.922376  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:24.923264  1628 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:24.925043  1633 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:02:24.829824  8887 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:24.938795  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:24.896663  8686 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:24.939584  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:24.940021  1630 raft_consensus.cc:2393] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 17: Already voted for candidate e4c78b411eb34b3d92183a86d34a81f1 in this term.
I20260709 13:02:24.834205  8813 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:24.805639  1449 catalog_manager.cc:5697] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:24.945747  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:24.948546  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:24.953437  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:24.954434  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:24.830360  8531 consensus_queue.cc:237] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:24.837054  8872 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:24.947669  2286 leader_election.cc:336] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:24.965642  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:24.966140  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:24.943913  8901 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:24.945382  8711 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:24.966760  2328 raft_consensus.cc:2468] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
W20260709 13:02:24.971974  2286 leader_election.cc:336] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:24.950733  8828 raft_consensus.cc:697] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:24.915016  8350 consensus_queue.cc:1059] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:02:24.955276  8780 raft_consensus.cc:2804] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:24.976423  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:24.972954  2286 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:24.958530  8686 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:24.904074  8840 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:24.977557  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 163927us
I20260709 13:02:24.940660  8848 consensus_queue.cc:1059] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:02:24.984120  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:24.992771  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:24.980234  2286 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:24.994454  8902 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:24.994594  8828 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.995296  8902 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:24.997099  8350 raft_consensus.cc:3055] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:24.997529  8350 raft_consensus.cc:740] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
W20260709 13:02:24.999034  8908 log.cc:927] Time spent T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:25.000764  8914 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:25.001879  8866 log.cc:927] Time spent T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 1.544s	user 0.000s	sys 0.012s
I20260709 13:02:24.966686  8906 raft_consensus.cc:2764] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:25.006210  2326 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 13:02:25.006843  8889 log.cc:927] Time spent T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.512s	user 0.002s	sys 0.000s
I20260709 13:02:25.009692  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:24.998510  8350 consensus_queue.cc:260] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:25.012871  1523 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:24.969028  8901 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:24.969329  8813 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:24.969599  8677 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:24.978729  8797 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:24.964674  8891 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:02:25.027808  1523 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:24.981868  8780 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.981774  8883 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:25.026604  8914 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:25.060710  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:25.060246  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:25.061563  1630 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:02:24.986079  8687 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:02:25.020606  8901 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:24.978411  8711 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.039614  8915 raft_consensus.cc:2804] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:25.030961  1706 raft_consensus.cc:2468] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 21.
W20260709 13:02:25.047350  1673 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:25.077297  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:25.087456  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:25.041113  8906 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:25.060199  8907 log.cc:927] Time spent T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:02:25.041855  8780 raft_consensus.cc:3060] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:25.020699  8841 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
I20260709 13:02:25.046092  1598 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:25.093107  2323 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:02:25.110147  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 80673.8us
I20260709 13:02:25.114429  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:02:25.117764  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 127454us
I20260709 13:02:25.122066  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:02:25.127699  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 136091us
I20260709 13:02:25.088876  8902 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:25.085172  8915 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:25.040326  8813 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.040495  8677 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.102170  8906 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.091787  8914 raft_consensus.cc:476] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Not starting pre-election -- already a leader
I20260709 13:02:25.143607  8823 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:25.143853  8510 consensus_queue.cc:1059] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:25.144141  8924 consensus_queue.cc:1059] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:25.144912  1672 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:25.147473  8711 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:25.147832  8872 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:25.158913  8916 log.cc:927] Time spent T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:02:25.154518  1673 leader_election.cc:336] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:25.170879  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:25.176311  1672 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:02:25.176620  1673 leader_election.cc:336] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:25.180209  1673 leader_election.cc:336] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:25.183337  8677 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:25.183733  8615 raft_consensus.cc:3055] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:25.173838  8914 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:25.173600  8214 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:25.190241  8813 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:25.141279  8915 raft_consensus.cc:3060] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:25.201574  8840 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:25.230893  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50755.5us
W20260709 13:02:25.231876  1673 leader_election.cc:336] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:25.202765  8924 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:02:25.171178  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 125341us
I20260709 13:02:25.208849  8619 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:25.209278  8510 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:25.160753  8906 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:25.275965  8905 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.276949  8905 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.280118  8905 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:25.280676  8813 raft_consensus.cc:3055] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:25.281181  8813 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:25.282235  8813 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:25.284053  8813 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:25.229846  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 101024us
I20260709 13:02:25.232736  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:25.223464  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 194539us
I20260709 13:02:25.226101  8615 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:25.232677  8677 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:25.292047  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:25.295240  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.299280  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:25.300251  2322 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 22.
W20260709 13:02:25.298301  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 176399us
I20260709 13:02:25.303340  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:02:25.308293  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 76508.1us
W20260709 13:02:25.309240  1673 leader_election.cc:336] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:25.310199  1673 leader_election.cc:336] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:25.310693  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:25.302523  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:25.268146  8619 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:25.273844  8510 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:25.325589  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:25.288729  8794 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.288280  8914 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.337380  8927 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:25.338268  8615 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:25.340152  8615 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:25.317726  8622 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:25.329119  8619 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:02:25.334901  8822 consensus_meta.cc:287] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.005s
I20260709 13:02:25.328039  8510 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:25.354336  8622 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:25.362257  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 185186us
W20260709 13:02:25.377002  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 66850.4us
W20260709 13:02:25.377926  1673 leader_election.cc:336] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:25.379124  1673 leader_election.cc:336] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:25.379626  1673 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:25.381668  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 78470.4us
I20260709 13:02:25.385718  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:25.388291  1633 raft_consensus.cc:1240] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:25.390303  1672 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:25.351825  8794 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:25.397925  1673 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:25.377619  8622 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:02:25.400048  1673 leader_election.cc:336] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:25.407126  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.363673  8822 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:25.393045  8870 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.413549  8214 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:25.414021  8926 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:25.395110  8841 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:25.424974  8904 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:25.425487  8936 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.351590  8914 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.486775  8677 raft_consensus.cc:697] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:02:25.488569  8932 log.cc:927] Time spent T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:02:25.489743  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.517104  8920 log.cc:927] Time spent T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:02:25.470362  8936 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:25.439200  8780 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:25.433061  8870 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.614625  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:25.615439  1705 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22.
I20260709 13:02:25.594126  8822 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:25.593844  8677 consensus_queue.cc:237] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:25.595108  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 209724us
I20260709 13:02:25.487353  8929 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:25.432482  8811 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:25.611626  8939 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:25.629433  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:25.634588  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:25.635330  1704 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 21.
I20260709 13:02:25.661584  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:25.663077  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:25.663446  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:25.625304  8901 consensus_meta.cc:287] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.520s	user 0.012s	sys 0.000s
I20260709 13:02:25.666232  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:25.677450  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:25.677798  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:25.678306  1628 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 15: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:25.634827  8904 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:25.641425  8914 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:25.688433  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:25.618713  8820 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:02:25.692427  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:25.677620  8922 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:25.640388  8939 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:25.696723  8872 consensus_meta.cc:287] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.002s
I20260709 13:02:25.713115  8689 raft_consensus.cc:3055] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:02:25.714421  8930 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:02:25.722816  8921 log.cc:927] Time spent T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.381s	user 0.004s	sys 0.002s
I20260709 13:02:25.729151  8820 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:25.734856  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:25.739773  1630 raft_consensus.cc:1240] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:25.742324  8936 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:25.751005  8820 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:25.739143  8689 raft_consensus.cc:740] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:25.715946  8510 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.753420  8689 consensus_queue.cc:260] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.754104  8906 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.754725  8689 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:25.675575  8901 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:25.756202  8925 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:02:25.748374  8794 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:25.757467  8901 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 25 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:25.746542  8622 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.761340  8622 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:25.691857  8904 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:25.707466  8922 raft_consensus.cc:697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:25.768952  8820 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:25.770000  8904 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:02:25.767311  8510 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:25.770056  8870 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:25.777555  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.778170  2286 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:25.780510  8711 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:02:25.781299  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 378541us
I20260709 13:02:25.781162  8711 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.782743  2288 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:25.783746  8711 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:25.784010  2288 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:25.784761  8894 consensus_queue.cc:1059] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:02:25.785039  8922 consensus_queue.cc:237] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:25.785838  8894 raft_consensus.cc:2804] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:02:25.784981  8933 log.cc:927] Time spent T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:02:25.786357  8894 raft_consensus.cc:697] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:25.787262  8894 consensus_queue.cc:237] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.789301  8580 raft_consensus.cc:3055] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:25.789799  8580 raft_consensus.cc:740] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:25.790706  8580 consensus_queue.cc:260] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.791723  8780 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:25.792114  8580 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:25.792338  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:25.793393  8895 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.794217  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:25.793996  8895 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.798313  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:25.799435  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:25.800148  2327 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:25.800208  1633 raft_consensus.cc:1240] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:25.803701  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:25.797786  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:25.805162  2328 raft_consensus.cc:2410] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:02:25.805444  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:25.806319  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:25.793640  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:25.817314  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:25.821172  1707 raft_consensus.cc:1240] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 24. Current term is 25. Ops: []
I20260709 13:02:25.821365  2320 raft_consensus.cc:3055] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:25.823835  2320 raft_consensus.cc:740] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:25.824026  2327 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 23.
I20260709 13:02:25.825906  2325 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 22. Current term is 23. Ops: [20.15-22.16]
I20260709 13:02:25.828876  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:25.825775  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:25.831166  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:25.813194  8915 consensus_meta.cc:287] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.000s
I20260709 13:02:25.824707  2320 consensus_queue.cc:260] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.838146  2320 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:25.762465  8619 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.836840  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:25.839720  8547 consensus_queue.cc:1059] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:25.813261  8884 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:25.845651  8547 raft_consensus.cc:3055] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:02:25.846240  8547 raft_consensus.cc:740] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:25.846364  8939 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:25.847472  1632 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:25.821857  8897 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:25.850293  8897 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:25.850740  8897 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:25.854813  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:25.855862  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:25.857622  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:25.859853  1702 raft_consensus.cc:1240] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:25.853106  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:25.863616  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:25.831920  8812 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:25.864179  1707 raft_consensus.cc:2393] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:25.868057  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:25.837108  8936 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:25.836784  8045 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:02:25.875427  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.871417  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:25.873410  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:25.873596  8939 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:25.843391  8915 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.874329  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:25.882470  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.898082  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:25.854728  8884 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:25.875929  8799 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:25.913808  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 135085us
I20260709 13:02:25.869194  8811 consensus_queue.cc:1059] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:02:25.909575  8884 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:25.911944  8812 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:02:25.921392  2286 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:25.909674  8904 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:25.918766  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:25.928421  2286 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:25.912961  8045 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:02:25.931958  2286 leader_election.cc:336] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:25.932670  2286 leader_election.cc:336] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:25.933050  2286 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:25.916751  8936 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:02:25.935467  2286 leader_election.cc:336] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:25.935940  2286 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:25.939085  1526 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:25.942919  8902 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:25.936829  8804 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:25.945355  8931 log.cc:927] Time spent T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.516s	user 0.000s	sys 0.011s
I20260709 13:02:25.946238  8899 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:25.946671  8899 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:25.947454  8899 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.949221  8045 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:25.957209  8944 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:02:25.959568  8619 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 24 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:25.841117  8802 consensus_queue.cc:1175] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" responder_term: 19 status { last_received { term: 17 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:25.964618  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:25.936342  8415 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:25.967347  1706 raft_consensus.cc:1275] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:25.967796  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:25.968605  1701 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 19.
I20260709 13:02:25.942250  8677 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:25.972826  8834 raft_consensus.cc:3055] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:25.973333  8834 raft_consensus.cc:740] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:25.974135  8834 consensus_queue.cc:260] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:25.974741  8906 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:25.976157  8528 consensus_queue.cc:1059] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:25.978411  8885 raft_consensus.cc:3055] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:25.978837  8885 raft_consensus.cc:740] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:25.979708  8885 consensus_queue.cc:260] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:25.985222  8935 log.cc:927] Time spent T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.556s	user 0.001s	sys 0.006s
I20260709 13:02:25.975183  8834 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:25.980872  8895 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:25.931782  8904 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.989017  8939 raft_consensus.cc:3055] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:25.989506  8939 raft_consensus.cc:740] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:25.990386  8939 consensus_queue.cc:260] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:25.982270  8936 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:25.994343  8936 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:25.996165  8897 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:25.940907  2286 leader_election.cc:336] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:25.998191  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 57347.3us
I20260709 13:02:25.948464  8899 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:25.982975  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:26.005100  1675 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:26.040853  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:26.043565  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:26.052560  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:26.055287  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:26.063611  1703 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:26.057757  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 119121us
I20260709 13:02:26.055653  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:26.056916  1702 raft_consensus.cc:1275] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:26.057317  2321 raft_consensus.cc:1240] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:26.057885  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:26.067528  1707 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:02:26.068087  8906 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:26.068672  8906 raft_consensus.cc:697] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:26.051131  8890 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:02:26.069651  8906 consensus_queue.cc:237] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:26.057165  8510 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:02:26.071143  8510 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:26.071511  8510 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:26.004287  8885 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:26.051903  8523 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:26.090193  8884 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:26.091317  1706 raft_consensus.cc:1240] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:26.076859  2320 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:02:26.092232  2320 pending_rounds.cc:85] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Aborting all ops after (but not including) 12
I20260709 13:02:26.092628  2320 pending_rounds.cc:107] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:02:26.009225  8939 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:26.088240  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.089255  8853 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:26.092989  2320 raft_consensus.cc:2889] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:26.094296  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:26.043689  8677 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:26.101191  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:26.110081  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:26.110242  2286 leader_election.cc:336] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:26.111325  2286 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:26.114514  8905 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:26.115765  8622 consensus_queue.cc:1048] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:26.114805  8884 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:26.117002  8804 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:26.117939  2323 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:26.118355  8923 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:26.073412  8547 consensus_queue.cc:260] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:26.120817  8547 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:26.120877  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:26.123292  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:26.124665  8799 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:26.123895  8922 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:26.125675  1601 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:26.092505  8350 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:26.126574  8689 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:26.127231  8689 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.127674  8689 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:26.128362  8531 consensus_queue.cc:1048] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:26.131054  8853 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:26.131500  8853 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:26.131770  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:26.132617  8531 consensus_queue.cc:1059] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:26.132432  8853 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:26.133857  8905 raft_consensus.cc:3055] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:26.134047  8915 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:26.134361  8905 raft_consensus.cc:740] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:26.134543  8839 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:26.072419  8510 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:26.135149  8839 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:26.135675  8510 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:26.139782  8822 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.139998  8622 consensus_queue.cc:1059] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:02:26.140390  8822 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:26.141263  8841 raft_consensus.cc:3055] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:26.141659  8841 raft_consensus.cc:740] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:26.142402  8841 consensus_queue.cc:260] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:26.143801  8841 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:26.135286  8905 consensus_queue.cc:260] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:26.142781  8822 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:26.144528  8904 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:26.144670  8839 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:26.145269  8905 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:26.146567  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:26.149303  1675 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:26.141186  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:26.150322  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:26.152125  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:26.152661  1703 raft_consensus.cc:2468] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 19.
I20260709 13:02:26.152827  1704 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 19.
I20260709 13:02:26.154683  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:26.156184  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:26.157193  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:26.159198  1601 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:26.161684  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.190872  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:26.214115  1672 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:26.157506  2323 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 21.
I20260709 13:02:26.133857  8853 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:02:26.216480  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 57445.8us
I20260709 13:02:26.225673  1629 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 LEADER]: Rejecting Update request from peer 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:02:26.166524  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:26.166524  2286 leader_election.cc:336] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.207103  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:26.100368  8941 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:26.216562  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:26.228248  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 61787.7us
I20260709 13:02:26.215600  8839 raft_consensus.cc:2804] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:26.219730  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:26.221329  1633 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:26.231868  1601 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:26.183979  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:26.233228  1632 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 18: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:26.234462  1702 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:26.174263  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:26.229326  1626 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:02:26.231307  2286 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.227535  1707 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:26.215616  8901 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:26.246480  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:26.249845  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:26.251869  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:26.165333  8890 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:02:26.255410  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 284708us
W20260709 13:02:26.257862  2286 leader_election.cc:336] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.258896  2286 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:26.263039  8923 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:26.267817  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:26.268800  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.269145  1702 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 21.
I20260709 13:02:26.270186  8794 raft_consensus.cc:3060] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:26.255053  8929 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:26.286744  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:26.287447  8615 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:26.290323  8615 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:26.293462  8946 log.cc:927] Time spent T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:26.298840  8615 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:26.289148  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:26.289647  8929 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:26.288981  1523 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:26.301045  8941 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:26.301716  8941 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 21 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:26.302793  8941 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:26.307669  1599 consensus_peers.cc:597] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:26.308951  1599 consensus_peers.cc:597] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:26.309670  2323 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:26.311813  8929 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:02:26.326110  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.263921  8952 log.cc:927] Time spent T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 13:02:26.329896  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:26.256029  8799 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:26.349783  1702 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:26.347517  1526 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:26.353012  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:26.309932  1599 leader_election.cc:336] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.318082  8804 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:26.355907  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:26.354573  1599 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:26.323122  8045 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:26.360944  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:26.366537  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.317193  8794 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:26.378427  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 68612.4us
I20260709 13:02:26.343910  8839 raft_consensus.cc:697] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:26.356544  8929 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:26.354463  8812 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:26.405906  8812 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:26.406409  8812 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:26.407572  2287 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.413168  8929 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:26.415637  8689 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:26.416455  2286 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.416913  2285 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.373273  8811 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:26.418258  8689 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:26.373250  8780 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:26.420665  8622 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:26.393601  1599 leader_election.cc:336] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.246284  8677 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:26.358577  8686 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:26.360008  8045 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.404485  8839 consensus_queue.cc:237] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:26.426781  1599 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:26.470088  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:26.470992  1704 raft_consensus.cc:3060] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:26.394026  8897 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:26.488557  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 95047.6us
W20260709 13:02:26.489450  1599 leader_election.cc:336] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.489899  1599 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:26.443094  8045 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:26.510689  1704 raft_consensus.cc:2468] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 20.
I20260709 13:02:26.533495  1601 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:26.498610  1599 consensus_peers.cc:597] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:26.512178  1708 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 23. Current term is 24. Ops: []
I20260709 13:02:26.497293  8841 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:26.500764  8870 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:26.536104  1599 leader_election.cc:336] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.550113  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:26.552088  1599 leader_election.cc:336] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.552742  1599 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:26.514771  8897 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:26.532366  8580 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:26.579653  8622 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:26.591718  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 440402us
I20260709 13:02:26.575333  8689 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:26.575836  8531 raft_consensus.cc:2804] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:26.586128  8906 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:26.603114  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.585337  8580 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:26.607512  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.608567  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.593271  8528 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.590031  8872 consensus_queue.cc:1059] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.019s
I20260709 13:02:26.590976  8897 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:26.626318  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 74305.4us
W20260709 13:02:26.627480  1599 consensus_peers.cc:597] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:26.628333  1599 leader_election.cc:336] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.628957  1599 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:26.627164  8872 raft_consensus.cc:3055] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:02:26.629995  8841 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:26.630427  8872 raft_consensus.cc:740] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:26.606549  8531 raft_consensus.cc:697] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:02:26.633872  1599 leader_election.cc:336] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:26.635084  1599 leader_election.cc:336] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.635596  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:26.640957  1709 raft_consensus.cc:1275] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:02:26.642840  1673 consensus_peers.cc:597] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:26.642917  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:26.640869  8939 consensus_meta.cc:287] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.004s
W20260709 13:02:26.649051  1599 leader_election.cc:336] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.660931  1599 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:26.662787  8905 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:26.664152  1599 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.664772  1599 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:26.653203  1673 consensus_peers.cc:597] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:26.607365  8906 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:26.670814  1599 consensus_peers.cc:597] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:26.671677  1673 consensus_peers.cc:597] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:26.663187  8959 log.cc:927] Time spent T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Append to log took a long time: real 0.050s	user 0.000s	sys 0.002s
I20260709 13:02:26.618122  8528 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:26.672931  8870 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:26.669552  8822 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:26.648880  8823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.004s	sys 0.019s
W20260709 13:02:26.672386  1599 consensus_peers.cc:597] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:26.726181  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 53873.5us
W20260709 13:02:26.727229  1599 consensus_peers.cc:597] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:26.690860  1673 consensus_peers.cc:597] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:26.686050  8531 consensus_queue.cc:237] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:26.717487  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.743201  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 70530.8us
W20260709 13:02:26.726457  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 354470us
W20260709 13:02:26.754110  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 382459us
W20260709 13:02:26.767779  1673 leader_election.cc:336] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.767908  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:26.768280  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:26.769127  2327 raft_consensus.cc:1240] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:26.712481  8939 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:26.823380  8939 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:26.825794  8939 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:26.826529  8686 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:26.827129  8686 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:26.829241  8686 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:26.832515  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64702.3us
W20260709 13:02:26.759819  8961 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:02:26.844614  1626 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Rejecting Update request from peer 6b9e73092f6146639bf310a3d18cfe37 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:02:26.847443  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:26.849476  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:26.812420  8941 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.834949  8622 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:26.836665  8939 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:26.858572  2326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.014s	sys 0.046s
W20260709 13:02:26.862340  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 94636.4us
W20260709 13:02:26.874372  2326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.014s	sys 0.047s
I20260709 13:02:26.863590  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:26.875005  1673 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.859603  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:26.875453  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:26.864017  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:26.860167  1701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.033s	sys 0.078s
W20260709 13:02:26.876413  1701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.033s	sys 0.078s
I20260709 13:02:26.869195  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:26.859177  1598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.004s	sys 0.046s
W20260709 13:02:26.877050  1599 leader_election.cc:336] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:26.877427  1598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.004s	sys 0.046s
I20260709 13:02:26.877502  1635 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
W20260709 13:02:26.878372  1599 leader_election.cc:336] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.878808  1599 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:26.879801  1599 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:26.880162  1599 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:26.875275  1632 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:02:26.845772  8689 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.884255  8580 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:26.870038  8848 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:26.867268  8890 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:26.932742  1673 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:26.933976  8812 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.527s	user 0.014s	sys 0.000s
I20260709 13:02:26.955320  1633 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:26.955385  8906 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:26.923888  8839 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:26.957662  8839 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.958753  8839 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:26.962437  8834 consensus_meta.cc:287] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.923s	user 0.011s	sys 0.000s
I20260709 13:02:26.964084  8839 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:26.965111  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:26.914820  8897 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:26.950719  1628 raft_consensus.cc:2468] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22.
I20260709 13:02:26.918365  8622 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:26.971277  8622 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:26.979453  8973 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:26.980430  8973 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:26.882899  8929 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.940826  8677 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:02:26.984362  8890 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:26.867055  8941 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:26.995802  8890 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:26.996333  8941 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:26.851958  8686 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:02:26.999800  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:27.002581  8045 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.006294  8973 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:27.007081  8973 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.007541  8939 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.007678  8973 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:27.008364  8968 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:27.008205  8939 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.010619  8939 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:27.011659  2320 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:02:27.012310  8939 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:26.991087  8929 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.013063  8939 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.014469  8929 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:27.015000  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:27.015223  8929 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:26.930632  8239 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:27.015684  8939 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:26.874379  8936 consensus_queue.cc:1059] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.109s
I20260709 13:02:27.016674  2320 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 16: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:27.018214  1629 raft_consensus.cc:2468] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:02:27.012491  8973 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:27.017139  8936 raft_consensus.cc:3055] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:27.019071  8936 raft_consensus.cc:740] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:27.020253  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:27.020009  8936 consensus_queue.cc:260] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.020936  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:26.993907  8964 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:27.017302  8799 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:26.917323  8934 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:27.025065  8528 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:27.026330  2286 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:27.029512  8045 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:26.955199  8812 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:27.041399  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:26.923827  8689 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:27.052793  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.052335  2323 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:02:26.952450  1673 leader_election.cc:336] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:27.065670  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 113303us
W20260709 13:02:27.066670  1673 consensus_peers.cc:597] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:27.067422  1673 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:27.067921  1673 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:27.082193  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:27.083207  1673 consensus_peers.cc:597] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:27.084012  1673 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:27.085177  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:27.087477  1673 leader_election.cc:336] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:27.093307  1673 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:27.064810  8619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.004s	sys 0.012s
I20260709 13:02:27.103055  1629 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:27.058753  8812 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:27.103399  1632 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:27.108660  8689 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:27.110200  1629 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:27.110795  8972 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:27.103741  8823 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:27.111677  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:27.112681  1634 raft_consensus.cc:2393] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 21: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:26.985611  8872 consensus_queue.cc:260] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.114156  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:27.114984  1634 raft_consensus.cc:2393] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 16: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
W20260709 13:02:27.105955  8619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.004s	sys 0.012s
I20260709 13:02:27.098585  8973 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:02:27.097565  8853 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:27.117620  1634 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:02:27.118824  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:27.119736  1629 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 18: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:27.123175  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:27.123883  1628 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:27.124395  8897 consensus_queue.cc:1048] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:27.135506  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:27.140455  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:27.142100  8811 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:02:27.139166  8780 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:27.141638  8929 raft_consensus.cc:3060] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:27.160835  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 281183us
I20260709 13:02:27.139233  8972 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:02:27.140411  8973 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:02:27.154608  8922 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:27.177093  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:27.178369  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 225450us
I20260709 13:02:27.176234  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.179498  1708 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 19: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:02:27.182278  1673 leader_election.cc:336] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:27.182801  1673 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:27.192778  1707 raft_consensus.cc:2393] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 21: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:27.194308  8528 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:27.194835  1673 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:27.197770  1701 raft_consensus.cc:1275] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:02:27.198025  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.168762  8899 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.198804  1706 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 16: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:27.200006  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:27.195474  1673 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:27.205391  1708 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:27.205793  1673 leader_election.cc:336] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:27.207474  1673 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:27.242434  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.244256  1701 raft_consensus.cc:2410] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:02:27.157915  8812 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:02:27.192117  8922 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.253358  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:27.257110  1629 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:02:27.254347  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:27.169723  8780 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:27.264305  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 58588.3us
W20260709 13:02:27.265198  1673 leader_election.cc:336] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:27.265630  1673 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:27.243446  8973 consensus_queue.cc:1243] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer 8106dfc0bda54df0ae10ba13c28ccc18 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:02:27.269752  1673 consensus_peers.cc:597] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:27.279389  1708 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 20.
I20260709 13:02:27.266294  8528 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:27.297646  1599 consensus_peers.cc:597] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:27.298313  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 136728us
I20260709 13:02:27.300895  8929 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:27.262070  8922 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:27.314580  8872 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:27.243219  8899 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.318674  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.319576  1704 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:02:27.321543  8899 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:27.336198  8977 log.cc:927] Time spent T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:02:27.338929  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:27.345433  2288 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:27.347235  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:27.275707  8853 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:27.354192  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.355192  1708 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 21.
I20260709 13:02:27.352777  8799 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.358357  2288 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:02:27.354723  1673 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:27.349431  8580 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.349704  8884 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:27.357226  8936 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:27.396977  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:27.397991  2328 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 21.
I20260709 13:02:27.401212  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:27.402097  2328 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:02:27.385370  1673 consensus_peers.cc:597] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:27.403801  1673 leader_election.cc:336] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:27.404742  1673 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:27.378449  8547 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:27.419452  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.423180  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.434229  1704 raft_consensus.cc:1240] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 23. Current term is 24. Ops: []
I20260709 13:02:27.453622  2328 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 20.
I20260709 13:02:27.414639  8897 raft_consensus.cc:2804] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:27.376713  8799 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:27.443609  8952 log.cc:927] Time spent T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:02:27.416806  8547 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:27.419209  8973 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:27.387038  8580 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:27.508601  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 65842.5us
I20260709 13:02:27.457839  8689 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:27.521339  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 117636us
W20260709 13:02:27.528481  1673 leader_election.cc:336] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:27.529501  1673 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:27.530742  1673 leader_election.cc:336] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:27.531194  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:27.496161  8965 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:02:27.525066  1675 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:27.532644  1598 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:27.493621  8984 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:27.553342  1673 leader_election.cc:336] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:27.554455  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:27.495507  8528 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:27.506094  8547 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:27.499153  8853 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:27.501423  8897 raft_consensus.cc:697] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 22 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:27.504253  8974 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.606560  1628 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:02:27.609007  1701 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:02:27.609632  1701 pending_rounds.cc:85] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 15
I20260709 13:02:27.609953  1701 pending_rounds.cc:107] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:02:27.610219  1701 raft_consensus.cc:2889] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:27.560084  8615 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:27.573592  8982 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:27.584195  8812 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.626329  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.531342  8973 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:27.603803  8045 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:27.605557  8804 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:27.550918  8689 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.652806  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.617713  8528 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:27.661527  1701 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:02:27.635649  8811 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:02:27.620561  8780 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:27.583923  8984 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:27.605080  8853 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.668229  8811 consensus_queue.cc:1243] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer 8106dfc0bda54df0ae10ba13c28ccc18 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:27.656428  8804 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.650961  8045 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:27.630513  8983 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.713899  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:27.716760  1627 raft_consensus.cc:2376] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22. Re-sending same reply.
W20260709 13:02:27.677016  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 318901us
I20260709 13:02:27.687786  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.692162  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.693485  8580 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:27.662245  8528 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.613452  8974 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.715579  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:27.673862  1706 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:02:27.633833  8812 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:27.666020  8615 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.759683  1704 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:27.690968  8897 consensus_queue.cc:237] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.766073  8922 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:27.767521  8812 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:27.723803  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:27.769716  1627 raft_consensus.cc:2368] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 19. Current term is 20.
I20260709 13:02:27.770609  8974 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:27.769174  1706 pending_rounds.cc:85] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 10
I20260709 13:02:27.771229  1706 pending_rounds.cc:107] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:02:27.771637  1706 raft_consensus.cc:2889] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:27.771724  8997 log.cc:927] Time spent T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:02:27.674454  8884 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.772903  8884 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.773519  8689 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:27.775465  8984 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:27.778373  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.780167  1701 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:27.781322  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.781620  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:27.785344  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 45625.4us
I20260709 13:02:27.784314  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:27.786666  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:27.787590  1627 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:27.675839  8915 raft_consensus.cc:3055] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:27.791002  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.798524  1706 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 21.
I20260709 13:02:27.799294  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:27.799479  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.721330  1707 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:27.799961  1628 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:02:27.800920  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.795692  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:27.809744  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:27.762545  8995 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:02:27.810341  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:27.761164  8988 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:02:27.761853  8993 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:02:27.812826  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 300371us
W20260709 13:02:27.757874  8996 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:27.822507  8804 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:27.824004  8984 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.763854  8973 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:27.824152  8884 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:27.768277  8922 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:27.816172  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:27.824059  1599 consensus_peers.cc:597] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:27.871843  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 47884.1us
I20260709 13:02:27.776371  8615 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.705113  8811 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:27.827014  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:27.825829  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:27.797134  8528 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:27.867705  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:27.878576  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 52869.2us
I20260709 13:02:27.879295  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:27.879942  1707 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:27.867705  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:27.860639  8872 consensus_meta.cc:287] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.005s
I20260709 13:02:27.870127  1701 raft_consensus.cc:1275] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:27.872303  1627 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
W20260709 13:02:27.872545  1599 leader_election.cc:336] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:27.883459  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:27.765353  8853 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:27.884496  1599 leader_election.cc:336] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:27.885718  1599 leader_election.cc:336] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:27.886219  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:27.853016  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 286971us
I20260709 13:02:27.798173  8915 raft_consensus.cc:740] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:02:27.854404  8964 log.cc:927] Time spent T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:02:27.887810  1598 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:27.888602  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 61688.9us
I20260709 13:02:27.816679  8812 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:27.851629  8677 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:27.894318  1599 consensus_peers.cc:597] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:27.901870  1599 leader_election.cc:336] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:27.902367  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:27.902482  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:27.853210  9003 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:27.905295  1706 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 25.
I20260709 13:02:27.913349  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:27.897904  8973 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:27.863533  8984 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.926362  1526 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:27.864384  8780 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:02:27.935909  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:27.706226  8045 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:27.904271  9010 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:27.887897  8811 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:27.940380  8812 consensus_queue.cc:1059] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
W20260709 13:02:27.952769  9004 log.cc:927] Time spent T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:02:27.913671  8923 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:02:27.923462  8677 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:27.944419  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:27.961359  1705 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:27.933094  8922 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:27.938815  8780 consensus_queue.cc:1243] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer 4f6fa2fd61114dc190d8f9b310696e1a log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:02:27.981637  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 79841.3us
W20260709 13:02:28.026365  1599 leader_election.cc:336] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:27.913810  8974 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
W20260709 13:02:27.993108  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.015363  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:27.919452  9003 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:27.949927  8939 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:27.947952  8686 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:28.028996  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.964370  8970 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:28.034168  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:28.027522  1599 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 113 similar messages]
I20260709 13:02:27.727852  8983 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:28.014458  8872 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:28.039120  2323 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.009s	sys 0.013s
I20260709 13:02:27.977761  8839 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:27.971843  8848 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:02:28.046680  2323 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.009s	sys 0.013s
I20260709 13:02:28.034063  8812 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:28.038740  8929 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:28.071491  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:28.046939  8936 consensus_meta.cc:287] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.652s	user 0.005s	sys 0.007s
I20260709 13:02:28.074671  1708 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:02:28.048386  8922 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:28.106295  8811 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:28.072798  9025 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.109910  9025 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.112780  8799 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:28.066718  8848 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:28.087268  9021 log.cc:927] Time spent T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:28.094120  9003 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:28.058634  8899 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:28.016192  8677 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:28.118281  8677 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:28.102806  9005 log.cc:927] Time spent T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
I20260709 13:02:28.103777  8615 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:28.115097  8848 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:28.124634  8983 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:28.072093  8812 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:28.129870  8812 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:28.115087  8984 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:28.139170  1707 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
I20260709 13:02:28.186411  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:28.187134  2286 leader_election.cc:336] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:28.194470  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:02:28.071555  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 183934us
I20260709 13:02:28.206102  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:02:28.184856  8547 consensus_meta.cc:287] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.004s
I20260709 13:02:28.173985  8839 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:28.213106  2288 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:28.213629  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:28.214429  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:28.224498  1629 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 24.
I20260709 13:02:28.224903  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:28.215929  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:28.173985  8615 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:28.154897  8523 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:28.223268  2327 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:28.188759  8834 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.250705  2328 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:02:28.254503  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:28.275653  1599 leader_election.cc:336] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:28.218607  8580 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:02:28.256846  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 60664us
I20260709 13:02:28.258167  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:28.258427  2288 leader_election.cc:400] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 19. Current term is 20.
I20260709 13:02:28.287110  2288 leader_election.cc:403] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.285157  8936 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:28.289113  8936 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.290309  8899 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:28.290918  8899 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:28.277761  1601 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:28.227788  8884 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:02:28.304929  9026 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 19. Current term is 20.
I20260709 13:02:28.305163  8884 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.305701  8884 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:28.251811  9033 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:28.309487  9033 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:28.312033  9033 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:28.252007  8615 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.286252  1598 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:28.278090  1633 raft_consensus.cc:2393] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 22: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:28.246912  8974 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:28.296563  8936 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:28.299108  9011 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:28.301291  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:28.342571  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:28.285151  8580 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.302793  9024 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:28.295929  8923 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.303560  8799 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.303450  9015 consensus_queue.cc:1048] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:02:28.304616  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 56479.7us
I20260709 13:02:28.314975  8915 consensus_queue.cc:260] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:28.316434  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:28.295260  1599 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:28.319007  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:28.399384  1599 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:28.399714  2326 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 23.
I20260709 13:02:28.220489  9025 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:28.254537  9029 raft_consensus.cc:493] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:28.247977  9017 raft_consensus.cc:2804] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:28.409970  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 114797us
W20260709 13:02:28.411087  1599 consensus_peers.cc:597] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.254365  8922 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:28.329077  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:28.331857  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 45710.3us
I20260709 13:02:28.419088  2328 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:02:28.227656  8547 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.345492  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:28.347620  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:28.285625  8622 consensus_queue.cc:1048] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:02:28.287213  8834 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:28.392831   431 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 1585)
I20260709 13:02:28.408102  1672 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:02:28.425577  1703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.029s	sys 0.055s
W20260709 13:02:28.425792  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 121175us
W20260709 13:02:28.426139  1703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.029s	sys 0.056s
I20260709 13:02:28.426374  1672 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:28.413561  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
W20260709 13:02:28.420653  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 73198.7us
I20260709 13:02:28.341776  9033 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:28.339524  8929 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.431737  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:28.432451  2321 raft_consensus.cc:1240] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:28.349264  8677 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:28.276451  8523 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.346505  9011 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:28.349380  8580 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:28.445919  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:28.446610  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:28.444542  1675 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:28.415810  8970 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:28.449765  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:28.457231  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:28.460870  1702 raft_consensus.cc:2393] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 24: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:28.401147  8973 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:28.422243  8915 raft_consensus.cc:3060] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:28.426323  9017 raft_consensus.cc:697] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:28.346400  8974 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:28.490761  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:28.449379  9033 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.449280  9013 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:28.435081  8936 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:28.450363  8890 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:28.405382  8923 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.467319  8619 raft_consensus.cc:3060] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:28.417125  9029 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.450410  9011 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:28.503134  8983 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.446883  9032 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:28.342382  8839 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.549918  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:28.499343  8523 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:28.562441  8899 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.452715  8929 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:28.569032  8936 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:28.548486  9033 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:28.578032  8974 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:28.553328  9013 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.581363  8547 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:28.583689  8615 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:28.586962  8923 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:28.587672  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:28.590952  8580 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.594051  1632 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 24.
I20260709 13:02:28.414752  8799 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:28.673272  8580 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:28.674098  9015 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.674386  8799 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:28.660987  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 208639us
I20260709 13:02:28.617509  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:28.675311  1706 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:28.630273  9032 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:28.675855  9032 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:28.563233  8834 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:28.642295  9017 consensus_queue.cc:237] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.641045  8983 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.681167  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:28.682063  8983 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:28.646191  8045 consensus_meta.cc:287] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.000s
I20260709 13:02:28.682657  9011 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:28.579332  8528 consensus_meta.cc:287] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.682s	user 0.006s	sys 0.005s
I20260709 13:02:28.446220  8980 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:02:28.701634  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:28.702819  1709 raft_consensus.cc:1217] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Deduplicated request from leader. Original: 14.13->[17.14-21.16]   Dedup: 17.14->[19.15-21.16]
I20260709 13:02:28.703508  1709 pending_rounds.cc:85] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting all ops after (but not including) 14
I20260709 13:02:28.703812  1709 pending_rounds.cc:107] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:02:28.704108  1709 raft_consensus.cc:2889] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:28.593204  8970 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.659821  8804 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:28.629994  8822 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.669692  8899 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:28.661996  9013 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:28.584882  8922 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:28.674777  9015 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:28.682812  8045 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.554263  8890 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:28.646417  8884 raft_consensus.cc:515] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.721072  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:28.721072  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:28.744917  1701 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:28.659633  8936 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.701475  8528 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:28.753022  1631 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 21.
I20260709 13:02:28.755270  2327 raft_consensus.cc:2393] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 26: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:28.713877  8970 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:28.745539  8890 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:28.759526  8936 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:28.765223  1705 raft_consensus.cc:2368] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17.
I20260709 13:02:28.724639  8804 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.762948  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:28.736454  8822 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.763475  9011 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:28.768159  1706 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:02:28.798139  1702 raft_consensus.cc:1240] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:02:28.801679  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:28.780838  8677 raft_consensus.cc:697] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
W20260709 13:02:28.786005  8812 consensus_meta.cc:287] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Time spent flushing consensus metadata: real 0.656s	user 0.012s	sys 0.001s
I20260709 13:02:28.806082  1701 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22.
I20260709 13:02:28.806753  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:28.816946  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:28.818349  1635 raft_consensus.cc:2393] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:28.824137  1626 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:02:28.852823  2288 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:28.807435  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:28.810503  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:28.883438  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 69064.1us
W20260709 13:02:28.890031  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 565579us
I20260709 13:02:28.902271  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:28.919082  1700 raft_consensus.cc:1240] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
W20260709 13:02:28.916330  2286 leader_election.cc:336] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:28.925161  8984 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:28.928846  8884 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:28.931203  9032 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:28.887665  9023 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.974004  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:28.975266  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:28.938189  2286 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:28.940455  1634 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:28.991539  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.904110  9025 raft_consensus.cc:2804] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:29.078744  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:29.079435  2328 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 23.
W20260709 13:02:29.081882  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 165658us
I20260709 13:02:29.097281  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:28.822785  8812 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:29.104398  1525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.021s	sys 0.030s
I20260709 13:02:28.921922  9029 leader_election.cc:290] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:29.102145  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 206196us
I20260709 13:02:29.110240  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:29.111344  2328 raft_consensus.cc:2368] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 25. Current term is 26.
W20260709 13:02:29.111833  1525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.022s	sys 0.030s
I20260709 13:02:29.115290  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:28.973006  8780 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.119602  1598 leader_election.cc:400] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 25 pre-election: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 25. Current term is 26.
I20260709 13:02:29.116120  1523 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:29.080816  8915 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.123222  1598 leader_election.cc:403] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.097713  9043 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.110543  9040 log.cc:927] Time spent T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.369s	user 0.001s	sys 0.001s
I20260709 13:02:29.095743  9026 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:29.145011  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:29.145875  1700 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:29.151003  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.154906  1630 raft_consensus.cc:2410] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:29.077632  8984 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.166669  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:29.157061  1673 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:29.168368  2327 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 23.
I20260709 13:02:29.168264  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:29.169759  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:29.168660  1673 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:29.172781  8615 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:29.142748  9015 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:29.142633  8045 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.152258  8822 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.101501  9023 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.153244  9043 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:29.184435  8619 consensus_meta.cc:287] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.000s
W20260709 13:02:29.207058  1599 consensus_peers.cc:597] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:29.225939  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 814498us
I20260709 13:02:29.179850  8799 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.112722  8677 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:29.201642  9051 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:02:29.201546  1700 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 26.
W20260709 13:02:29.205890  9042 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:02:29.149823  8915 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.206148  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:29.170588  8970 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:29.140460  8780 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:29.181414  9052 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:29.169185  8872 raft_consensus.cc:3060] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Advancing to term 26
W20260709 13:02:29.209185  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46120 (request call id 1439) took 1496 ms (client timeout 1790 ms). Trace:
W20260709 13:02:29.256106  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 50124.8us
W20260709 13:02:29.256722  1631 rpcz_store.cc:269] 0709 13:02:27.712524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.715335 (+  2811us) service_pool.cc:224] Handling call
0709 13:02:29.208970 (+1493635us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b5400247a54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:29.209094 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2263656320}
I20260709 13:02:29.257663  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:29.230209  9041 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.351s	user 0.001s	sys 0.000s
W20260709 13:02:29.195859  9033 consensus_meta.cc:287] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.001s
I20260709 13:02:29.187424  8528 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:29.206496  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 97796us
I20260709 13:02:29.224498  8804 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:29.225464  8686 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:29.258347  9052 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.238616  8619 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:29.279752  8812 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:29.281900  1703 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:29.282894  9043 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.276859  9052 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:29.293951  8915 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.295217  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 24 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:29.297675  9013 consensus_meta.cc:287] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.582s	user 0.005s	sys 0.006s
I20260709 13:02:29.298151  9013 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.245229  8799 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:29.301045  1707 raft_consensus.cc:2393] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 24: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:29.302030  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.265574  8923 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:29.261159  8970 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.317013  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 90346.4us
I20260709 13:02:29.261186  9044 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:29.269541  8972 consensus_queue.cc:1059] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:02:29.275957  9033 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.317262  9045 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.346899  2321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58628 (request call id 1549) took 1308 ms. Trace:
W20260709 13:02:29.340462  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 224569us
I20260709 13:02:29.347880  1523 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:29.347398  2321 rpcz_store.cc:276] 0709 13:02:28.038669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.039798 (+  1129us) service_pool.cc:224] Handling call
0709 13:02:28.040109 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.451312 (+411203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.346639 (+895327us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400426154. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:29.346841 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884916608}
I20260709 13:02:29.349854  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:29.323663  8686 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:29.334686  8822 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.344432  8890 consensus_meta.cc:287] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.002s
W20260709 13:02:29.364595  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.006s	sys 0.022s
I20260709 13:02:29.337301  9025 raft_consensus.cc:697] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:02:29.365556  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.007s	sys 0.022s
I20260709 13:02:29.370232  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:29.369500  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 99149.7us
I20260709 13:02:29.372324  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.374048  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.377393  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.372375  2288 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:29.378661  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:29.378820  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:29.380070  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:29.380982  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:29.383471  1630 raft_consensus.cc:3060] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:29.323801  8970 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.361047  9048 raft_consensus.cc:493] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.386538  1523 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:29.359200  9032 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:29.365634  8528 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:29.392478  8990 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:29.392863  8528 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:29.393167  8990 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.395179  8528 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:29.395479  8990 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.396268  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.396795  9033 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.398128  8799 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:29.398820  1630 raft_consensus.cc:2468] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22.
I20260709 13:02:29.364928  8615 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:29.399296  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 24 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.402350  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:29.402415  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:29.403059  2320 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:29.404487  1526 leader_election.cc:400] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17.
I20260709 13:02:29.404842  1526 leader_election.cc:403] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.371447  9037 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:29.375605  8983 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:29.417681  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:29.427065   431 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 1585)
I20260709 13:02:29.388851  9044 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:29.387399  9047 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:29.366935  8686 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.387698  8905 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:29.392551  8934 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:29.455503  9047 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:29.458256  8934 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:29.404673  9048 raft_consensus.cc:515] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.459590  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:29.403820  9029 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:29.460489  9048 leader_election.cc:290] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.460637  8934 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:29.461092  9017 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:29.373430  8890 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.461789  1629 raft_consensus.cc:1275] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:29.367033  8822 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:29.444067  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:29.464322  1702 raft_consensus.cc:2393] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 in current term 16: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:29.446421  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:29.464999  1627 raft_consensus.cc:2368] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17.
I20260709 13:02:29.404786  9060 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:29.454193  9026 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:29.439502  9059 raft_consensus.cc:2804] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:02:29.441154  8799 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:29.457553  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 53695.3us
I20260709 13:02:29.460851  9029 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.398655  8970 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.396502  9025 consensus_queue.cc:237] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.467742  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.468207  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:29.362141  9045 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.463829  8890 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.474344  2288 leader_election.cc:400] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17.
I20260709 13:02:29.457362  1632 raft_consensus.cc:1275] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:29.478845  2320 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:02:29.442540  8811 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.405395  9052 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.507155  9052 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 25 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.455947  9063 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:29.484283  1635 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:02:29.508323  8972 raft_consensus.cc:3055] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:29.478058  9023 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.508839  1631 raft_consensus.cc:2368] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 24. Current term is 25.
I20260709 13:02:29.509294  8811 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:29.510879  9063 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.511430  8811 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:29.500605  8983 consensus_queue.cc:1059] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:02:29.508838  8972 raft_consensus.cc:740] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:29.515117  8972 consensus_queue.cc:260] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:29.516405  8686 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.516404  8972 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:29.433920  9037 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.519924  9045 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.486928  9059 raft_consensus.cc:697] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:29.521735  9059 consensus_queue.cc:237] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.488633  9071 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:29.530819  8890 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.532996  9023 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:29.533855  9023 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:29.535251  8872 raft_consensus.cc:2749] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387) with higher term. Message: Invalid argument: T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 25. Current term is 26.
I20260709 13:02:29.469038  8905 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.538576  8905 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.460382  9047 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:29.531721  8890 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:29.494289  2288 leader_election.cc:403] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.498608  8822 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:29.479946  9013 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 24 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.415521  8615 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:29.482133  8780 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:29.513480  9063 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:29.487464  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:29.558718  1633 raft_consensus.cc:3060] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:29.543687  1626 raft_consensus.cc:2468] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 26.
I20260709 13:02:29.493752  1598 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:29.559808  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 66182.9us
I20260709 13:02:29.561444  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:29.562072  2320 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Advancing to term 25
W20260709 13:02:29.553180  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 79032.9us
I20260709 13:02:29.564483  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.565078  1630 raft_consensus.cc:2376] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22. Re-sending same reply.
I20260709 13:02:29.566004  2321 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:02:29.568733  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.569635  1630 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 23.
I20260709 13:02:29.572190  2320 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 25.
I20260709 13:02:29.555572  9026 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 16. Current term is 17.
I20260709 13:02:29.573854  2288 leader_election.cc:400] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 24. Current term is 25.
I20260709 13:02:29.574100  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35632 (request call id 1392) took 1131 ms. Trace:
I20260709 13:02:29.574218  2288 leader_election.cc:403] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.544464  9037 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.574544  1707 rpcz_store.cc:276] 0709 13:02:28.429293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.429492 (+   199us) service_pool.cc:224] Handling call
0709 13:02:29.294942 (+865450us) spinlock_profiling.cc:243] Waited 899 us on lock 0x7b5800011798. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed6960a22 00007f0edf879c09 00007f0ede9d3ee0 00007f0edea9d0ab 00007f0edea9d131 00007f0edea4b0a0 00007f0edea4a984 00007f0ed7fc56d4 00007f0ed7fc5662
0709 13:02:29.560641 (+265699us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b5400397e54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:29.560793 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12810368}
I20260709 13:02:29.577764  2288 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:29.554183  9023 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:02:29.573058  8822 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:29.594192  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:29.585765  8804 consensus_queue.cc:1048] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:02:29.598223  9017 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:29.606637  8615 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:29.607404  9029 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.610181  8890 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:29.619578  1705 raft_consensus.cc:1240] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:02:29.620819  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:29.622510  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.622910  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.623020  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:29.623135  1701 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 21.
I20260709 13:02:29.623597  1707 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 24.
I20260709 13:02:29.623718  1704 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:29.625545  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a5771425b14503aa3a070b20d0bf86" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.626264  1706 raft_consensus.cc:2368] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 25. Current term is 26.
I20260709 13:02:29.631891  9071 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17.
I20260709 13:02:29.594643  9032 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:29.632805  8804 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:29.633049  9032 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:29.633535  9032 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:29.633462  8804 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.635890  8804 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:29.636446  8804 consensus_queue.cc:1048] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:02:29.623484  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.641788  1704 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:29.639551  1709 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 15.
I20260709 13:02:29.643743  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:29.645895  1705 raft_consensus.cc:2368] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 21. Current term is 22.
I20260709 13:02:29.647853  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f9ac80ae924622bceefdf9814aca1e" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.644721  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.651695  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:29.584983  8780 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.588492  8884 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 24. Current term is 25.
I20260709 13:02:29.654726  1598 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:29.656225  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:29.666752  1709 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:29.661741  1633 raft_consensus.cc:2468] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
W20260709 13:02:29.654520  2286 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:29.591223  9009 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:29.668241  2286 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:29.669528  2286 leader_election.cc:336] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:29.669924  2286 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:29.670862  2286 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:29.671231  2286 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:29.671574  2286 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:29.672667  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:29.673251  1701 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:02:29.679177  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 196272us
W20260709 13:02:29.680428  2286 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:29.685043  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.690765  1701 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 25.
I20260709 13:02:29.693230  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.695636  1701 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:29.638785  8822 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:02:29.699301  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 44671.3us
I20260709 13:02:29.720451  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:29.678628  8547 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:29.722581  1601 leader_election.cc:400] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 25 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 25. Current term is 26.
I20260709 13:02:29.679867  9063 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:29.688445  9026 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:29.708168  9047 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:02:29.689337  9066 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:02:29.748739  1675 leader_election.cc:304] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:29.752983  8929 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:29.753449  8985 raft_consensus.cc:2764] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
W20260709 13:02:29.756100  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.756940  1673 leader_election.cc:336] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:29.757465  1673 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:29.734148  8905 consensus_queue.cc:1059] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
W20260709 13:02:29.758654  1673 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:29.759330  1673 leader_election.cc:336] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:29.759771  1673 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:29.760186  8905 raft_consensus.cc:3055] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:02:29.760603  8905 raft_consensus.cc:740] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:29.761157  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.761418  8905 consensus_queue.cc:260] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.762317  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.762625  8905 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:29.763438  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.765683  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:29.766276  9081 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:29.766935  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:29.766178  9061 log.cc:927] Time spent T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.358s	user 0.005s	sys 0.000s
I20260709 13:02:29.768090  9013 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:02:29.769063  9033 consensus_queue.cc:1175] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6b9e73092f6146639bf310a3d18cfe37" responder_term: 23 status { last_received { term: 23 index: 16 } last_committed_idx: 15 last_received_current_leader { term: 23 index: 16 } }
I20260709 13:02:29.768103  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.775158  8984 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:29.775381  1675 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:29.776403  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 48324.7us
I20260709 13:02:29.768630  8510 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:29.778687  1707 raft_consensus.cc:1240] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:29.779927  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.793365  1706 raft_consensus.cc:2410] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:29.780977  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:29.678898  8780 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.789642  1634 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:02:29.794618  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:29.809859  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.796911  1675 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:29.741189  9029 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:29.833540  1626 raft_consensus.cc:2393] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 21: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:29.835345  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:29.863338  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 76298.6us
I20260709 13:02:29.698028  9009 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.846983  8510 raft_consensus.cc:2804] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:29.880457  8510 raft_consensus.cc:697] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:29.881632  8510 consensus_queue.cc:237] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:29.832573  9042 log.cc:927] Time spent T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:02:29.865049  1599 leader_election.cc:336] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:29.868366  1601 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:29.894300  1601 leader_election.cc:400] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 21. Current term is 22.
I20260709 13:02:29.894641  1601 leader_election.cc:403] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.898880  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.900413  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.902521  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:29.906965  1709 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
I20260709 13:02:29.879582  9009 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:29.907773  1599 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:29.869261  1701 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 21.
W20260709 13:02:29.911396  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 53369.5us
W20260709 13:02:29.841605  1673 leader_election.cc:336] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:29.914582  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 73045.7us
I20260709 13:02:29.933611  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.847276  8812 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.832921  9011 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:29.831825  8619 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:29.973333  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.853768  9029 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:29.957111  1599 leader_election.cc:336] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:29.970281  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:29.972730  1673 leader_election.cc:336] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:29.864162  8971 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.979444  1673 leader_election.cc:336] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:29.982381  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:29.983798  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:29.985987  1673 leader_election.cc:336] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:29.863216  9047 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:29.867367  8929 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:29.910437  8834 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.978574  1599 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:30.003733  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:29.986737  1673 leader_election.cc:336] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:30.004956  1599 leader_election.cc:336] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:30.005232  1673 leader_election.cc:336] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:30.006033  1673 leader_election.cc:336] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:29.931196  8872 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:29.994055  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:29.949438  9071 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.931135  8689 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 21. Current term is 22.
I20260709 13:02:30.017745  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:29.972766  9034 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:29.956238  8811 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.028882  8811 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:30.005226  9078 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:30.031047  8811 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.026508  1675 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:30.033528  1675 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:30.034225  8922 raft_consensus.cc:3055] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:30.037346  8922 raft_consensus.cc:740] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:30.038661  8922 consensus_queue.cc:260] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.034613  8523 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:30.027858  1628 raft_consensus.cc:2393] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 18: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:30.042068  8985 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:30.040555  8922 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:30.043447  1675 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:30.048209  8985 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:29.890375  9080 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.139s
I20260709 13:02:30.056849  1523 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a
I20260709 13:02:29.975314  8884 raft_consensus.cc:493] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:29.987363  8936 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:29.988878  9029 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:30.074324  1523 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:30.065505  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:30.066879  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 57801.6us
I20260709 13:02:30.093415  1523 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:30.014144  8872 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.867756  8822 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:29.988133  8812 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:30.080031  9051 log.cc:927] Time spent T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:02:30.079756  9031 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.020s	sys 0.021s
I20260709 13:02:29.996388  9011 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.122783  1709 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:29.996074  8971 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:30.044118  9032 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:30.102206  9000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.011s	sys 0.043s
W20260709 13:02:30.132273  9000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.011s	sys 0.044s
I20260709 13:02:30.133921  9032 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:30.138545  2323 raft_consensus.cc:2393] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 24: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:30.097313  9062 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:30.011052  8929 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.058673  9071 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.106909  8923 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:30.100023  8811 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:30.095896  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:30.110698  8872 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:30.109617  9078 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:30.126857  9031 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.021s	sys 0.021s
I20260709 13:02:30.168835  8811 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.153100  1601 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:30.022951  8834 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.167268  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:30.122421  8984 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:30.124537  9059 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:30.126204  8936 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:30.081467  8884 raft_consensus.cc:515] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:30.172549  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 76799.3us
I20260709 13:02:30.205214  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:30.131196  9009 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:30.206295  9009 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.152697  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:30.210321  8923 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:30.140352  9087 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:30.180776  1601 leader_election.cc:304] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:30.213943  1601 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:30.215396  8045 raft_consensus.cc:2749] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:30.211930  9087 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:30.221369  9083 log.cc:927] Time spent T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:30.226109  9071 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:30.227272  9094 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:30.227877  9094 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.230396  9094 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:30.233131  9085 log.cc:927] Time spent T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:02:30.234894  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:30.237171  9084 log.cc:927] Time spent T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:02:30.239331  8780 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:30.182376  8811 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:30.242725  8812 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.245862  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:30.251756  9092 log.cc:927] Time spent T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:02:30.177196  9062 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:30.143088  9047 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.195363  1700 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:02:30.173585  9017 consensus_meta.cc:287] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.003s
I20260709 13:02:30.161957  8915 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:30.190398  8834 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:30.174602  8239 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:30.270129  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.193820  8990 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:30.220289  9087 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.208494  9009 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.284266  9062 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:30.179517  9078 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:30.285631  9017 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:30.308415  8619 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.202579  8984 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:30.256975  9059 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.283841  8915 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:30.300473  8990 raft_consensus.cc:697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:30.291326  8239 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:30.324790  1599 leader_election.cc:336] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:30.327790  1599 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:30.316205  8619 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:30.331702  1599 leader_election.cc:336] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:30.332299  1599 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:30.320627  9026 raft_consensus.cc:493] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:02:30.339231  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 246051us
I20260709 13:02:30.378043  1626 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 26 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:02:30.332994  9052 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:02:30.379395  1599 leader_election.cc:336] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:30.389705  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:30.390149  1599 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:30.390944  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:30.394199  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:30.396037  1599 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:30.396314  8884 leader_election.cc:290] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:30.397583  1599 leader_election.cc:336] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:30.397848  9078 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.398047  1599 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:30.406157  8971 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.370395  8689 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:30.410616  2286 leader_election.cc:336] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:30.416148  2286 leader_election.cc:336] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:30.417948  1701 raft_consensus.cc:1275] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:02:30.416666  2286 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:30.427752   431 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 1585)
I20260709 13:02:30.430229  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.426390  8971 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:30.429797  8547 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:30.444995  8990 consensus_queue.cc:237] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:30.380138  9062 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:30.447206  8929 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:30.392975  9011 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:30.416446  9048 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:30.369247  9026 raft_consensus.cc:515] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.457465  8547 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:30.455367  9091 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:02:30.454761  9029 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:30.471944  9026 leader_election.cc:290] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.472714  9029 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.473223  1627 raft_consensus.cc:2393] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 22: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:30.439317  8045 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:30.431929  8804 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:30.473721  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 268697us
I20260709 13:02:30.474017  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc7199563cc4b68b76fa96af21d01c4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:30.464438  1599 leader_election.cc:336] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:30.474982  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 260111us
I20260709 13:02:30.478142  1599 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:30.480129  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:30.426596  8884 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.047s
I20260709 13:02:30.481163  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:30.482039  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:30.482982  2320 raft_consensus.cc:2393] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 25: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:30.483825  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.484112  1701 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:30.461244  8239 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.461026  8899 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:30.485520  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:30.486502  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:30.487443  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:30.490190  2320 raft_consensus.cc:2393] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 23: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:30.491770  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.495090  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.496141  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538f09573cd4214b1d7cab1dddee46f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.451354  8872 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:30.499480  1700 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:02:30.452140  8811 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.505049  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:30.508848  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.508894  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.510872  2288 leader_election.cc:304] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:30.558411  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 60863.2us
W20260709 13:02:30.557291  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 130319us
I20260709 13:02:30.481118  9048 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:30.564210  2323 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 23. Current term is 24. Ops: []
W20260709 13:02:30.560129  8905 consensus_meta.cc:287] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.797s	user 0.013s	sys 0.000s
I20260709 13:02:30.569096  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:30.494449  9009 consensus_queue.cc:1048] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.077s
I20260709 13:02:30.573096  1630 raft_consensus.cc:2410] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:02:30.574180  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:30.488991  9011 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:30.577092  1675 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:30.580706  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 69973.9us
I20260709 13:02:30.588716  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.610052  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:30.611068  1701 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:30.613500  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.586668  2288 leader_election.cc:304] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:30.589816  1709 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 20.
W20260709 13:02:30.623811  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 49626.3us
I20260709 13:02:30.661679  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:30.663821  8929 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:30.665509  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58640 (request call id 1764) took 1468 ms. Trace:
I20260709 13:02:30.665944  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:30.674121  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:30.666064  2328 rpcz_store.cc:276] 0709 13:02:29.165530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.166349 (+   819us) service_pool.cc:224] Handling call
0709 13:02:30.633528 (+1467179us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540064fd54. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:30.633746 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3048296320}
I20260709 13:02:30.496171  8899 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.681542  1701 raft_consensus.cc:2468] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 22.
I20260709 13:02:30.664638  8922 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.591161  8890 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:30.566570  8990 consensus_queue.cc:1059] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.103s
I20260709 13:02:30.622051  8804 raft_consensus.cc:2749] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:30.587615  9098 raft_consensus.cc:2749] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:30.627955  8973 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:30.708534  8547 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:30.591611  9029 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.105s
I20260709 13:02:30.684829  9101 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.695943  8915 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.705344  8834 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.712522  9059 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.785588  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:30.664629  8929 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:30.720997  2328 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:30.729823  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:30.805263  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:30.711303  8811 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:30.592381  9011 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.734350  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:30.712519  8990 raft_consensus.cc:3055] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:30.766254  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.768667  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:30.657045  9026 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:30.719627  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:30.795980  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 56192.5us
I20260709 13:02:30.798899  2320 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:02:30.826996  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 92986.6us
I20260709 13:02:30.835414  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:30.832461  9062 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:30.836315  8915 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:30.836978  9062 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:30.826845  8990 raft_consensus.cc:740] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:30.838953  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:30.839583  1700 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:02:30.842875  8905 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:30.767771  9101 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:30.846755  9101 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.701251  8922 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.850781  8922 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:30.853842  1700 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 24.
W20260709 13:02:30.860306  9105 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:02:30.862053  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.751749  9080 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.903941  9080 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:30.906414  9080 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.731846  8973 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:30.914494  8973 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.748898  8936 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 13:02:30.922071  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:30.922484  8929 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.821990  8834 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.933748  8834 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:30.872176  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:30.877282  9112 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:02:30.878372  8872 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:30.881448  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 3365) took 1037 ms. Trace:
I20260709 13:02:30.882529  9026 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:30.883265  8811 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:30.885056  8045 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:30.886332  9011 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:30.899224  1703 raft_consensus.cc:1275] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:30.899338  1704 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:30.935628  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:30.940639  2286 leader_election.cc:336] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:30.940553  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.943523  2322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:30.865383  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.945619  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.948765  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:30.953959  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60066 (request call id 3181) took 1051 ms. Trace:
I20260709 13:02:30.942322  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:30.971009  1630 rpcz_store.cc:276] 0709 13:02:29.902120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.902254 (+   134us) service_pool.cc:224] Handling call
0709 13:02:30.953768 (+1051514us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54000da7d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a892fa 00007f0edea4ab17 00007f0ed7fc56d4 00007f0ed7fc5662 00007f0ed7fc5591 00007f0ed7fc550c 00007f0ed7fc47c2 00007f0ed7dc048c 00007f0ed7dbf8c6 00007f0ed7dbf26f
0709 13:02:30.953897 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1540530432}
I20260709 13:02:30.957213  1634 rpcz_store.cc:276] 0709 13:02:29.844357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.844962 (+   605us) service_pool.cc:224] Handling call
0709 13:02:29.845431 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:29.845751 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.845792 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:29.890852 (+ 45060us) log.cc:844] Serialized 26 byte log entry
0709 13:02:30.428634 (+537782us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:30.428709 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.428811 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.881239 (+452428us) raft_consensus.cc:1685] finished
0709 13:02:30.881259 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.881388 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":425625,"threads_started":1,"wal-append.queue_time_us":775627}
I20260709 13:02:30.961669  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:30.972530  2327 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:30.969568  2286 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:30.969841  1706 raft_consensus.cc:2468] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:30.993378  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:30.998034  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 57499.2us
I20260709 13:02:30.992919  2327 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 24.
I20260709 13:02:30.973824  8045 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:30.974747  8811 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:31.000841  9059 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:31.003320  9063 consensus_queue.cc:1048] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.013s
I20260709 13:02:31.085234  1523 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:31.092697  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 148408us
W20260709 13:02:31.095531  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 456949us
I20260709 13:02:31.098424  1601 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:31.090941  1523 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:31.138705  8929 consensus_queue.cc:1059] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:02:31.146371  8936 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:31.149304  9099 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:31.150902  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 60383.2us
I20260709 13:02:31.162328  9026 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:31.167476  1673 consensus_peers.cc:597] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:31.173162  9102 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:31.183804  8811 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:31.185289  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:31.188333  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
W20260709 13:02:31.194762  9048 consensus_meta.cc:287] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
W20260709 13:02:31.132313  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 157450us
W20260709 13:02:31.210531  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 43583.7us
I20260709 13:02:31.188454  8510 raft_consensus.cc:493] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.225335  9102 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:31.228143  9048 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:31.232784  1708 raft_consensus.cc:1275] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:31.232028  1704 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:02:31.233711  1523 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:31.234232  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:31.236783  1706 raft_consensus.cc:1240] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:31.238688  8811 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:31.238579  8922 consensus_queue.cc:1059] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:31.243175  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:31.251149  8510 raft_consensus.cc:515] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:31.253615  1673 leader_election.cc:336] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:31.254487  8510 leader_election.cc:290] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:31.265543  1632 raft_consensus.cc:2410] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 13:02:31.272660  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 86032.4us
I20260709 13:02:31.275844  1523 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:31.284256  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 282443us
W20260709 13:02:31.289693  2286 leader_election.cc:336] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:31.290721  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:31.290079  1706 raft_consensus.cc:1275] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:02:31.303836  8922 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.309257  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:31.309358  8984 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:31.310711  1633 raft_consensus.cc:2410] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
W20260709 13:02:31.316856  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 49502.8us
I20260709 13:02:31.317425  8839 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.318642  8839 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:31.320923  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:31.322590  1630 raft_consensus.cc:2393] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 22: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:31.288184  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:31.305146  8922 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:31.330722  8884 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:02:31.325137  8990 consensus_queue.cc:260] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:31.336671  8990 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:31.345072  9080 raft_consensus.cc:3055] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:02:31.345661  9080 raft_consensus.cc:740] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:31.348286  9062 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:31.352802  9080 consensus_queue.cc:260] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:31.355429  9080 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:31.357573  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:31.364709  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:31.350710  8839 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:31.366571  1706 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 24.
W20260709 13:02:31.368196  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 54609us
W20260709 13:02:31.377920  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 130662us
W20260709 13:02:31.380319  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.387817  8922 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:31.394171  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:31.395699  2320 raft_consensus.cc:2410] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:02:31.408839  1523 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:31.411996  8973 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:31.412833  1523 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:31.415213  1523 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:31.409578  9101 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.416266  9062 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:31.423962  9101 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:31.426848  2320 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:02:31.426991  9101 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:31.428076  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:31.429152   431 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 1585)
I20260709 13:02:31.431959  1626 raft_consensus.cc:1240] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 23. Current term is 24. Ops: []
I20260709 13:02:31.433180  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:31.435300  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:31.432094  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:31.437083  1672 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:31.438561  8811 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:31.440433  8890 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:31.452096  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:31.455209  1634 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:31.440150  1672 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:31.459223  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 169811us
I20260709 13:02:31.445875  8973 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:02:31.455621  8619 consensus_meta.cc:287] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: Time spent flushing consensus metadata: real 1.116s	user 0.015s	sys 0.011s
I20260709 13:02:31.470113  2321 raft_consensus.cc:1240] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:31.470248  8936 raft_consensus.cc:3055] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:31.472694  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:31.477501  8973 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 24 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:31.481037  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:31.488408  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:31.492275  2286 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:31.493636  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 53761.1us
I20260709 13:02:31.502595  1523 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:31.503100  8922 raft_consensus.cc:493] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.503448  8853 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:31.518414  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:31.509570  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:31.512403  8619 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:31.522913  1707 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 16: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
I20260709 13:02:31.523783  8619 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:31.523885  8899 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:31.540956  2327 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 24.
W20260709 13:02:31.541203  1673 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:31.525357  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 58030.4us
I20260709 13:02:31.528867  9099 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:31.529155  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:31.529467  2286 leader_election.cc:336] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:31.531020  1672 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:31.539819  8922 raft_consensus.cc:515] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:31.533445  8045 consensus_meta.cc:287] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.003s
I20260709 13:02:31.536686  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:31.540385  8929 consensus_queue.cc:1059] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:31.499805  8936 raft_consensus.cc:740] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:31.551231  2286 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:31.553879  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:31.553004  8045 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:31.569299  8890 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:31.569566  8936 consensus_queue.cc:260] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:31.570180  9066 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:31.570815  8936 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:31.570873  9066 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.580765  1626 raft_consensus.cc:1240] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:31.581820  9066 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:31.586915  9029 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.044s
I20260709 13:02:31.591225  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46120 (request call id 1466) took 1104 ms. Trace:
I20260709 13:02:31.599504  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:31.601368  8922 leader_election.cc:290] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:31.605229  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 75917.3us
W20260709 13:02:31.606287  2286 leader_election.cc:336] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:31.606864  2286 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:31.606545  8973 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:31.607954  9009 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:31.608875  9009 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:31.575213  8045 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:31.624068  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:31.632752  2286 leader_election.cc:336] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:31.633446  2286 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:31.638196  2286 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:31.638911  2286 leader_election.cc:336] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:31.639298  2286 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:31.640064  9026 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:31.640836  9026 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:31.643329  2286 leader_election.cc:336] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:31.643859  2286 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:31.645897  8884 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:31.651551  1599 leader_election.cc:336] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:31.652014  1599 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:31.653380  9034 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:31.656713  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 114780us
I20260709 13:02:31.658339  9066 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:31.657727  1599 leader_election.cc:336] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:31.661844  1599 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:31.662508  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:31.668596  2329 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:31.671288  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:31.672190  1706 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:02:31.672796  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.591749  1635 rpcz_store.cc:276] 0709 13:02:30.486320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.486428 (+   108us) service_pool.cc:224] Handling call
0709 13:02:30.486680 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.492637 (+1005957us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:31.492997 (+   360us) log.cc:844] Serialized 14 byte log entry
0709 13:02:31.548275 (+ 55278us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:31.548341 (+    66us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:31.548407 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.590838 (+ 42431us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000da2d4. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a85e01 00007f0ed9a8483e 00007f0edea49419 00007f0ed7fc0bd4 00007f0ed7fc0b62 00007f0ed7fc0a91 00007f0ed7fc0a0c 00007f0ed7fbfcc2 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:31.590889 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.591022 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":166,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":8735,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":22207,"spinlock_wait_cycles":2313235968,"thread_start_us":50945,"threads_started":1,"wal-append.queue_time_us":99679}
W20260709 13:02:31.673828  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 92351.9us
I20260709 13:02:31.676343  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f4d9e2c0643f1be1fe0de2078f6da" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:31.677403  9102 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:31.678490  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:31.679311  2328 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 18: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:31.679728  8929 raft_consensus.cc:493] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.680397  8929 raft_consensus.cc:515] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:31.680670  9080 consensus_queue.cc:1059] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:31.682749  8929 leader_election.cc:290] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:31.665817  9066 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 25 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:31.685174  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:31.685784  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:31.688259  2329 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 25.
I20260709 13:02:31.690690  1706 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 25.
I20260709 13:02:31.676223  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:31.694226  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 189382us
I20260709 13:02:31.694823  1598 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:31.699419  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:31.700922  9102 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:02:31.710245  1675 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:31.701440  9066 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:31.711395  1601 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:31.715839  8922 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:31.717561  9102 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
W20260709 13:02:31.726948  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 69723.4us
I20260709 13:02:31.729018  8580 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.729737  8580 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:31.733917  9062 raft_consensus.cc:3055] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:31.734395  9062 raft_consensus.cc:740] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:31.735479  9062 consensus_queue.cc:260] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:31.735877  1599 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:31.740913  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 64875.7us
I20260709 13:02:31.739866  1675 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:31.744755  1599 leader_election.cc:336] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:31.735366  8580 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:31.742748  9062 raft_consensus.cc:3060] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:31.720261  9102 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:31.752128  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 221387us
W20260709 13:02:31.756814  9135 log.cc:927] Time spent T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.088s	user 0.001s	sys 0.002s
I20260709 13:02:31.760725  8971 raft_consensus.cc:2804] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:31.761459  8971 raft_consensus.cc:697] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:31.762765  8971 consensus_queue.cc:237] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:31.747416  9116 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:31.750511  1701 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20.
I20260709 13:02:31.769987  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:31.775830  1672 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:31.773542  8899 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:31.777045  8899 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:31.777423  8899 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:31.747293  8811 raft_consensus.cc:3055] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:31.777669  8922 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.773603  9123 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:02:31.784746  8884 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.785382  8884 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:31.785810  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:31.787712  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:31.788517  8936 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:31.789683  8936 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:31.790187  9143 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:31.794309  9142 log.cc:927] Time spent T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
I20260709 13:02:31.781267  8811 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:31.802429  9116 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:31.803041  9116 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:31.804663  8922 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:31.811625  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 67759.9us
I20260709 13:02:31.809558  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:31.816807  2327 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:31.824605  9144 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:31.819814  9034 consensus_queue.cc:1048] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:02:31.830724  8899 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:31.831982  1449 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57414 (request call id 194) took 36092 ms (client timeout 15000 ms). Trace:
I20260709 13:02:31.788313  8884 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:31.837888  1452 catalog_manager.cc:5697] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 8 to 11, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.815696  8922 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:31.843806  1599 leader_election.cc:336] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:31.853142  1599 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:31.864509  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:31.865648  1705 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:02:31.867774  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60052 (request call id 3370) took 1249 ms. Trace:
I20260709 13:02:31.856341  8899 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:31.868913  9034 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:31.816200  8811 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:31.870406  8811 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:31.859956  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:31.873296  1701 raft_consensus.cc:2393] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8106dfc0bda54df0ae10ba13c28ccc18 in current term 18: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:31.834859  8045 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.024s
I20260709 13:02:31.877314  1452 catalog_manager.cc:5697] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 8 to 10, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 10 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:31.880146  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:31.881624  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:31.882501  8936 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:31.882980  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:31.883392  8936 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:31.884339  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 108557us
I20260709 13:02:31.885360  1672 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:31.885131  1452 catalog_manager.cc:5697] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 8 to 9, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:31.892199  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ceb3afda0646d2b7815d235d107857" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:31.893386  8990 consensus_queue.cc:1048] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:02:31.899237  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 160190us
I20260709 13:02:31.868250  1627 rpcz_store.cc:276] 0709 13:02:30.500780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.806351 (+305571us) service_pool.cc:224] Handling call
0709 13:02:30.806676 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:30.807052 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.807079 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:30.868074 (+ 60995us) log.cc:844] Serialized 52 byte log entry
0709 13:02:31.597363 (+729289us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b18003b7ca0. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed697ae07 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b 00007f0ed9624d23 00007f0ed96250d1 00007f0ed9a40a0f
0709 13:02:31.710850 (+113487us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:31.710903 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.711029 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:31.741497 (+ 30468us) raft_consensus.cc:1685] finished
0709 13:02:31.741516 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.749522 (+  8006us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19512,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134,"spinlock_wait_cycles":34182656,"thread_start_us":29142,"threads_started":1,"wal-append.queue_time_us":841006}
W20260709 13:02:31.832470  1449 rpcz_store.cc:269] 0709 13:01:55.739559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.776882 (+ 37323us) service_pool.cc:224] Handling call
0709 13:02:31.831748 (+36054866us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:25.903408 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:25.904310 (+   902us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:25.904375 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:02:25.904395 (+    20us) tablet.cc:662] Decoding operations
0709 13:02:25.906687 (+  2292us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:25.906830 (+   143us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:25.906873 (+    43us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:02:25.992905 (+ 86032us) tablet.cc:701] Row locks acquired
0709 13:02:25.993015 (+   110us) write_op.cc:260] PREPARE: finished
0709 13:02:25.993211 (+   196us) write_op.cc:270] Start()
0709 13:02:25.993363 (+   152us) write_op.cc:276] Timestamp: P: 1783602145993115 usec, L: 0
0709 13:02:25.993406 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:02:25.994201 (+   795us) log.cc:844] Serialized 8197 byte log entry
0709 13:02:26.078659 (+ 84458us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b4400022b4c. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed68bec85 00007f0ed68bf6a2 00007f0ed96311db 00007f0ed962caaf 00007f0ed697b0ac 00007f0edf7d5ab9 00007f0ed699769b 00007f0ed699593f 00007f0ed6997c02 00007f0ed961f20b
0709 13:02:27.262409 (+1183750us) op_driver.cc:464] REPLICATION: finished
0709 13:02:28.051327 (+788918us) write_op.cc:301] APPLY: starting
0709 13:02:28.071590 (+ 20263us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:28.781509 (+709919us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:28.784755 (+  3246us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:29.542092 (+757337us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:29.542519 (+   427us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:02:29.542586 (+    67us) write_op.cc:312] APPLY: finished
0709 13:02:29.543160 (+   574us) log.cc:844] Serialized 188 byte log entry
0709 13:02:30.132907 (+589747us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:30.133161 (+   254us) write_op.cc:454] Released schema lock
0709 13:02:30.133266 (+   105us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:30.133841 (+   575us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:30.133880 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":476107,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":747355,"apply.run_cpu_time_us":89589,"apply.run_wall_time_us":2101550,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91781,"num_ops":21,"prepare.queue_time_us":107575,"prepare.run_cpu_time_us":57204,"prepare.run_wall_time_us":476660,"raft.queue_time_us":342137,"raft.run_cpu_time_us":47449,"raft.run_wall_time_us":492227,"replication_time_us":1209796,"spinlock_wait_cycles":7837440,"thread_start_us":1602261,"threads_started":5,"wal-append.queue_time_us":1363396,"wal-append.run_cpu_time_us":74121,"wal-append.run_wall_time_us":2475625}]]}
I20260709 13:02:31.906582  8929 raft_consensus.cc:2804] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:31.908272  1601 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:31.915208  9143 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:31.953449  9116 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:31.955277  9116 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:31.956732  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:31.959103  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:31.966940  8936 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.967711  8936 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:31.969579  8822 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:31.969841  8936 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:31.943672  8929 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.977082  8929 raft_consensus.cc:3060] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:31.950505  1675 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:31.984090  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:31.934760  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 100470us
I20260709 13:02:31.934940  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:31.988925  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 54103.1us
I20260709 13:02:31.992432  1672 leader_election.cc:304] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:31.988574  1599 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:31.996600  1599 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:31.998302  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 332490us
W20260709 13:02:32.000903  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:32.013773  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 69895.3us
I20260709 13:02:32.002086  9144 raft_consensus.cc:2749] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:32.007531  8922 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:32.029853  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:32.031590  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:32.032248  9066 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:32.034580  9032 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:32.035411  9032 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:32.036100  8811 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:32.038136  9032 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:32.071187  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 85707.3us
I20260709 13:02:32.047345  8936 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:32.078944  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:32.096715  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:32.098357  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 78128.9us
I20260709 13:02:32.099793  8973 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.102588  2327 raft_consensus.cc:1240] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Rejecting Update request from peer 8106dfc0bda54df0ae10ba13c28ccc18 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:32.118882  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:32.122779  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:32.123416  1705 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:32.131446  1630 raft_consensus.cc:1240] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 LEADER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:02:32.133438  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54abded5f0d34ab1871704bc5a3c1b4a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:32.142386  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:32.100440  8973 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:32.161579  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:32.160750  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:32.170028  1635 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:32.171590  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:32.186945  8973 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:32.116484  1452 catalog_manager.cc:5697] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 10 to 11, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 11 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:32.149869  9102 consensus_queue.cc:1059] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:02:32.195767  8822 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:32.165032  8936 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.239933  9116 raft_consensus.cc:3055] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:32.247485  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:32.248055  9152 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.085s	user 0.002s	sys 0.002s
I20260709 13:02:32.250839  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:32.257701  2328 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:02:32.256450  2286 leader_election.cc:336] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:32.272706  2286 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:32.279359  1526 leader_election.cc:304] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:32.283557  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 127507us
I20260709 13:02:32.284914  1675 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:32.288905  2286 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:32.290274  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:32.264827  9116 raft_consensus.cc:740] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:32.271500  8971 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:32.296360  2286 leader_election.cc:336] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:32.277426  8510 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:32.333355  1627 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:32.334259  1708 raft_consensus.cc:1275] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:02:32.335438  1599 consensus_peers.cc:597] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:32.335907  8990 consensus_queue.cc:1048] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:02:32.305050  9146 log.cc:927] Time spent T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.175s	user 0.000s	sys 0.006s
I20260709 13:02:32.336848  2288 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:32.338742  8899 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:32.339527  9153 log.cc:927] Time spent T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.175s	user 0.001s	sys 0.002s
I20260709 13:02:32.305547  8973 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:32.342200  8973 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:32.344837  8973 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:32.307518  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 6325e0281aa547efa677c29cabdf5de4 with delete_type TABLET_DATA_TOMBSTONED (TS 4f6fa2fd61114dc190d8f9b310696e1a not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:40122
I20260709 13:02:32.297824  8811 raft_consensus.cc:2749] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:32.287070  9080 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:02:32.313436  1452 catalog_manager.cc:5697] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:32.286415  8922 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.299577  8619 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:32.315786  9151 log.cc:927] Time spent T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.211s	user 0.000s	sys 0.003s
I20260709 13:02:32.316735  9116 consensus_queue.cc:260] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:32.293233  9026 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:32.318357  8936 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:32.320106  8971 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:32.272929  8929 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:32.347615  9152 log.cc:927] Time spent T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:32.341230  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:32.359763  1452 catalog_manager.cc:5697] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 3 to 11. New cstate: current_term: 11 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:32.360690  1526 leader_election.cc:304] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:32.380890  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:32.364800  1599 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:32.373368  2326 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:02:32.378322  9116 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:32.387353  8922 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:32.388984  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:32.378851  8971 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:32.395586  8922 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:32.382928  1704 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 18.
I20260709 13:02:32.391073  1599 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:32.391439  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 106655us
I20260709 13:02:32.396133  9009 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:32.379048  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:32.396297  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 55170.2us
W20260709 13:02:32.399664  2286 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:32.403687  1601 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:32.403923  2286 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:32.405025  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:32.413189  9062 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:32.410025  2286 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:32.416316  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 51589.6us
W20260709 13:02:32.418063  1599 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:32.401245  9099 raft_consensus.cc:2749] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:32.413816  9062 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:32.425558  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:32.426294  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:32.429589  8811 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:32.434262  8811 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.434664  8811 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:32.406867  8045 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.033s
W20260709 13:02:32.429981   431 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 1585)
I20260709 13:02:32.440485  9048 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:32.441167  9048 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:32.442338  2286 leader_election.cc:336] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:32.442783  2286 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:32.443507  9048 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:32.445066  9066 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:32.445492  8884 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:32.445875  9029 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:32.448182  1526 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:32.410733  8899 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:32.467659  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:32.473932  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:32.421932  8971 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:32.476519  1705 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:02:32.478577  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:32.472821  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:32.453143  9066 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.478114  9062 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:32.483094  8922 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:32.496484  9066 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:32.500221  8936 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:32.534510  1629 raft_consensus.cc:1240] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Rejecting Update request from peer e4c78b411eb34b3d92183a86d34a81f1 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:32.482084  9029 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:32.518514  9099 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:32.554116  8929 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:32.554471  9164 tablet_replica.cc:333] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
W20260709 13:02:32.575114  1599 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:32.576202  1599 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:32.569525  1673 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:32.578169  1673 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:32.580446  1705 raft_consensus.cc:1275] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:02:32.585331  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485c87933f940ec96f52fe33972ecd3" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:32.576783  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:32.635931  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 47827us
W20260709 13:02:32.637826  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 45998.7us
I20260709 13:02:32.638644  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:32.640203  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:32.641326  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:32.589737  8822 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:32.591080  9144 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:32.645380  9171 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:02:32.644497  1526 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:32.648787  8936 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:32.665762  9171 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:32.669219  8936 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:32.670063  8936 consensus_queue.cc:1059] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:32.666189  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:32.671254  8936 raft_consensus.cc:3055] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:32.671689  8936 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:32.675504  8936 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:32.678320  8936 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:32.669271  9165 log.cc:927] Time spent T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:02:32.651285  8929 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:32.648984  8973 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.593343  9099 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:32.726029  9123 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:32.726929  9123 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:32.731580  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:32.744771  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 96572.7us
W20260709 13:02:32.753371  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 264479us
I20260709 13:02:32.744953  9123 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:32.759862  9099 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:32.753047  9144 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:32.769069  8811 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:32.778513  8811 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:32.750638  8973 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:32.783675  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:32.784435  1705 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:32.784924  8973 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:32.790835  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:32.795199  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:32.793540  1673 consensus_peers.cc:597] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:32.798321  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:32.798343  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:32.799461  2329 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:32.814308  1673 consensus_peers.cc:597] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:32.833472  2329 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
W20260709 13:02:32.819473  1673 consensus_peers.cc:597] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:32.800571  9144 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:32.839474  8811 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.841925  1705 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:32.848824  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:32.847999  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:32.857870  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:32.859467  9144 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:32.860427  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:32.869509  1631 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:32.872303  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:32.881716  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:32.888402  1526 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:32.888101  8929 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:32.878216  8973 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:02:32.892448  9180 log.cc:927] Time spent T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: Append to log took a long time: real 0.062s	user 0.003s	sys 0.000s
I20260709 13:02:32.891990  9099 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:32.898950  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:32.868983  9066 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:32.857187  8811 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:32.911765  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:32.914508  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:32.915349  1634 raft_consensus.cc:2393] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 19: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:32.917778  9174 consensus_queue.cc:1048] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:32.922971  1526 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:32.934327  9099 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:32.935149  9062 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:32.935708  9062 raft_consensus.cc:697] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:32.936282  1675 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:32.937001  9062 consensus_queue.cc:237] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:32.937801  8834 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:32.946229  9166 log.cc:927] Time spent T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: Append to log took a long time: real 0.275s	user 0.000s	sys 0.006s
I20260709 13:02:32.954545  9066 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:32.957291  8811 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:32.942142  1631 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:32.961447  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:32.964368  1701 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:32.963423  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:32.966533  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:02:32.973244  2286 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:32.977761  9164 raft_consensus.cc:2243] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:32.979282  9164 raft_consensus.cc:2272] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:32.979897  9029 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:32.999730  1673 consensus_peers.cc:597] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:33.013818  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:33.014515  1673 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:32.988009  8899 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:33.015049  1673 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:33.015702  8899 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:33.010447  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 372285us
I20260709 13:02:33.017493  8834 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:33.018316  8899 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:32.965142  8936 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.021162  8936 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:33.023406  8936 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:33.025511  8811 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:33.026280  8811 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:33.028443  9080 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.028636  8811 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:32.986366  2321 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 24.
I20260709 13:02:33.029182  9080 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:33.016395  1673 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:32.997491  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:33.032449  1523 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:33.032882  1631 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 24.
I20260709 13:02:33.033747  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:33.035270  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:33.036952  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:33.037680  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:32.980836  1701 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 19.
I20260709 13:02:33.044026  1601 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:33.049559  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:33.050477  1707 raft_consensus.cc:2368] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19.
I20260709 13:02:33.051474  9080 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:33.052572  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:33.037906  8936 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:33.053318  8936 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.053658  8936 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:02:33.057116  2286 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 179 similar messages]
I20260709 13:02:33.059904  9080 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.061141  9169 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:33.062083  9169 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:33.062991  9169 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:33.064010  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6325e0281aa547efa677c29cabdf5de4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:33.066284  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:33.067622  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:33.068109  9160 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:33.068907  9160 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:33.060926  9080 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:33.075592  9080 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:33.087951  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 48150.3us
I20260709 13:02:33.087895  1526 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:33.090080  9062 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:33.093369  1673 consensus_peers.cc:597] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:33.095541  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:33.096062  1673 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:33.093928  8834 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:33.095088  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:32.987007  9164 ts_tablet_manager.cc:1916] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:33.101459  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:33.111855  2288 leader_election.cc:400] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19.
I20260709 13:02:33.112304  2288 leader_election.cc:403] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:33.112944  8936 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:33.113590  8884 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:02:33.114565  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:33.115963  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:33.116573  1626 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:33.118301  9062 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:33.121783  8884 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) with higher term. Message: Invalid argument: T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b9e73092f6146639bf310a3d18cfe37 for earlier term 18. Current term is 19.
I20260709 13:02:33.124827  1626 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 25.
I20260709 13:02:33.126441  1526 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
W20260709 13:02:33.126731  1673 consensus_peers.cc:597] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:33.127561  9062 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:02:33.128291  9062 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 25 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:33.129511  9062 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:33.149219  8936 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 25 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:33.153216  1599 leader_election.cc:336] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:33.155980  1599 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:33.151474  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:33.165133  2321 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:33.169868  9029 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:33.173446  9080 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.174314  9080 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:33.176942  9080 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:33.177537  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:33.181928  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:33.186787  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:33.189195  8936 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:33.190197  8936 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.190747  8936 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:33.194397  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:33.195180  2327 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 17.
I20260709 13:02:33.195307  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:33.196054  1626 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 16.
I20260709 13:02:33.197427  1523 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:33.198383  8922 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:33.198812  8922 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.199162  8922 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:33.204070  2321 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 25.
W20260709 13:02:33.212241  1599 consensus_peers.cc:597] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:33.213359  1599 consensus_peers.cc:597] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:33.214994  1599 consensus_peers.cc:597] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:33.216204  1599 consensus_peers.cc:597] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:33.218158  1599 consensus_peers.cc:597] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:33.218766  1599 leader_election.cc:336] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:33.219180  1599 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:33.219980  9066 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:33.223248  1599 consensus_peers.cc:597] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:33.212293  8922 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:33.243264  1673 consensus_peers.cc:597] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:33.245065  8922 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:33.203305  8936 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:33.246513  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:33.247148  2327 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:33.250566  9062 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.251156  9062 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:33.253546  9062 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:33.256057  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:33.256877  1626 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:02:33.278600  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:33.279440  1707 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 16: Already voted for candidate 4f6fa2fd61114dc190d8f9b310696e1a in this term.
W20260709 13:02:33.280300  1599 consensus_peers.cc:597] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:33.292133  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:33.292943  1634 raft_consensus.cc:2393] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4c78b411eb34b3d92183a86d34a81f1 in current term 16: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:33.295383  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:33.297051  1599 consensus_peers.cc:597] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:33.297287  8936 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:33.298969  1673 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:33.300678  2327 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:33.301584  1626 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 18.
I20260709 13:02:33.302218  1523 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:33.304488  9062 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:33.307617  9062 raft_consensus.cc:697] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:33.309417  8922 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.310067  8922 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:33.316035  8922 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:33.320525  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:33.321417  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:33.322757  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:33.323853  8922 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:33.308624  9062 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:33.347631  1673 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:33.330418  1449 catalog_manager.cc:5697] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 14 to 15, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:33.363029  1449 catalog_manager.cc:5697] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 18 to 21, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:33.364734  1449 catalog_manager.cc:5697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:33.366181  1449 catalog_manager.cc:5697] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 12 to 15, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:33.368666  1449 catalog_manager.cc:5697] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 13 to 15, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 15 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:33.333442  9164 ts_tablet_manager.cc:1929] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.8
I20260709 13:02:33.375859  9164 log.cc:1199] T 6325e0281aa547efa677c29cabdf5de4 P 4f6fa2fd61114dc190d8f9b310696e1a: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-2-root/wals/6325e0281aa547efa677c29cabdf5de4
I20260709 13:02:33.375898  1449 catalog_manager.cc:5697] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.377494  9164 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40122 (request call id 0) took 1116 ms. Trace:
I20260709 13:02:33.378000  1449 catalog_manager.cc:5697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 13 to 16, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:33.379783  1449 catalog_manager.cc:5697] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.381855  1449 catalog_manager.cc:5697] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 14 to 17, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:33.377939  9164 rpcz_store.cc:276] 0709 13:02:32.289967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.307245 (+ 17278us) service_pool.cc:224] Handling call
0709 13:02:32.536831 (+229586us) ts_tablet_manager.cc:1151] Deleting tablet 6325e0281aa547efa677c29cabdf5de4
0709 13:02:32.553966 (+ 17135us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:33.229252 (+675286us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:33.333273 (+104021us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:33.377409 (+ 44136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":402646,"tablet-delete.queue_time_us":164519,"thread_start_us":105391,"threads_started":1}
I20260709 13:02:33.401292  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 6325e0281aa547efa677c29cabdf5de4 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 13:02:33.416837  1449 catalog_manager.cc:5697] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 13 to 16, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 16 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:33.418391  1449 catalog_manager.cc:5697] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 11 to 15, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.420075  1449 catalog_manager.cc:5697] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 15 to 16, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:02:33.436829   431 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 1585)
I20260709 13:02:33.436621  1449 catalog_manager.cc:5697] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.392728  8936 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:33.444257  1449 catalog_manager.cc:5697] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:33.457489  1449 catalog_manager.cc:5697] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 14 to 15, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.463714  1449 catalog_manager.cc:5697] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.466041  1449 catalog_manager.cc:5697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 7 to 15, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:33.473655  1449 catalog_manager.cc:5697] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 11 to 17, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.476392  1449 catalog_manager.cc:5697] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.481025  1449 catalog_manager.cc:5697] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.492376  1449 catalog_manager.cc:5697] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 9 to 14, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.495195  1707 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:02:33.507330  1599 consensus_peers.cc:597] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:33.495195  1449 catalog_manager.cc:5697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:33.509812  1449 catalog_manager.cc:5697] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.511453  1449 catalog_manager.cc:5697] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 17 to 20, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 20 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.520989  1449 catalog_manager.cc:5697] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.524277  2327 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:02:33.502286  1452 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41156 (request call id 262) took 73920 ms (client timeout 15000 ms). Trace:
I20260709 13:02:33.528684  9099 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:33.523864  8619 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:33.531457  8619 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:33.540556  2321 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:02:33.541210  1626 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:33.545944  1700 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:33.540374  9029 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:33.546046  1673 consensus_peers.cc:597] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:33.558084  8811 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:33.560240  8922 raft_consensus.cc:493] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.560925  8922 raft_consensus.cc:515] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:33.563207  8922 leader_election.cc:290] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:33.565001  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:33.566839  9167 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:33.567672  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c707e7d0374c378524e43ee47284c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:33.568020  9029 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:33.570369  1526 leader_election.cc:304] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:33.570485  9029 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:33.572461  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:33.554062  9080 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:02:33.573796  2321 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 21.
I20260709 13:02:33.574826  9080 raft_consensus.cc:2749] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:33.575568  9062 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:33.577775  8619 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:33.574851  1598 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:33.581135  9062 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.581805  9066 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:33.581683  9062 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:33.582358  9066 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.582831  9066 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:33.584040  9062 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:33.590354  2329 raft_consensus.cc:1275] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:02:33.592808  9029 consensus_queue.cc:1048] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:33.588819  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:33.598445  2321 raft_consensus.cc:2393] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 21: Already voted for candidate 6b9e73092f6146639bf310a3d18cfe37 in this term.
I20260709 13:02:33.600263  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:33.600955  1700 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
I20260709 13:02:33.608386  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:33.652846  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:33.647840  2286 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:33.656313  2286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 49023.3us
I20260709 13:02:33.653735  1634 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 19.
W20260709 13:02:33.657281  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 104539us
I20260709 13:02:33.652648  9062 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:33.648859  9099 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.665208  9062 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.673038  9159 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:33.678654  9099 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:33.689215  9099 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:33.693020  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:33.680817  9062 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:33.698654  1634 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:02:33.700474  8936 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.009s
I20260709 13:02:33.713603  9159 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:33.735955  9159 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:33.745873  9066 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:33.748054  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:02:33.751124  1673 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:33.754698  1523 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:33.755952  8936 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:33.759541  2321 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:33.767282  9080 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:02:33.525934  1452 rpcz_store.cc:269] 0709 13:01:19.576950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.577261 (+   311us) service_pool.cc:224] Handling call
0709 13:02:33.496769 (+73919508us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:32.666209 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:32.666895 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:32.666942 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:02:32.666961 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:32.667932 (+   971us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:32.668076 (+   144us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:32.668116 (+    40us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:02:32.679122 (+ 11006us) tablet.cc:701] Row locks acquired
0709 13:02:32.679188 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:02:32.679399 (+   211us) write_op.cc:270] Start()
0709 13:02:32.679596 (+   197us) write_op.cc:276] Timestamp: P: 1783602152679320 usec, L: 0
0709 13:02:32.679650 (+    54us) op_driver.cc:348] REPLICATION: starting
0709 13:02:32.711349 (+ 31699us) log.cc:844] Serialized 2472 byte log entry
0709 13:02:33.075360 (+364011us) op_driver.cc:464] REPLICATION: finished
0709 13:02:33.147687 (+ 72327us) write_op.cc:301] APPLY: starting
0709 13:02:33.147791 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:33.191744 (+ 43953us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b18003b5660. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edf860de1 00007f0edf86d5b1 00007f0ed97c40ec 00007f0ed97c6af7 00007f0ed97c7fb0 00007f0edd4dc1bb 00007f0edd4dc532 00007f0edd523b93 00007f0edd3d0de3 00007f0edd3d06ab 00007f0edd3d1e77
0709 13:02:33.193544 (+  1800us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:33.193585 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:33.223762 (+ 30177us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:33.224105 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:02:33.224149 (+    44us) write_op.cc:312] APPLY: finished
0709 13:02:33.224518 (+   369us) log.cc:844] Serialized 65 byte log entry
0709 13:02:33.225526 (+  1008us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:33.225657 (+   131us) write_op.cc:454] Released schema lock
0709 13:02:33.225733 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:33.226394 (+   661us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:33.226432 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35678,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":72036,"apply.run_cpu_time_us":14920,"apply.run_wall_time_us":78653,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29171,"num_ops":6,"prepare.queue_time_us":91168,"prepare.run_cpu_time_us":22934,"prepare.run_wall_time_us":131356,"raft.queue_time_us":180638,"raft.run_cpu_time_us":26049,"raft.run_wall_time_us":108555,"replication_time_us":395550,"spinlock_wait_cycles":10572032,"thread_start_us":251902,"threads_started":4,"wal-append.queue_time_us":111483}]]}
I20260709 13:02:33.748098  9066 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 election: Requested vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:33.808866  9062 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:33.812492  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:33.813356  1626 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:33.844901  2321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:33.845539  2321 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:33.851752  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 191393us
I20260709 13:02:33.859109  1626 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
I20260709 13:02:33.862284  1526 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:33.864461  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:33.868422  1702 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 20.
I20260709 13:02:33.869793  9080 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:33.869534  9062 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:33.891875  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:33.894425  1700 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:02:33.895179  9080 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:34.005550  1700 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 22.
W20260709 13:02:34.006140  1599 consensus_peers.cc:597] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:34.015133  2321 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 22.
W20260709 13:02:34.026346  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 166581us
I20260709 13:02:34.057746  9080 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.061177  9160 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.061826  9160 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.063442  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:34.064214  1634 raft_consensus.cc:2368] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 21. Current term is 22.
I20260709 13:02:34.064224  9160 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:34.087647  9212 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.088304  9212 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.091135  9212 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:34.095970  1626 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:34.106040  9160 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.104568  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:34.106948  9160 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.110430  9160 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:34.118685  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 91305.5us
W20260709 13:02:34.122547  1599 consensus_peers.cc:597] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:34.123466  1599 consensus_peers.cc:597] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:34.124323  1599 consensus_peers.cc:597] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:34.126482  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:34.131246  1598 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:34.133665  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:34.135140  1635 raft_consensus.cc:2393] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a in current term 21: Already voted for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in this term.
I20260709 13:02:34.141403  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:34.142412  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:34.143303  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3426c98205bc4a609f37342176ca9b0a" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:34.145748  1702 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:34.154960  2286 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:34.150076  9218 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:34.169791  8922 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.184163  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:34.184872  1706 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 16.
I20260709 13:02:34.185669  8922 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.197721  8922 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:34.198689  1526 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:34.199785  9099 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:34.201344  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:34.202181  1706 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
I20260709 13:02:34.207511  1675 leader_election.cc:400] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 21. Current term is 22.
I20260709 13:02:34.207901  1675 leader_election.cc:403] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:34.208425  9218 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:34.209438  9218 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:34.210196  1702 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 20.
I20260709 13:02:34.211333  9227 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887) with higher term. Message: Invalid argument: T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f6fa2fd61114dc190d8f9b310696e1a for earlier term 21. Current term is 22.
I20260709 13:02:34.200254  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:34.167244  8811 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.081s
W20260709 13:02:34.248487  2286 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:34.257608  9230 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:34.218847  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:34.259372  1626 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 21.
I20260709 13:02:34.214787  1601 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:34.265631  9169 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:34.266145  9169 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.266500  9169 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:34.220990  1675 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:34.270750  9159 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:34.269799  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 48934us
W20260709 13:02:34.276728  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 62035us
W20260709 13:02:34.292568  1599 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:34.243997  9228 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:34.304435  9228 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.308003  9228 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:34.310374  9169 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:34.257754  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 57608.4us
I20260709 13:02:34.359548  9169 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:34.360087  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:34.360737  1702 raft_consensus.cc:3060] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:34.359814  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:34.368808  1702 raft_consensus.cc:2468] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 17.
W20260709 13:02:34.340524  2286 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:34.373255  1449 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57414 (request call id 195) took 15474 ms (client timeout 15000 ms). Trace:
I20260709 13:02:34.373802  9080 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:34.378423  1601 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:34.378778  9080 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.379249  9080 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:34.379388  9169 raft_consensus.cc:2804] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:34.380461  9169 raft_consensus.cc:697] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:34.381457  9169 consensus_queue.cc:237] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.334966  9159 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:34.410811  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:34.409300  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:34.404282  1449 rpcz_store.cc:269] 0709 13:02:18.898957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.101812 (+13202855us) service_pool.cc:224] Handling call
0709 13:02:34.373145 (+2271333us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:33.711030 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:33.726996 (+ 15966us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:33.727038 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:02:33.727059 (+    21us) tablet.cc:662] Decoding operations
0709 13:02:33.729100 (+  2041us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:33.729169 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:33.729204 (+    35us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:02:33.731472 (+  2268us) tablet.cc:701] Row locks acquired
0709 13:02:33.731495 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:02:33.731693 (+   198us) write_op.cc:270] Start()
0709 13:02:33.731821 (+   128us) write_op.cc:276] Timestamp: P: 1783602153731642 usec, L: 0
0709 13:02:33.731846 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:02:33.757747 (+ 25901us) log.cc:844] Serialized 9792 byte log entry
0709 13:02:33.898590 (+140843us) op_driver.cc:464] REPLICATION: finished
0709 13:02:34.204698 (+306108us) write_op.cc:301] APPLY: starting
0709 13:02:34.204779 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:34.239892 (+ 35113us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:34.239986 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:34.258061 (+ 18075us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:34.258394 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:02:34.258439 (+    45us) write_op.cc:312] APPLY: finished
0709 13:02:34.258926 (+   487us) log.cc:844] Serialized 220 byte log entry
0709 13:02:34.259761 (+   835us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:34.259971 (+   210us) write_op.cc:454] Released schema lock
0709 13:02:34.260031 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:34.260432 (+   401us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:34.260460 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30067,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":285208,"apply.run_cpu_time_us":35333,"apply.run_wall_time_us":55708,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108477,"num_ops":25,"prepare.queue_time_us":91335,"prepare.run_cpu_time_us":7097,"prepare.run_wall_time_us":72673,"replication_time_us":166572,"thread_start_us":317818,"threads_started":2}]]}
I20260709 13:02:34.422394  8811 raft_consensus.cc:493] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:34.434253  8811 raft_consensus.cc:515] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.435597  1450 catalog_manager.cc:5697] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 8 to 10, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 10 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:34.437284   431 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 1585)
I20260709 13:02:34.444203  1450 catalog_manager.cc:5697] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:34.448413  1450 catalog_manager.cc:5697] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 5 to 13, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 13 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:34.449668  8811 leader_election.cc:290] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:34.391206  9080 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.474550  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:34.475137  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bc2b03c4ec4de282e245ab3015bfd6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:34.481345  1450 catalog_manager.cc:5697] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:34.482035  9080 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:34.484958  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:34.485977  8811 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:34.495775  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:34.496730  1635 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:34.497094  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:34.497797  1701 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:34.483919  1450 catalog_manager.cc:5697] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 9 to 11, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 11 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:34.506469  1450 catalog_manager.cc:5697] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:34.509541  8811 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.510227  8811 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.513357  8811 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:34.509518  1635 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 22.
W20260709 13:02:34.538476  1599 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:34.511848  1701 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4c78b411eb34b3d92183a86d34a81f1 in term 22.
I20260709 13:02:34.549467  1526 leader_election.cc:304] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:34.550959  1526 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1; no voters: 
I20260709 13:02:34.553261  8811 raft_consensus.cc:2749] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:34.508807  1450 catalog_manager.cc:5697] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 11 to 14, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 14 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:34.558899  1450 catalog_manager.cc:5697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 13 to 14, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:34.570293  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:34.570888  1634 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:02:34.571743  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746cf49ba083454e8a50cff619835a56" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:34.574015  8811 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:34.580772  8811 raft_consensus.cc:697] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 LEADER]: Becoming Leader. State: Replica: e4c78b411eb34b3d92183a86d34a81f1, State: Running, Role: LEADER
I20260709 13:02:34.581823  8811 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.609135  1450 catalog_manager.cc:5697] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:34.609905  9230 raft_consensus.cc:493] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.610615  9230 raft_consensus.cc:515] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.612799  9230 leader_election.cc:290] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:34.614535  1526 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:34.636864  9230 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:34.648135  9099 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:34.653609  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:34.655223  1673 consensus_peers.cc:597] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:34.657069  1701 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:02:34.663985  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e112d5c05d14e7ca923c272912bcec9" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:34.678954  1526 leader_election.cc:304] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:34.684435  8811 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:02:34.697295  9099 raft_consensus.cc:2749] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:34.730214  1701 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:02:34.734143  9222 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:34.744174  9099 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.759163  9099 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:34.788393  9080 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.798919  9080 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.801458  9080 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:34.806290  2327 raft_consensus.cc:1275] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:02:34.807880  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:34.807348  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:34.817456  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:34.811702  9099 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:34.810892  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:34.821285  1599 consensus_peers.cc:597] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:34.821446  9099 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:34.811801  9206 consensus_queue.cc:1048] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:02:34.823783  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:34.826232  1526 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:34.827137  9099 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:34.831085  1599 consensus_peers.cc:597] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:34.839051  2286 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:34.845419  9237 log.cc:927] Time spent T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:34.877243  9228 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:02:34.878316  9228 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.892271  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:34.895666  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22195ce47a0c43e5ab7e7ed47f7e5a1f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:34.890784  9228 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:34.907939  1700 raft_consensus.cc:1275] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:34.909863  9222 consensus_queue.cc:1048] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:34.919962  9230 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.920745  9230 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:34.952838  9230 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:34.947116  1526 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:34.993144  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 46153.7us
W20260709 13:02:35.003497  1673 consensus_peers.cc:597] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:35.004817  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:35.006273  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:35.011224  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:35.012159  9080 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:34.996034  9230 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:35.028091  1599 consensus_peers.cc:597] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:35.041266  2286 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:35.055994  9230 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.056892  9230 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:35.067415  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:35.076464  9230 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:35.078243  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ce544917f545499da64014539a4ff2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:35.081019  1523 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:35.082362  9080 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:35.098466  9080 raft_consensus.cc:493] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:35.099164  9080 raft_consensus.cc:515] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:35.101688  9080 leader_election.cc:290] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:35.103287  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:35.103368  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8e024148f547e4b090c0c8c1155232" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:35.121286  1526 leader_election.cc:304] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:35.123237  9080 raft_consensus.cc:2749] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:35.140710  9080 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.141327  9080 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:35.145135  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:35.147936  9080 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:35.149001  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b0712953ef42ddb724cd8c29a0ec0b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:35.151371  1526 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:35.161887  9080 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:35.167502  9230 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.168146  9230 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:35.174374  9230 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:35.177295  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:35.177318  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:35.183727  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:35.195952  9230 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:35.215371  1626 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:02:35.216928  8811 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.217552  8811 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:35.219771  8811 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:35.229317  1700 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Refusing update from remote peer e4c78b411eb34b3d92183a86d34a81f1: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:02:35.232825  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:35.236171  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:35.242281  9230 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:35.277896  9080 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:35.278633  9080 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:35.281127  9080 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:35.282111  1450 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41166 (request call id 329) took 49053 ms (client timeout 15000 ms). Trace:
I20260709 13:02:35.282872  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:35.286916  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:35.293036  8811 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:35.293216  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 6325e0281aa547efa677c29cabdf5de4 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:40122
I20260709 13:02:35.284830  1449 catalog_manager.cc:5697] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 19 to 23, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 23 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:35.297171  1449 catalog_manager.cc:5697] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 22 to 23, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 23 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.303032  1449 catalog_manager.cc:5697] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 15 to 17, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.309531  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:35.313135  1526 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:35.306435  9230 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.301051  9080 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:02:35.317162  1449 catalog_manager.cc:5697] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 7 to 16. New cstate: current_term: 16 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.325433  9243 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:35.324961  9230 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:35.328044  1673 consensus_peers.cc:597] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:35.282649  1450 rpcz_store.cc:269] 0709 13:01:46.229096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.229377 (+   281us) service_pool.cc:224] Handling call
0709 13:01:46.650125 (+420748us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b5400230690. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed6820db1 00007f0ed6960b71 00007f0ed69610b2 00007f0edf8daa89 00007f0edf872da6 00007f0edf844088 00007f0edf94237e 00007f0edde032a4 00007f0edde03232 00007f0edde03161 00007f0edde030dc
0709 13:02:35.282015 (+48631890us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:34.872227 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:34.872785 (+   558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:34.872818 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:02:34.872837 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:34.873781 (+   944us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:34.873860 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:34.873896 (+    36us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:02:34.874577 (+   681us) tablet.cc:701] Row locks acquired
0709 13:02:34.874595 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:02:34.874762 (+   167us) write_op.cc:270] Start()
0709 13:02:34.874876 (+   114us) write_op.cc:276] Timestamp: P: 1783602154874685 usec, L: 0
0709 13:02:34.874896 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:02:34.891768 (+ 16872us) log.cc:844] Serialized 3641 byte log entry
0709 13:02:34.935489 (+ 43721us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b540029f754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ee571 00007f0ed9a80e28 00007f0edd4bb581 00007f0edd4bad58 00007f0edd4bf9f1 00007f0edd4bf9a9 00007f0edd4bf939 00007f0edd4bf901 00007f0edd4beb2d 000000000038f354 000000000038f199
0709 13:02:35.026021 (+ 90532us) op_driver.cc:464] REPLICATION: finished
0709 13:02:35.092274 (+ 66253us) write_op.cc:301] APPLY: starting
0709 13:02:35.092356 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:35.121333 (+ 28977us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:35.121362 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:35.127526 (+  6164us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:35.127771 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:02:35.127817 (+    46us) write_op.cc:312] APPLY: finished
0709 13:02:35.128104 (+   287us) log.cc:844] Serialized 89 byte log entry
0709 13:02:35.128296 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:35.128577 (+   281us) write_op.cc:454] Released schema lock
0709 13:02:35.128688 (+   111us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:35.137998 (+  9310us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:35.138032 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":192332,"reported_tablets":48,"spinlock_wait_cycles":55275392,"child_traces":[["op",{"apply.queue_time_us":65974,"apply.run_cpu_time_us":13849,"apply.run_wall_time_us":45737,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41693,"num_ops":9,"prepare.queue_time_us":98586,"prepare.run_cpu_time_us":6507,"prepare.run_wall_time_us":63472,"replication_time_us":150964,"spinlock_wait_cycles":26357248,"thread_start_us":125261,"threads_started":2}]]}
I20260709 13:02:35.344997  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 6325e0281aa547efa677c29cabdf5de4 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 13:02:35.345883  1449 catalog_manager.cc:5697] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 10 to 18, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.349903  1449 catalog_manager.cc:5697] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.361349  1449 catalog_manager.cc:5697] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 8 to 16. New cstate: current_term: 16 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.364548  9230 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:35.369190  1449 catalog_manager.cc:5697] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 15 to 16, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.370992  1449 catalog_manager.cc:5697] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 9 to 17, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 17 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:35.372617  1449 catalog_manager.cc:5697] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:35.374266  1449 catalog_manager.cc:5697] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 16 to 18, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.376346  1449 catalog_manager.cc:5697] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 15 to 16, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.378222  1449 catalog_manager.cc:5697] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.379796  1449 catalog_manager.cc:5697] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 11 to 19. New cstate: current_term: 19 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.381215  1449 catalog_manager.cc:5697] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:35.382597  1449 catalog_manager.cc:5697] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.384130  1449 catalog_manager.cc:5697] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 15 to 16, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.385985  1449 catalog_manager.cc:5697] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 11 to 14, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 14 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:35.388722  1449 catalog_manager.cc:5697] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 14 to 15, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.390528  1449 catalog_manager.cc:5697] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 19 to 20, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 20 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.392411  1449 catalog_manager.cc:5697] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.394019  1449 catalog_manager.cc:5697] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 14 to 20, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 20 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:35.395854  1449 catalog_manager.cc:5697] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 14 to 20, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.397567  1449 catalog_manager.cc:5697] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 17 to 24, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 24 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.399010  1449 catalog_manager.cc:5697] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 12 to 19, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.401043  1449 catalog_manager.cc:5697] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 16 to 23. New cstate: current_term: 23 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.402602  1449 catalog_manager.cc:5697] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.404405  1449 catalog_manager.cc:5697] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:35.406042  1449 catalog_manager.cc:5697] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.409343  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:35.411706  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b9ebe321414b42a927557c66adbb7e" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:35.426489  1599 consensus_peers.cc:597] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:35.437750   431 thread.cc:527] Waited for 8000ms trying to join with heartbeat (tid 1585)
I20260709 13:02:35.455623  1526 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:35.457258  9251 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:35.468878  2286 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:35.472564  1599 consensus_peers.cc:597] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:35.478861  1673 consensus_peers.cc:597] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:35.518327  1599 consensus_peers.cc:597] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:35.559644  1599 consensus_peers.cc:597] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:35.560546  9251 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.561187  9251 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:02:35.564023  9251 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:35.564026  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:35.568033  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89d6bd5df2a49f7b78e8695456652b5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:35.581391  1526 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:35.582156  9099 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:35.586055  1673 consensus_peers.cc:597] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:35.599285  1673 consensus_peers.cc:597] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:35.694587  9099 raft_consensus.cc:493] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:35.695238  9099 raft_consensus.cc:515] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:35.699352  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:35.708005  9099 leader_election.cc:290] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:35.709493  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9d192f7349b7bb550962c2e6c957" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:35.711532  1526 leader_election.cc:304] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:35.705204  1452 catalog_manager.cc:5697] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 14 to 22, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 22 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.712713  9099 raft_consensus.cc:2749] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:35.713713  1452 catalog_manager.cc:5697] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 16 to 18, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.715801  1452 catalog_manager.cc:5697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 10 to 17, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
W20260709 13:02:35.724334  1673 consensus_peers.cc:597] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:35.729321  9099 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.728907  1452 catalog_manager.cc:5697] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.729920  9099 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:35.730804  1452 catalog_manager.cc:5697] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:02:35.731333  1673 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:35.732182  9099 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:35.733139  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:35.734010  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48837d0ac86f4664b4bfe442411bc28f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:35.718065  1449 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41160 (request call id 301) took 5688 ms. Trace:
I20260709 13:02:35.735692  1523 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:35.737177  9099 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:35.745796  1452 catalog_manager.cc:5697] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 9 to 13, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 13 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.738211  1449 rpcz_store.cc:276] 0709 13:02:30.029850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.452009 (+4422159us) service_pool.cc:224] Handling call
0709 13:02:35.717966 (+1265957us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:35.416220 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:35.416760 (+   540us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:35.416791 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:02:35.416807 (+    16us) tablet.cc:662] Decoding operations
0709 13:02:35.421428 (+  4621us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:35.421483 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:35.421515 (+    32us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:02:35.423641 (+  2126us) tablet.cc:701] Row locks acquired
0709 13:02:35.423660 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:02:35.423803 (+   143us) write_op.cc:270] Start()
0709 13:02:35.424040 (+   237us) write_op.cc:276] Timestamp: P: 1783602155423756 usec, L: 0
0709 13:02:35.424066 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:02:35.428897 (+  4831us) log.cc:844] Serialized 11400 byte log entry
0709 13:02:35.432560 (+  3663us) op_driver.cc:464] REPLICATION: finished
0709 13:02:35.433449 (+   889us) write_op.cc:301] APPLY: starting
0709 13:02:35.433542 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:35.499947 (+ 66405us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:35.500062 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:35.609922 (+109860us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:35.610331 (+   409us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 13:02:35.610392 (+    61us) write_op.cc:312] APPLY: finished
0709 13:02:35.610871 (+   479us) log.cc:844] Serialized 252 byte log entry
0709 13:02:35.616715 (+  5844us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:35.617083 (+   368us) write_op.cc:454] Released schema lock
0709 13:02:35.617162 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:35.647486 (+ 30324us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:35.647516 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9243,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":438,"apply.run_cpu_time_us":42751,"apply.run_wall_time_us":214031,"cfile_cache_hit":116,"cfile_cache_hit_bytes":121046,"num_ops":29,"prepare.queue_time_us":195,"prepare.run_cpu_time_us":6641,"prepare.run_wall_time_us":12968,"replication_time_us":8281}]]}
I20260709 13:02:35.748171  1452 catalog_manager.cc:5697] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 13 to 16, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.762394  1452 catalog_manager.cc:5697] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 16 to 18, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.758775  9099 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.765962  9099 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:35.777511  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:35.781929  9099 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:35.782536  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702e80023fd4939b4565d5f3dde73c2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:35.771687  1452 catalog_manager.cc:5697] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.784760  1526 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:35.788270  9251 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:35.803217  1673 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:35.888237  9099 raft_consensus.cc:493] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.888847  9099 raft_consensus.cc:515] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:35.892093  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:35.895375  9099 leader_election.cc:290] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:35.896466  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d71f760473d4219a951e6e5f061bfb5" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:35.898147  1523 leader_election.cc:304] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:35.899250  9099 raft_consensus.cc:2749] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:35.903331  1599 consensus_peers.cc:597] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:35.893006  1449 catalog_manager.cc:5697] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.915560  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 6325e0281aa547efa677c29cabdf5de4 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:40122
I20260709 13:02:35.916949  1449 catalog_manager.cc:5697] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 21 to 22, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 22 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.926447  1449 catalog_manager.cc:5697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.927736  1449 catalog_manager.cc:5697] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.929076  1449 catalog_manager.cc:5697] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.930307  1449 catalog_manager.cc:5697] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 14 to 21, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 21 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.932886  1452 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41166 (request call id 331) took 6161 ms. Trace:
I20260709 13:02:35.933276  1452 rpcz_store.cc:276] 0709 13:02:29.771444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.803329 (+4031885us) service_pool.cc:224] Handling call
0709 13:02:34.200379 (+397050us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540029f754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ef090 00007f0ed9a8df3a 00007f0edf8441cc 00007f0edf94237e 00007f0edde032a4 00007f0edde03232 00007f0edde03161 00007f0edde030dc 00007f0edde02392 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:35.932830 (+1732451us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:35.805307 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:35.805889 (+   582us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:35.805964 (+    75us) write_op.cc:435] Acquired schema lock
0709 13:02:35.805979 (+    15us) tablet.cc:662] Decoding operations
0709 13:02:35.806888 (+   909us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:35.806939 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:35.806967 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:02:35.807667 (+   700us) tablet.cc:701] Row locks acquired
0709 13:02:35.807686 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:02:35.807821 (+   135us) write_op.cc:270] Start()
0709 13:02:35.807936 (+   115us) write_op.cc:276] Timestamp: P: 1783602155807779 usec, L: 0
0709 13:02:35.807956 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:02:35.816148 (+  8192us) log.cc:844] Serialized 3602 byte log entry
0709 13:02:35.824877 (+  8729us) op_driver.cc:464] REPLICATION: finished
0709 13:02:35.827459 (+  2582us) write_op.cc:301] APPLY: starting
0709 13:02:35.827551 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:35.835672 (+  8121us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:35.835780 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:35.857049 (+ 21269us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:35.857276 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:02:35.857321 (+    45us) write_op.cc:312] APPLY: finished
0709 13:02:35.857597 (+   276us) log.cc:844] Serialized 89 byte log entry
0709 13:02:35.860769 (+  3172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:35.860905 (+   136us) write_op.cc:454] Released schema lock
0709 13:02:35.860957 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:35.861384 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:35.861423 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":77761,"reported_tablets":48,"spinlock_wait_cycles":294436736,"child_traces":[["op",{"apply.queue_time_us":2331,"apply.run_cpu_time_us":13335,"apply.run_wall_time_us":33905,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37566,"num_ops":9,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":3807,"prepare.run_wall_time_us":13521,"replication_time_us":16739}]]}
W20260709 13:02:35.940891  1599 consensus_peers.cc:597] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:35.955191  1599 consensus_peers.cc:597] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:35.946602  1449 catalog_manager.cc:5697] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 13 to 25. New cstate: current_term: 25 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:35.975051  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 6325e0281aa547efa677c29cabdf5de4 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
I20260709 13:02:35.974020  1449 catalog_manager.cc:5697] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 18 to 25, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 25 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:02:35.980326  1673 consensus_peers.cc:597] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:35.987389  1673 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:36.003880  1673 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:35.981918  1449 catalog_manager.cc:5697] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:36.012241  1449 catalog_manager.cc:5697] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 15 to 18, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:36.037309  1449 catalog_manager.cc:5697] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:36.051765  9099 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:36.052464  9099 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:36.055881  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:36.056175  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec8ad3927940f69c368052fdeef53b" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:36.058656  1526 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:36.059533  9251 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:36.054718  9099 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:36.054840  1449 catalog_manager.cc:5697] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.061642  1449 catalog_manager.cc:5697] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:36.087437  1599 consensus_peers.cc:597] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:36.125506  2286 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:36.129411  1599 consensus_peers.cc:597] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:36.169966  9251 raft_consensus.cc:493] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:36.170795  9251 raft_consensus.cc:515] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:36.176187  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:36.183185  9251 leader_election.cc:290] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:36.233127  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d92f9e0b7fb49ab8fad982d80cbd39f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:36.237445  1523 leader_election.cc:304] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:02:36.246686  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 44755.2us
I20260709 13:02:36.248489  9251 raft_consensus.cc:2749] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:36.290544  2286 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:36.318186  1449 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57414 (request call id 196) took 1963 ms. Trace:
I20260709 13:02:36.319007  9099 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.350505  9099 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:36.332147  2286 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:36.353874  9099 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:36.356112  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:36.359086  1449 rpcz_store.cc:276] 0709 13:02:34.355160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.758461 (+1403301us) service_pool.cc:224] Handling call
0709 13:02:36.318067 (+559606us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:36.127782 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:36.128339 (+   557us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:36.128386 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:02:36.128405 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:36.129494 (+  1089us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:36.129549 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:36.129576 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:02:36.131182 (+  1606us) tablet.cc:701] Row locks acquired
0709 13:02:36.131202 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:02:36.131346 (+   144us) write_op.cc:270] Start()
0709 13:02:36.131460 (+   114us) write_op.cc:276] Timestamp: P: 1783602156131294 usec, L: 0
0709 13:02:36.131482 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:02:36.133019 (+  1537us) log.cc:844] Serialized 5196 byte log entry
0709 13:02:36.138483 (+  5464us) op_driver.cc:464] REPLICATION: finished
0709 13:02:36.139540 (+  1057us) write_op.cc:301] APPLY: starting
0709 13:02:36.139632 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:36.146535 (+  6903us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:36.146637 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:36.174822 (+ 28185us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:36.175131 (+   309us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:02:36.175176 (+    45us) write_op.cc:312] APPLY: finished
0709 13:02:36.175484 (+   308us) log.cc:844] Serialized 121 byte log entry
0709 13:02:36.199303 (+ 23819us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.199449 (+   146us) write_op.cc:454] Released schema lock
0709 13:02:36.199503 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:36.199974 (+   471us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.200004 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56434,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":817,"apply.run_cpu_time_us":16892,"apply.run_wall_time_us":60380,"cfile_cache_hit":52,"cfile_cache_hit_bytes":54262,"num_ops":13,"prepare.queue_time_us":769,"prepare.run_cpu_time_us":4556,"prepare.run_wall_time_us":8694,"replication_time_us":6830}]]}
I20260709 13:02:36.365314  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79c0adefd7b845bb8ddbb72d7edb7bc7" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:36.382803  1526 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:36.383764  9099 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:36.438432   431 thread.cc:527] Waited for 9000ms trying to join with heartbeat (tid 1585)
W20260709 13:02:36.451296  1673 consensus_peers.cc:597] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:36.498039  1456 catalog_manager.cc:5697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.532840  1456 catalog_manager.cc:5697] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:36.550297  1453 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41156 (request call id 261) took 97350 ms (client timeout 15000 ms). Trace:
I20260709 13:02:36.535909  1456 catalog_manager.cc:5697] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 10 to 13, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:36.550932  1453 rpcz_store.cc:269] 0709 13:00:59.199955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.200311 (+   356us) service_pool.cc:224] Handling call
0709 13:02:36.550158 (+97349847us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":47,"spinlock_wait_cycles":130944}
I20260709 13:02:36.589973  1453 catalog_manager.cc:5697] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 17 to 22, leader changed from 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 22 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:02:36.654851  1456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41160 (request call id 300) took 27285 ms (client timeout 15000 ms). Trace:
W20260709 13:02:36.656886  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 114971us
W20260709 13:02:36.658195  1599 consensus_peers.cc:597] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:36.670532  1599 consensus_peers.cc:597] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:36.671200  1599 consensus_peers.cc:597] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:36.674731  1456 rpcz_store.cc:269] 0709 13:02:09.369653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.370043 (+   390us) service_pool.cc:224] Handling call
0709 13:02:36.579144 (+27209101us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.579170 (+    26us) write_op.cc:454] Released schema lock
0709 13:02:36.654692 (+ 75522us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:36.561866 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:36.562503 (+   637us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:36.562535 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:02:36.562554 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:36.563076 (+   522us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:36.563135 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:36.563323 (+   188us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:02:36.563754 (+   431us) tablet.cc:701] Row locks acquired
0709 13:02:36.563774 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:02:36.563916 (+   142us) write_op.cc:270] Start()
0709 13:02:36.564036 (+   120us) write_op.cc:276] Timestamp: P: 1783602156563870 usec, L: 0
0709 13:02:36.564057 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:02:36.564773 (+   716us) log.cc:844] Serialized 1317 byte log entry
0709 13:02:36.566944 (+  2171us) op_driver.cc:464] REPLICATION: finished
0709 13:02:36.567445 (+   501us) write_op.cc:301] APPLY: starting
0709 13:02:36.567535 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:36.569935 (+  2400us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:36.570048 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:36.573080 (+  3032us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:36.573264 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:02:36.577560 (+  4296us) write_op.cc:312] APPLY: finished
0709 13:02:36.577789 (+   229us) log.cc:844] Serialized 41 byte log entry
0709 13:02:36.578560 (+   771us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.578655 (+    95us) write_op.cc:454] Released schema lock
0709 13:02:36.578698 (+    43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1632277,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":303,"apply.run_cpu_time_us":6445,"apply.run_wall_time_us":11559,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12522,"num_ops":3,"prepare.queue_time_us":7049,"prepare.run_cpu_time_us":3233,"prepare.run_wall_time_us":11022,"replication_time_us":2730}]]}
I20260709 13:02:36.767992  9099 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.768537  9099 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:36.773555  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:36.778214  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4ee010e653949d581d35eb9b09d59dd" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:36.780299  1526 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:36.781471  9260 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:36.782243  9099 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:36.817688  2286 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:36.828691  1455 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41156 (request call id 263) took 56686 ms (client timeout 15000 ms). Trace:
W20260709 13:02:36.829170  1455 rpcz_store.cc:269] 0709 13:01:40.117640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.117892 (+   252us) service_pool.cc:224] Handling call
0709 13:02:36.799000 (+56681108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16850,"reported_tablets":47}
I20260709 13:02:36.838267  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 6325e0281aa547efa677c29cabdf5de4 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 2 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:40122
I20260709 13:02:36.866307  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 6325e0281aa547efa677c29cabdf5de4 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
W20260709 13:02:36.866597  1457 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41166 (request call id 327) took 104681 ms (client timeout 15000 ms). Trace:
W20260709 13:02:36.867005  1457 rpcz_store.cc:269] 0709 13:00:52.185125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.187527 (+  2402us) service_pool.cc:224] Handling call
0709 13:02:36.866383 (+104678856us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40276,"reported_tablets":48}
I20260709 13:02:36.905284  9099 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.905994  9099 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:36.908921  9099 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:36.909509  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:36.909641  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dee5ecdb2748fb89b7b02c8a346cb1" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:36.912497  1526 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
W20260709 13:02:36.911569  1673 consensus_peers.cc:597] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:36.913645  9099 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:36.925181  1454 catalog_manager.cc:5697] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 10 to 17. New cstate: current_term: 17 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:36.937122  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 6325e0281aa547efa677c29cabdf5de4 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 2 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:40122
I20260709 13:02:36.938979  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 6325e0281aa547efa677c29cabdf5de4 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
W20260709 13:02:36.942948  1458 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41166 (request call id 328) took 78694 ms (client timeout 15000 ms). Trace:
W20260709 13:02:36.943430  1458 rpcz_store.cc:269] 0709 13:01:18.248182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.256673 (+  8491us) service_pool.cc:224] Handling call
0709 13:02:36.942716 (+78686043us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16859,"reported_tablets":48,"spinlock_wait_cycles":18688}
I20260709 13:02:36.945612  9099 raft_consensus.cc:493] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:36.946202  9099 raft_consensus.cc:515] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:36.951033  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:36.952798  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1242a7b5484b4cc6a066e0c93629550f" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:36.958161  1523 leader_election.cc:304] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:36.959045  9261 raft_consensus.cc:2749] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:36.948354  9099 leader_election.cc:290] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:37.074849  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 54378.4us
W20260709 13:02:37.078841  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 58119.4us
I20260709 13:02:37.089259  9260 raft_consensus.cc:493] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:37.090148  9260 raft_consensus.cc:515] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:37.093325  9260 leader_election.cc:290] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:37.094724  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:37.091741  9099 raft_consensus.cc:493] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:02:37.103579  9099 raft_consensus.cc:515] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:37.191777  1672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 79898.2us
I20260709 13:02:37.200484  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:37.261140  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 60592.7us
W20260709 13:02:37.265211  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 60300.6us
I20260709 13:02:37.311861  9099 leader_election.cc:290] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:37.345383  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 75973.4us
W20260709 13:02:37.353758  1454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41156 (request call id 264) took 27980 ms (client timeout 15000 ms). Trace:
I20260709 13:02:37.362165  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f3a55bc1874c9cbd400712a345dcf0" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:37.362457  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428c176495744009b63bfa690baa17c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
W20260709 13:02:37.365108  1523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 98220.8us
W20260709 13:02:37.378949  1454 rpcz_store.cc:269] 0709 13:02:09.373126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.044938 (+4671812us) service_pool.cc:224] Handling call
0709 13:02:36.976000 (+22931062us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.976037 (+    37us) write_op.cc:454] Released schema lock
0709 13:02:37.353678 (+377641us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:36.965769 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:36.966347 (+   578us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:36.966388 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:02:36.966405 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:36.966771 (+   366us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:36.966834 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:36.966868 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:36.967056 (+   188us) tablet.cc:701] Row locks acquired
0709 13:02:36.967075 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:02:36.967249 (+   174us) write_op.cc:270] Start()
0709 13:02:36.967368 (+   119us) write_op.cc:276] Timestamp: P: 1783602156967201 usec, L: 0
0709 13:02:36.967388 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:02:36.968055 (+   667us) log.cc:844] Serialized 541 byte log entry
0709 13:02:36.971532 (+  3477us) op_driver.cc:464] REPLICATION: finished
0709 13:02:36.972005 (+   473us) write_op.cc:301] APPLY: starting
0709 13:02:36.972096 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:36.972998 (+   902us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:36.973120 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:36.974096 (+   976us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:36.974265 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:02:36.974318 (+    53us) write_op.cc:312] APPLY: finished
0709 13:02:36.974518 (+   200us) log.cc:844] Serialized 25 byte log entry
0709 13:02:36.974700 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.974784 (+    84us) write_op.cc:454] Released schema lock
0709 13:02:36.974832 (+    48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":107431,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":274,"apply.run_cpu_time_us":3128,"apply.run_wall_time_us":3125,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":150,"prepare.run_cpu_time_us":2583,"prepare.run_wall_time_us":2582,"replication_time_us":3999}]]}
W20260709 13:02:37.382997  2286 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:37.344693  1450 catalog_manager.cc:5697] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 17 to 18, leader changed from 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.414049  1450 catalog_manager.cc:5697] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 16 to 20, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.417043  1526 leader_election.cc:304] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:37.422735  9276 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:37.427644  2286 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:37.436666  9276 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:37.437283  9272 raft_consensus.cc:2749] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:37.439877   431 thread.cc:527] Waited for 10000ms trying to join with heartbeat (tid 1585)
I20260709 13:02:37.430874  1697 tablet_service.cc:1558] Processing DeleteTablet for tablet 6325e0281aa547efa677c29cabdf5de4 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:40122
I20260709 13:02:37.433090  1526 leader_election.cc:304] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:37.433779  1450 catalog_manager.cc:5697] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:37.447834  1450 catalog_manager.cc:5697] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 reported cstate change: term changed from 17 to 19, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.453061  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:37.441696  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d906a33e42d4a08ae9d1a9d2e39351c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:37.455349  9269 raft_consensus.cc:2749] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:37.439034  9276 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:37.467839  1523 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:37.492507  9278 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:37.500509  1451 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41166 (request call id 330) took 25725 ms (client timeout 15000 ms). Trace:
W20260709 13:02:37.501037  1451 rpcz_store.cc:269] 0709 13:02:11.775113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.082033 (+10306920us) service_pool.cc:224] Handling call
0709 13:02:22.525928 (+443895us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b540029f754. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0ed99ef090 00007f0ed9a8df3a 00007f0edf8441cc 00007f0edf94237e 00007f0edde032a4 00007f0edde03232 00007f0edde03161 00007f0edde030dc 00007f0edde02392 00007f0ed7dc048c 00007f0ed7dbf8c6
0709 13:02:37.500277 (+14974349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178823,"reported_tablets":48,"spinlock_wait_cycles":37619584}
W20260709 13:02:37.526854  1599 consensus_peers.cc:597] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:37.527377  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 57928.7us
W20260709 13:02:37.528439  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 50619.8us
W20260709 13:02:37.531140  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 64087us
W20260709 13:02:37.531705  1599 consensus_peers.cc:597] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:37.532770  1673 consensus_peers.cc:597] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:37.541571  1445 catalog_manager.cc:5028] TS 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): tablet 6325e0281aa547efa677c29cabdf5de4 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
W20260709 13:02:37.604869  1599 consensus_peers.cc:597] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:37.669363  1443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 62999.8us
W20260709 13:02:37.671365  1443 catalog_manager.cc:4755] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): ChangeConfig:REMOVE_PEER RPC failed for tablet 7b6551a6ae764e24a141aa53353df444: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:37.698887  1452 catalog_manager.cc:5697] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:37.700745  1452 catalog_manager.cc:5697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:37.702214  1452 catalog_manager.cc:5697] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 15 to 22. New cstate: current_term: 22 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.703830  1452 catalog_manager.cc:5697] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 17 to 18, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:37.712795  2286 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:37.728386  1452 catalog_manager.cc:5697] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "e4c78b411eb34b3d92183a86d34a81f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } }
I20260709 13:02:37.726689  1450 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41156 (request call id 265) took 7099 ms. Trace:
I20260709 13:02:37.732633  1450 rpcz_store.cc:276] 0709 13:02:30.670055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.375469 (+4705414us) service_pool.cc:224] Handling call
0709 13:02:37.726613 (+2351144us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:37.485628 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:37.505169 (+ 19541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:37.505221 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:02:37.505249 (+    28us) tablet.cc:662] Decoding operations
0709 13:02:37.506043 (+   794us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:37.506120 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:37.506161 (+    41us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:02:37.506643 (+   482us) tablet.cc:701] Row locks acquired
0709 13:02:37.506658 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:02:37.506812 (+   154us) write_op.cc:270] Start()
0709 13:02:37.506950 (+   138us) write_op.cc:276] Timestamp: P: 1783602157506767 usec, L: 0
0709 13:02:37.506975 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:02:37.536852 (+ 29877us) log.cc:844] Serialized 1706 byte log entry
0709 13:02:37.578763 (+ 41911us) op_driver.cc:464] REPLICATION: finished
0709 13:02:37.623758 (+ 44995us) write_op.cc:301] APPLY: starting
0709 13:02:37.623850 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:37.627006 (+  3156us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:37.627118 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:37.631267 (+  4149us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:37.631556 (+   289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:02:37.631603 (+    47us) write_op.cc:312] APPLY: finished
0709 13:02:37.632043 (+   440us) log.cc:844] Serialized 49 byte log entry
0709 13:02:37.632334 (+   291us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:37.632472 (+   138us) write_op.cc:454] Released schema lock
0709 13:02:37.632527 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:37.635559 (+  3032us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:37.635594 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25936,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":44724,"apply.run_cpu_time_us":8495,"apply.run_wall_time_us":9594,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20823,"num_ops":4,"prepare.queue_time_us":4566,"prepare.run_cpu_time_us":4441,"prepare.run_wall_time_us":67118,"replication_time_us":71564,"thread_start_us":10392,"threads_started":1}]]}
I20260709 13:02:37.764717   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:37.766373   431 tablet_replica.cc:333] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:37.768131   431 raft_consensus.cc:2243] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:37.768898   431 raft_consensus.cc:2272] T 01dee5ecdb2748fb89b7b02c8a346cb1 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:37.772814   431 tablet_replica.cc:333] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:37.774227   431 raft_consensus.cc:2243] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:37.778093   431 pending_rounds.cc:70] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Trying to abort 1 pending ops.
I20260709 13:02:37.778530   431 pending_rounds.cc:77] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting op as it isn't in flight: id { term: 18 index: 12 } timestamp: 7305634391898951680 op_type: NO_OP noop_request { }
I20260709 13:02:37.779018   431 raft_consensus.cc:2889] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:37.779441   431 raft_consensus.cc:2272] T 1702e80023fd4939b4565d5f3dde73c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:37.784873  9272 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.785380   431 tablet_replica.cc:333] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:37.789070   431 raft_consensus.cc:2243] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:37.792616   431 pending_rounds.cc:70] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Trying to abort 1 pending ops.
I20260709 13:02:37.792999   431 pending_rounds.cc:77] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting op as it isn't in flight: id { term: 14 index: 11 } timestamp: 7305634302548729856 op_type: NO_OP noop_request { }
I20260709 13:02:37.793432   431 raft_consensus.cc:2889] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:37.793869   431 raft_consensus.cc:2272] T a4ce544917f545499da64014539a4ff2 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:37.785429  9272 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:37.798307  9272 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:37.800238   431 tablet_replica.cc:333] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:37.801590   431 raft_consensus.cc:2243] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:37.803637  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:37.806981  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149d64e3d354b728df20cd4c75510c6" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:37.810803  1526 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:37.814500  9272 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:37.815562   431 raft_consensus.cc:2272] T 15bc2b03c4ec4de282e245ab3015bfd6 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:37.819185   431 tablet_replica.cc:333] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:37.820292   431 raft_consensus.cc:2243] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:37.821301   431 raft_consensus.cc:2272] T f4ee010e653949d581d35eb9b09d59dd P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:37.824446   431 tablet_replica.cc:333] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:37.825428   431 raft_consensus.cc:2243] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:37.826582   431 raft_consensus.cc:2272] T 076fd1ae95e4457d8361a9b4c963b26f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:37.807894  1452 catalog_manager.cc:5697] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.867015   431 tablet_replica.cc:333] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:37.873145   431 raft_consensus.cc:2243] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:37.875226   431 raft_consensus.cc:2272] T 1242a7b5484b4cc6a066e0c93629550f P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:37.878342   431 tablet_replica.cc:333] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:37.879442   431 raft_consensus.cc:2243] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:37.881541   431 raft_consensus.cc:2272] T bf4201f98c934feca49bae13648b2835 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:37.887192   431 tablet_replica.cc:333] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:37.890957   431 raft_consensus.cc:2243] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:02:37.893821   431 raft_consensus.cc:2272] T 81a2ecbb8bc64b12a8b6f2f3af475103 P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:37.909868   431 tablet_replica.cc:333] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:37.911196   431 raft_consensus.cc:2243] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:37.917868   431 raft_consensus.cc:2272] T 7b6551a6ae764e24a141aa53353df444 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:37.934598   431 tablet_replica.cc:333] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:37.952715   431 raft_consensus.cc:2243] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:37.968035  9278 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.968767  9278 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:37.970968  9278 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:37.972028   431 raft_consensus.cc:2272] T 15f3a55bc1874c9cbd400712a345dcf0 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:37.976184  1452 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41160 (request call id 302) took 2121 ms. Trace:
I20260709 13:02:37.983618   431 tablet_replica.cc:333] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:37.976714  1452 rpcz_store.cc:276] 0709 13:02:35.854981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.950614 (+ 95633us) service_pool.cc:224] Handling call
0709 13:02:37.976109 (+2025495us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:37.861198 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:37.861773 (+   575us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:37.861808 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:02:37.861828 (+    20us) tablet.cc:662] Decoding operations
0709 13:02:37.862663 (+   835us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:37.862732 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:37.862767 (+    35us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:02:37.863347 (+   580us) tablet.cc:701] Row locks acquired
0709 13:02:37.863368 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:02:37.863520 (+   152us) write_op.cc:270] Start()
0709 13:02:37.863669 (+   149us) write_op.cc:276] Timestamp: P: 1783602157863469 usec, L: 0
0709 13:02:37.863710 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:02:37.864376 (+   666us) log.cc:844] Serialized 2478 byte log entry
0709 13:02:37.867513 (+  3137us) op_driver.cc:464] REPLICATION: finished
0709 13:02:37.868263 (+   750us) write_op.cc:301] APPLY: starting
0709 13:02:37.868362 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:37.872894 (+  4532us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:37.872997 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:37.881939 (+  8942us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:37.882147 (+   208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:02:37.882198 (+    51us) write_op.cc:312] APPLY: finished
0709 13:02:37.882461 (+   263us) log.cc:844] Serialized 65 byte log entry
0709 13:02:37.890130 (+  7669us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:37.890266 (+   136us) write_op.cc:454] Released schema lock
0709 13:02:37.890331 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:37.910643 (+ 20312us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b540029f5a8. stack: 00007f0ed6966343 00007f0ed6966240 00007f0ed62f51d4 00007f0ee0033304 00007f0ee0033299 00007f0edfe419e1 00007f0edfe4064c 00007f0edd4d13fd 00007f0edd4bd389 00007f0edd4bcb53 00007f0edd4c0d61 00007f0edd4c0d19 00007f0edd4c0ca9 00007f0edd4c0c71 00007f0edd4bfe9d 000000000038f354
0709 13:02:37.911311 (+   668us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:37.911339 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9841,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":518,"apply.run_cpu_time_us":13187,"apply.run_wall_time_us":43018,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25044,"num_ops":6,"prepare.queue_time_us":125,"prepare.run_cpu_time_us":3554,"prepare.run_wall_time_us":5943,"replication_time_us":3660,"spinlock_wait_cycles":42008960}]]}
I20260709 13:02:37.985036   431 raft_consensus.cc:2243] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:02:37.997304  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:37.998472   431 raft_consensus.cc:2272] T 1bf16dd2ae6a404a9ae81192db51e512 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.002233   431 tablet_replica.cc:333] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.003777   431 raft_consensus.cc:2243] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.004561   431 raft_consensus.cc:2272] T 48837d0ac86f4664b4bfe442411bc28f P e4c78b411eb34b3d92183a86d34a81f1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.005673  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ab117f13144a07986c484571fb73a2" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:38.032366  1526 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:38.033491  9272 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:38.021522   431 tablet_replica.cc:333] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.041441   431 raft_consensus.cc:2243] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:38.044016  1673 consensus_peers.cc:597] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:38.044970  1673 consensus_peers.cc:597] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:38.047124  9268 raft_consensus.cc:493] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.047705  9268 raft_consensus.cc:515] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:38.050594  9268 leader_election.cc:290] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:38.052453  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:38.055071   431 raft_consensus.cc:2272] T 0f3f4d9e2c0643f1be1fe0de2078f6da P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.057842  1449 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41166 (request call id 332) took 1948 ms. Trace:
I20260709 13:02:38.061661  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d2a27acc8245ffb64e2f7a75ff92a4" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:38.061942  1673 consensus_peers.cc:597] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:38.058681  9268 raft_consensus.cc:493] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6b9e73092f6146639bf310a3d18cfe37)
I20260709 13:02:38.062966  9268 raft_consensus.cc:515] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:38.063344  1526 leader_election.cc:304] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:38.064189  9278 raft_consensus.cc:2749] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:38.061205  1449 rpcz_store.cc:276] 0709 13:02:36.109206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.367096 (+257890us) service_pool.cc:224] Handling call
0709 13:02:38.057776 (+1690680us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26559,"reported_tablets":28}
W20260709 13:02:38.082171  1673 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 355 similar messages]
I20260709 13:02:38.083240  9278 raft_consensus.cc:493] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.087039  9278 raft_consensus.cc:515] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:38.087412  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:38.089862  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:38.090466  9278 leader_election.cc:290] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:38.091543  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "627d40025a324704a4ae94c9ed8c404c" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:38.091770  9268 leader_election.cc:290] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:38.092195  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec5abf47e7f48a3a476ef08dd5f179d" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:38.093382   431 tablet_replica.cc:333] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.094187  1523 leader_election.cc:304] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:38.094595   431 raft_consensus.cc:2243] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.095633   431 raft_consensus.cc:2272] T 52b0712953ef42ddb724cd8c29a0ec0b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.096978  9268 raft_consensus.cc:2749] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:38.098905  1526 leader_election.cc:304] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:38.099829  9278 raft_consensus.cc:2749] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:38.102964   431 tablet_replica.cc:333] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.103971   431 raft_consensus.cc:2243] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:02:38.109923   431 raft_consensus.cc:2272] T 1a2e95946efd462d8cee2bc7302fe094 P e4c78b411eb34b3d92183a86d34a81f1 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:38.117964  1673 consensus_peers.cc:597] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:38.140877   431 tablet_replica.cc:333] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.142135   431 raft_consensus.cc:2243] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.143186   431 pending_rounds.cc:70] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Trying to abort 1 pending ops.
I20260709 13:02:38.143508   431 pending_rounds.cc:77] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1: Aborting op as it isn't in flight: id { term: 21 index: 13 } timestamp: 7305634408311537664 op_type: NO_OP noop_request { }
I20260709 13:02:38.143922   431 raft_consensus.cc:2889] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:38.144307   431 raft_consensus.cc:2272] T 01ab117f13144a07986c484571fb73a2 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.156308   431 tablet_replica.cc:333] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.157560   431 raft_consensus.cc:2243] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.158504   431 raft_consensus.cc:2272] T 1d92f9e0b7fb49ab8fad982d80cbd39f P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.165416  9268 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.166066  9268 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:38.169004  9268 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:38.169734   431 tablet_replica.cc:333] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.170780  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:38.171316  9268 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.171444  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78e528e98cb24afd985ad0425501f5ed" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:38.171921  9268 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:38.174263  9268 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:38.170790   431 raft_consensus.cc:2243] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:38.176018   431 raft_consensus.cc:2272] T bb62bfd8ccab4ff7925d27d979888b38 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.178987  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:38.181953   431 tablet_replica.cc:333] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.182488  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376e686ba5f94a11b46d68b6abe55d53" candidate_uuid: "e4c78b411eb34b3d92183a86d34a81f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:38.183265   431 raft_consensus.cc:2243] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.185722  1526 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:38.187320  9268 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:38.190126  1526 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4c78b411eb34b3d92183a86d34a81f1; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:02:38.191205  9268 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:38.184002   431 raft_consensus.cc:2272] T 4d71f760473d4219a951e6e5f061bfb5 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:38.194521  1673 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:38.196491  1673 consensus_peers.cc:597] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:38.197124   431 tablet_replica.cc:333] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.198134   431 raft_consensus.cc:2243] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.211995   431 raft_consensus.cc:2272] T 4d906a33e42d4a08ae9d1a9d2e39351c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:38.226626  1599 consensus_peers.cc:597] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:38.228542   431 tablet_replica.cc:333] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.230027   431 raft_consensus.cc:2243] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.231232   431 raft_consensus.cc:2272] T 4ec5abf47e7f48a3a476ef08dd5f179d P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:38.267735  1599 consensus_peers.cc:597] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:38.271598   431 tablet_replica.cc:333] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.272753   431 raft_consensus.cc:2243] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.273586   431 raft_consensus.cc:2272] T 54abded5f0d34ab1871704bc5a3c1b4a P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.278136   431 tablet_replica.cc:333] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.279317   431 raft_consensus.cc:2243] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:02:38.280882   431 raft_consensus.cc:2272] T 327c042262d94ababf63c12c177e29ed P e4c78b411eb34b3d92183a86d34a81f1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.288842   431 tablet_replica.cc:333] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.290748   431 raft_consensus.cc:2243] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.291450   431 raft_consensus.cc:2272] T 746cf49ba083454e8a50cff619835a56 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.295096   431 tablet_replica.cc:333] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.296096   431 raft_consensus.cc:2243] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.296921   431 raft_consensus.cc:2272] T 9e112d5c05d14e7ca923c272912bcec9 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.305481   431 tablet_replica.cc:333] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.306483   431 raft_consensus.cc:2243] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.321028   431 pending_rounds.cc:70] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Trying to abort 2 pending ops.
I20260709 13:02:38.321316   431 pending_rounds.cc:77] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Aborting op as it isn't in flight: id { term: 14 index: 8 } timestamp: 7305634309739704320 op_type: NO_OP noop_request { }
I20260709 13:02:38.321820   431 raft_consensus.cc:2889] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:38.322145   431 pending_rounds.cc:77] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1: Aborting op as it isn't in flight: id { term: 12 index: 7 } timestamp: 7305634276089815040 op_type: NO_OP noop_request { }
I20260709 13:02:38.322697   431 raft_consensus.cc:2889] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:38.323060   431 raft_consensus.cc:2272] T 376e686ba5f94a11b46d68b6abe55d53 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.326201   431 tablet_replica.cc:333] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.341144   431 raft_consensus.cc:2243] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.342217   431 raft_consensus.cc:2272] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.345549   431 tablet_replica.cc:333] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.346521   431 raft_consensus.cc:2243] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:38.347764   431 raft_consensus.cc:2272] T d1461e6ea3a84192b5ce68699dc52d80 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.350854   431 tablet_replica.cc:333] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.351727   431 raft_consensus.cc:2243] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:38.358428  1673 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:38.359201  1673 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:38.352368   431 raft_consensus.cc:2272] T 78e528e98cb24afd985ad0425501f5ed P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.367838   431 tablet_replica.cc:333] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.381660   431 raft_consensus.cc:2243] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.387042   431 raft_consensus.cc:2272] T 08d2a27acc8245ffb64e2f7a75ff92a4 P e4c78b411eb34b3d92183a86d34a81f1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.405532   431 tablet_replica.cc:333] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.406704   431 raft_consensus.cc:2243] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:38.407974   431 raft_consensus.cc:2272] T c6bbedfd642f4fde92dc31fa176c6582 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.418934   431 tablet_replica.cc:333] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.419821   431 raft_consensus.cc:2243] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.420542   431 raft_consensus.cc:2272] T 1b8e024148f547e4b090c0c8c1155232 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.422694   431 tablet_replica.cc:333] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.423453   431 raft_consensus.cc:2243] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.423935   431 raft_consensus.cc:2272] T f0b9ebe321414b42a927557c66adbb7e P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.427006   431 tablet_replica.cc:333] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.428918   431 raft_consensus.cc:2243] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.429602   431 raft_consensus.cc:2272] T 57c707e7d0374c378524e43ee47284c2 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.432104   431 tablet_replica.cc:333] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.433212   431 raft_consensus.cc:2243] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.434038   431 pending_rounds.cc:70] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Trying to abort 1 pending ops.
I20260709 13:02:38.434280   431 pending_rounds.cc:77] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1: Aborting op as it isn't in flight: id { term: 19 index: 13 } timestamp: 7305634347896332288 op_type: NO_OP noop_request { }
I20260709 13:02:38.434635   431 raft_consensus.cc:2889] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:38.435001   431 raft_consensus.cc:2272] T 6325e0281aa547efa677c29cabdf5de4 P e4c78b411eb34b3d92183a86d34a81f1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.438247   431 tablet_replica.cc:333] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.439069   431 raft_consensus.cc:2243] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.440061   431 raft_consensus.cc:2272] T 3426c98205bc4a609f37342176ca9b0a P e4c78b411eb34b3d92183a86d34a81f1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.443950   431 tablet_replica.cc:333] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.444866   431 raft_consensus.cc:2243] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.445608   431 raft_consensus.cc:2272] T e89d6bd5df2a49f7b78e8695456652b5 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.449110   431 tablet_replica.cc:333] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.450094   431 raft_consensus.cc:2243] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.450796   431 raft_consensus.cc:2272] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P e4c78b411eb34b3d92183a86d34a81f1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.454386   431 tablet_replica.cc:333] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.455291   431 raft_consensus.cc:2243] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.456182   431 pending_rounds.cc:70] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Trying to abort 2 pending ops.
I20260709 13:02:38.456452   431 pending_rounds.cc:77] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Aborting op as it isn't in flight: id { term: 17 index: 9 } timestamp: 7305634360824455168 op_type: NO_OP noop_request { }
I20260709 13:02:38.456949   431 raft_consensus.cc:2889] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:38.457551   431 pending_rounds.cc:77] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1: Aborting op as it isn't in flight: id { term: 15 index: 8 } timestamp: 7305634319504019456 op_type: NO_OP noop_request { }
I20260709 13:02:38.457964   431 raft_consensus.cc:2889] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:38.458348   431 raft_consensus.cc:2272] T dd7d9d192f7349b7bb550962c2e6c957 P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.461615   431 tablet_replica.cc:333] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.462795   431 raft_consensus.cc:2243] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:02:38.463994   431 raft_consensus.cc:2272] T a5e08456c7bb4b07bedf36cb9587b6b4 P e4c78b411eb34b3d92183a86d34a81f1 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:38.464552  1599 consensus_peers.cc:597] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:38.466971   431 tablet_replica.cc:333] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.467873   431 raft_consensus.cc:2243] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.469831   431 raft_consensus.cc:2272] T b4ec8ad3927940f69c368052fdeef53b P e4c78b411eb34b3d92183a86d34a81f1 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:38.470924  1599 consensus_peers.cc:597] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:38.472966   431 tablet_replica.cc:333] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.473976   431 raft_consensus.cc:2243] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.474725   431 raft_consensus.cc:2272] T 627d40025a324704a4ae94c9ed8c404c P e4c78b411eb34b3d92183a86d34a81f1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.480712   431 tablet_replica.cc:333] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.486773   431 raft_consensus.cc:2243] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.487447   431 raft_consensus.cc:2272] T 7485c87933f940ec96f52fe33972ecd3 P e4c78b411eb34b3d92183a86d34a81f1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.490439   431 tablet_replica.cc:333] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
W20260709 13:02:38.491863  1673 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:38.495985   431 raft_consensus.cc:2243] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.496975   431 raft_consensus.cc:2272] T 5149d64e3d354b728df20cd4c75510c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.500849   431 tablet_replica.cc:333] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.501551   431 raft_consensus.cc:2243] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:02:38.506718   431 raft_consensus.cc:2272] T 03348d9c2a344a6f8e716751b1024647 P e4c78b411eb34b3d92183a86d34a81f1 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.510105   431 tablet_replica.cc:333] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1: stopping tablet replica
I20260709 13:02:38.510911   431 raft_consensus.cc:2243] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.512015   431 raft_consensus.cc:2272] T 428c176495744009b63bfa690baa17c6 P e4c78b411eb34b3d92183a86d34a81f1 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:38.561139  1599 consensus_peers.cc:597] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:38.564357  1599 consensus_peers.cc:597] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:38.569864  1599 consensus_peers.cc:597] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:38.586707  2286 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:38.587788  1599 consensus_peers.cc:597] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:38.646708  1673 consensus_peers.cc:597] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:38.804744  1599 consensus_peers.cc:597] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:38.912462  9273 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:38.913151  9273 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:38.915509  9273 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:38.917457  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:02:38.948601  2286 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:38.945225  1599 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:38.949656  1599 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:38.952857  9277 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:38.953483  9277 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:38.954785  9262 raft_consensus.cc:2749] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:38.960409  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:38.978657  9277 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:38.980484  9279 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:38.981166  9279 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:38.983173  1673 consensus_peers.cc:597] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:38.990931  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:38.991941  1626 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 18.
I20260709 13:02:39.005613  9294 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.006278  9294 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.017786  9294 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:38.987377  9279 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:39.045151  1443 catalog_manager.cc:4755] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): ChangeConfig:REMOVE_PEER RPC failed for tablet 7b6551a6ae764e24a141aa53353df444: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.069612  2288 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:39.071668  2286 leader_election.cc:336] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:02:39.077962  2286 leader_election.cc:336] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:02:39.078399  2286 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:02:39.079257  9296 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:39.079945  9296 raft_consensus.cc:493] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.080603  9296 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:39.080739  9279 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.081337  9279 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.084792  9279 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:39.091102  2286 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.092142  9296 raft_consensus.cc:515] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.093484  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:39.094961  9296 leader_election.cc:290] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:39.095108  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:39.102069  2286 leader_election.cc:336] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.102860  9279 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:39.105657  9287 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.106827  9287 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:39.124367  9287 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:39.137732  1673 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.156406  9283 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.157045  9283 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:39.159422  9283 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:39.213649  1599 leader_election.cc:336] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.215363  1599 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.249389  9277 raft_consensus.cc:2749] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:39.255789  1673 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.274703  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:39.275554  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:39.276564  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076fd1ae95e4457d8361a9b4c963b26f" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:39.277165  1635 raft_consensus.cc:3060] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:39.287137  1635 raft_consensus.cc:2468] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:02:39.288872  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:39.289575  1631 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:02:39.293368  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:39.299873  1675 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.300843  9306 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:39.301296  9306 raft_consensus.cc:493] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.302737  1675 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.303185  9306 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:39.303767  9302 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:39.310627  9303 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.311275  9303 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.315282  9303 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:39.316100  2288 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.317322  9296 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:39.318887  2288 leader_election.cc:304] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.321516  9296 raft_consensus.cc:2804] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:39.322098  9296 raft_consensus.cc:697] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:39.327854  9296 consensus_queue.cc:237] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.329692  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:39.330422  2328 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 19.
I20260709 13:02:39.333300  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:39.337064  9306 raft_consensus.cc:515] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:39.343137  9305 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.343849  9305 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.346067  9305 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:39.346995  1673 leader_election.cc:336] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.347898  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:39.351974  9306 leader_election.cc:290] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:39.354691  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4201f98c934feca49bae13648b2835" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:39.355348  1635 raft_consensus.cc:3060] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:39.364252  1599 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.364847  1599 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.365671  9305 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:39.367026  1599 leader_election.cc:336] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.367519  1599 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.368286  9305 raft_consensus.cc:2749] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:39.373905  1635 raft_consensus.cc:2468] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20.
I20260709 13:02:39.381714  1675 leader_election.cc:304] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.382685  9306 raft_consensus.cc:2804] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:39.384132  9306 raft_consensus.cc:697] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:39.385203  9306 consensus_queue.cc:237] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:02:39.395316  1599 consensus_peers.cc:597] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:39.406915  1599 consensus_peers.cc:597] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:39.412763  2286 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:39.421095  1449 catalog_manager.cc:5697] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 18 to 19, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:39.429955  1673 consensus_peers.cc:597] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:39.438227  1452 catalog_manager.cc:5697] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 19 to 20, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 20 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.442622  9298 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.444612  9298 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.447314  9298 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:39.451630  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:39.453868  9302 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.465305  9302 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:39.468772  2286 leader_election.cc:336] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.469357  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.470124  9296 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:39.470229  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:39.471000  1635 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:02:39.476821  9277 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.483145  9277 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.486440  9277 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:39.478528  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:39.494805  2328 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:02:39.486560  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:39.495510  2326 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 13.
W20260709 13:02:39.487709  1673 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.496788  1598 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:39.478783  9306 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.497707  9306 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.500049  9306 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:39.500226  1672 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.501147  9304 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:39.501639  9304 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.502040  9304 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:39.503425  1599 consensus_peers.cc:597] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:39.506615  9301 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:39.507090  9301 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.507256  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:39.507486  9301 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:39.510612  1673 leader_election.cc:336] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.511127  1673 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.511888  9306 raft_consensus.cc:2749] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:39.512732  9305 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.513268  9305 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:39.515321  9305 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:39.516569  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:39.517341  1700 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 20.
I20260709 13:02:39.517648  9300 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.518282  9300 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.521523  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:39.521838  1601 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:39.522246  2326 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 25.
I20260709 13:02:39.522784  9303 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:39.523175  9303 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.477380  9302 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:39.523581  9303 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:39.530293  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:39.531436  9277 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:02:39.531842  9277 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.532196  9277 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:39.539044  9302 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.539899  9300 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:39.539623  9302 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.543051  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:39.546169  9304 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.546192  9302 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:39.535283  9303 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:39.550865  9306 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.552193  9298 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.552748  9298 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.554900  9298 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:39.551445  9306 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:39.555346  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:39.555930  1707 raft_consensus.cc:3060] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:39.557825  9306 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:39.559661  2286 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.562083  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:39.563318  9300 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.563849  9300 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.566887  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:39.566342  9300 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:39.523522  9301 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.570394  1707 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 21.
I20260709 13:02:39.571988  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:39.572661  1635 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:39.574869  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a2ecbb8bc64b12a8b6f2f3af475103" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:39.575915  2326 raft_consensus.cc:3060] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:39.589872  9304 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:39.590015  9303 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:39.584957  1599 leader_election.cc:336] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.592139  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:39.594661  2326 raft_consensus.cc:2468] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 14.
I20260709 13:02:39.592871  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b6551a6ae764e24a141aa53353df444" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:39.595307  2328 raft_consensus.cc:3060] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:39.595781  1598 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:39.593324  9301 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:39.597344  9277 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.602213  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2e95946efd462d8cee2bc7302fe094" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:39.602900  2326 raft_consensus.cc:3060] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:39.604022  2328 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20.
I20260709 13:02:39.604131  9304 raft_consensus.cc:2804] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:39.604540  9277 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 26 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:39.606906  9304 raft_consensus.cc:697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:39.608192  9304 consensus_queue.cc:237] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:39.612071  1599 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:02:39.612871  1599 leader_election.cc:336] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:02:39.616181  1673 leader_election.cc:336] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.620885  2326 raft_consensus.cc:2468] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 26.
I20260709 13:02:39.622092  1598 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:39.622926  9300 raft_consensus.cc:2804] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:02:39.623385  9300 raft_consensus.cc:697] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 26 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:39.624256  9300 consensus_queue.cc:237] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.625061  1635 raft_consensus.cc:2468] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20.
I20260709 13:02:39.625602  9298 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.626847  1675 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
W20260709 13:02:39.627103  1599 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.629163  9301 raft_consensus.cc:2804] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:39.629745  9301 raft_consensus.cc:697] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:39.627985  1601 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.616690  1673 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.632611  9305 raft_consensus.cc:2804] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:39.628273  9298 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.630647  9301 consensus_queue.cc:237] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.636349  9306 raft_consensus.cc:2749] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:39.637588  9305 raft_consensus.cc:697] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:39.644456  9302 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.645007  9302 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.645274  9305 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:39.647105  9302 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:02:39.638345  9298 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:39.648882  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:02:39.649487  2328 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 21.
I20260709 13:02:39.639652  2288 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.638379  9296 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
W20260709 13:02:39.638686  1673 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.650559  1672 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:39.652297  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.651651  9279 raft_consensus.cc:2749] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:39.652187  9296 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:39.653851  1673 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:02:39.654099  2286 leader_election.cc:336] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:02:39.654709  1599 leader_election.cc:336] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.656543  1599 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:02:39.657917  1599 leader_election.cc:336] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:02:39.658573  1599 leader_election.cc:336] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.659756  9262 raft_consensus.cc:2749] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:39.664754  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:39.665730  1635 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:02:39.668781  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.657672  9302 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:39.678521  9279 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:39.681855  9279 raft_consensus.cc:493] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.682317  9279 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:39.655989  9306 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:39.690186  9306 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.690615  9306 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:39.695616  9296 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:02:39.708825  2286 leader_election.cc:336] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.731853  9304 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.732542  9304 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:39.734764  9304 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:39.735737  1452 catalog_manager.cc:5697] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 13 to 14, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.737674  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:39.738325  1707 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 22.
W20260709 13:02:39.739470  1673 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.740403  1601 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: 
I20260709 13:02:39.741186  9299 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:39.741568  9299 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.741887  9299 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:02:39.743678  1599 consensus_peers.cc:597] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:39.744918  1599 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.747605  9279 raft_consensus.cc:515] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.759297  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" is_pre_election: true
I20260709 13:02:39.760021  1635 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
W20260709 13:02:39.762704  2286 leader_election.cc:336] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.745407  9296 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.770905  9296 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.773082  9296 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:39.777930  2286 leader_election.cc:336] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.779435  9298 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.780032  9298 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.782258  9298 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:39.780232  2288 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.784665  9298 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:39.785328  9298 raft_consensus.cc:493] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.785872  9298 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:39.792147  2286 leader_election.cc:336] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.794201  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:39.794873  1707 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 24.
I20260709 13:02:39.802201  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:02:39.800261  9279 leader_election.cc:290] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:39.802894  1707 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 16.
I20260709 13:02:39.806001  9299 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:39.809017  9299 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:39.809405  1452 catalog_manager.cc:5697] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 19 to 20, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 20 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.811193  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:39.811774  1707 raft_consensus.cc:3060] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:02:39.815409  2286 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:39.818252  2286 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:39.832203  1599 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:39.833305  9306 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.836417  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "327c042262d94ababf63c12c177e29ed" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:02:39.836640  1707 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8106dfc0bda54df0ae10ba13c28ccc18 in term 23.
I20260709 13:02:39.837044  2326 raft_consensus.cc:3060] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:39.837766  1601 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.838819  9262 raft_consensus.cc:2804] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:39.839313  9262 raft_consensus.cc:697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 LEADER]: Becoming Leader. State: Replica: 8106dfc0bda54df0ae10ba13c28ccc18, State: Running, Role: LEADER
I20260709 13:02:39.840155  9262 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:02:39.842664  1449 catalog_manager.cc:5697] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 25 to 26, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 26 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.846328  2326 raft_consensus.cc:2468] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 22.
I20260709 13:02:39.847402  1672 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:39.848505  9301 raft_consensus.cc:2804] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:39.849087  9301 raft_consensus.cc:697] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:02:39.849987  9301 consensus_queue.cc:237] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.844324  1449 catalog_manager.cc:5697] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 20 to 21, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.871217  9298 raft_consensus.cc:515] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:39.879053   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1581)
I20260709 13:02:39.886617  9298 leader_election.cc:290] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:39.857659  9306 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:02:39.910805  2286 leader_election.cc:336] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:02:39.904104  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 102542us
I20260709 13:02:39.914440  2288 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.915319  9298 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:39.915601  2288 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.922307  9296 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:39.922780  9296 raft_consensus.cc:493] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.923153  9296 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:39.923466  1635 raft_consensus.cc:1275] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:39.900663  1449 catalog_manager.cc:5697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: term changed from 22 to 23, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194). New cstate: current_term: 23 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:39.916963  1673 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:02:39.925452  1673 consensus_peers.cc:597] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:39.926581  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1461e6ea3a84192b5ce68699dc52d80" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:39.926834  1631 raft_consensus.cc:1275] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:02:39.927211  1634 raft_consensus.cc:3060] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:39.927907  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb62bfd8ccab4ff7925d27d979888b38" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8106dfc0bda54df0ae10ba13c28ccc18"
I20260709 13:02:39.928478  1635 raft_consensus.cc:3060] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:39.939899  1635 raft_consensus.cc:2468] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:02:39.932704  9298 raft_consensus.cc:493] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Starting leader election (detected failure of leader e4c78b411eb34b3d92183a86d34a81f1)
I20260709 13:02:39.945166  9298 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:39.946969  1634 raft_consensus.cc:2468] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:02:39.943593  9287 consensus_queue.cc:1048] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:39.947736  1452 catalog_manager.cc:5697] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 21 to 22, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 22 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:39.960752  2286 consensus_peers.cc:597] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:39.970845  9296 raft_consensus.cc:515] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.988373  9320 consensus_queue.cc:1048] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:39.991369  2288 leader_election.cc:304] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.992499  9320 raft_consensus.cc:2804] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:39.993309  9320 raft_consensus.cc:697] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:39.992995  2288 leader_election.cc:304] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:39.997005  9319 raft_consensus.cc:2804] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:39.997170  9320 consensus_queue.cc:237] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:39.997762  9319 raft_consensus.cc:697] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:39.998709  9319 consensus_queue.cc:237] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:40.006381  9296 leader_election.cc:290] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:40.007934  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbedfd642f4fde92dc31fa176c6582" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:40.008610  1700 raft_consensus.cc:3060] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:40.031185  2286 leader_election.cc:336] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:40.039335  1700 raft_consensus.cc:2468] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 17.
I20260709 13:02:40.041093  2288 leader_election.cc:304] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:02:40.044051  9279 raft_consensus.cc:2804] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:40.044608  9279 raft_consensus.cc:697] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:02:40.038481  9298 raft_consensus.cc:515] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:40.058754  9298 leader_election.cc:290] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 25 election: Requested vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:40.061043  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03348d9c2a344a6f8e716751b1024647" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:02:40.061693  1700 raft_consensus.cc:3060] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:40.067492  2326 raft_consensus.cc:1275] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:40.086776  1707 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:02:40.088275  9279 consensus_queue.cc:237] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:40.088688  9305 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:40.094645  2326 raft_consensus.cc:1275] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:02:40.117396  1452 catalog_manager.cc:5697] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 16 to 17, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.117146  1700 raft_consensus.cc:2468] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 25.
I20260709 13:02:40.075456  9304 consensus_queue.cc:1048] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:02:40.144901  2288 leader_election.cc:304] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:02:40.117514  9262 consensus_queue.cc:1048] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
W20260709 13:02:40.140056  1445 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7b6551a6ae764e24a141aa53353df444 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:02:40.153731  9279 raft_consensus.cc:2804] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:02:40.182865  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 61079.2us
I20260709 13:02:40.184973  1634 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:02:40.197062  1599 consensus_peers.cc:597] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:40.197587  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 68929.5us
W20260709 13:02:40.219524  2286 leader_election.cc:336] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:40.241545  9306 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:40.256946  2327 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:02:40.259138  2286 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:40.264151  1673 consensus_peers.cc:597] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:40.268324  1599 consensus_peers.cc:597] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:40.274343  1599 consensus_peers.cc:597] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:40.275375  1599 consensus_peers.cc:597] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:40.220834  9279 raft_consensus.cc:697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
W20260709 13:02:40.276630  1673 consensus_peers.cc:597] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:40.273554  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 49714.6us
I20260709 13:02:40.281453  9333 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:02:40.286007  9279 consensus_queue.cc:237] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:40.291673  1673 consensus_peers.cc:597] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.329545  1449 catalog_manager.cc:5697] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 16 to 17, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.331919  1449 catalog_manager.cc:5697] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 16 to 17, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.334679  2327 raft_consensus.cc:1275] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:40.337692  9332 consensus_queue.cc:1048] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:40.412619  1707 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:02:40.414908  9299 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:02:40.432857  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 76896.5us
W20260709 13:02:40.501995  2286 consensus_peers.cc:597] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:40.529325  1599 consensus_peers.cc:597] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:40.529906  1599 consensus_peers.cc:597] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:40.569387  1673 consensus_peers.cc:597] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:02:40.600888  1700 raft_consensus.cc:1275] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:02:40.613757  2286 consensus_peers.cc:597] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:40.618505  1673 consensus_peers.cc:597] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:02:40.620018  1626 raft_consensus.cc:1275] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:40.620534  1634 raft_consensus.cc:1275] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:02:40.629168  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 139854us
I20260709 13:02:40.634032  9336 consensus_queue.cc:1048] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:40.636632  9316 consensus_queue.cc:1048] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:02:40.626814  9319 consensus_queue.cc:1048] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
W20260709 13:02:40.644398  2286 consensus_peers.cc:597] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:40.653532  1673 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:02:40.685843  1449 catalog_manager.cc:5697] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 24 to 25, leader changed from e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 25 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:40.696492  1673 consensus_peers.cc:597] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:40.699208  1599 consensus_peers.cc:597] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:40.769219  2286 consensus_peers.cc:597] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:40.776373  1673 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:40.800277  1673 consensus_peers.cc:597] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:02:40.831058  1707 raft_consensus.cc:1275] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Refusing update from remote peer 6b9e73092f6146639bf310a3d18cfe37: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:02:40.833012  9336 consensus_queue.cc:1048] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:02:40.858767  1599 consensus_peers.cc:597] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:40.884934   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:40.893332  1599 consensus_peers.cc:597] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:40.917186  1673 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:40.956736  1673 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:40.979179  1599 consensus_peers.cc:597] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:41.036509  1673 consensus_peers.cc:597] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:41.093691  1599 consensus_peers.cc:597] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:41.206037  2286 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:41.235025  1599 consensus_peers.cc:597] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:41.241052  1673 consensus_peers.cc:597] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:41.241645  1673 consensus_peers.cc:597] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:41.276336  1599 consensus_peers.cc:597] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:41.276953  1599 consensus_peers.cc:597] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:41.379348  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 51007.6us
W20260709 13:02:41.464716  1599 consensus_peers.cc:597] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:41.613489  2286 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:41.650041  2286 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:41.826256  2286 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:41.885670   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:42.033471  1599 consensus_peers.cc:597] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:02:42.251046  1701 consensus_queue.cc:237] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:42.268707  1673 consensus_peers.cc:597] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:42.269258  2286 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:42.329077  2321 raft_consensus.cc:1275] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:42.332441  9287 consensus_queue.cc:1048] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:02:42.339854  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 74688.9us
W20260709 13:02:42.343678  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 83763.3us
W20260709 13:02:42.353633  1673 consensus_peers.cc:597] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.358428  1599 consensus_peers.cc:597] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:42.368112  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 67422.4us
W20260709 13:02:42.394057  2286 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:42.412876  9333 raft_consensus.cc:2955] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 4 to 14, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:42.425401  2327 raft_consensus.cc:2955] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 4 to 14, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:42.439239  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7b6551a6ae764e24a141aa53353df444 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
W20260709 13:02:42.379470  1599 consensus_peers.cc:597] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:42.442020  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 62641.8us
I20260709 13:02:42.452860  1449 catalog_manager.cc:5697] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 4 to 14, VOTER 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) evicted. New cstate: current_term: 20 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:42.472949  1673 consensus_peers.cc:597] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:42.478457  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 92669.3us
W20260709 13:02:42.505268  1599 consensus_peers.cc:597] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:42.526158  2286 consensus_peers.cc:597] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:42.550181  1599 consensus_peers.cc:597] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:42.551002  1599 consensus_peers.cc:597] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:42.601588  2286 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:42.652168  1619 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b6551a6ae764e24a141aa53353df444 with delete_type TABLET_DATA_TOMBSTONED (TS 8106dfc0bda54df0ae10ba13c28ccc18 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:36194
I20260709 13:02:42.679607  9381 tablet_replica.cc:333] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:42.683604  9381 raft_consensus.cc:2243] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.686592  9381 raft_consensus.cc:2272] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.709677  9381 ts_tablet_manager.cc:1916] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:02:42.731070  1673 consensus_peers.cc:597] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:42.793358  1599 consensus_peers.cc:597] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:42.795100  1673 consensus_peers.cc:597] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:42.802135  1599 consensus_peers.cc:597] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:42.805608  9381 ts_tablet_manager.cc:1929] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.13
I20260709 13:02:42.813198  9381 log.cc:1199] T 7b6551a6ae764e24a141aa53353df444 P 8106dfc0bda54df0ae10ba13c28ccc18: Deleting WAL directory at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0/minicluster-data/ts-1-root/wals/7b6551a6ae764e24a141aa53353df444
I20260709 13:02:42.815618  1445 catalog_manager.cc:5028] TS 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): tablet 7b6551a6ae764e24a141aa53353df444 (table test-workload [id=42382d5664d647d6af9c2fb7f701ad97]) successfully deleted
W20260709 13:02:42.882901  2286 consensus_peers.cc:597] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:42.886240   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:42.944633  1599 consensus_peers.cc:597] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:43.020481  1599 consensus_peers.cc:597] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:43.073062  1673 consensus_peers.cc:597] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:43.075096  2286 consensus_peers.cc:597] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:43.097394  2286 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111) [suppressed 450 similar messages]
W20260709 13:02:43.116514  1673 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:43.133742  1673 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:43.390758  1599 consensus_peers.cc:597] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:43.391600  1599 consensus_peers.cc:597] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:43.480341  2350 debug-util.cc:398] Leaking SignalData structure 0x7b08001a5940 after lost signal to thread 434
W20260709 13:02:43.481809  2350 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4a60 after lost signal to thread 1492
W20260709 13:02:43.483660  2350 debug-util.cc:398] Leaking SignalData structure 0x7b0800333d80 after lost signal to thread 1659
W20260709 13:02:43.485508  2350 debug-util.cc:398] Leaking SignalData structure 0x7b08002a7d20 after lost signal to thread 1733
W20260709 13:02:43.487346  2350 debug-util.cc:398] Leaking SignalData structure 0x7b080013e620 after lost signal to thread 2353
W20260709 13:02:43.480283  1673 consensus_peers.cc:597] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:43.492906  1673 consensus_peers.cc:597] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:43.502916  1599 consensus_peers.cc:597] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:43.497640  1673 consensus_peers.cc:597] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:43.507442  1599 consensus_peers.cc:597] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:43.548410  2286 consensus_peers.cc:597] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:43.568742  2286 consensus_peers.cc:597] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:43.590211  1673 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:43.611572  1599 consensus_peers.cc:597] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:43.718469  1673 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:43.795246  1708 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
W20260709 13:02:43.816066  1599 consensus_peers.cc:597] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:43.828661  1627 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:43.831120  9389 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:02:43.835011  1672 consensus_peers.cc:597] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4ec8ad3927940f69c368052fdeef53b. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.847399  1673 consensus_peers.cc:597] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.849319  1599 consensus_peers.cc:597] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:02:43.857203  9390 raft_consensus.cc:2955] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 13:02:43.859201  1627 raft_consensus.cc:2955] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 13:02:43.883484  1708 consensus_queue.cc:237] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
W20260709 13:02:43.887598   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1581)
I20260709 13:02:43.889613  1449 catalog_manager.cc:5697] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index -1 to 12, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:43.918701  1627 raft_consensus.cc:1275] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:02:43.919225  1672 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 627d40025a324704a4ae94c9ed8c404c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:43.920550  9364 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:02:43.926873  1673 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:43.983392  1599 consensus_peers.cc:597] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:43.992709  2286 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:44.062848  1673 consensus_peers.cc:597] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:44.066254  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:42699, user_credentials={real_user=slave}} blocked reactor thread for 54871.4us
W20260709 13:02:44.090724  1599 consensus_peers.cc:597] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:44.153589  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 56312.4us
I20260709 13:02:44.158116  9287 raft_consensus.cc:2955] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 13:02:44.165037  1627 raft_consensus.cc:2955] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
W20260709 13:02:44.180649  1673 consensus_peers.cc:597] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:44.181185  1673 consensus_peers.cc:597] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:44.195607  2286 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:44.204300  1452 catalog_manager.cc:5697] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 10, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 13 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 13:02:44.242410  1627 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 13:02:44.272302  9412 ts_tablet_manager.cc:933] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:02:44.280203  1707 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:44.283128  9403 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:02:44.287724  1598 consensus_peers.cc:597] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1bf16dd2ae6a404a9ae81192db51e512. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.291397  1599 consensus_peers.cc:597] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.313093  9412 tablet_copy_client.cc:323] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:42699
I20260709 13:02:44.315546  1719 tablet_copy_service.cc:140] P 4f6fa2fd61114dc190d8f9b310696e1a: Received BeginTabletCopySession request for tablet b4ec8ad3927940f69c368052fdeef53b from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:35632)
I20260709 13:02:44.316478  1719 tablet_copy_service.cc:161] P 4f6fa2fd61114dc190d8f9b310696e1a: Beginning new tablet copy session on tablet b4ec8ad3927940f69c368052fdeef53b from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:35632: session id = 6b9e73092f6146639bf310a3d18cfe37-b4ec8ad3927940f69c368052fdeef53b
I20260709 13:02:44.328161  1719 tablet_copy_source_session.cc:215] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:02:44.329720  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08003962c0 after lost signal to thread 434
W20260709 13:02:44.337311  1656 debug-util.cc:398] Leaking SignalData structure 0x7b0800260760 after lost signal to thread 1492
W20260709 13:02:44.339705  1656 debug-util.cc:398] Leaking SignalData structure 0x7b080032ea60 after lost signal to thread 1733
W20260709 13:02:44.341305  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08001972a0 after lost signal to thread 2353
I20260709 13:02:44.342198  9412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ec8ad3927940f69c368052fdeef53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.343503  9403 raft_consensus.cc:2955] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 13:02:44.354899  1708 raft_consensus.cc:2955] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
W20260709 13:02:44.363000  2286 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:44.365933  2286 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:44.373208  2286 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:44.412698  9412 tablet_copy_client.cc:806] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:44.413514  9412 tablet_copy_client.cc:670] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:44.427320  9412 tablet_copy_client.cc:538] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:44.446660  1634 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 13:02:44.450984  1449 catalog_manager.cc:5697] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index -1 to 13, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 21 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 13:02:44.464571  9412 tablet_bootstrap.cc:492] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 13:02:44.490751  9416 ts_tablet_manager.cc:933] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:02:44.495482  1598 consensus_peers.cc:597] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387): Couldn't send request to peer 6b9e73092f6146639bf310a3d18cfe37. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5e08456c7bb4b07bedf36cb9587b6b4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.520504  1708 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:02:44.529740  9416 tablet_copy_client.cc:323] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:42699
I20260709 13:02:44.544595  9402 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:44.576468  1719 tablet_copy_service.cc:140] P 4f6fa2fd61114dc190d8f9b310696e1a: Received BeginTabletCopySession request for tablet 627d40025a324704a4ae94c9ed8c404c from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:35632)
I20260709 13:02:44.577136  1719 tablet_copy_service.cc:161] P 4f6fa2fd61114dc190d8f9b310696e1a: Beginning new tablet copy session on tablet 627d40025a324704a4ae94c9ed8c404c from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:35632: session id = 6b9e73092f6146639bf310a3d18cfe37-627d40025a324704a4ae94c9ed8c404c
I20260709 13:02:44.598834  1719 tablet_copy_source_session.cc:215] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:44.652719  9403 raft_consensus.cc:2955] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
I20260709 13:02:44.664666  9416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 627d40025a324704a4ae94c9ed8c404c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.681896  1708 raft_consensus.cc:2955] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } } }
W20260709 13:02:44.710094  1599 consensus_peers.cc:597] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.710986  1599 consensus_peers.cc:597] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:44.751590  1449 catalog_manager.cc:5697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index -1 to 14, NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) added. New cstate: current_term: 23 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.753063  9425 ts_tablet_manager.cc:933] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:44.790256  9412 tablet_bootstrap.cc:492] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:44.799758  9412 tablet_bootstrap.cc:492] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 13:02:44.800653  9412 ts_tablet_manager.cc:1403] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.336s	user 0.044s	sys 0.015s
I20260709 13:02:44.803802  9412 raft_consensus.cc:359] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 13:02:44.804728  9412 raft_consensus.cc:740] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 13:02:44.805420  9412 consensus_queue.cc:260] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 13:02:44.826009  9425 tablet_copy_client.cc:323] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43887
I20260709 13:02:44.827963  9412 ts_tablet_manager.cc:1434] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.004s
I20260709 13:02:44.829617  1645 tablet_copy_service.cc:140] P 8106dfc0bda54df0ae10ba13c28ccc18: Received BeginTabletCopySession request for tablet 1bf16dd2ae6a404a9ae81192db51e512 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:46120)
I20260709 13:02:44.830327  1645 tablet_copy_service.cc:161] P 8106dfc0bda54df0ae10ba13c28ccc18: Beginning new tablet copy session on tablet 1bf16dd2ae6a404a9ae81192db51e512 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:46120: session id = 6b9e73092f6146639bf310a3d18cfe37-1bf16dd2ae6a404a9ae81192db51e512
I20260709 13:02:44.833784  1719 tablet_copy_service.cc:342] P 4f6fa2fd61114dc190d8f9b310696e1a: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-b4ec8ad3927940f69c368052fdeef53b received from {username='slave'} at 127.0.0.1:35632
I20260709 13:02:44.834424  1719 tablet_copy_service.cc:434] P 4f6fa2fd61114dc190d8f9b310696e1a: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-b4ec8ad3927940f69c368052fdeef53b on tablet b4ec8ad3927940f69c368052fdeef53b with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:44.849154  1645 tablet_copy_source_session.cc:215] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:44.860321  9425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf16dd2ae6a404a9ae81192db51e512. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:44.860767  2286 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:44.871585  1599 consensus_peers.cc:597] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:44.876556  1599 consensus_peers.cc:597] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:44.879679  9416 tablet_copy_client.cc:806] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:44.882763  9416 tablet_copy_client.cc:670] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
W20260709 13:02:44.888113   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1581)
I20260709 13:02:44.890611  9416 tablet_copy_client.cc:538] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:44.911860  9416 tablet_bootstrap.cc:492] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
W20260709 13:02:44.933300  1599 consensus_peers.cc:597] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:44.975538  1673 consensus_peers.cc:597] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:45.083644  9412 ts_tablet_manager.cc:933] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37: Initiating tablet copy from peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:02:45.085714  9416 tablet_bootstrap.cc:492] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.086760  9416 tablet_bootstrap.cc:492] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 13:02:45.101584  9425 tablet_copy_client.cc:806] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:45.102324  9425 tablet_copy_client.cc:670] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:45.087699  9416 ts_tablet_manager.cc:1403] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.176s	user 0.042s	sys 0.004s
I20260709 13:02:45.136626  9416 raft_consensus.cc:359] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 13:02:45.137521  9416 raft_consensus.cc:740] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 13:02:45.143330  9412 tablet_copy_client.cc:323] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43887
I20260709 13:02:45.138231  9416 consensus_queue.cc:260] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
W20260709 13:02:45.158509  2286 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:45.159432  9416 ts_tablet_manager.cc:1434] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 13:02:45.167721  1719 tablet_copy_service.cc:342] P 4f6fa2fd61114dc190d8f9b310696e1a: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-627d40025a324704a4ae94c9ed8c404c received from {username='slave'} at 127.0.0.1:35632
I20260709 13:02:45.168232  1719 tablet_copy_service.cc:434] P 4f6fa2fd61114dc190d8f9b310696e1a: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-627d40025a324704a4ae94c9ed8c404c on tablet 627d40025a324704a4ae94c9ed8c404c with peer 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:02:45.205374  2286 consensus_peers.cc:597] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:45.213950  1673 consensus_peers.cc:597] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:45.214522  1673 consensus_peers.cc:597] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:45.248179  1645 tablet_copy_service.cc:140] P 8106dfc0bda54df0ae10ba13c28ccc18: Received BeginTabletCopySession request for tablet a5e08456c7bb4b07bedf36cb9587b6b4 from peer 6b9e73092f6146639bf310a3d18cfe37 ({username='slave'} at 127.0.0.1:46120)
I20260709 13:02:45.248904  1645 tablet_copy_service.cc:161] P 8106dfc0bda54df0ae10ba13c28ccc18: Beginning new tablet copy session on tablet a5e08456c7bb4b07bedf36cb9587b6b4 from peer 6b9e73092f6146639bf310a3d18cfe37 at {username='slave'} at 127.0.0.1:46120: session id = 6b9e73092f6146639bf310a3d18cfe37-a5e08456c7bb4b07bedf36cb9587b6b4
W20260709 13:02:45.270603  1599 consensus_peers.cc:597] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:45.277290  1645 tablet_copy_source_session.cc:215] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:45.279680  9425 tablet_copy_client.cc:538] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:02:45.284224  1673 consensus_peers.cc:597] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:45.318526  9425 tablet_bootstrap.cc:492] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
I20260709 13:02:45.345398  2327 raft_consensus.cc:1217] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
I20260709 13:02:45.353749  9412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e08456c7bb4b07bedf36cb9587b6b4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:45.389546  1599 consensus_peers.cc:597] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:45.406575  9412 tablet_copy_client.cc:806] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:45.407225  9412 tablet_copy_client.cc:670] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:45.426700  9412 tablet_copy_client.cc:538] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:45.463100  2327 raft_consensus.cc:1217] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
W20260709 13:02:45.477138  2286 consensus_peers.cc:597] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:45.524256  1673 consensus_peers.cc:597] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:45.534714  1673 consensus_peers.cc:597] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:45.546059  9412 tablet_bootstrap.cc:492] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap starting.
W20260709 13:02:45.582867  2286 consensus_peers.cc:597] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:45.584029  1599 consensus_peers.cc:597] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:45.663995  1599 consensus_peers.cc:597] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:45.717279  9412 tablet_bootstrap.cc:492] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.718379  9412 tablet_bootstrap.cc:492] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 13:02:45.719156  9412 ts_tablet_manager.cc:1403] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.173s	user 0.044s	sys 0.005s
I20260709 13:02:45.722441  9412 raft_consensus.cc:359] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
W20260709 13:02:45.723582  1673 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:45.766388  9412 raft_consensus.cc:740] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 13:02:45.770231  9412 consensus_queue.cc:260] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
W20260709 13:02:45.773478  1673 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:45.778847  9412 ts_tablet_manager.cc:1434] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.001s
I20260709 13:02:45.797731  1645 tablet_copy_service.cc:342] P 8106dfc0bda54df0ae10ba13c28ccc18: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-a5e08456c7bb4b07bedf36cb9587b6b4 received from {username='slave'} at 127.0.0.1:46120
I20260709 13:02:45.798267  1645 tablet_copy_service.cc:434] P 8106dfc0bda54df0ae10ba13c28ccc18: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-a5e08456c7bb4b07bedf36cb9587b6b4 on tablet a5e08456c7bb4b07bedf36cb9587b6b4 with peer 6b9e73092f6146639bf310a3d18cfe37
I20260709 13:02:45.810045  9425 tablet_bootstrap.cc:492] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:45.811100  9425 tablet_bootstrap.cc:492] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37: Bootstrap complete.
I20260709 13:02:45.811911  9425 ts_tablet_manager.cc:1403] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37: Time spent bootstrapping tablet: real 0.494s	user 0.046s	sys 0.010s
W20260709 13:02:45.812237  1599 consensus_peers.cc:597] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:45.840251  9425 raft_consensus.cc:359] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 13:02:45.841351  9425 raft_consensus.cc:740] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Initialized, Role: LEARNER
I20260709 13:02:45.842142  9425 consensus_queue.cc:260] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: true } }
I20260709 13:02:45.862317  9425 ts_tablet_manager.cc:1434] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.003s
I20260709 13:02:45.864146  1645 tablet_copy_service.cc:342] P 8106dfc0bda54df0ae10ba13c28ccc18: Request end of tablet copy session 6b9e73092f6146639bf310a3d18cfe37-1bf16dd2ae6a404a9ae81192db51e512 received from {username='slave'} at 127.0.0.1:46120
I20260709 13:02:45.864650  1645 tablet_copy_service.cc:434] P 8106dfc0bda54df0ae10ba13c28ccc18: ending tablet copy session 6b9e73092f6146639bf310a3d18cfe37-1bf16dd2ae6a404a9ae81192db51e512 on tablet 1bf16dd2ae6a404a9ae81192db51e512 with peer 6b9e73092f6146639bf310a3d18cfe37
W20260709 13:02:45.888860   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:45.889520  1599 consensus_peers.cc:597] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:45.923705  1599 consensus_peers.cc:597] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:45.934026  9287 raft_consensus.cc:1064] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 13:02:45.951239  9406 raft_consensus.cc:1064] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 13:02:45.952931  9287 consensus_queue.cc:237] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:45.959824  1673 consensus_peers.cc:597] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:45.965441  9406 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:45.976251  1599 consensus_peers.cc:597] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:45.987848  2286 consensus_peers.cc:597] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:45.994302  2327 raft_consensus.cc:1275] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 LEARNER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:46.003718  9424 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
W20260709 13:02:46.012203  1673 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:46.031467  2327 raft_consensus.cc:1217] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.13->[23.14-23.14]   Dedup: 23.14->[]
I20260709 13:02:46.061250  1634 raft_consensus.cc:1275] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:46.064357  2327 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEARNER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:46.066808  9424 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:46.074127  9434 consensus_queue.cc:1048] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:02:46.076836  1673 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.095001  1635 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:46.097851  9406 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:02:46.106014  1673 consensus_peers.cc:597] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:46.125854  9435 log.cc:927] Time spent T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:02:46.146799  2327 raft_consensus.cc:1217] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.12->[21.13-21.13]   Dedup: 21.13->[]
I20260709 13:02:46.155905  9287 raft_consensus.cc:2955] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:46.168907  9406 raft_consensus.cc:2955] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:02:46.171438  1599 consensus_peers.cc:597] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:46.175084  2321 raft_consensus.cc:2955] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:46.178228  1634 raft_consensus.cc:2955] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:46.201400  1627 raft_consensus.cc:2955] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:02:46.209574  2286 consensus_peers.cc:597] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:46.218802  1599 consensus_peers.cc:597] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:46.229574  1450 catalog_manager.cc:5697] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 reported cstate change: config changed from index 10 to 11, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:46.244151  1452 catalog_manager.cc:5697] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 12 to 13, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.267508  2321 raft_consensus.cc:2955] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } attrs { replace: true } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:02:46.286216  1673 consensus_peers.cc:597] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:46.344847  2286 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:46.404917  1599 consensus_peers.cc:597] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:46.418823  9402 raft_consensus.cc:1064] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 13:02:46.429888  9402 consensus_queue.cc:237] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 12, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:46.439313  1708 consensus_queue.cc:237] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:02:46.461141  2327 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:46.462622  1627 raft_consensus.cc:1275] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:46.468544  2327 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:02:46.472168  9422 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:46.472304  9441 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:46.473941  1700 raft_consensus.cc:1275] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:02:46.475221  9440 consensus_queue.cc:1048] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:46.482873  9422 consensus_queue.cc:1048] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:46.492192  9433 raft_consensus.cc:2955] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:46.496380  2320 raft_consensus.cc:2955] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:02:46.512251  1599 consensus_peers.cc:597] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:46.512849  1599 consensus_peers.cc:597] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:46.517793  1673 consensus_peers.cc:597] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:46.521414  1634 raft_consensus.cc:2955] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:46.522432  9402 raft_consensus.cc:2955] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:46.528833  1700 raft_consensus.cc:2955] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:46.566006  2321 raft_consensus.cc:2955] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:46.580564  1450 catalog_manager.cc:5697] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 13 to 14, VOTER e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193) evicted. New cstate: current_term: 17 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:46.590418  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b4ec8ad3927940f69c368052fdeef53b with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:46.612150  1449 catalog_manager.cc:5697] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: config changed from index 14 to 15, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:02:46.676406  2286 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:46.700060  2286 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:46.700753  2286 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:02:46.701632  9443 raft_consensus.cc:1064] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: attempting to promote NON_VOTER 6b9e73092f6146639bf310a3d18cfe37 to VOTER
I20260709 13:02:46.708678  9443 consensus_queue.cc:237] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:02:46.783936  1599 consensus_peers.cc:597] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:46.789547  1443 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 122404us
W20260709 13:02:46.796032  1673 consensus_peers.cc:597] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:46.803121  1443 catalog_manager.cc:4755] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b4ec8ad3927940f69c368052fdeef53b: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:02:46.812084  1700 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:46.820942  9443 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:02:46.824908  1599 consensus_peers.cc:597] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.846674  2321 raft_consensus.cc:1275] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 LEARNER]: Refusing update from remote peer 8106dfc0bda54df0ae10ba13c28ccc18: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:46.850101  9443 consensus_queue.cc:1048] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
W20260709 13:02:46.859016  1673 consensus_peers.cc:597] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:46.892405   431 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1581)
I20260709 13:02:46.905761  9443 raft_consensus.cc:2955] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:46.909974  2321 raft_consensus.cc:2955] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:46.937515  1700 raft_consensus.cc:2955] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
I20260709 13:02:46.948510  1449 catalog_manager.cc:5697] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: config changed from index 13 to 14, 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } } }
W20260709 13:02:47.040627  2286 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:47.380406  1673 consensus_peers.cc:597] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:47.407641  1599 consensus_peers.cc:597] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:47.413379  1599 consensus_peers.cc:597] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:47.509702  2286 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:47.509828  1599 consensus_peers.cc:597] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:47.529544  1599 consensus_peers.cc:597] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:47.587239  2286 consensus_peers.cc:597] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:47.599200  1673 consensus_peers.cc:597] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:47.713460  2286 consensus_peers.cc:597] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:47.728086  1599 consensus_peers.cc:597] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:47.765872  2286 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:47.814921  1673 consensus_peers.cc:597] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:47.835906  2286 consensus_peers.cc:597] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:47.862448  1599 consensus_peers.cc:597] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:47.881196  1673 consensus_peers.cc:597] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:47.892988   431 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:47.928202  1599 consensus_peers.cc:597] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:48.000272  1673 consensus_peers.cc:597] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:48.020813  1673 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:48.103791  1443 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111) [suppressed 458 similar messages]
W20260709 13:02:48.127566  1443 catalog_manager.cc:4755] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b4ec8ad3927940f69c368052fdeef53b: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:02:48.233371  1673 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:48.240190  1673 consensus_peers.cc:597] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:48.250063  1673 consensus_peers.cc:597] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:48.306792  1599 consensus_peers.cc:597] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:48.384742  1599 consensus_peers.cc:597] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:48.415704  1599 consensus_peers.cc:597] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:48.428483  2286 consensus_peers.cc:597] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:48.566627  1673 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:48.574756  1673 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:48.603509  1599 consensus_peers.cc:597] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:48.647719  1599 consensus_peers.cc:597] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:48.678772  1599 consensus_peers.cc:597] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:48.682102  1599 consensus_peers.cc:597] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:48.716817  2286 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:48.841909  1673 consensus_peers.cc:597] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:48.871379  2286 consensus_peers.cc:597] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:48.893610   431 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:48.972074  1599 consensus_peers.cc:597] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:49.038872  1599 consensus_peers.cc:597] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:49.176517  1673 consensus_peers.cc:597] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:49.177064  1673 consensus_peers.cc:597] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:49.178037  1599 consensus_peers.cc:597] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:49.237691  1443 catalog_manager.cc:4755] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b4ec8ad3927940f69c368052fdeef53b: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:02:49.282362  2286 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:49.309782  1599 consensus_peers.cc:597] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:49.337678  2286 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:49.347361  2286 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:49.361294  1673 consensus_peers.cc:597] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:49.507184  1599 consensus_peers.cc:597] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:49.658743  2286 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:49.894140   431 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:49.899502  1673 consensus_peers.cc:597] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:50.021066  1599 consensus_peers.cc:597] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:50.021760  1599 consensus_peers.cc:597] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:50.033802  1599 consensus_peers.cc:597] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:50.043210  2286 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:50.092653  1599 consensus_peers.cc:597] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:50.110661  2286 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:50.140568  2286 consensus_peers.cc:597] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:50.151438  1599 consensus_peers.cc:597] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:50.177292  2286 consensus_peers.cc:597] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:50.289968  1673 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:50.327847  1599 consensus_peers.cc:597] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:50.336921  1673 consensus_peers.cc:597] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:50.421756  2286 consensus_peers.cc:597] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:50.440946  1673 consensus_peers.cc:597] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:50.682673  1599 consensus_peers.cc:597] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:50.727349  1673 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:50.730520  1673 consensus_peers.cc:597] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:50.730937  2286 consensus_peers.cc:597] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:50.758620  1673 consensus_peers.cc:597] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:50.759275  1673 consensus_peers.cc:597] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:50.799364  1599 consensus_peers.cc:597] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:50.864432  1673 consensus_peers.cc:597] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:50.897374   431 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:50.934515  1599 consensus_peers.cc:597] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:50.996621  2286 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:51.030917  2286 consensus_peers.cc:597] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:51.083916  1673 consensus_peers.cc:597] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:51.149046  1673 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:51.173774  1599 consensus_peers.cc:597] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:51.175340  1599 consensus_peers.cc:597] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:51.195367  1673 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:51.231211  1599 consensus_peers.cc:597] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:51.345916  1599 consensus_peers.cc:597] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:51.363055  1599 consensus_peers.cc:597] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:51.415616  1443 catalog_manager.cc:4755] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b4ec8ad3927940f69c368052fdeef53b: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:02:51.552282  2286 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:51.626806  1673 consensus_peers.cc:597] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:51.715665  1599 consensus_peers.cc:597] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:51.800709  1673 consensus_peers.cc:597] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:51.836244  1673 consensus_peers.cc:597] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:51.899483   431 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:52.004170  1599 consensus_peers.cc:597] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:52.005033  1599 consensus_peers.cc:597] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:52.040364  1599 consensus_peers.cc:597] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:52.040997  1599 consensus_peers.cc:597] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:52.059139  2286 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:52.067276  2286 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:52.264111  1599 consensus_peers.cc:597] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:52.315411  1673 consensus_peers.cc:597] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:52.324847  2286 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:52.592288  2286 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:52.592906  1599 consensus_peers.cc:597] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:52.634765  1599 consensus_peers.cc:597] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:52.635535  1599 consensus_peers.cc:597] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:52.657146  1599 consensus_peers.cc:597] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:52.691514  2286 consensus_peers.cc:597] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:52.774223  1673 consensus_peers.cc:597] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:52.774528  2286 consensus_peers.cc:597] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:52.815747  1673 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:52.839744  1673 consensus_peers.cc:597] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:52.842826  1599 consensus_peers.cc:597] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:52.885097  2286 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:52.900069   431 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:52.911689  1673 consensus_peers.cc:597] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:52.937606  1673 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:52.981361  1673 consensus_peers.cc:597] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:53.026132  2286 consensus_peers.cc:597] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:53.045708  1599 consensus_peers.cc:597] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:53.107550  1599 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111) [suppressed 456 similar messages]
W20260709 13:02:53.287063  1673 consensus_peers.cc:597] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:53.333703  1599 consensus_peers.cc:597] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:53.366724  2286 consensus_peers.cc:597] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:53.506850  2286 consensus_peers.cc:597] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:53.509423  1673 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:53.510051  1673 consensus_peers.cc:597] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:53.534533  1599 consensus_peers.cc:597] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:53.576699  1599 consensus_peers.cc:597] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:02:53.615844  1447 maintenance_manager.cc:419] P 1d002eece69f4b28add96a7bb163d0f2: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033345
W20260709 13:02:53.621762  1599 consensus_peers.cc:597] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:53.672386  1673 consensus_peers.cc:597] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:53.692512  2286 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:53.701818  1599 consensus_peers.cc:597] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:53.705878  1673 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:02:53.710104  1446 maintenance_manager.cc:643] P 1d002eece69f4b28add96a7bb163d0f2: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.093s	user 0.036s	sys 0.008s Metrics: {"bytes_written":6794,"delete_count":0,"lbm_write_time_us":1029,"lbm_writes_lt_1ms":6,"reinsert_count":0,"thread_start_us":13618,"threads_started":1,"update_count":274,"wal-append.queue_time_us":13266}
I20260709 13:02:53.721771  1447 maintenance_manager.cc:419] P 1d002eece69f4b28add96a7bb163d0f2: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.316996
W20260709 13:02:53.747855  1599 consensus_peers.cc:597] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:53.900605   431 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:54.241066  1599 consensus_peers.cc:597] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:54.242062  1599 consensus_peers.cc:597] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:54.242528  1599 consensus_peers.cc:597] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:54.272068  1599 consensus_peers.cc:597] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:54.332913  2286 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:02:54.365821  1446 maintenance_manager.cc:643] P 1d002eece69f4b28add96a7bb163d0f2: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.643s	user 0.097s	sys 0.024s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":27570,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":22022,"dirs.run_cpu_time_us":548,"dirs.run_wall_time_us":3971,"lbm_read_time_us":2188,"lbm_reads_lt_1ms":25,"lbm_write_time_us":4108,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":10,"peak_mem_usage":299004,"reinsert_count":0,"thread_start_us":26870,"threads_started":2,"update_count":277}
I20260709 13:02:54.368664  1447 maintenance_manager.cc:419] P 1d002eece69f4b28add96a7bb163d0f2: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:02:54.371388  1446 maintenance_manager.cc:643] P 1d002eece69f4b28add96a7bb163d0f2: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 13:02:54.399398  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 77022.3us
W20260709 13:02:54.458429  1673 consensus_peers.cc:597] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:54.467965  1673 consensus_peers.cc:597] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:54.469723  1673 consensus_peers.cc:597] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:54.626752  1599 consensus_peers.cc:597] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:54.661188  2286 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:54.750342  2286 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:54.814738  2286 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:54.901222   431 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:54.947608  1489 debug-util.cc:398] Leaking SignalData structure 0x7b0800178120 after lost signal to thread 434
W20260709 13:02:54.949086  1489 debug-util.cc:398] Leaking SignalData structure 0x7b08003c9100 after lost signal to thread 1492
W20260709 13:02:54.950596  1489 debug-util.cc:398] Leaking SignalData structure 0x7b08001e23e0 after lost signal to thread 1659
W20260709 13:02:54.951843  1489 debug-util.cc:398] Leaking SignalData structure 0x7b080028eec0 after lost signal to thread 1733
W20260709 13:02:54.953941  1489 debug-util.cc:398] Leaking SignalData structure 0x7b080017e960 after lost signal to thread 2353
W20260709 13:02:55.100513  1673 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:55.131668  1673 consensus_peers.cc:597] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:55.177989  2286 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:55.221714  2286 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:55.321807  2286 consensus_peers.cc:597] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:55.233865  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 101438us
W20260709 13:02:55.454905  2286 consensus_peers.cc:597] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:55.460446  1673 consensus_peers.cc:597] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:55.463104  1673 consensus_peers.cc:597] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:55.480494  1673 consensus_peers.cc:597] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:55.595304  1673 consensus_peers.cc:597] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:55.598979  1443 catalog_manager.cc:4755] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b4ec8ad3927940f69c368052fdeef53b: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:02:55.656551  1673 consensus_peers.cc:597] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:55.735261  1673 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:55.901724   431 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:55.929494  2286 consensus_peers.cc:597] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:55.939827  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43439, user_credentials={real_user=slave}} blocked reactor thread for 162114us
W20260709 13:02:56.060632  2286 consensus_peers.cc:597] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:56.090545  1599 consensus_peers.cc:597] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:56.091233  1599 consensus_peers.cc:597] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:56.092489  1599 consensus_peers.cc:597] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:56.093549  1599 consensus_peers.cc:597] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:56.098177  1673 consensus_peers.cc:597] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:56.138437  2286 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:56.171094  1599 consensus_peers.cc:597] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:56.176143  1599 consensus_peers.cc:597] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:56.271900  1673 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:56.286008  1599 consensus_peers.cc:597] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:56.305079  2286 consensus_peers.cc:597] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:56.340229  1673 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:56.348016  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3d60 after lost signal to thread 434
W20260709 13:02:56.348407  1673 consensus_peers.cc:597] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:56.349388  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff040 after lost signal to thread 1492
W20260709 13:02:56.350905  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08002253c0 after lost signal to thread 1659
W20260709 13:02:56.352169  1730 debug-util.cc:398] Leaking SignalData structure 0x7b080037bc60 after lost signal to thread 1733
W20260709 13:02:56.360126  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08002745e0 after lost signal to thread 2353
W20260709 13:02:56.563994  1673 consensus_peers.cc:597] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:56.698056  2286 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:56.801450  1599 consensus_peers.cc:597] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:56.850734  1598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39387, user_credentials={real_user=slave}} blocked reactor thread for 54217.3us
W20260709 13:02:56.855669  1599 consensus_peers.cc:597] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:56.902292   431 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:56.917398  1675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43887, user_credentials={real_user=slave}} blocked reactor thread for 52525us
W20260709 13:02:56.921316  2286 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:56.945659  1673 consensus_peers.cc:597] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:56.972421  1599 consensus_peers.cc:597] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:02:56.980477  2286 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:57.001751  1673 consensus_peers.cc:597] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:57.095566  1599 consensus_peers.cc:597] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:57.099027  1599 consensus_peers.cc:597] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:57.219594  1599 consensus_peers.cc:597] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:57.263317  1599 consensus_peers.cc:597] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:57.362494  1599 consensus_peers.cc:597] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:57.370258  2286 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:57.439608  1599 consensus_peers.cc:597] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:57.549345  1599 consensus_peers.cc:597] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:57.725387  1673 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:57.739126  1599 consensus_peers.cc:597] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:57.739642  1673 consensus_peers.cc:597] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:57.740756  2286 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:57.803555  1673 consensus_peers.cc:597] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:57.809011  2286 consensus_peers.cc:597] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:57.866163  2286 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:57.900651  1673 consensus_peers.cc:597] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:57.902941   431 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:58.058282  2286 consensus_peers.cc:597] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:58.124854  1673 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111) [suppressed 418 similar messages]
W20260709 13:02:58.134362  1599 consensus_peers.cc:597] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:02:58.135360  1673 consensus_peers.cc:597] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:58.182664  2286 consensus_peers.cc:597] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:58.242841  1599 consensus_peers.cc:597] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:58.303988  1673 consensus_peers.cc:597] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:58.315019  1673 consensus_peers.cc:597] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:58.317112  1599 consensus_peers.cc:597] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.324998  1599 consensus_peers.cc:597] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:58.387377  2286 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:02:58.418170  1673 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:58.493273  1673 consensus_peers.cc:597] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:58.580238  1599 consensus_peers.cc:597] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:58.629997  1599 consensus_peers.cc:597] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:58.705292  2286 consensus_peers.cc:597] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:58.786717  1599 consensus_peers.cc:597] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:58.798223  1599 consensus_peers.cc:597] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:58.838443  2286 consensus_peers.cc:597] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:58.874325  1599 consensus_peers.cc:597] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:02:58.953025  2286 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:02:58.989095  1673 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:59.019496  1673 consensus_peers.cc:597] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:59.025293  2286 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:02:59.071636  1673 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:59.144613  1673 consensus_peers.cc:597] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:59.180802  2286 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:02:59.263943   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:02:59.295415  1673 consensus_peers.cc:597] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:59.301036  1599 consensus_peers.cc:597] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:02:59.425967   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:02:59.439605  2288 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:59.466208  1675 consensus_peers.cc:597] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:59.476852  2288 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:59.481192  1673 consensus_peers.cc:597] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:59.494021  1599 consensus_peers.cc:597] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:02:59.512879  2288 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.523119   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:59.524196   431 tablet_replica.cc:333] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.525271   431 raft_consensus.cc:2243] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.526669   431 raft_consensus.cc:2272] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.529580   431 tablet_replica.cc:333] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.530464   431 raft_consensus.cc:2243] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.531656   431 raft_consensus.cc:2272] T 1702e80023fd4939b4565d5f3dde73c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.536114   431 tablet_replica.cc:333] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.537084   431 raft_consensus.cc:2243] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.538378   431 raft_consensus.cc:2272] T 78990af8f5ef4464b9e3bbb9749e7337 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.541728   431 tablet_replica.cc:333] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.542531   431 raft_consensus.cc:2243] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.543195   431 raft_consensus.cc:2272] T 076fd1ae95e4457d8361a9b4c963b26f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.546077   431 tablet_replica.cc:333] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.546967   431 raft_consensus.cc:2243] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.548144   431 raft_consensus.cc:2272] T 32eb5ab4f2154adb88f8148264914ee9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.550860   431 tablet_replica.cc:333] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.551848   431 raft_consensus.cc:2243] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.552698   431 raft_consensus.cc:2272] T bf4201f98c934feca49bae13648b2835 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.555266   431 tablet_replica.cc:333] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.555979   431 raft_consensus.cc:2243] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.558897   431 raft_consensus.cc:2272] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.562045   431 tablet_replica.cc:333] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.563016   431 raft_consensus.cc:2243] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.563936   431 raft_consensus.cc:2272] T e8ceb3afda0646d2b7815d235d107857 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.567493   431 tablet_replica.cc:333] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.568333   431 raft_consensus.cc:2243] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.569763   431 raft_consensus.cc:2272] T 48837d0ac86f4664b4bfe442411bc28f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:59.572655  2288 consensus_peers.cc:597] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.576743   431 tablet_replica.cc:333] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.577630   431 raft_consensus.cc:2243] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.578390   431 raft_consensus.cc:2272] T 1242a7b5484b4cc6a066e0c93629550f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.581173   431 tablet_replica.cc:333] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.581962   431 raft_consensus.cc:2243] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.583115   431 raft_consensus.cc:2272] T 234fc17fda8e45db9455b24cfd3939f4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.585762   431 tablet_replica.cc:333] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.586583   431 raft_consensus.cc:2243] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.587708   431 raft_consensus.cc:2272] T 193165fa679c4f6c9d6ac6b39ef823bd P 8106dfc0bda54df0ae10ba13c28ccc18 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:59.589803  1675 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.590744   431 tablet_replica.cc:333] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.591605   431 raft_consensus.cc:2243] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.592245   431 raft_consensus.cc:2272] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:59.594580  1599 consensus_peers.cc:597] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:02:59.595120   431 tablet_replica.cc:333] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.596004   431 raft_consensus.cc:2243] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.597180   431 raft_consensus.cc:2272] T 01ab117f13144a07986c484571fb73a2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.600118   431 tablet_replica.cc:333] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.601001   431 raft_consensus.cc:2243] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.602478   431 raft_consensus.cc:2272] T 1a2e95946efd462d8cee2bc7302fe094 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:59.601773  1675 consensus_peers.cc:597] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.605386   431 tablet_replica.cc:333] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.606281   431 raft_consensus.cc:2243] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.607028   431 raft_consensus.cc:2272] T bb62bfd8ccab4ff7925d27d979888b38 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:59.607005  1675 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.610265   431 tablet_replica.cc:333] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.611084   431 raft_consensus.cc:2243] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.611994   431 raft_consensus.cc:2272] T f4a5771425b14503aa3a070b20d0bf86 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.614737   431 tablet_replica.cc:333] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.615499   431 raft_consensus.cc:2243] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.616266   431 raft_consensus.cc:2272] T 54abded5f0d34ab1871704bc5a3c1b4a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.618944   431 tablet_replica.cc:333] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.619822   431 raft_consensus.cc:2243] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.621616   431 raft_consensus.cc:2272] T 5299151db28746cf82a5b6d791a71d60 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.624481   431 tablet_replica.cc:333] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.625906   431 raft_consensus.cc:2243] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.626617   431 raft_consensus.cc:2272] T 4ec5abf47e7f48a3a476ef08dd5f179d P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:59.627336  2288 consensus_peers.cc:597] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:59.629094  1675 consensus_peers.cc:597] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.629535   431 tablet_replica.cc:333] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.630359   431 raft_consensus.cc:2243] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.630954   431 raft_consensus.cc:2272] T 15bc2b03c4ec4de282e245ab3015bfd6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.633651   431 tablet_replica.cc:333] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.634459   431 raft_consensus.cc:2243] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.635157   431 raft_consensus.cc:2272] T d1461e6ea3a84192b5ce68699dc52d80 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.638091   431 tablet_replica.cc:333] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.638962   431 raft_consensus.cc:2243] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.640180   431 raft_consensus.cc:2272] T 78e528e98cb24afd985ad0425501f5ed P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.643711   431 tablet_replica.cc:333] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.644532   431 raft_consensus.cc:2243] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.646445   431 raft_consensus.cc:2272] T 746cf49ba083454e8a50cff619835a56 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.649184   431 tablet_replica.cc:333] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.650025   431 raft_consensus.cc:2243] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:59.650256  1675 consensus_peers.cc:597] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.650802   431 raft_consensus.cc:2272] T 9e112d5c05d14e7ca923c272912bcec9 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.653663   431 tablet_replica.cc:333] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.654503   431 raft_consensus.cc:2243] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.655865   431 raft_consensus.cc:2272] T 376e686ba5f94a11b46d68b6abe55d53 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.658488   431 tablet_replica.cc:333] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.659210   431 raft_consensus.cc:2243] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.660271   431 raft_consensus.cc:2272] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.663584   431 tablet_replica.cc:333] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.664387   431 raft_consensus.cc:2243] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.671036   431 raft_consensus.cc:2272] T a6272972864842479d82e86cc14f8ff4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:59.672116  2286 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:02:59.674196   431 tablet_replica.cc:333] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.675117   431 raft_consensus.cc:2243] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 LEADER]: Raft consensus shutting down.
W20260709 13:02:59.675982  1599 consensus_peers.cc:597] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:02:59.676517   431 raft_consensus.cc:2272] T 3426c98205bc4a609f37342176ca9b0a P 8106dfc0bda54df0ae10ba13c28ccc18 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.679333   431 tablet_replica.cc:333] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.680212   431 raft_consensus.cc:2243] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.681452   431 raft_consensus.cc:2272] T e89d6bd5df2a49f7b78e8695456652b5 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.684304   431 tablet_replica.cc:333] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.685288   431 raft_consensus.cc:2243] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.686476   431 raft_consensus.cc:2272] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.689270   431 tablet_replica.cc:333] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.690080   431 raft_consensus.cc:2243] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.690722   431 raft_consensus.cc:2272] T dd7d9d192f7349b7bb550962c2e6c957 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.693485   431 tablet_replica.cc:333] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.694268   431 raft_consensus.cc:2243] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.695520   431 raft_consensus.cc:2272] T f0b9ebe321414b42a927557c66adbb7e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.698396   431 tablet_replica.cc:333] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.699222   431 raft_consensus.cc:2243] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.699846   431 raft_consensus.cc:2272] T 57c707e7d0374c378524e43ee47284c2 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.702488   431 tablet_replica.cc:333] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.703310   431 raft_consensus.cc:2243] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.704453   431 raft_consensus.cc:2272] T 6325e0281aa547efa677c29cabdf5de4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.707257   431 tablet_replica.cc:333] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.708066   431 raft_consensus.cc:2243] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.709537   431 raft_consensus.cc:2272] T 7485c87933f940ec96f52fe33972ecd3 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:59.712016  1675 consensus_peers.cc:597] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.712519   431 tablet_replica.cc:333] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.714010   431 raft_consensus.cc:2243] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.714818   431 raft_consensus.cc:2272] T e5f9ac80ae924622bceefdf9814aca1e P 8106dfc0bda54df0ae10ba13c28ccc18 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.717666   431 tablet_replica.cc:333] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.718461   431 raft_consensus.cc:2243] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.719600   431 raft_consensus.cc:2272] T 5c1e1be9de68405393292149e41c0724 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.722280   431 tablet_replica.cc:333] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
W20260709 13:02:59.722710  2288 consensus_peers.cc:597] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.723439   431 raft_consensus.cc:2243] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.724766   431 raft_consensus.cc:2272] T 5149d64e3d354b728df20cd4c75510c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:59.727865  2288 consensus_peers.cc:597] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.728009   431 tablet_replica.cc:333] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.728880   431 raft_consensus.cc:2243] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.730206   431 raft_consensus.cc:2272] T a5e08456c7bb4b07bedf36cb9587b6b4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.732496   431 tablet_replica.cc:333] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.734074   431 raft_consensus.cc:2243] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.735291   431 raft_consensus.cc:2272] T b4ec8ad3927940f69c368052fdeef53b P 8106dfc0bda54df0ae10ba13c28ccc18 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.739068   431 tablet_replica.cc:333] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.739951   431 raft_consensus.cc:2243] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.740904   431 raft_consensus.cc:2272] T 627d40025a324704a4ae94c9ed8c404c P 8106dfc0bda54df0ae10ba13c28ccc18 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.743382   431 tablet_replica.cc:333] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.744055   431 raft_consensus.cc:2243] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.744644   431 raft_consensus.cc:2272] T dfc7199563cc4b68b76fa96af21d01c4 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.748708   431 tablet_replica.cc:333] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.749478   431 raft_consensus.cc:2243] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.750084   431 raft_consensus.cc:2272] T c538f09573cd4214b1d7cab1dddee46f P 8106dfc0bda54df0ae10ba13c28ccc18 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:59.750010  1675 consensus_peers.cc:597] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.753021   431 tablet_replica.cc:333] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.753800   431 raft_consensus.cc:2243] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:02:59.755111   431 raft_consensus.cc:2272] T 1bf16dd2ae6a404a9ae81192db51e512 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.757416   431 tablet_replica.cc:333] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.758188   431 raft_consensus.cc:2243] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.758750   431 raft_consensus.cc:2272] T 15f3a55bc1874c9cbd400712a345dcf0 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.761116   431 tablet_replica.cc:333] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18: stopping tablet replica
I20260709 13:02:59.761786   431 raft_consensus.cc:2243] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.762300   431 raft_consensus.cc:2272] T 428c176495744009b63bfa690baa17c6 P 8106dfc0bda54df0ae10ba13c28ccc18 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:59.780624  2288 consensus_peers.cc:597] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:59.787825  2288 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:59.824751  1675 consensus_peers.cc:597] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:59.874586  2288 consensus_peers.cc:597] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:59.924748  1675 consensus_peers.cc:597] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:59.998121  1675 consensus_peers.cc:597] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:00.036270  1673 consensus_peers.cc:597] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:00.157358  1673 consensus_peers.cc:597] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:00.260367  1673 consensus_peers.cc:597] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:00.420760  2286 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:00.443406  2286 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:03:00.511662  9522 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.512530  9522 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.515894  9522 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:03:00.519045  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:03:00.531400  2288 leader_election.cc:336] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.531972  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:00.532743  9522 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:03:00.548923  2286 consensus_peers.cc:597] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:00.572705  2286 consensus_peers.cc:597] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:00.582449  1673 consensus_peers.cc:597] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:00.603820  1673 consensus_peers.cc:597] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:00.612764  9516 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.613332  9516 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.616744  9516 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:03:00.618467  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:03:00.619483  2327 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 25.
W20260709 13:03:00.620630  1675 leader_election.cc:336] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.621842  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:00.622870  9516 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:00.623327  9516 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.623986  9516 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:00.627262  9522 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.628072  9522 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.630185  9522 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:03:00.630129  1673 consensus_peers.cc:597] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:00.638654  2288 leader_election.cc:336] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:00.640134  2286 leader_election.cc:336] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:00.640786  2286 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:00.641601  9522 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:00.646606  9516 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.650024  9526 raft_consensus.cc:493] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.650616  9526 raft_consensus.cc:515] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:03:00.652951  9526 leader_election.cc:290] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:03:00.654372  1675 leader_election.cc:336] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.649235  9516 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 26 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:03:00.656852  1675 leader_election.cc:336] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.656816  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78990af8f5ef4464b9e3bbb9749e7337" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:03:00.658674  2327 raft_consensus.cc:3060] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:00.659408  9516 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.660223  9516 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:03:00.671629  1675 leader_election.cc:336] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.676561  2320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
W20260709 13:03:00.676819  1673 leader_election.cc:336] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:00.677284  1673 leader_election.cc:304] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:00.678370  1672 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:00.678647  9526 raft_consensus.cc:2749] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:00.679242  9517 raft_consensus.cc:2749] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:00.676632  2327 raft_consensus.cc:2468] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 26.
I20260709 13:03:00.680121  9516 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:03:00.681491  1672 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:00.682173  9516 raft_consensus.cc:2804] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:03:00.682734  9517 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.683301  9517 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.683959  9516 raft_consensus.cc:697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:03:00.684952  9516 consensus_queue.cc:237] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.685413  9517 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:03:00.688829  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:03:00.706440  9522 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.707031  9522 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.708966  9522 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:03:00.711833  1675 leader_election.cc:336] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.712306  1675 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:00.713732  9517 raft_consensus.cc:2749] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:03:00.719802  2288 leader_election.cc:336] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:00.721326  2286 leader_election.cc:336] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:00.721856  2286 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:00.723547  9522 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:00.731781  1450 catalog_manager.cc:5697] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 25 to 26, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 26 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:00.738626  9522 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.739351  9522 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.745605  9522 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:03:00.746618  2288 leader_election.cc:336] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.747882  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:03:00.749825  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:00.750751  9522 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:00.754083  9522 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.754644  9522 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.756668  9522 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:03:00.763747  2286 leader_election.cc:336] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:00.765055  9517 raft_consensus.cc:493] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:03:00.764309  2288 leader_election.cc:336] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.765806  9517 raft_consensus.cc:515] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:03:00.766151  2288 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:00.768740  9516 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.769310  9516 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.771073  9535 raft_consensus.cc:2749] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:00.774591  1675 leader_election.cc:336] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.775086  9516 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:03:00.777527  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:03:00.778236  2327 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 15.
I20260709 13:03:00.782658  1672 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:03:00.783778  9516 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:00.784174  9516 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:03:00.784863  1673 leader_election.cc:336] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:00.785354  1673 leader_election.cc:304] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:00.784572  9516 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:00.786938  9526 raft_consensus.cc:2749] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:00.788859  9517 leader_election.cc:290] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:03:00.792503  1675 leader_election.cc:336] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:00.791945  2286 consensus_peers.cc:597] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:00.797518  9522 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.803470  9522 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.805505  9522 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:03:00.802915  9517 raft_consensus.cc:493] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.807175  9517 raft_consensus.cc:515] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:03:00.812320  2286 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:00.812891  2286 leader_election.cc:336] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:00.822402  9517 leader_election.cc:290] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:03:00.826501  9522 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.829205  9522 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:03:00.831305  2288 leader_election.cc:336] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.831861  2288 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:00.832460  9522 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:03:00.832649  9535 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:00.835457  1673 leader_election.cc:336] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:00.836525  9517 raft_consensus.cc:493] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.838739  9517 raft_consensus.cc:515] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:03:00.836362  9516 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.840816  9517 leader_election.cc:290] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:03:00.843282  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6272972864842479d82e86cc14f8ff4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
W20260709 13:03:00.843554  2288 leader_election.cc:336] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.843927  2327 raft_consensus.cc:3060] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:00.846457  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:03:00.847101  1707 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 19.
I20260709 13:03:00.849702  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:00.851214  9535 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:00.851625  9535 raft_consensus.cc:493] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.851961  9535 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:00.852428  9517 raft_consensus.cc:493] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.853014  9517 raft_consensus.cc:515] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:03:00.855122  9517 leader_election.cc:290] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:03:00.865552  1675 leader_election.cc:336] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.864068  2327 raft_consensus.cc:2468] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 16.
I20260709 13:03:00.868428  1672 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:03:00.868850  1675 leader_election.cc:304] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:00.869292  9517 raft_consensus.cc:2804] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:00.870399  9516 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:03:00.871644  9535 raft_consensus.cc:515] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.872977  9517 raft_consensus.cc:697] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:03:00.873086  9540 raft_consensus.cc:2749] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:00.874010  9517 consensus_queue.cc:237] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.876536  9535 leader_election.cc:290] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:03:00.879495  9533 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.880039  9533 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:03:00.881605  2288 leader_election.cc:336] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:00.882337  1673 leader_election.cc:336] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:00.882805  9533 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:03:00.885716  1673 leader_election.cc:336] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:00.887274  9533 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.887887  9533 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.889007  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32eb5ab4f2154adb88f8148264914ee9" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:03:00.889998  1707 raft_consensus.cc:3060] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:00.890589  9533 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:03:00.890776  2288 leader_election.cc:336] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.892841  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:03:00.893594  1700 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 25.
I20260709 13:03:00.900529  9526 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.901154  9526 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.902995  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:03:00.904394  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:03:00.907930  9517 raft_consensus.cc:493] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.904428  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:00.904544  9526 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:03:00.908710  9517 raft_consensus.cc:515] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:03:00.910918  1450 catalog_manager.cc:5697] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 15 to 16, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 16 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:00.913070  9533 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:00.913563  9533 raft_consensus.cc:493] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.913964  9533 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:03:00.919587  1673 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:03:00.920467  1675 leader_election.cc:336] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.921002  1675 leader_election.cc:304] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:00.922619  1707 raft_consensus.cc:2468] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 20.
I20260709 13:03:00.923267  9517 leader_election.cc:290] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:03:00.924124  9526 raft_consensus.cc:2749] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:00.925549  1675 leader_election.cc:336] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:00.926290  1675 leader_election.cc:336] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.926661  1675 leader_election.cc:304] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:03:00.924265  2288 leader_election.cc:336] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.927421  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:00.928202  9535 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:00.927506  9533 raft_consensus.cc:515] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.929519  9526 raft_consensus.cc:2749] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:00.930861  9533 leader_election.cc:290] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:03:00.928848  2288 leader_election.cc:304] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:00.932861  9533 raft_consensus.cc:2804] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:00.935461  9533 raft_consensus.cc:697] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:03:00.936867  9533 consensus_queue.cc:237] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:03:00.940973  2288 leader_election.cc:336] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.947719  9522 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.948285  9522 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:00.952615  9522 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:03:00.956072  2288 leader_election.cc:336] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.962492  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:03:00.963258  1700 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 22.
I20260709 13:03:00.963967  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193165fa679c4f6c9d6ac6b39ef823bd" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:03:00.964777  1707 raft_consensus.cc:3060] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:03:00.971464  1675 leader_election.cc:336] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:00.972009  1675 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:00.974539  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:00.975998  9533 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:00.976473  9533 raft_consensus.cc:493] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.976796  9526 raft_consensus.cc:2749] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:00.976924  9533 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:00.977160  1450 catalog_manager.cc:5697] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 19 to 20, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 20 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.983839  9517 raft_consensus.cc:493] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:00.984333  9517 raft_consensus.cc:515] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:03:00.986708  9517 leader_election.cc:290] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:03:00.998302  1673 leader_election.cc:336] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:01.002097  9526 raft_consensus.cc:493] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:01.003015  9526 raft_consensus.cc:515] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:03:01.003473  1707 raft_consensus.cc:2468] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 26.
I20260709 13:03:01.005368  2288 leader_election.cc:304] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:01.006353  9526 leader_election.cc:290] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:03:01.007143  9535 raft_consensus.cc:2804] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:03:01.008015  9535 raft_consensus.cc:697] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 26 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:03:01.009030  9535 consensus_queue.cc:237] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:03:01.016098  1675 leader_election.cc:336] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:01.016680  1675 leader_election.cc:304] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:01.017482  9526 raft_consensus.cc:2749] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:01.019342  9517 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:01.022121  9517 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:01.019832  9516 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:01.027456  9516 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:01.040371  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:03:01.041177  2327 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 17.
I20260709 13:03:01.043860  9516 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:03:01.045272  1672 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
W20260709 13:03:01.048141  1673 leader_election.cc:336] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:03:01.048790  1673 consensus_peers.cc:597] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:03:01.049043  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:03:01.051805  9517 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:03:01.052320  9517 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:01.052596  9517 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:01.052976  9517 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:01.002123  9533 raft_consensus.cc:515] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:01.058363  9533 leader_election.cc:290] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:03:01.059829  9549 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:01.059118  1450 catalog_manager.cc:5697] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 25 to 26, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 26 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:01.062456  9517 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:01.063503  9549 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:01.065734  9549 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:03:01.065943  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5299151db28746cf82a5b6d791a71d60" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:03:01.066591  2327 raft_consensus.cc:3060] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:01.067095  2288 leader_election.cc:336] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:01.070402  2288 leader_election.cc:336] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:01.074777  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
W20260709 13:03:01.074312  1673 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:01.076159  1673 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:01.076821  9517 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:03:01.076957  9516 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:01.077703  1673 consensus_peers.cc:597] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:03:01.079909  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:01.080237  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234fc17fda8e45db9455b24cfd3939f4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a"
I20260709 13:03:01.080931  1700 raft_consensus.cc:3060] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:01.082451  1675 leader_election.cc:336] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:01.082906  1675 leader_election.cc:304] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:01.083887  9517 raft_consensus.cc:2749] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:01.085269  9533 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:01.081482  2327 raft_consensus.cc:2468] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 18.
I20260709 13:03:01.088646  1672 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:03:01.089365  9517 raft_consensus.cc:2804] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:01.090018  9517 raft_consensus.cc:697] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:03:01.091176  9517 consensus_queue.cc:237] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:01.093248  9549 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:01.094151  9549 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:01.096333  9549 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:03:01.097762  1700 raft_consensus.cc:2468] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 23.
W20260709 13:03:01.104806  2286 leader_election.cc:336] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:01.109864  9526 raft_consensus.cc:493] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:01.110625  9516 raft_consensus.cc:493] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:01.111720  9516 raft_consensus.cc:515] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:03:01.114135  9516 leader_election.cc:290] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:03:01.111676  9526 raft_consensus.cc:515] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
I20260709 13:03:01.115832  9526 leader_election.cc:290] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:03:01.111338  1675 leader_election.cc:336] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:01.116549  1675 leader_election.cc:304] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:01.117280  9540 raft_consensus.cc:2749] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:01.119388  2288 leader_election.cc:336] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:01.125221  1673 leader_election.cc:336] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:01.124670  2288 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:03:01.121646  1675 leader_election.cc:336] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:01.126794  9533 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:01.132710  1675 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:01.133556  1675 leader_election.cc:336] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:01.138283  2288 leader_election.cc:304] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:01.139369  9540 raft_consensus.cc:493] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:01.143954  9540 raft_consensus.cc:515] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } }
W20260709 13:03:01.146720  1675 leader_election.cc:336] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:01.147059  2286 consensus_peers.cc:597] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:01.147234  1675 leader_election.cc:304] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:01.148113  9516 raft_consensus.cc:2749] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:01.148633  9540 leader_election.cc:290] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:03:01.143183  1673 leader_election.cc:336] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:01.149539  9533 raft_consensus.cc:2804] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:01.150104  9533 raft_consensus.cc:697] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 LEADER]: Becoming Leader. State: Replica: 6b9e73092f6146639bf310a3d18cfe37, State: Running, Role: LEADER
I20260709 13:03:01.150964  9540 raft_consensus.cc:493] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:01.152359  9540 raft_consensus.cc:515] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } }
I20260709 13:03:01.151005  9533 consensus_queue.cc:237] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:01.156735   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:03:01.156612  1675 leader_election.cc:336] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:01.157307  9540 leader_election.cc:290] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439)
I20260709 13:03:01.160171  9549 raft_consensus.cc:493] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:01.160991  9549 raft_consensus.cc:515] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:01.158185  1675 leader_election.cc:304] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:01.165337  9517 raft_consensus.cc:2749] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:01.166373  1673 leader_election.cc:336] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:03:01.166965  1673 leader_election.cc:336] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:03:01.172879  2286 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:01.172000  1450 catalog_manager.cc:5697] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 17 to 18, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:01.173991  9549 leader_election.cc:290] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:03:01.177765  1675 leader_election.cc:336] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:01.178479  1675 leader_election.cc:304] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:01.179360  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e08456c7bb4b07bedf36cb9587b6b4" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:03:01.180020  1700 raft_consensus.cc:2468] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 23.
I20260709 13:03:01.180735  9540 raft_consensus.cc:2749] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:01.181973  1675 leader_election.cc:336] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:01.182413  1675 leader_election.cc:304] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:01.183779  9516 raft_consensus.cc:2749] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:01.185149  9517 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
W20260709 13:03:01.186110  1675 consensus_peers.cc:597] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.185659  9517 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:03:01.192286  2288 leader_election.cc:336] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:01.195962  2286 consensus_peers.cc:597] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:01.196794  2288 leader_election.cc:304] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:01.197566  9533 raft_consensus.cc:2749] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:01.192189  1450 catalog_manager.cc:5697] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 reported cstate change: term changed from 22 to 23, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196). New cstate: current_term: 23 leader_uuid: "6b9e73092f6146639bf310a3d18cfe37" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:01.199625  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:03:01.200395  2327 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 19.
I20260709 13:03:01.200474  9540 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:01.201206  9540 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:01.201699  1672 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 
I20260709 13:03:01.204797  9516 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:01.205415  9516 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:01.205777  9516 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:01.207499  9540 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:03:01.208832  9517 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
W20260709 13:03:01.216058  1673 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:01.230346  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37" is_pre_election: true
I20260709 13:03:01.232499  1672 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a; no voters: 6b9e73092f6146639bf310a3d18cfe37, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:03:01.235730  1675 leader_election.cc:336] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:01.236784  1675 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:01.240980  9533 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:01.241199  2320 raft_consensus.cc:1275] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Refusing update from remote peer 4f6fa2fd61114dc190d8f9b310696e1a: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:03:01.242098  9533 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:01.243575  9526 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:01.245316  9526 consensus_queue.cc:1048] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:03:01.245527  9533 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:03:01.254539  2286 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:01.257177  9516 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:01.260977  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c1e1be9de68405393292149e41c0724" candidate_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6b9e73092f6146639bf310a3d18cfe37"
I20260709 13:03:01.261947  2327 raft_consensus.cc:3060] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:01.264251  1675 leader_election.cc:336] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:01.266947  2288 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:01.267634  2288 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:01.269840  9549 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:01.269840  1673 consensus_peers.cc:597] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:03:01.278033  2327 raft_consensus.cc:2468] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6fa2fd61114dc190d8f9b310696e1a in term 20.
I20260709 13:03:01.279491  1672 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f6fa2fd61114dc190d8f9b310696e1a, 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:01.280392  9517 raft_consensus.cc:2804] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:01.280941  9517 raft_consensus.cc:697] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Becoming Leader. State: Replica: 4f6fa2fd61114dc190d8f9b310696e1a, State: Running, Role: LEADER
I20260709 13:03:01.281948  9517 consensus_queue.cc:237] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:01.300879  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf16dd2ae6a404a9ae81192db51e512" candidate_uuid: "6b9e73092f6146639bf310a3d18cfe37" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" is_pre_election: true
I20260709 13:03:01.301978  1700 raft_consensus.cc:2468] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b9e73092f6146639bf310a3d18cfe37 in term 21.
W20260709 13:03:01.303544  1673 consensus_peers.cc:597] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:03:01.306535  9516 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [CANDIDATE]: Term 20 election: Requested vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 6b9e73092f6146639bf310a3d18cfe37 (127.0.107.196:39387)
I20260709 13:03:01.323498  1450 catalog_manager.cc:5697] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a reported cstate change: term changed from 19 to 20, leader changed from 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194) to 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195). New cstate: current_term: 20 leader_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:01.342672  2286 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:01.348845  1675 consensus_peers.cc:597] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.363022   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:03:01.403786  2288 consensus_peers.cc:597] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Couldn't send request to peer 4f6fa2fd61114dc190d8f9b310696e1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:01.433569  2288 consensus_peers.cc:597] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Couldn't send request to peer 4f6fa2fd61114dc190d8f9b310696e1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.453389   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:03:01.453547  2288 consensus_peers.cc:597] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Couldn't send request to peer 4f6fa2fd61114dc190d8f9b310696e1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.455104   431 tablet_replica.cc:333] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.456045   431 raft_consensus.cc:2243] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.457059   431 raft_consensus.cc:2272] T 01dee5ecdb2748fb89b7b02c8a346cb1 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.459750   431 tablet_replica.cc:333] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.460309   431 raft_consensus.cc:2243] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.461380   431 raft_consensus.cc:2272] T 15bc2b03c4ec4de282e245ab3015bfd6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.464023   431 tablet_replica.cc:333] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.464888   431 raft_consensus.cc:2243] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.465840   431 raft_consensus.cc:2272] T 1702e80023fd4939b4565d5f3dde73c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:01.468700  2288 consensus_peers.cc:597] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.469249   431 tablet_replica.cc:333] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.470294   431 raft_consensus.cc:2243] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.471529   431 raft_consensus.cc:2272] T 78990af8f5ef4464b9e3bbb9749e7337 P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.476435   431 tablet_replica.cc:333] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
W20260709 13:03:01.476315  2288 consensus_peers.cc:597] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Couldn't send request to peer 4f6fa2fd61114dc190d8f9b310696e1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.477415   431 raft_consensus.cc:2243] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.478399   431 raft_consensus.cc:2272] T a4ce544917f545499da64014539a4ff2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.480398   431 tablet_replica.cc:333] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.481050   431 raft_consensus.cc:2243] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.481848   431 pending_rounds.cc:70] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a: Trying to abort 1 pending ops.
I20260709 13:03:01.482015   431 pending_rounds.cc:77] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting op as it isn't in flight: id { term: 16 index: 14 } timestamp: 7305634532872462336 op_type: NO_OP noop_request { }
I20260709 13:03:01.482370   431 raft_consensus.cc:2889] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:01.482687   431 raft_consensus.cc:2272] T a6272972864842479d82e86cc14f8ff4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.486011   431 tablet_replica.cc:333] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.487033   431 raft_consensus.cc:2243] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.487766   431 raft_consensus.cc:2272] T e8ceb3afda0646d2b7815d235d107857 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.490649   431 tablet_replica.cc:333] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.491801   431 raft_consensus.cc:2243] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.492532   431 raft_consensus.cc:2272] T 32eb5ab4f2154adb88f8148264914ee9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.495280   431 tablet_replica.cc:333] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.496070   431 raft_consensus.cc:2243] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.497334   431 raft_consensus.cc:2272] T bf4201f98c934feca49bae13648b2835 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.500155   431 tablet_replica.cc:333] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.500980   431 raft_consensus.cc:2243] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.502377   431 raft_consensus.cc:2272] T 7b6551a6ae764e24a141aa53353df444 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.505205   431 tablet_replica.cc:333] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.506287   431 raft_consensus.cc:2243] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.506958   431 raft_consensus.cc:2272] T e5f9ac80ae924622bceefdf9814aca1e P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.509645   431 tablet_replica.cc:333] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.510458   431 raft_consensus.cc:2243] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.511111   431 raft_consensus.cc:2272] T 234fc17fda8e45db9455b24cfd3939f4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.513728   431 tablet_replica.cc:333] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.514508   431 raft_consensus.cc:2243] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.515267   431 raft_consensus.cc:2272] T 193165fa679c4f6c9d6ac6b39ef823bd P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.518019   431 tablet_replica.cc:333] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.518796   431 raft_consensus.cc:2243] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.519724   431 pending_rounds.cc:70] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Trying to abort 1 pending ops.
I20260709 13:03:01.519984   431 pending_rounds.cc:77] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting op as it isn't in flight: id { term: 18 index: 16 } timestamp: 7305634533767241728 op_type: NO_OP noop_request { }
I20260709 13:03:01.520326   431 raft_consensus.cc:2889] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:01.520711   431 raft_consensus.cc:2272] T 5299151db28746cf82a5b6d791a71d60 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.524415   431 tablet_replica.cc:333] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.530370   431 raft_consensus.cc:2243] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.531152   431 raft_consensus.cc:2272] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:01.531874  1673 consensus_peers.cc:597] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:03:01.534013   431 tablet_replica.cc:333] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
W20260709 13:03:01.534303  2288 consensus_peers.cc:597] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Couldn't send request to peer 4f6fa2fd61114dc190d8f9b310696e1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.534883   431 raft_consensus.cc:2243] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.535874   431 raft_consensus.cc:2272] T f4ee010e653949d581d35eb9b09d59dd P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.538463   431 tablet_replica.cc:333] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.539052   431 raft_consensus.cc:2243] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.539531   431 raft_consensus.cc:2272] T 01ab117f13144a07986c484571fb73a2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.541574   431 tablet_replica.cc:333] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.542164   431 raft_consensus.cc:2243] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.542683   431 raft_consensus.cc:2272] T 4d71f760473d4219a951e6e5f061bfb5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.544651   431 tablet_replica.cc:333] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.545272   431 raft_consensus.cc:2243] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.546483   431 raft_consensus.cc:2272] T 52b0712953ef42ddb724cd8c29a0ec0b P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.549001   431 tablet_replica.cc:333] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.549780   431 raft_consensus.cc:2243] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.550397   431 raft_consensus.cc:2272] T f4a5771425b14503aa3a070b20d0bf86 P 4f6fa2fd61114dc190d8f9b310696e1a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.553181   431 tablet_replica.cc:333] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.553838   431 raft_consensus.cc:2243] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.554814   431 raft_consensus.cc:2272] T 4d906a33e42d4a08ae9d1a9d2e39351c P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.557601   431 tablet_replica.cc:333] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.558609   431 raft_consensus.cc:2243] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.560117   431 raft_consensus.cc:2272] T 327c042262d94ababf63c12c177e29ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.563246   431 tablet_replica.cc:333] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.564168   431 raft_consensus.cc:2243] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.565172   431 raft_consensus.cc:2272] T 78e528e98cb24afd985ad0425501f5ed P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.567986   431 tablet_replica.cc:333] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.568645   431 raft_consensus.cc:2243] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.569393   431 raft_consensus.cc:2272] T 746cf49ba083454e8a50cff619835a56 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.572602   431 tablet_replica.cc:333] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.573318   431 raft_consensus.cc:2243] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.574280   431 raft_consensus.cc:2272] T 9e112d5c05d14e7ca923c272912bcec9 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.576869   431 tablet_replica.cc:333] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
W20260709 13:03:01.577188  2288 consensus_peers.cc:597] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Couldn't send request to peer 4f6fa2fd61114dc190d8f9b310696e1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.577518   431 raft_consensus.cc:2243] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.578673   431 raft_consensus.cc:2272] T f0b9ebe321414b42a927557c66adbb7e P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.581966   431 tablet_replica.cc:333] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.582835   431 raft_consensus.cc:2243] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.584232   431 raft_consensus.cc:2272] T 57c707e7d0374c378524e43ee47284c2 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.586910   431 tablet_replica.cc:333] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.587846   431 raft_consensus.cc:2243] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.588454   431 raft_consensus.cc:2272] T 22195ce47a0c43e5ab7e7ed47f7e5a1f P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.591753   431 tablet_replica.cc:333] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.592505   431 raft_consensus.cc:2243] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.593381   431 raft_consensus.cc:2272] T 376e686ba5f94a11b46d68b6abe55d53 P 4f6fa2fd61114dc190d8f9b310696e1a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.596130   431 tablet_replica.cc:333] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.596997   431 raft_consensus.cc:2243] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.597664   431 raft_consensus.cc:2272] T 3426c98205bc4a609f37342176ca9b0a P 4f6fa2fd61114dc190d8f9b310696e1a [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:01.598471  2288 consensus_peers.cc:597] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.600128   431 tablet_replica.cc:333] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.600939   431 raft_consensus.cc:2243] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.601528   431 raft_consensus.cc:2272] T e89d6bd5df2a49f7b78e8695456652b5 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.603693   431 tablet_replica.cc:333] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.604239   431 raft_consensus.cc:2243] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.605180   431 raft_consensus.cc:2272] T dd7d9d192f7349b7bb550962c2e6c957 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.607132   431 tablet_replica.cc:333] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.607622   431 raft_consensus.cc:2243] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.608150   431 raft_consensus.cc:2272] T 5149d64e3d354b728df20cd4c75510c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.610158   431 tablet_replica.cc:333] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.610793   431 raft_consensus.cc:2243] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.611394   431 raft_consensus.cc:2272] T 03348d9c2a344a6f8e716751b1024647 P 4f6fa2fd61114dc190d8f9b310696e1a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.613250   431 tablet_replica.cc:333] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.613972   431 raft_consensus.cc:2243] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.614964   431 pending_rounds.cc:70] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Trying to abort 1 pending ops.
I20260709 13:03:01.615168   431 pending_rounds.cc:77] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a: Aborting op as it isn't in flight: id { term: 20 index: 17 } timestamp: 7305634534625505280 op_type: NO_OP noop_request { }
I20260709 13:03:01.615562   431 raft_consensus.cc:2889] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:01.615878   431 raft_consensus.cc:2272] T 5c1e1be9de68405393292149e41c0724 P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.618516   431 tablet_replica.cc:333] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.619216   431 raft_consensus.cc:2243] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.619648   431 raft_consensus.cc:2272] T 7485c87933f940ec96f52fe33972ecd3 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.621515   431 tablet_replica.cc:333] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.622164   431 raft_consensus.cc:2243] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.623816   431 raft_consensus.cc:2272] T 627d40025a324704a4ae94c9ed8c404c P 4f6fa2fd61114dc190d8f9b310696e1a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.626257   431 tablet_replica.cc:333] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.627027   431 raft_consensus.cc:2243] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.628077   431 raft_consensus.cc:2272] T dfc7199563cc4b68b76fa96af21d01c4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:01.628450  2288 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:01.630148  2288 consensus_peers.cc:597] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Couldn't send request to peer 4f6fa2fd61114dc190d8f9b310696e1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.630668   431 tablet_replica.cc:333] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.631211   431 raft_consensus.cc:2243] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.631807   431 raft_consensus.cc:2272] T a5e08456c7bb4b07bedf36cb9587b6b4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.634196   431 tablet_replica.cc:333] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.634943   431 raft_consensus.cc:2243] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.636132   431 raft_consensus.cc:2272] T b4ec8ad3927940f69c368052fdeef53b P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.638862   431 tablet_replica.cc:333] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.639608   431 raft_consensus.cc:2243] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.640461   431 raft_consensus.cc:2272] T 1bf16dd2ae6a404a9ae81192db51e512 P 4f6fa2fd61114dc190d8f9b310696e1a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.643043   431 tablet_replica.cc:333] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.643816   431 raft_consensus.cc:2243] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.645135   431 raft_consensus.cc:2272] T 15f3a55bc1874c9cbd400712a345dcf0 P 4f6fa2fd61114dc190d8f9b310696e1a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.647789   431 tablet_replica.cc:333] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.648643   431 raft_consensus.cc:2243] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.649727   431 raft_consensus.cc:2272] T c538f09573cd4214b1d7cab1dddee46f P 4f6fa2fd61114dc190d8f9b310696e1a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.652837   431 tablet_replica.cc:333] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.653549   431 raft_consensus.cc:2243] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:03:01.654138  2286 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:03:01.654824   431 raft_consensus.cc:2272] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 4f6fa2fd61114dc190d8f9b310696e1a [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:01.654102  2288 consensus_peers.cc:597] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Couldn't send request to peer 4f6fa2fd61114dc190d8f9b310696e1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:01.657474   431 tablet_replica.cc:333] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.658057   431 raft_consensus.cc:2243] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.658663   431 raft_consensus.cc:2272] T c6bbedfd642f4fde92dc31fa176c6582 P 4f6fa2fd61114dc190d8f9b310696e1a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.661365   431 tablet_replica.cc:333] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.661942   431 raft_consensus.cc:2243] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.662488   431 raft_consensus.cc:2272] T 1b8e024148f547e4b090c0c8c1155232 P 4f6fa2fd61114dc190d8f9b310696e1a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.665102   431 tablet_replica.cc:333] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a: stopping tablet replica
I20260709 13:03:01.665647   431 raft_consensus.cc:2243] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:01.666823   431 raft_consensus.cc:2272] T 428c176495744009b63bfa690baa17c6 P 4f6fa2fd61114dc190d8f9b310696e1a [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:01.734871  2288 consensus_peers.cc:597] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:01.737895  2286 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:01.769855  2288 consensus_peers.cc:597] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Couldn't send request to peer 4f6fa2fd61114dc190d8f9b310696e1a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:01.817749  2288 consensus_peers.cc:597] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Couldn't send request to peer 4f6fa2fd61114dc190d8f9b310696e1a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:01.828414  2288 consensus_peers.cc:597] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Couldn't send request to peer 4f6fa2fd61114dc190d8f9b310696e1a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:01.958371  2288 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:02.052176  2288 consensus_peers.cc:597] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:02.052804  2288 consensus_peers.cc:597] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:02.106701  2288 consensus_peers.cc:597] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:02.168727  2288 consensus_peers.cc:597] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:02.303956  2286 consensus_peers.cc:597] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:02.326700  2288 consensus_peers.cc:597] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:02.335358  2288 consensus_peers.cc:597] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:02.344564  9533 raft_consensus.cc:493] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:02.345803  9533 raft_consensus.cc:515] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:02.348738  9533 leader_election.cc:290] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:03:02.354518  2286 leader_election.cc:336] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:03:02.356006  2288 leader_election.cc:336] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:02.356513  2288 leader_election.cc:304] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:02.358392  9533 raft_consensus.cc:2749] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:03:02.358548  2288 consensus_peers.cc:597] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:02.400952  9533 raft_consensus.cc:493] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:02.401995  9533 raft_consensus.cc:515] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:02.418956  9533 leader_election.cc:290] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
W20260709 13:03:02.418978  2286 leader_election.cc:336] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:03:02.428030  2288 leader_election.cc:336] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:02.428499  2288 leader_election.cc:304] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:02.429697  9533 raft_consensus.cc:2749] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:02.583091  9533 raft_consensus.cc:493] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.583985  9533 raft_consensus.cc:515] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:02.602499  9549 raft_consensus.cc:493] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:03:02.603461  9549 raft_consensus.cc:515] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:03:02.604990  2288 leader_election.cc:336] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:02.605924  9549 leader_election.cc:290] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:03:02.601845  9533 leader_election.cc:290] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:03:02.609982  2288 leader_election.cc:336] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111)
I20260709 13:03:02.610468  2288 leader_election.cc:304] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:02.611200  9533 raft_consensus.cc:2749] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:02.614368  2288 leader_election.cc:336] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:02.615134  2288 leader_election.cc:336] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111)
I20260709 13:03:02.615501  2288 leader_election.cc:304] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:02.616245  9533 raft_consensus.cc:2749] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:02.631016  2288 consensus_peers.cc:597] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 -> Peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Couldn't send request to peer 8106dfc0bda54df0ae10ba13c28ccc18. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:02.664743   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:02.684000  9533 raft_consensus.cc:493] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:03:02.685168  9533 raft_consensus.cc:515] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:02.688551  9533 leader_election.cc:290] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:03:02.692932  9533 raft_consensus.cc:493] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:03:02.693842  9533 raft_consensus.cc:515] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:03:02.695518  2286 leader_election.cc:336] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:02.696375  9549 raft_consensus.cc:493] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
W20260709 13:03:02.696909  2288 leader_election.cc:336] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111)
I20260709 13:03:02.697477  2288 leader_election.cc:304] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:02.697283  9549 raft_consensus.cc:515] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:02.698626  9559 raft_consensus.cc:2749] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:02.702502  9549 leader_election.cc:290] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:03:02.707438  2286 leader_election.cc:336] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:02.710144  9533 leader_election.cc:290] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:03:02.709318  2288 leader_election.cc:336] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111)
I20260709 13:03:02.715138  2288 leader_election.cc:304] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:03:02.715287  2286 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:02.716331  9533 raft_consensus.cc:2749] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:02.727367  2288 leader_election.cc:336] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111)
I20260709 13:03:02.728050  2288 leader_election.cc:304] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:02.729238  9533 raft_consensus.cc:2749] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:02.794832  9533 raft_consensus.cc:493] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:03:02.795571  9533 raft_consensus.cc:515] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:02.800568  9533 leader_election.cc:290] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:03:02.804782  2288 leader_election.cc:336] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:02.806238  9533 raft_consensus.cc:493] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.806980  9533 raft_consensus.cc:515] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:03:02.807507  2288 leader_election.cc:336] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111)
I20260709 13:03:02.808048  2288 leader_election.cc:304] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:02.808946  9549 raft_consensus.cc:2749] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:02.809881  9533 leader_election.cc:290] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:03:02.816567  2288 leader_election.cc:336] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:02.817418  2288 leader_election.cc:336] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111)
I20260709 13:03:02.817894  2288 leader_election.cc:304] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:02.818774  9549 raft_consensus.cc:2749] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:02.832774   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:03:02.848912  9549 raft_consensus.cc:493] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.849777  9549 raft_consensus.cc:515] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:02.852452  9549 leader_election.cc:290] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:03:02.857795  2288 leader_election.cc:336] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111)
W20260709 13:03:02.858410  2288 leader_election.cc:336] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:02.860664  2288 leader_election.cc:304] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, 8106dfc0bda54df0ae10ba13c28ccc18
I20260709 13:03:02.861516  9549 raft_consensus.cc:2749] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:02.869825  9549 raft_consensus.cc:493] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:02.871276  9549 raft_consensus.cc:515] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:02.879912  9533 raft_consensus.cc:493] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:02.880861  9533 raft_consensus.cc:515] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } attrs { replace: true } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
W20260709 13:03:02.882618  2286 leader_election.cc:336] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:02.883803  9549 leader_election.cc:290] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:03:02.884083  9533 leader_election.cc:290] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
W20260709 13:03:02.890825  2286 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
W20260709 13:03:02.898381  2288 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:02.898986  2288 leader_election.cc:304] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:02.899767  9533 raft_consensus.cc:2749] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:02.899708  2288 leader_election.cc:336] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:02.900840   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:02.901221  2288 leader_election.cc:304] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:02.902201   431 tablet_replica.cc:333] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:02.902498  9533 raft_consensus.cc:2749] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:02.904762  2288 leader_election.cc:336] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111)
I20260709 13:03:02.904891   431 raft_consensus.cc:2243] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.906713   431 raft_consensus.cc:2272] T 7b6551a6ae764e24a141aa53353df444 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.911470   431 tablet_replica.cc:333] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:02.912978   431 raft_consensus.cc:2243] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.914307   431 raft_consensus.cc:2272] T 627d40025a324704a4ae94c9ed8c404c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.918844   431 tablet_replica.cc:333] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:02.919874   431 raft_consensus.cc:2243] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:02.919901  2286 consensus_peers.cc:597] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:03:02.921037   431 raft_consensus.cc:2272] T 6325e0281aa547efa677c29cabdf5de4 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.924439  9533 raft_consensus.cc:493] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:03:02.925556   431 tablet_replica.cc:333] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:02.925239  9533 raft_consensus.cc:515] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:02.926618   431 raft_consensus.cc:2243] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.927338   431 raft_consensus.cc:2272] T 5299151db28746cf82a5b6d791a71d60 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.927462  9533 leader_election.cc:290] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:03:02.931847   431 tablet_replica.cc:333] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:02.933089   431 raft_consensus.cc:2243] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:02.935614  2288 leader_election.cc:336] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111)
W20260709 13:03:02.943243  2286 leader_election.cc:336] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:02.943562   431 raft_consensus.cc:2272] T 08d2a27acc8245ffb64e2f7a75ff92a4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.943728  2286 leader_election.cc:304] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:02.944555  9533 raft_consensus.cc:2749] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:02.948148   431 tablet_replica.cc:333] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:02.949343   431 raft_consensus.cc:2243] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.950682   431 raft_consensus.cc:2272] T a5e08456c7bb4b07bedf36cb9587b6b4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.955036   431 tablet_replica.cc:333] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:02.956207   431 raft_consensus.cc:2243] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.957464   431 raft_consensus.cc:2272] T b4ec8ad3927940f69c368052fdeef53b P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.961230   431 tablet_replica.cc:333] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:02.962242   431 raft_consensus.cc:2243] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:02.964097   431 raft_consensus.cc:2272] T d1461e6ea3a84192b5ce68699dc52d80 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.966241  9533 raft_consensus.cc:493] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:03:02.966795  9533 raft_consensus.cc:515] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:02.968681   431 tablet_replica.cc:333] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:02.969339  9533 leader_election.cc:290] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:03:02.969870   431 raft_consensus.cc:2243] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.971174   431 raft_consensus.cc:2272] T dfc7199563cc4b68b76fa96af21d01c4 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.974974   431 tablet_replica.cc:333] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
W20260709 13:03:02.975636  2286 leader_election.cc:336] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:02.976137   431 raft_consensus.cc:2243] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:02.976225  2288 leader_election.cc:336] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111)
I20260709 13:03:02.976881  2288 leader_election.cc:304] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:02.977592  9533 raft_consensus.cc:2749] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:02.977762   431 raft_consensus.cc:2272] T 1bf16dd2ae6a404a9ae81192db51e512 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.979226  9533 raft_consensus.cc:493] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:02.979730  9533 raft_consensus.cc:515] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:02.981937  9533 leader_election.cc:290] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:03:02.983028   431 tablet_replica.cc:333] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:02.984265   431 raft_consensus.cc:2243] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.985122   431 raft_consensus.cc:2272] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:02.987895  2288 leader_election.cc:336] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
W20260709 13:03:02.988469  2286 leader_election.cc:336] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:02.988646   431 tablet_replica.cc:333] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:02.989128  2286 leader_election.cc:304] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
W20260709 13:03:02.989693  2286 raft_consensus.cc:2686] T 48837d0ac86f4664b4bfe442411bc28f P 6b9e73092f6146639bf310a3d18cfe37: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:03:02.989773   431 raft_consensus.cc:2243] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.990710   431 raft_consensus.cc:2272] T 78990af8f5ef4464b9e3bbb9749e7337 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.994486   431 tablet_replica.cc:333] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:02.995433   431 raft_consensus.cc:2243] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:03:02.996626  2286 consensus_peers.cc:597] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 -> Peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Couldn't send request to peer e4c78b411eb34b3d92183a86d34a81f1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:03:02.996987   431 raft_consensus.cc:2272] T 0f3f4d9e2c0643f1be1fe0de2078f6da P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.001451   431 tablet_replica.cc:333] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.002390   431 raft_consensus.cc:2243] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.003296   431 raft_consensus.cc:2272] T a4ce544917f545499da64014539a4ff2 P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.006678   431 tablet_replica.cc:333] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.007634   431 raft_consensus.cc:2243] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.009249   431 raft_consensus.cc:2272] T 54abded5f0d34ab1871704bc5a3c1b4a P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.013453   431 tablet_replica.cc:333] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.014256   431 raft_consensus.cc:2243] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.015084   431 raft_consensus.cc:2272] T 5c1e1be9de68405393292149e41c0724 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.019225   431 tablet_replica.cc:333] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.020025   431 raft_consensus.cc:2243] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.020787   431 raft_consensus.cc:2272] T 4d906a33e42d4a08ae9d1a9d2e39351c P 6b9e73092f6146639bf310a3d18cfe37 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.024571   431 tablet_replica.cc:333] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.025491  9533 raft_consensus.cc:493] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4f6fa2fd61114dc190d8f9b310696e1a)
I20260709 13:03:03.025794   431 raft_consensus.cc:2243] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.026187  9533 raft_consensus.cc:515] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "4f6fa2fd61114dc190d8f9b310696e1a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42699 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:03.028198   431 raft_consensus.cc:2272] T 03348d9c2a344a6f8e716751b1024647 P 6b9e73092f6146639bf310a3d18cfe37 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.028831  9533 leader_election.cc:290] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699)
I20260709 13:03:03.032122   431 tablet_replica.cc:333] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.033073   431 raft_consensus.cc:2243] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.034408   431 raft_consensus.cc:2272] T 1d92f9e0b7fb49ab8fad982d80cbd39f P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:03.035960  2286 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:03.037434   431 tablet_replica.cc:333] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
W20260709 13:03:03.037459  2288 leader_election.cc:336] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 4f6fa2fd61114dc190d8f9b310696e1a (127.0.107.195:42699): Network error: Client connection negotiation failed: client connection to 127.0.107.195:42699: connect: Connection refused (error 111)
I20260709 13:03:03.038102  2288 leader_election.cc:304] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 4f6fa2fd61114dc190d8f9b310696e1a, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:03.038408   431 raft_consensus.cc:2243] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.039412   431 raft_consensus.cc:2272] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.039783  9549 raft_consensus.cc:2706] T 327c042262d94ababf63c12c177e29ed P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Received pre-election callback for term 23 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 13:03:03.043084   431 tablet_replica.cc:333] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.043859   431 raft_consensus.cc:2243] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.045230   431 pending_rounds.cc:70] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Trying to abort 1 pending ops.
I20260709 13:03:03.045547   431 pending_rounds.cc:77] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37: Aborting op as it isn't in flight: id { term: 26 index: 18 } timestamp: 7305634533433118720 op_type: NO_OP noop_request { }
I20260709 13:03:03.046051   431 raft_consensus.cc:2889] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 26 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:03.046427   431 raft_consensus.cc:2272] T 193165fa679c4f6c9d6ac6b39ef823bd P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.046692  9549 raft_consensus.cc:493] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8106dfc0bda54df0ae10ba13c28ccc18)
I20260709 13:03:03.047330  9549 raft_consensus.cc:515] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4c78b411eb34b3d92183a86d34a81f1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "8106dfc0bda54df0ae10ba13c28ccc18" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43887 } } peers { permanent_uuid: "6b9e73092f6146639bf310a3d18cfe37" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39387 } attrs { promote: false } }
I20260709 13:03:03.049273   431 tablet_replica.cc:333] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.049893  9549 leader_election.cc:290] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439), 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887)
I20260709 13:03:03.050211   431 raft_consensus.cc:2243] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.053069   431 raft_consensus.cc:2272] T c6bbedfd642f4fde92dc31fa176c6582 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:03.055191  2286 leader_election.cc:336] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:03.056205   431 tablet_replica.cc:333] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
W20260709 13:03:03.056619  2288 leader_election.cc:336] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8106dfc0bda54df0ae10ba13c28ccc18 (127.0.107.194:43887): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43887: connect: Connection refused (error 111)
I20260709 13:03:03.057021   431 raft_consensus.cc:2243] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.057081  2288 leader_election.cc:304] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b9e73092f6146639bf310a3d18cfe37; no voters: 8106dfc0bda54df0ae10ba13c28ccc18, e4c78b411eb34b3d92183a86d34a81f1
I20260709 13:03:03.057929  9549 raft_consensus.cc:2749] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:03.058480   431 raft_consensus.cc:2272] T f4a5771425b14503aa3a070b20d0bf86 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.061049   431 tablet_replica.cc:333] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.061667   431 raft_consensus.cc:2243] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.062387   431 raft_consensus.cc:2272] T 81a2ecbb8bc64b12a8b6f2f3af475103 P 6b9e73092f6146639bf310a3d18cfe37 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.064827   431 tablet_replica.cc:333] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.065412   431 raft_consensus.cc:2243] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.066525   431 pending_rounds.cc:70] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Trying to abort 1 pending ops.
I20260709 13:03:03.066730   431 pending_rounds.cc:77] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37: Aborting op as it isn't in flight: id { term: 20 index: 14 } timestamp: 7305634533159555072 op_type: NO_OP noop_request { }
I20260709 13:03:03.067025   431 raft_consensus.cc:2889] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:03.067346   431 raft_consensus.cc:2272] T 32eb5ab4f2154adb88f8148264914ee9 P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.069655   431 tablet_replica.cc:333] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.070288   431 raft_consensus.cc:2243] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.070919   431 raft_consensus.cc:2272] T c538f09573cd4214b1d7cab1dddee46f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.073271   431 tablet_replica.cc:333] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.073931   431 raft_consensus.cc:2243] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.074600   431 raft_consensus.cc:2272] T f4ee010e653949d581d35eb9b09d59dd P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.077302   431 tablet_replica.cc:333] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.077915   431 raft_consensus.cc:2243] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.078877   431 raft_consensus.cc:2272] T 4d71f760473d4219a951e6e5f061bfb5 P 6b9e73092f6146639bf310a3d18cfe37 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.081257   431 tablet_replica.cc:333] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.081897   431 raft_consensus.cc:2243] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.083087   431 raft_consensus.cc:2272] T bb62bfd8ccab4ff7925d27d979888b38 P 6b9e73092f6146639bf310a3d18cfe37 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.085487   431 tablet_replica.cc:333] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.086099   431 raft_consensus.cc:2243] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.087239   431 raft_consensus.cc:2272] T e5f9ac80ae924622bceefdf9814aca1e P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.089869   431 tablet_replica.cc:333] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.090664   431 raft_consensus.cc:2243] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.091568   431 raft_consensus.cc:2272] T 79c0adefd7b845bb8ddbb72d7edb7bc7 P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.093947   431 tablet_replica.cc:333] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.094851   431 raft_consensus.cc:2243] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.095850   431 raft_consensus.cc:2272] T e8ceb3afda0646d2b7815d235d107857 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.098217   431 tablet_replica.cc:333] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.098884   431 raft_consensus.cc:2243] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.099611   431 raft_consensus.cc:2272] T 1a2e95946efd462d8cee2bc7302fe094 P 6b9e73092f6146639bf310a3d18cfe37 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.102198   431 tablet_replica.cc:333] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.102746   431 raft_consensus.cc:2243] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.103266   431 raft_consensus.cc:2272] T 52b0712953ef42ddb724cd8c29a0ec0b P 6b9e73092f6146639bf310a3d18cfe37 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.105433   431 tablet_replica.cc:333] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.105969   431 raft_consensus.cc:2243] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.106484   431 raft_consensus.cc:2272] T a6272972864842479d82e86cc14f8ff4 P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.108517   431 tablet_replica.cc:333] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.109097   431 raft_consensus.cc:2243] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.110313   431 raft_consensus.cc:2272] T 076fd1ae95e4457d8361a9b4c963b26f P 6b9e73092f6146639bf310a3d18cfe37 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.112659   431 tablet_replica.cc:333] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.113270   431 raft_consensus.cc:2243] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.114233   431 pending_rounds.cc:70] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Trying to abort 1 pending ops.
I20260709 13:03:03.114454   431 pending_rounds.cc:77] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37: Aborting op as it isn't in flight: id { term: 23 index: 17 } timestamp: 7305634534010400768 op_type: NO_OP noop_request { }
I20260709 13:03:03.114746   431 raft_consensus.cc:2889] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:03.115178   431 raft_consensus.cc:2272] T 234fc17fda8e45db9455b24cfd3939f4 P 6b9e73092f6146639bf310a3d18cfe37 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.118095   431 tablet_replica.cc:333] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.118644   431 raft_consensus.cc:2243] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.119632   431 raft_consensus.cc:2272] T 1b8e024148f547e4b090c0c8c1155232 P 6b9e73092f6146639bf310a3d18cfe37 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.122028   431 tablet_replica.cc:333] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.122531   431 raft_consensus.cc:2243] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.123598   431 raft_consensus.cc:2272] T 1242a7b5484b4cc6a066e0c93629550f P 6b9e73092f6146639bf310a3d18cfe37 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.125962   431 tablet_replica.cc:333] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37: stopping tablet replica
I20260709 13:03:03.126431   431 raft_consensus.cc:2243] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.127622   431 raft_consensus.cc:2272] T 4ec5abf47e7f48a3a476ef08dd5f179d P 6b9e73092f6146639bf310a3d18cfe37 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.638108   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:03:03.722357   431 master.cc:562] Master@127.0.107.254:44807 shutting down...
W20260709 13:03:03.780969  1506 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:03:03.781672  1506 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:03.782178  1506 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:03.782634  1506 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:03:03.782855  1506 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:03.783090  1506 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:03.783454  1506 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:03:03.783619  1506 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:03.783804  1506 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:03.797902  1443 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111) [suppressed 553 similar messages]
W20260709 13:03:03.801359  1443 catalog_manager.cc:4755] TS e4c78b411eb34b3d92183a86d34a81f1 (127.0.107.193:43439): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b4ec8ad3927940f69c368052fdeef53b: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 13:03:03.808696   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.809427   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.809734   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1d002eece69f4b28add96a7bb163d0f2: stopping tablet replica
I20260709 13:03:04.042100   431 master.cc:584] Master@127.0.107.254:44807 shutdown complete.
I20260709 13:03:04.089991   431 test_util.cc:182] -----------------------------------------------
I20260709 13:03:04.090234   431 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601889622018-431-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (269938 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:03:04.094213   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:33941
I20260709 13:03:04.095427   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:04.101507  9563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.101523  9564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.103648  9566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:04.105316   431 server_base.cc:1061] running on GCE node
I20260709 13:03:04.109102   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:04.109334   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:04.109673   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602184109615 us; error 0 us; skew 500 ppm
I20260709 13:03:04.110297   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:04.113065   431 webserver.cc:533] Webserver started at http://127.0.107.254:38391/ using document root <none> and password file <none>
I20260709 13:03:04.113631   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:04.113883   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:04.114185   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:04.115495   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/master-0-root/instance:
uuid: "47b2f201f08043c7937fe627602622bd"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-c08m"
I20260709 13:03:04.120496   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:03:04.124323  9571 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.125329   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:04.125670   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/master-0-root
uuid: "47b2f201f08043c7937fe627602622bd"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-c08m"
I20260709 13:03:04.125986   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:04.149819   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:04.151172   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:04.193104   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:33941
I20260709 13:03:04.193241  9622 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:33941 every 8 connection(s)
I20260709 13:03:04.197286  9623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.208984  9623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd: Bootstrap starting.
I20260709 13:03:04.214289  9623 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:04.219604  9623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd: No bootstrap required, opened a new log
I20260709 13:03:04.222101  9623 raft_consensus.cc:359] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b2f201f08043c7937fe627602622bd" member_type: VOTER }
I20260709 13:03:04.222545  9623 raft_consensus.cc:385] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:04.222827  9623 raft_consensus.cc:740] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b2f201f08043c7937fe627602622bd, State: Initialized, Role: FOLLOWER
I20260709 13:03:04.223496  9623 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b2f201f08043c7937fe627602622bd" member_type: VOTER }
I20260709 13:03:04.223973  9623 raft_consensus.cc:399] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:04.224196  9623 raft_consensus.cc:493] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:04.224514  9623 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:04.229897  9623 raft_consensus.cc:515] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b2f201f08043c7937fe627602622bd" member_type: VOTER }
I20260709 13:03:04.230659  9623 leader_election.cc:304] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47b2f201f08043c7937fe627602622bd; no voters: 
I20260709 13:03:04.232293  9623 leader_election.cc:290] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:04.232681  9626 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:04.234171  9626 raft_consensus.cc:697] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [term 1 LEADER]: Becoming Leader. State: Replica: 47b2f201f08043c7937fe627602622bd, State: Running, Role: LEADER
I20260709 13:03:04.234930  9626 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b2f201f08043c7937fe627602622bd" member_type: VOTER }
I20260709 13:03:04.235670  9623 sys_catalog.cc:565] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:04.241899  9627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47b2f201f08043c7937fe627602622bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b2f201f08043c7937fe627602622bd" member_type: VOTER } }
I20260709 13:03:04.241830  9628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47b2f201f08043c7937fe627602622bd. Latest consensus state: current_term: 1 leader_uuid: "47b2f201f08043c7937fe627602622bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b2f201f08043c7937fe627602622bd" member_type: VOTER } }
I20260709 13:03:04.242911  9627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:04.242942  9628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:04.247756  9635 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:04.252998  9635 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:04.254135   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:04.262452  9635 catalog_manager.cc:1383] Generated new cluster ID: 26f8b4fe82774392a4b68ad2eb8274d6
I20260709 13:03:04.262791  9635 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:04.282974  9635 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:04.284322  9635 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:04.303139  9635 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd: Generated new TSK 0
I20260709 13:03:04.304112  9635 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:04.321781   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:04.329586  9644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.330050  9645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.331573  9647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:04.333467   431 server_base.cc:1061] running on GCE node
I20260709 13:03:04.337777   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:04.338012   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:04.338213   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602184338198 us; error 0 us; skew 500 ppm
I20260709 13:03:04.338858   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:04.342262   431 webserver.cc:533] Webserver started at http://127.0.107.193:44105/ using document root <none> and password file <none>
I20260709 13:03:04.342840   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:04.343056   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:04.343348   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:04.344552   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-0-root/instance:
uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-c08m"
I20260709 13:03:04.349562   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:04.353632  9652 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.354785   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:03:04.355178   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-0-root
uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-c08m"
I20260709 13:03:04.355569   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:04.369997   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:04.371186   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:04.372627   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:04.374980   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:04.375159   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.375465   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:04.375618   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.420214   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:32917
I20260709 13:03:04.420342  9714 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:32917 every 8 connection(s)
I20260709 13:03:04.425225   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:04.434053  9719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.435457  9720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.438865  9722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:04.440011   431 server_base.cc:1061] running on GCE node
I20260709 13:03:04.443833   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:04.444187   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:04.444379   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602184444364 us; error 0 us; skew 500 ppm
I20260709 13:03:04.445117   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:04.445044  9715 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33941
I20260709 13:03:04.445705  9715 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:04.446768  9715 heartbeater.cc:507] Master 127.0.107.254:33941 requested a full tablet report, sending...
I20260709 13:03:04.448434   431 webserver.cc:533] Webserver started at http://127.0.107.194:42509/ using document root <none> and password file <none>
I20260709 13:03:04.449079   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:04.449290   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:04.449352  9588 ts_manager.cc:194] Registered new tserver with Master: 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:04.449589   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:04.450888   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-1-root/instance:
uuid: "837fad20523b4348b68f0a1e1af12404"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-c08m"
I20260709 13:03:04.451354  9588 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42592
I20260709 13:03:04.457090   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:03:04.461690  9727 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.462786   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 13:03:04.463373   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-1-root
uuid: "837fad20523b4348b68f0a1e1af12404"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-c08m"
I20260709 13:03:04.463850   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:04.483176   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:04.484534   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:04.486157   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:04.488454   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:04.488718   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.488969   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:04.489140   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.532913   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:44623
I20260709 13:03:04.533044  9789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:44623 every 8 connection(s)
I20260709 13:03:04.538141   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:04.546690  9793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.547276  9794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:04.552875  9790 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33941
I20260709 13:03:04.553385  9790 heartbeater.cc:461] Registering TS with master...
W20260709 13:03:04.554090  9796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:04.554428  9790 heartbeater.cc:507] Master 127.0.107.254:33941 requested a full tablet report, sending...
I20260709 13:03:04.554677   431 server_base.cc:1061] running on GCE node
I20260709 13:03:04.557248   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:04.557547   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:04.557760   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602184557740 us; error 0 us; skew 500 ppm
I20260709 13:03:04.558061  9588 ts_manager.cc:194] Registered new tserver with Master: 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:04.558624   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:04.560279  9588 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42596
I20260709 13:03:04.562073   431 webserver.cc:533] Webserver started at http://127.0.107.195:41827/ using document root <none> and password file <none>
I20260709 13:03:04.562638   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:04.562830   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:04.563138   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:04.565001   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-2-root/instance:
uuid: "451c871fd36f4d95a76b62d041aa7b60"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-c08m"
I20260709 13:03:04.569810   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:04.573623  9801 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.574645   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:03:04.575574   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-2-root
uuid: "451c871fd36f4d95a76b62d041aa7b60"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-c08m"
I20260709 13:03:04.575906   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:04.594152   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:04.595458   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:04.597031   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:04.599411   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:04.599674   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.599926   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:04.600107   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.644021   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:35769
I20260709 13:03:04.644136  9863 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:35769 every 8 connection(s)
I20260709 13:03:04.649044   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:04.656980  9867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.659026  9868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:04.661204  9870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:04.662129   431 server_base.cc:1061] running on GCE node
I20260709 13:03:04.662258  9864 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33941
I20260709 13:03:04.662740  9864 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:04.663164   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:04.663437   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:04.663566  9864 heartbeater.cc:507] Master 127.0.107.254:33941 requested a full tablet report, sending...
I20260709 13:03:04.663645   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602184663625 us; error 0 us; skew 500 ppm
I20260709 13:03:04.664459   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:04.666213  9588 ts_manager.cc:194] Registered new tserver with Master: 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:04.667441   431 webserver.cc:533] Webserver started at http://127.0.107.196:33337/ using document root <none> and password file <none>
I20260709 13:03:04.668186   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:04.668175  9588 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42610
I20260709 13:03:04.668758   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:04.669173   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:04.670466   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-3-root/instance:
uuid: "8557220d7e6a4ccbbef222e80a5584a5"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-c08m"
I20260709 13:03:04.675252   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 13:03:04.679479  9875 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.680508   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:03:04.680924   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-3-root
uuid: "8557220d7e6a4ccbbef222e80a5584a5"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-c08m"
I20260709 13:03:04.681260   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:04.695677   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:04.697108   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:04.698665   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:04.701135   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:04.701401   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.701648   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:04.701822   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:04.757627   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:36227
I20260709 13:03:04.757680  9937 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:36227 every 8 connection(s)
I20260709 13:03:04.774405  9938 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33941
I20260709 13:03:04.774883  9938 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:04.775631  9938 heartbeater.cc:507] Master 127.0.107.254:33941 requested a full tablet report, sending...
I20260709 13:03:04.777865  9588 ts_manager.cc:194] Registered new tserver with Master: 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:04.778508   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017361047s
I20260709 13:03:04.780316  9588 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42612
I20260709 13:03:04.809689  9588 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42620:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:03:05.058872  9755 tablet_service.cc:1511] Processing CreateTablet for tablet df66a70431354160b6aa78186f21c43b (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:05.060478  9755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df66a70431354160b6aa78186f21c43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.064430  9754 tablet_service.cc:1511] Processing CreateTablet for tablet 44eaceee580a4f8c8edd343f46ce1b32 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:05.067119  9754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44eaceee580a4f8c8edd343f46ce1b32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.070715  9903 tablet_service.cc:1511] Processing CreateTablet for tablet df66a70431354160b6aa78186f21c43b (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:05.072991  9903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df66a70431354160b6aa78186f21c43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.085708  9902 tablet_service.cc:1511] Processing CreateTablet for tablet 3e792dd7473944b79554c8d6ad554fab (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:05.087438  9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e792dd7473944b79554c8d6ad554fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.088426  9753 tablet_service.cc:1511] Processing CreateTablet for tablet 3e792dd7473944b79554c8d6ad554fab (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:05.090096  9753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e792dd7473944b79554c8d6ad554fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.092691  9901 tablet_service.cc:1511] Processing CreateTablet for tablet dd27b85a4d824953b7b73f36aff6acc9 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:05.094565  9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd27b85a4d824953b7b73f36aff6acc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.114418  9752 tablet_service.cc:1511] Processing CreateTablet for tablet ceffadfaf404425f90705c5a6e0e60bc (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:05.116019  9752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceffadfaf404425f90705c5a6e0e60bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.117818  9900 tablet_service.cc:1511] Processing CreateTablet for tablet dfad36487cbe42f3adf25a44fa2b1b62 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:05.119357  9900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfad36487cbe42f3adf25a44fa2b1b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.125171  9829 tablet_service.cc:1511] Processing CreateTablet for tablet df66a70431354160b6aa78186f21c43b (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:05.126282  9827 tablet_service.cc:1511] Processing CreateTablet for tablet dd27b85a4d824953b7b73f36aff6acc9 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:05.128824  9826 tablet_service.cc:1511] Processing CreateTablet for tablet ceffadfaf404425f90705c5a6e0e60bc (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:05.128484  9828 tablet_service.cc:1511] Processing CreateTablet for tablet 44eaceee580a4f8c8edd343f46ce1b32 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:05.126740  9829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df66a70431354160b6aa78186f21c43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.131878  9751 tablet_service.cc:1511] Processing CreateTablet for tablet dfad36487cbe42f3adf25a44fa2b1b62 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:05.133320  9751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfad36487cbe42f3adf25a44fa2b1b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.137048  9827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd27b85a4d824953b7b73f36aff6acc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.141076  9826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceffadfaf404425f90705c5a6e0e60bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.143965  9828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44eaceee580a4f8c8edd343f46ce1b32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.147650  9958 tablet_bootstrap.cc:492] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:05.154934  9958 tablet_bootstrap.cc:654] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.157330  9680 tablet_service.cc:1511] Processing CreateTablet for tablet 44eaceee580a4f8c8edd343f46ce1b32 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:05.161486  9679 tablet_service.cc:1511] Processing CreateTablet for tablet 3e792dd7473944b79554c8d6ad554fab (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:05.164099  9678 tablet_service.cc:1511] Processing CreateTablet for tablet dd27b85a4d824953b7b73f36aff6acc9 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:05.166816  9677 tablet_service.cc:1511] Processing CreateTablet for tablet ceffadfaf404425f90705c5a6e0e60bc (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:05.170411  9676 tablet_service.cc:1511] Processing CreateTablet for tablet dfad36487cbe42f3adf25a44fa2b1b62 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:05.173038  9680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44eaceee580a4f8c8edd343f46ce1b32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.174568  9959 tablet_bootstrap.cc:492] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:05.177012  9678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd27b85a4d824953b7b73f36aff6acc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.179529  9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceffadfaf404425f90705c5a6e0e60bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.180343  9679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e792dd7473944b79554c8d6ad554fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.181975  9676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfad36487cbe42f3adf25a44fa2b1b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.208243  9959 tablet_bootstrap.cc:654] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.226295  9825 tablet_service.cc:1511] Processing CreateTablet for tablet 62f57279c5dc4c9a8a1d2c4a65a1c167 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:05.228178  9900 tablet_service.cc:1511] Processing CreateTablet for tablet 62f57279c5dc4c9a8a1d2c4a65a1c167 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:05.228681  9825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f57279c5dc4c9a8a1d2c4a65a1c167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.229660  9900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f57279c5dc4c9a8a1d2c4a65a1c167. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:05.274889  9636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:05.296480  9959 tablet_bootstrap.cc:492] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:05.297312  9959 ts_tablet_manager.cc:1403] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.059s
I20260709 13:03:05.299981  9675 tablet_service.cc:1511] Processing CreateTablet for tablet 62f57279c5dc4c9a8a1d2c4a65a1c167 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:05.302166  9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f57279c5dc4c9a8a1d2c4a65a1c167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.312238  9958 tablet_bootstrap.cc:492] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:05.312826  9958 ts_tablet_manager.cc:1403] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.166s	user 0.065s	sys 0.038s
I20260709 13:03:05.314811  9751 tablet_service.cc:1511] Processing CreateTablet for tablet b7422f3d4e364cb68af3b39f23fd94bf (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:05.314944  9824 tablet_service.cc:1511] Processing CreateTablet for tablet b7422f3d4e364cb68af3b39f23fd94bf (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:05.316445  9824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7422f3d4e364cb68af3b39f23fd94bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.316366  9751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7422f3d4e364cb68af3b39f23fd94bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.318430  9961 tablet_bootstrap.cc:492] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:05.319401  9959 raft_consensus.cc:359] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:05.320228  9959 raft_consensus.cc:385] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.320534  9959 raft_consensus.cc:740] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.322038  9900 tablet_service.cc:1511] Processing CreateTablet for tablet b7422f3d4e364cb68af3b39f23fd94bf (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:05.323400  9900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7422f3d4e364cb68af3b39f23fd94bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.323112  9959 consensus_queue.cc:260] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:05.340915  9958 raft_consensus.cc:359] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:05.342630  9958 raft_consensus.cc:385] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.342962  9958 raft_consensus.cc:740] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.354470  9963 tablet_bootstrap.cc:492] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:05.355551  9680 tablet_service.cc:1511] Processing CreateTablet for tablet a0f0ca4181d94a888b1dd8f39485828c (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:05.358840  9752 tablet_service.cc:1511] Processing CreateTablet for tablet a0f0ca4181d94a888b1dd8f39485828c (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:05.359839  9680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f0ca4181d94a888b1dd8f39485828c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.360491  9752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f0ca4181d94a888b1dd8f39485828c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.363121  9938 heartbeater.cc:499] Master 127.0.107.254:33941 was elected leader, sending a full tablet report...
I20260709 13:03:05.366375  9958 consensus_queue.cc:260] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:05.371227  9828 tablet_service.cc:1511] Processing CreateTablet for tablet a0f0ca4181d94a888b1dd8f39485828c (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:05.359376  9959 ts_tablet_manager.cc:1434] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.062s	user 0.023s	sys 0.012s
I20260709 13:03:05.380909  9901 tablet_service.cc:1511] Processing CreateTablet for tablet 4df3f52d3b03462987204a034f95a927 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:05.383503  9959 tablet_bootstrap.cc:492] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:05.383831  9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df3f52d3b03462987204a034f95a927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.385074  9828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f0ca4181d94a888b1dd8f39485828c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.389672  9961 tablet_bootstrap.cc:654] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.403187  9959 tablet_bootstrap.cc:654] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.389698  9963 tablet_bootstrap.cc:654] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.407431  9790 heartbeater.cc:499] Master 127.0.107.254:33941 was elected leader, sending a full tablet report...
I20260709 13:03:05.413991  9958 ts_tablet_manager.cc:1434] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.101s	user 0.009s	sys 0.001s
I20260709 13:03:05.419296  9678 tablet_service.cc:1511] Processing CreateTablet for tablet 4df3f52d3b03462987204a034f95a927 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:05.419615  9751 tablet_service.cc:1511] Processing CreateTablet for tablet 4df3f52d3b03462987204a034f95a927 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:05.420881  9678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df3f52d3b03462987204a034f95a927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.431558  9900 tablet_service.cc:1511] Processing CreateTablet for tablet 95ddf7a725a64a6e9c3c1ede3c67402d (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:05.434696  9826 tablet_service.cc:1511] Processing CreateTablet for tablet 95ddf7a725a64a6e9c3c1ede3c67402d (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:05.435835  9961 tablet_bootstrap.cc:492] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:05.436159  9826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ddf7a725a64a6e9c3c1ede3c67402d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.436386  9961 ts_tablet_manager.cc:1403] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.118s	user 0.020s	sys 0.013s
I20260709 13:03:05.419358  9958 tablet_bootstrap.cc:492] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:05.442782  9903 tablet_service.cc:1511] Processing CreateTablet for tablet 52ab365fb7404f4d88cf7333834d27c5 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:05.443940  9751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df3f52d3b03462987204a034f95a927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.449209  9900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ddf7a725a64a6e9c3c1ede3c67402d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.454720  9715 heartbeater.cc:499] Master 127.0.107.254:33941 was elected leader, sending a full tablet report...
I20260709 13:03:05.454123  9753 tablet_service.cc:1511] Processing CreateTablet for tablet ffeb40161a4049b8a9b37f9cadfdc50f (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:05.456382  9753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffeb40161a4049b8a9b37f9cadfdc50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.454888  9903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ab365fb7404f4d88cf7333834d27c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.460489  9675 tablet_service.cc:1511] Processing CreateTablet for tablet ffeb40161a4049b8a9b37f9cadfdc50f (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:05.461946  9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffeb40161a4049b8a9b37f9cadfdc50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.466142  9679 tablet_service.cc:1511] Processing CreateTablet for tablet 95ddf7a725a64a6e9c3c1ede3c67402d (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:05.467662  9679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ddf7a725a64a6e9c3c1ede3c67402d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.468050  9963 tablet_bootstrap.cc:492] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:05.468575  9965 raft_consensus.cc:493] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.469105  9963 ts_tablet_manager.cc:1403] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.115s	user 0.029s	sys 0.015s
I20260709 13:03:05.469180  9965 raft_consensus.cc:515] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:05.482265  9963 raft_consensus.cc:359] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:05.486449  9964 raft_consensus.cc:493] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.487018  9964 raft_consensus.cc:515] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:05.487782  9824 tablet_service.cc:1511] Processing CreateTablet for tablet 52ab365fb7404f4d88cf7333834d27c5 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:05.489245  9824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ab365fb7404f4d88cf7333834d27c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.486119  9752 tablet_service.cc:1511] Processing CreateTablet for tablet 52ab365fb7404f4d88cf7333834d27c5 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:05.491163  9963 raft_consensus.cc:385] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.494388  9963 raft_consensus.cc:740] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.495419  9963 consensus_queue.cc:260] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:05.480093  9965 leader_election.cc:290] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:05.503063  9964 leader_election.cc:290] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:05.504290  9828 tablet_service.cc:1511] Processing CreateTablet for tablet ffeb40161a4049b8a9b37f9cadfdc50f (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:05.506305  9828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffeb40161a4049b8a9b37f9cadfdc50f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:05.512902  9939 tablet.cc:2406] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:05.517285  9752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ab365fb7404f4d88cf7333834d27c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.540099  9961 raft_consensus.cc:359] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:05.559728  9961 raft_consensus.cc:385] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.560052  9961 raft_consensus.cc:740] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.561038  9959 tablet_bootstrap.cc:492] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:05.561601  9959 ts_tablet_manager.cc:1403] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.178s	user 0.052s	sys 0.063s
I20260709 13:03:05.579218  9959 raft_consensus.cc:359] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:05.582113  9961 consensus_queue.cc:260] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:05.595022  9864 heartbeater.cc:499] Master 127.0.107.254:33941 was elected leader, sending a full tablet report...
I20260709 13:03:05.596002  9961 ts_tablet_manager.cc:1434] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.159s	user 0.011s	sys 0.003s
I20260709 13:03:05.597502  9961 tablet_bootstrap.cc:492] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:05.602882  9901 tablet_service.cc:1511] Processing CreateTablet for tablet de10962da0124f0eb699ad981d76d6f4 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:05.604471  9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de10962da0124f0eb699ad981d76d6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.605624  9961 tablet_bootstrap.cc:654] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.613238  9963 ts_tablet_manager.cc:1434] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.143s	user 0.022s	sys 0.024s
I20260709 13:03:05.614534  9963 tablet_bootstrap.cc:492] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:05.619798  9755 tablet_service.cc:1511] Processing CreateTablet for tablet 60ee1293277e45038d5f7e4289589ded (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:05.620615  9828 tablet_service.cc:1511] Processing CreateTablet for tablet e3b14229f08e4078b2e335de63179868 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:05.621378  9755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ee1293277e45038d5f7e4289589ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.621954  9828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b14229f08e4078b2e335de63179868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.625097  9754 tablet_service.cc:1511] Processing CreateTablet for tablet de10962da0124f0eb699ad981d76d6f4 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:05.626003  9902 tablet_service.cc:1511] Processing CreateTablet for tablet e3b14229f08e4078b2e335de63179868 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:05.626479  9754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de10962da0124f0eb699ad981d76d6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.627322  9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b14229f08e4078b2e335de63179868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.630048  9680 tablet_service.cc:1511] Processing CreateTablet for tablet de10962da0124f0eb699ad981d76d6f4 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:05.631426  9680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de10962da0124f0eb699ad981d76d6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.631382  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd27b85a4d824953b7b73f36aff6acc9" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:05.633391  9879 leader_election.cc:343] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.633620  9677 tablet_service.cc:1511] Processing CreateTablet for tablet e3b14229f08e4078b2e335de63179868 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:05.582231  9959 raft_consensus.cc:385] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.636500  9959 raft_consensus.cc:740] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.637492  9959 consensus_queue.cc:260] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:05.639866  9959 ts_tablet_manager.cc:1434] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 13:03:05.646160  9963 tablet_bootstrap.cc:654] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.648654  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df66a70431354160b6aa78186f21c43b" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:05.650250  9958 tablet_bootstrap.cc:654] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:05.652626  9731 leader_election.cc:343] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.661201  9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b14229f08e4078b2e335de63179868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.668339  9829 tablet_service.cc:1511] Processing CreateTablet for tablet 60ee1293277e45038d5f7e4289589ded (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:05.670032  9829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ee1293277e45038d5f7e4289589ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.680775  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df66a70431354160b6aa78186f21c43b" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:05.681051  9901 tablet_service.cc:1511] Processing CreateTablet for tablet 60ee1293277e45038d5f7e4289589ded (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
W20260709 13:03:05.682796  9728 leader_election.cc:343] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.684185  9728 leader_election.cc:304] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:05.684442  9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ee1293277e45038d5f7e4289589ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.685539  9965 raft_consensus.cc:2749] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:05.690353  9753 tablet_service.cc:1511] Processing CreateTablet for tablet 492d90625d5e4006b85a116618e1ebdd (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:05.693070  9959 tablet_bootstrap.cc:492] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:05.692463  9828 tablet_service.cc:1511] Processing CreateTablet for tablet 492d90625d5e4006b85a116618e1ebdd (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:05.693746  9678 tablet_service.cc:1511] Processing CreateTablet for tablet 492d90625d5e4006b85a116618e1ebdd (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:05.694844  9675 tablet_service.cc:1511] Processing CreateTablet for tablet 15a2118bc9914ddda2630ddb688ebaa9 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:05.695469  9678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492d90625d5e4006b85a116618e1ebdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.695451  9828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492d90625d5e4006b85a116618e1ebdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.698652  9752 tablet_service.cc:1511] Processing CreateTablet for tablet 15a2118bc9914ddda2630ddb688ebaa9 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:05.702373  9825 tablet_service.cc:1511] Processing CreateTablet for tablet b64e505f3a594381a9e50a8030c33783 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:05.691692  9753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492d90625d5e4006b85a116618e1ebdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.703784  9825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b64e505f3a594381a9e50a8030c33783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.705809  9900 tablet_service.cc:1511] Processing CreateTablet for tablet b64e505f3a594381a9e50a8030c33783 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:05.707178  9900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b64e505f3a594381a9e50a8030c33783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.714958  9676 tablet_service.cc:1511] Processing CreateTablet for tablet b64e505f3a594381a9e50a8030c33783 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:05.716167  9750 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0495f84dcd455a878471b702e53cdd (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:05.717569  9903 tablet_service.cc:1511] Processing CreateTablet for tablet 15a2118bc9914ddda2630ddb688ebaa9 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:05.720044  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd27b85a4d824953b7b73f36aff6acc9" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:05.720880  9839 raft_consensus.cc:2468] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:05.722440  9879 leader_election.cc:304] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:05.724980  9676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b64e505f3a594381a9e50a8030c33783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.725965  9899 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0495f84dcd455a878471b702e53cdd (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:05.724870  9964 raft_consensus.cc:2804] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.727499  9964 raft_consensus.cc:493] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.727887  9964 raft_consensus.cc:3060] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.728222  9674 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1663fd19784f6db7ea0fddb0fefb4c (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:05.730729  9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a2118bc9914ddda2630ddb688ebaa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.732784  9674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1663fd19784f6db7ea0fddb0fefb4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.736717  9749 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1663fd19784f6db7ea0fddb0fefb4c (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:05.739362  9826 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0495f84dcd455a878471b702e53cdd (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:05.745512  9752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a2118bc9914ddda2630ddb688ebaa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.747179  9903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a2118bc9914ddda2630ddb688ebaa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.758782  9959 tablet_bootstrap.cc:654] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.780709  9749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1663fd19784f6db7ea0fddb0fefb4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.781785  9750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0495f84dcd455a878471b702e53cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.793104  9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0495f84dcd455a878471b702e53cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.794757  9826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0495f84dcd455a878471b702e53cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.800269  9961 tablet_bootstrap.cc:492] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:05.800974  9961 ts_tablet_manager.cc:1403] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.204s	user 0.007s	sys 0.008s
I20260709 13:03:05.800513  9827 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1663fd19784f6db7ea0fddb0fefb4c (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:05.807086  9958 tablet_bootstrap.cc:492] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:05.807729  9958 ts_tablet_manager.cc:1403] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.389s	user 0.014s	sys 0.007s
I20260709 13:03:05.813474  9958 raft_consensus.cc:359] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:05.814270  9958 raft_consensus.cc:385] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.814569  9958 raft_consensus.cc:740] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.814627  9827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1663fd19784f6db7ea0fddb0fefb4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.806201  9964 raft_consensus.cc:515] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:05.823748  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd27b85a4d824953b7b73f36aff6acc9" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:05.824659  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd27b85a4d824953b7b73f36aff6acc9" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
W20260709 13:03:05.825249  9879 leader_election.cc:343] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.825379  9964 leader_election.cc:290] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:05.825289  9839 raft_consensus.cc:3060] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.804284  9961 raft_consensus.cc:359] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:05.833133  9961 raft_consensus.cc:385] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.833505  9961 raft_consensus.cc:740] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.834411  9839 raft_consensus.cc:2468] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:05.837277  9963 tablet_bootstrap.cc:492] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:05.837842  9963 ts_tablet_manager.cc:1403] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.224s	user 0.057s	sys 0.036s
I20260709 13:03:05.838425  9879 leader_election.cc:304] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:05.834304  9961 consensus_queue.cc:260] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:05.842201  9961 ts_tablet_manager.cc:1434] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:03:05.844012  9961 tablet_bootstrap.cc:492] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:05.848284  9958 consensus_queue.cc:260] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:05.842768  9964 raft_consensus.cc:2804] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.849298  9965 raft_consensus.cc:493] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.849812  9965 raft_consensus.cc:515] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:05.854838  9961 tablet_bootstrap.cc:654] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.858553  9965 leader_election.cc:290] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:05.861457  9963 raft_consensus.cc:359] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:05.861461  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44eaceee580a4f8c8edd343f46ce1b32" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:05.866999  9679 tablet_service.cc:1511] Processing CreateTablet for tablet 73b95221ddfd49cca2e58073915a692a (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:05.877552  9679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b95221ddfd49cca2e58073915a692a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.868062  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44eaceee580a4f8c8edd343f46ce1b32" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:05.881958  9731 leader_election.cc:343] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.870389  9900 tablet_service.cc:1511] Processing CreateTablet for tablet 73b95221ddfd49cca2e58073915a692a (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:05.869968  9829 tablet_service.cc:1511] Processing CreateTablet for tablet 12ec003b8fb0423eae15b72ac88ce69f (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:05.871930  9755 tablet_service.cc:1511] Processing CreateTablet for tablet 73b95221ddfd49cca2e58073915a692a (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:05.883957  9829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ec003b8fb0423eae15b72ac88ce69f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.883957  9900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b95221ddfd49cca2e58073915a692a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.884760  9963 raft_consensus.cc:385] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.888998  9963 raft_consensus.cc:740] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:05.889941  9963 consensus_queue.cc:260] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:05.890998  9690 raft_consensus.cc:2468] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:05.892195  9963 ts_tablet_manager.cc:1434] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:03:05.884783  9755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b95221ddfd49cca2e58073915a692a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.894832  9731 leader_election.cc:304] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:05.896304  9965 raft_consensus.cc:2804] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:05.896772  9965 raft_consensus.cc:493] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.897199  9965 raft_consensus.cc:3060] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.905710  9901 tablet_service.cc:1511] Processing CreateTablet for tablet 12ec003b8fb0423eae15b72ac88ce69f (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:05.907410  9964 raft_consensus.cc:697] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:05.908924  9964 consensus_queue.cc:237] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:05.911525  9677 tablet_service.cc:1511] Processing CreateTablet for tablet 12ec003b8fb0423eae15b72ac88ce69f (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:05.912631  9965 raft_consensus.cc:515] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:05.915073  9959 tablet_bootstrap.cc:492] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:05.913272  9963 tablet_bootstrap.cc:492] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:05.915621  9959 ts_tablet_manager.cc:1403] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.223s	user 0.011s	sys 0.004s
I20260709 13:03:05.922250  9825 tablet_service.cc:1511] Processing CreateTablet for tablet 048c260ea0264cacbc43596c71ecb9d4 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:05.923800  9825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 048c260ea0264cacbc43596c71ecb9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.923516  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44eaceee580a4f8c8edd343f46ce1b32" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:05.924314  9690 raft_consensus.cc:3060] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:05.925436  9965 leader_election.cc:290] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:05.926275  9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ec003b8fb0423eae15b72ac88ce69f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.929903  9753 tablet_service.cc:1511] Processing CreateTablet for tablet 048c260ea0264cacbc43596c71ecb9d4 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:05.931068  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44eaceee580a4f8c8edd343f46ce1b32" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:05.931484  9753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 048c260ea0264cacbc43596c71ecb9d4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:05.932804  9731 leader_election.cc:343] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:05.943183  9902 tablet_service.cc:1511] Processing CreateTablet for tablet 048c260ea0264cacbc43596c71ecb9d4 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:05.952631  9676 tablet_service.cc:1511] Processing CreateTablet for tablet 6dfed6059cc642b290ce15a921704fc4 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:05.953655  9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 048c260ea0264cacbc43596c71ecb9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.954403  9898 tablet_service.cc:1511] Processing CreateTablet for tablet 03e983261153492e83602412c376fa6f (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:05.954867  9827 tablet_service.cc:1511] Processing CreateTablet for tablet 6dfed6059cc642b290ce15a921704fc4 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:05.955470  9958 ts_tablet_manager.cc:1434] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.147s	user 0.009s	sys 0.005s
I20260709 13:03:05.955860  9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e983261153492e83602412c376fa6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.956138  9827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dfed6059cc642b290ce15a921704fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.958374  9749 tablet_service.cc:1511] Processing CreateTablet for tablet 6dfed6059cc642b290ce15a921704fc4 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:05.963397  9749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dfed6059cc642b290ce15a921704fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.961256  9972 raft_consensus.cc:493] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.963925  9690 raft_consensus.cc:2468] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:05.963982  9972 raft_consensus.cc:515] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:05.961946  9959 raft_consensus.cc:359] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:05.958925  9958 tablet_bootstrap.cc:492] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:05.966825  9959 raft_consensus.cc:385] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:05.968400  9731 leader_election.cc:304] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:05.948338  9963 tablet_bootstrap.cc:654] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:05.970676  9679 tablet_service.cc:1511] Processing CreateTablet for tablet 03e983261153492e83602412c376fa6f (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:05.979641  9981 raft_consensus.cc:2804] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:05.980270  9981 raft_consensus.cc:697] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:05.982000  9981 consensus_queue.cc:237] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:05.982308  9829 tablet_service.cc:1511] Processing CreateTablet for tablet 4d42567f00fd44cabc99c217e4df31d8 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:05.980553  9754 tablet_service.cc:1511] Processing CreateTablet for tablet 03e983261153492e83602412c376fa6f (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:05.984066  9829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d42567f00fd44cabc99c217e4df31d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.972746  9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ec003b8fb0423eae15b72ac88ce69f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.976432  9959 raft_consensus.cc:740] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.004768  9754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e983261153492e83602412c376fa6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.007342  9680 tablet_service.cc:1511] Processing CreateTablet for tablet 4d42567f00fd44cabc99c217e4df31d8 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:06.008700  9679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e983261153492e83602412c376fa6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.009471  9680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d42567f00fd44cabc99c217e4df31d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.009018  9588 catalog_manager.cc:5697] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.997529  9972 leader_election.cc:290] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:06.019347  9964 raft_consensus.cc:493] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.020298  9958 tablet_bootstrap.cc:654] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.019963  9964 raft_consensus.cc:515] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:06.021183  9959 consensus_queue.cc:260] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:06.054563  9752 tablet_service.cc:1511] Processing CreateTablet for tablet f36b261dca1448a8976c337d0adca949 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:06.056241  9752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36b261dca1448a8976c337d0adca949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.057606  9899 tablet_service.cc:1511] Processing CreateTablet for tablet 4d42567f00fd44cabc99c217e4df31d8 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:06.055105  9676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dfed6059cc642b290ce15a921704fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.059325  9961 tablet_bootstrap.cc:492] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:06.077319  9961 ts_tablet_manager.cc:1403] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.234s	user 0.017s	sys 0.004s
I20260709 13:03:06.083156  9959 ts_tablet_manager.cc:1434] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.167s	user 0.006s	sys 0.007s
I20260709 13:03:06.087735  9828 tablet_service.cc:1511] Processing CreateTablet for tablet f36b261dca1448a8976c337d0adca949 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:06.101503  9828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36b261dca1448a8976c337d0adca949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.101558  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e792dd7473944b79554c8d6ad554fab" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:06.103225  9879 leader_election.cc:343] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:06.075974  9897 tablet_service.cc:1511] Processing CreateTablet for tablet f36b261dca1448a8976c337d0adca949 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:06.093132  9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d42567f00fd44cabc99c217e4df31d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.094491  9750 tablet_service.cc:1511] Processing CreateTablet for tablet d7fb824343684771b7c7042727a90e40 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:06.105780  9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36b261dca1448a8976c337d0adca949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.106540  9750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7fb824343684771b7c7042727a90e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.109503  9959 tablet_bootstrap.cc:492] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:06.095975  9674 tablet_service.cc:1511] Processing CreateTablet for tablet d7fb824343684771b7c7042727a90e40 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:06.114226  9674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7fb824343684771b7c7042727a90e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.099673  9961 raft_consensus.cc:359] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:06.120827  9961 raft_consensus.cc:385] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.120990  9964 leader_election.cc:290] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:06.121236  9961 raft_consensus.cc:740] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.122403  9963 tablet_bootstrap.cc:492] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:06.123116  9963 ts_tablet_manager.cc:1403] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.210s	user 0.007s	sys 0.012s
I20260709 13:03:06.139127  9826 tablet_service.cc:1511] Processing CreateTablet for tablet d7fb824343684771b7c7042727a90e40 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:06.140573  9826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7fb824343684771b7c7042727a90e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.140697  9961 consensus_queue.cc:260] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:06.143308  9961 ts_tablet_manager.cc:1434] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.002s
I20260709 13:03:06.167577  9964 raft_consensus.cc:493] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.168398  9964 raft_consensus.cc:515] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:06.174611  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df66a70431354160b6aa78186f21c43b" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:06.175606  9839 raft_consensus.cc:2468] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:06.177534  9879 leader_election.cc:304] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:06.179121  9979 raft_consensus.cc:2804] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:06.179677  9979 raft_consensus.cc:493] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.180270  9979 raft_consensus.cc:3060] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:06.189517  9964 leader_election.cc:290] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:06.197014  9979 raft_consensus.cc:515] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:06.205850  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df66a70431354160b6aa78186f21c43b" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:06.206698  9839 raft_consensus.cc:3060] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:06.208259  9963 raft_consensus.cc:359] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:06.209193  9963 raft_consensus.cc:385] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.209681  9963 raft_consensus.cc:740] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.211051  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceffadfaf404425f90705c5a6e0e60bc" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
W20260709 13:03:06.213629  9654 leader_election.cc:343] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:06.215679  9839 raft_consensus.cc:2468] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:06.216096  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceffadfaf404425f90705c5a6e0e60bc" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
W20260709 13:03:06.217994  9656 leader_election.cc:343] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:06.218465  9656 leader_election.cc:304] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:06.219596  9972 raft_consensus.cc:2749] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:06.219970  9902 tablet_service.cc:1511] Processing CreateTablet for tablet e53ce2e48bf64a4cac0e42aed1e3ac61 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:06.242327  9979 leader_election.cc:290] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:06.260351  9959 tablet_bootstrap.cc:654] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.261046  9827 tablet_service.cc:1511] Processing CreateTablet for tablet 165514a80df44205b5aee88c4509ba6e (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:06.262708  9827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 165514a80df44205b5aee88c4509ba6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.252926  9879 leader_election.cc:304] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:06.252460  9961 tablet_bootstrap.cc:492] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:06.266557  9964 raft_consensus.cc:2804] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:06.267975  9898 tablet_service.cc:1511] Processing CreateTablet for tablet 165514a80df44205b5aee88c4509ba6e (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:06.256923  9753 tablet_service.cc:1511] Processing CreateTablet for tablet e53ce2e48bf64a4cac0e42aed1e3ac61 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:06.271425  9753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e53ce2e48bf64a4cac0e42aed1e3ac61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.257248  9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e53ce2e48bf64a4cac0e42aed1e3ac61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.286790  9680 tablet_service.cc:1511] Processing CreateTablet for tablet e53ce2e48bf64a4cac0e42aed1e3ac61 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:06.288457  9680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e53ce2e48bf64a4cac0e42aed1e3ac61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.249276  9963 consensus_queue.cc:260] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
W20260709 13:03:06.296662  9636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:06.297191  9677 tablet_service.cc:1511] Processing CreateTablet for tablet 165514a80df44205b5aee88c4509ba6e (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:06.305779  9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 165514a80df44205b5aee88c4509ba6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.308761  9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 165514a80df44205b5aee88c4509ba6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.310712  9963 ts_tablet_manager.cc:1434] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.187s	user 0.011s	sys 0.000s
I20260709 13:03:06.323544  9975 raft_consensus.cc:493] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.324172  9975 raft_consensus.cc:515] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:06.330608  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e792dd7473944b79554c8d6ad554fab" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:06.332120  9975 leader_election.cc:290] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:06.323621  9963 tablet_bootstrap.cc:492] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:06.272647  9586 catalog_manager.cc:5697] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:06.322119  9964 raft_consensus.cc:697] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:06.335491  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df66a70431354160b6aa78186f21c43b" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:06.351125  9764 raft_consensus.cc:3060] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:06.351411  9959 tablet_bootstrap.cc:492] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:06.352051  9959 ts_tablet_manager.cc:1403] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.243s	user 0.014s	sys 0.036s
I20260709 13:03:06.344816  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df66a70431354160b6aa78186f21c43b" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
W20260709 13:03:06.355680  9879 consensus_peers.cc:597] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.353619  9754 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbf0dc7bcfe41e58f7c298165f4d2b5 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:06.357575  9754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbf0dc7bcfe41e58f7c298165f4d2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.366715  9972 raft_consensus.cc:493] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.367304  9972 raft_consensus.cc:515] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:06.369937  9972 leader_election.cc:290] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:06.356066  9959 raft_consensus.cc:359] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:06.384555  9958 tablet_bootstrap.cc:492] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:06.384052  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad36487cbe42f3adf25a44fa2b1b62" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:06.385149  9958 ts_tablet_manager.cc:1403] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.426s	user 0.041s	sys 0.036s
W20260709 13:03:06.386533  9654 leader_election.cc:343] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:06.400141  9963 tablet_bootstrap.cc:654] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.404091  9994 consensus_queue.cc:1048] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:06.401804  9959 raft_consensus.cc:385] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.405366  9959 raft_consensus.cc:740] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.405550  9828 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbf0dc7bcfe41e58f7c298165f4d2b5 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:06.406209  9959 consensus_queue.cc:260] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:06.407059  9828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbf0dc7bcfe41e58f7c298165f4d2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.409375  9901 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbf0dc7bcfe41e58f7c298165f4d2b5 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:06.410782  9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbf0dc7bcfe41e58f7c298165f4d2b5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:06.431450  9990 log.cc:927] Time spent T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:03:06.421864  9964 consensus_queue.cc:237] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
W20260709 13:03:06.404342  9877 leader_election.cc:343] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:06.388280  9958 raft_consensus.cc:359] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:06.447842  9675 tablet_service.cc:1511] Processing CreateTablet for tablet 47136b305fde43d8b8b8af12cecd9750 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:06.452948  9961 tablet_bootstrap.cc:654] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.440864  9959 ts_tablet_manager.cc:1434] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.088s	user 0.012s	sys 0.000s
I20260709 13:03:06.460330  9959 tablet_bootstrap.cc:492] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:06.454035  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f57279c5dc4c9a8a1d2c4a65a1c167" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:06.463863  9805 leader_election.cc:343] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:06.457625  9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47136b305fde43d8b8b8af12cecd9750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.470081  9877 leader_election.cc:304] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:06.471060  9994 raft_consensus.cc:2749] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:06.471236  9877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:44623, user_credentials={real_user=slave}} blocked reactor thread for 67099.6us
I20260709 13:03:06.477174  9750 tablet_service.cc:1511] Processing CreateTablet for tablet 47136b305fde43d8b8b8af12cecd9750 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:06.478638  9750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47136b305fde43d8b8b8af12cecd9750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.455963  9958 raft_consensus.cc:385] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.456457  9764 raft_consensus.cc:2468] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:06.499547  9897 tablet_service.cc:1511] Processing CreateTablet for tablet 3f858210936a4559a877f1628213432c (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:06.487643  9958 raft_consensus.cc:740] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.509883  9981 consensus_queue.cc:1048] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:06.525609  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f57279c5dc4c9a8a1d2c4a65a1c167" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:06.523490  9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f858210936a4559a877f1628213432c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.533030  9958 consensus_queue.cc:260] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
W20260709 13:03:06.535002  9731 consensus_peers.cc:597] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 -> Peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Couldn't send request to peer 451c871fd36f4d95a76b62d041aa7b60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.535810  9676 tablet_service.cc:1511] Processing CreateTablet for tablet 3f858210936a4559a877f1628213432c (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:06.537298  9676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f858210936a4559a877f1628213432c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.539337  9755 tablet_service.cc:1511] Processing CreateTablet for tablet 3f858210936a4559a877f1628213432c (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:06.540889  9755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f858210936a4559a877f1628213432c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.545889  9827 tablet_service.cc:1511] Processing CreateTablet for tablet 47136b305fde43d8b8b8af12cecd9750 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:06.542146  9958 ts_tablet_manager.cc:1434] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.157s	user 0.009s	sys 0.000s
I20260709 13:03:06.553323  9827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47136b305fde43d8b8b8af12cecd9750. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:06.556154  9802 leader_election.cc:343] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:06.556830  9802 leader_election.cc:304] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:06.567793  9959 tablet_bootstrap.cc:654] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.570134  9963 tablet_bootstrap.cc:492] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:06.570819  9963 ts_tablet_manager.cc:1403] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.247s	user 0.017s	sys 0.026s
I20260709 13:03:06.558785  9975 raft_consensus.cc:2749] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:06.574091  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad36487cbe42f3adf25a44fa2b1b62" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:06.574874  9913 raft_consensus.cc:2468] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:06.576747  9653 leader_election.cc:304] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:06.581566  9826 tablet_service.cc:1511] Processing CreateTablet for tablet 12b5370a6691486895274f9b937bbb1e (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:06.584101  9972 raft_consensus.cc:2804] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:06.584735  9826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b5370a6691486895274f9b937bbb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.585659  9972 raft_consensus.cc:493] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.586078  9972 raft_consensus.cc:3060] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:06.591825  9899 tablet_service.cc:1511] Processing CreateTablet for tablet 12b5370a6691486895274f9b937bbb1e (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:06.593288  9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b5370a6691486895274f9b937bbb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.588114  9587 catalog_manager.cc:5697] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:06.564138  9958 tablet_bootstrap.cc:492] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:06.600900  9677 tablet_service.cc:1511] Processing CreateTablet for tablet 12b5370a6691486895274f9b937bbb1e (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:06.602484  9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b5370a6691486895274f9b937bbb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.615674  9972 raft_consensus.cc:515] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:06.621305  9753 tablet_service.cc:1511] Processing CreateTablet for tablet 752cedead4aa452ba24e59e59abfccfc (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:06.631103  9753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752cedead4aa452ba24e59e59abfccfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.631404  9961 tablet_bootstrap.cc:492] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:06.632053  9961 ts_tablet_manager.cc:1403] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.386s	user 0.019s	sys 0.002s
I20260709 13:03:06.625308  9898 tablet_service.cc:1511] Processing CreateTablet for tablet 752cedead4aa452ba24e59e59abfccfc (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:06.626524  9963 raft_consensus.cc:359] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:06.636308  9963 raft_consensus.cc:385] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.636731  9963 raft_consensus.cc:740] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.629591  9680 tablet_service.cc:1511] Processing CreateTablet for tablet e4079962b0054d1c828d8ab946214dfa (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:06.636463  9958 tablet_bootstrap.cc:654] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.637063  9961 raft_consensus.cc:359] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:06.642554  9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752cedead4aa452ba24e59e59abfccfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.645185  9680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4079962b0054d1c828d8ab946214dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.637555  9963 consensus_queue.cc:260] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:06.652189  9961 raft_consensus.cc:385] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.678476  9972 leader_election.cc:290] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:06.685243  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad36487cbe42f3adf25a44fa2b1b62" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:06.685883  9913 raft_consensus.cc:3060] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:06.694803  9958 tablet_bootstrap.cc:492] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:06.695420  9958 ts_tablet_manager.cc:1403] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.137s	user 0.023s	sys 0.007s
I20260709 13:03:06.696065  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad36487cbe42f3adf25a44fa2b1b62" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:06.696779  9764 raft_consensus.cc:3060] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:06.703208  9897 tablet_service.cc:1511] Processing CreateTablet for tablet 11c560f6bb9c4ebfa538d60759ae2739 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:06.704515  9825 tablet_service.cc:1511] Processing CreateTablet for tablet e4079962b0054d1c828d8ab946214dfa (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:06.705575  9676 tablet_service.cc:1511] Processing CreateTablet for tablet 11c560f6bb9c4ebfa538d60759ae2739 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:06.706023  9825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4079962b0054d1c828d8ab946214dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.705008  9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c560f6bb9c4ebfa538d60759ae2739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.674726  9961 raft_consensus.cc:740] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.718693  9958 raft_consensus.cc:359] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:06.719866  9958 raft_consensus.cc:385] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.720261  9958 raft_consensus.cc:740] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.725931  9959 tablet_bootstrap.cc:492] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:06.725193  9958 consensus_queue.cc:260] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:06.726518  9959 ts_tablet_manager.cc:1403] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.266s	user 0.011s	sys 0.011s
I20260709 13:03:06.729086  9958 ts_tablet_manager.cc:1434] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 13:03:06.728928  9827 tablet_service.cc:1511] Processing CreateTablet for tablet dd42823bee8f4722a5f2b15fc1a3dac5 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:06.730369  9827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd42823bee8f4722a5f2b15fc1a3dac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.730666  9958 tablet_bootstrap.cc:492] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:06.715488  9961 consensus_queue.cc:260] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:06.737100  9676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c560f6bb9c4ebfa538d60759ae2739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.741060  9958 tablet_bootstrap.cc:654] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.744508  9961 ts_tablet_manager.cc:1434] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.000s
I20260709 13:03:06.745782  9961 tablet_bootstrap.cc:492] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:06.747097  9755 tablet_service.cc:1511] Processing CreateTablet for tablet e4079962b0054d1c828d8ab946214dfa (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:06.748557  9755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4079962b0054d1c828d8ab946214dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.713044  9828 tablet_service.cc:1511] Processing CreateTablet for tablet 752cedead4aa452ba24e59e59abfccfc (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:06.709360  9913 raft_consensus.cc:2468] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:06.758673  9653 leader_election.cc:304] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:06.759939  9753 tablet_service.cc:1511] Processing CreateTablet for tablet 11c560f6bb9c4ebfa538d60759ae2739 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:06.759977  9972 raft_consensus.cc:2804] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:06.761723  9753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c560f6bb9c4ebfa538d60759ae2739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.761893  9972 raft_consensus.cc:697] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:06.762825  9972 consensus_queue.cc:237] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:06.722055  9764 raft_consensus.cc:2468] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:06.765975  9828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752cedead4aa452ba24e59e59abfccfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.783972  9899 tablet_service.cc:1511] Processing CreateTablet for tablet dd42823bee8f4722a5f2b15fc1a3dac5 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:06.785686  9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd42823bee8f4722a5f2b15fc1a3dac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.791109  9675 tablet_service.cc:1511] Processing CreateTablet for tablet dd42823bee8f4722a5f2b15fc1a3dac5 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:06.798070  9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd42823bee8f4722a5f2b15fc1a3dac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.810695  9750 tablet_service.cc:1511] Processing CreateTablet for tablet 8e878af3a78b443b8f7eb3a54f069a57 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:06.812186  9750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e878af3a78b443b8f7eb3a54f069a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.818188  9898 tablet_service.cc:1511] Processing CreateTablet for tablet 8e878af3a78b443b8f7eb3a54f069a57 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:06.819671  9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e878af3a78b443b8f7eb3a54f069a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.821760  9677 tablet_service.cc:1511] Processing CreateTablet for tablet 2169bc2b2ef940d0a49aeb2d93d1db5a (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:06.823390  9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2169bc2b2ef940d0a49aeb2d93d1db5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.825850  9754 tablet_service.cc:1511] Processing CreateTablet for tablet 2169bc2b2ef940d0a49aeb2d93d1db5a (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:06.827800  9754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2169bc2b2ef940d0a49aeb2d93d1db5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.833815  9959 raft_consensus.cc:359] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:06.834757  9959 raft_consensus.cc:385] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.835107  9959 raft_consensus.cc:740] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.837091  9587 catalog_manager.cc:5697] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:06.825883  9826 tablet_service.cc:1511] Processing CreateTablet for tablet 8e878af3a78b443b8f7eb3a54f069a57 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:06.841562  9963 ts_tablet_manager.cc:1434] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.270s	user 0.028s	sys 0.051s
I20260709 13:03:06.842299  9826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e878af3a78b443b8f7eb3a54f069a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.842897  9963 tablet_bootstrap.cc:492] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:06.850728  9958 tablet_bootstrap.cc:492] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:06.850960  9964 consensus_queue.cc:1048] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:06.851434  9958 ts_tablet_manager.cc:1403] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.121s	user 0.022s	sys 0.034s
I20260709 13:03:06.854902  9958 raft_consensus.cc:359] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:06.856385  9958 raft_consensus.cc:385] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.856805  9958 raft_consensus.cc:740] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.857959  9958 consensus_queue.cc:260] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:06.860283  9958 ts_tablet_manager.cc:1434] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:03:06.861428  9958 tablet_bootstrap.cc:492] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:06.874627  9898 tablet_service.cc:1511] Processing CreateTablet for tablet 76a88ee2ae1f4e17826b23090e31bf02 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:06.876040  9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a88ee2ae1f4e17826b23090e31bf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.836036  9959 consensus_queue.cc:260] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:06.890628  9961 tablet_bootstrap.cc:654] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.890404  9899 tablet_service.cc:1511] Processing CreateTablet for tablet 5b91b2a3a4a24086b9e05f782ee36615 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:06.891875  9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b91b2a3a4a24086b9e05f782ee36615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.891497  9749 tablet_service.cc:1511] Processing CreateTablet for tablet 76a88ee2ae1f4e17826b23090e31bf02 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:06.897931  9959 ts_tablet_manager.cc:1434] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.171s	user 0.004s	sys 0.007s
I20260709 13:03:06.898716  9749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a88ee2ae1f4e17826b23090e31bf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.898802  9676 tablet_service.cc:1511] Processing CreateTablet for tablet 76a88ee2ae1f4e17826b23090e31bf02 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:06.901329  9676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a88ee2ae1f4e17826b23090e31bf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.901907  9679 tablet_service.cc:1511] Processing CreateTablet for tablet 5b91b2a3a4a24086b9e05f782ee36615 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:06.903820  9679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b91b2a3a4a24086b9e05f782ee36615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.923974  9828 tablet_service.cc:1511] Processing CreateTablet for tablet 5b91b2a3a4a24086b9e05f782ee36615 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:06.925300  9828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b91b2a3a4a24086b9e05f782ee36615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.931102  9958 tablet_bootstrap.cc:654] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.936616  9979 consensus_queue.cc:1048] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:06.931845  9752 tablet_service.cc:1511] Processing CreateTablet for tablet f4213d5ed7d5428aa77410084c68a98b (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:06.947376  9752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4213d5ed7d5428aa77410084c68a98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.949858  9901 tablet_service.cc:1511] Processing CreateTablet for tablet f4213d5ed7d5428aa77410084c68a98b (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:06.951267  9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4213d5ed7d5428aa77410084c68a98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.899253  9959 tablet_bootstrap.cc:492] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:06.964107  9963 tablet_bootstrap.cc:654] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.966604  9829 tablet_service.cc:1511] Processing CreateTablet for tablet f4213d5ed7d5428aa77410084c68a98b (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:06.968279  9829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4213d5ed7d5428aa77410084c68a98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.990211  9755 tablet_service.cc:1511] Processing CreateTablet for tablet 55fdf0e57b3341a1a01a23f13df81770 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:06.992378  9755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55fdf0e57b3341a1a01a23f13df81770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.018817  9677 tablet_service.cc:1511] Processing CreateTablet for tablet 55fdf0e57b3341a1a01a23f13df81770 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:07.021040  9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55fdf0e57b3341a1a01a23f13df81770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.959390  9825 tablet_service.cc:1511] Processing CreateTablet for tablet 2169bc2b2ef940d0a49aeb2d93d1db5a (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:07.036194  9964 raft_consensus.cc:493] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.036835  9964 raft_consensus.cc:515] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:07.039420  9964 leader_election.cc:290] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:07.040942  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f57279c5dc4c9a8a1d2c4a65a1c167" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:07.041874  9959 tablet_bootstrap.cc:654] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.036768  9825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2169bc2b2ef940d0a49aeb2d93d1db5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.042143  9828 tablet_service.cc:1511] Processing CreateTablet for tablet 55fdf0e57b3341a1a01a23f13df81770 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:07.043623  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f57279c5dc4c9a8a1d2c4a65a1c167" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:07.044348  9838 raft_consensus.cc:2468] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:07.050069  9828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55fdf0e57b3341a1a01a23f13df81770. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:07.048728  9879 leader_election.cc:343] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.061614  9838 raft_consensus.cc:3060] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.061880  9879 leader_election.cc:304] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:07.062652  9897 tablet_service.cc:1511] Processing CreateTablet for tablet ef635d06ca2448f098dadbba833fa52c (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:07.063469  9964 raft_consensus.cc:2804] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:07.064041  9897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef635d06ca2448f098dadbba833fa52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.064216  9964 raft_consensus.cc:493] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.064786  9964 raft_consensus.cc:3060] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.068035  9958 tablet_bootstrap.cc:492] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:07.068691  9958 ts_tablet_manager.cc:1403] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.207s	user 0.032s	sys 0.056s
I20260709 13:03:07.070341  9961 tablet_bootstrap.cc:492] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:07.070922  9961 ts_tablet_manager.cc:1403] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.325s	user 0.022s	sys 0.044s
I20260709 13:03:07.071521  9826 tablet_service.cc:1511] Processing CreateTablet for tablet ef635d06ca2448f098dadbba833fa52c (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:07.074909  9676 tablet_service.cc:1511] Processing CreateTablet for tablet 38dadd5ead404b82a843d64283e7f2a1 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:07.080901  9676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38dadd5ead404b82a843d64283e7f2a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.084327 10016 raft_consensus.cc:493] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.084962 10016 raft_consensus.cc:515] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:07.089027  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e792dd7473944b79554c8d6ad554fab" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:07.089426  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e792dd7473944b79554c8d6ad554fab" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:07.089766  9764 raft_consensus.cc:2468] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:07.089600  9754 tablet_service.cc:1511] Processing CreateTablet for tablet 38dadd5ead404b82a843d64283e7f2a1 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:07.090255  9913 raft_consensus.cc:2468] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:07.098361  9753 tablet_service.cc:1511] Processing CreateTablet for tablet 00d0bc42f3174047b43f78e52fcfbd04 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:07.100004  9654 leader_election.cc:304] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:07.101539  9972 raft_consensus.cc:2804] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:07.102094  9972 raft_consensus.cc:493] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.102543  9972 raft_consensus.cc:3060] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.103657  9828 tablet_service.cc:1511] Processing CreateTablet for tablet 00d0bc42f3174047b43f78e52fcfbd04 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:07.104923  9826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef635d06ca2448f098dadbba833fa52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.105726  9828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d0bc42f3174047b43f78e52fcfbd04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.109505  9898 tablet_service.cc:1511] Processing CreateTablet for tablet 38dadd5ead404b82a843d64283e7f2a1 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:07.111053  9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38dadd5ead404b82a843d64283e7f2a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.091346  9754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38dadd5ead404b82a843d64283e7f2a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.091354 10016 leader_election.cc:290] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:07.121160  9675 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2b7abebcdc4cbbac180a3762ad607b (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:07.122661  9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2b7abebcdc4cbbac180a3762ad607b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.121160  9899 tablet_service.cc:1511] Processing CreateTablet for tablet 00d0bc42f3174047b43f78e52fcfbd04 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:07.133882  9679 tablet_service.cc:1511] Processing CreateTablet for tablet ef635d06ca2448f098dadbba833fa52c (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:07.137619  9749 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2b7abebcdc4cbbac180a3762ad607b (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:07.143570  9828 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2b7abebcdc4cbbac180a3762ad607b (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:03:07.148185  9653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:36227, user_credentials={real_user=slave}} blocked reactor thread for 51445.9us
I20260709 13:03:07.150733  9901 tablet_service.cc:1511] Processing CreateTablet for tablet 839d06ab83a14f179212ace3780771f2 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:07.155771  9752 tablet_service.cc:1511] Processing CreateTablet for tablet 839d06ab83a14f179212ace3780771f2 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:07.158679  9827 tablet_service.cc:1511] Processing CreateTablet for tablet d1d0271039c54d29bb678ff19e90a76a (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:07.159617  9902 tablet_service.cc:1511] Processing CreateTablet for tablet d1d0271039c54d29bb678ff19e90a76a (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:07.160390  9675 tablet_service.cc:1511] Processing CreateTablet for tablet 839d06ab83a14f179212ace3780771f2 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:07.160660  9679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef635d06ca2448f098dadbba833fa52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.164918  9677 tablet_service.cc:1511] Processing CreateTablet for tablet d1d0271039c54d29bb678ff19e90a76a (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:07.166587  9755 tablet_service.cc:1511] Processing CreateTablet for tablet 36e6a4d52c8045909369ffe63bfc03dc (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:07.167836  9963 tablet_bootstrap.cc:492] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:07.136727  9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d0bc42f3174047b43f78e52fcfbd04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.175751  9828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2b7abebcdc4cbbac180a3762ad607b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.173800  9824 tablet_service.cc:1511] Processing CreateTablet for tablet 36e6a4d52c8045909369ffe63bfc03dc (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:07.183362  9753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d0bc42f3174047b43f78e52fcfbd04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.190685  9750 tablet_service.cc:1511] Processing CreateTablet for tablet fa904b1a1a63492ca9d5820c1984c7e8 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:07.190964  9680 tablet_service.cc:1511] Processing CreateTablet for tablet fa904b1a1a63492ca9d5820c1984c7e8 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:07.191385  9903 tablet_service.cc:1511] Processing CreateTablet for tablet 36e6a4d52c8045909369ffe63bfc03dc (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:07.194813  9827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d0271039c54d29bb678ff19e90a76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.202006 10016 consensus_queue.cc:1048] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:07.203644  9963 ts_tablet_manager.cc:1403] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.361s	user 0.013s	sys 0.012s
I20260709 13:03:07.210287  9749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2b7abebcdc4cbbac180a3762ad607b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.211709  9750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa904b1a1a63492ca9d5820c1984c7e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.203234  9961 raft_consensus.cc:359] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.212775  9961 raft_consensus.cc:385] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.213210  9961 raft_consensus.cc:740] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.177522  9964 raft_consensus.cc:515] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:07.219784  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f57279c5dc4c9a8a1d2c4a65a1c167" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:07.220917  9837 raft_consensus.cc:3060] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.226989  9961 consensus_queue.cc:260] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.230391  9961 ts_tablet_manager.cc:1434] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.159s	user 0.007s	sys 0.004s
I20260709 13:03:07.231926  9961 tablet_bootstrap.cc:492] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:07.235350  9837 raft_consensus.cc:2468] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:07.236934  9879 leader_election.cc:304] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:07.237918  9979 raft_consensus.cc:2804] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:07.238706  9979 raft_consensus.cc:697] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:07.238788  9963 raft_consensus.cc:359] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:07.239748  9963 raft_consensus.cc:385] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.240070  9963 raft_consensus.cc:740] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.240348  9900 tablet_service.cc:1511] Processing CreateTablet for tablet e17ab55de9cb48ea8add7a3b93294673 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:07.239758  9979 consensus_queue.cc:237] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:07.241858  9900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17ab55de9cb48ea8add7a3b93294673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.249665  9680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa904b1a1a63492ca9d5820c1984c7e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.250499  9824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e6a4d52c8045909369ffe63bfc03dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.250916  9751 tablet_service.cc:1511] Processing CreateTablet for tablet e17ab55de9cb48ea8add7a3b93294673 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:07.258033  9675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839d06ab83a14f179212ace3780771f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.258564  9896 tablet_service.cc:1511] Processing CreateTablet for tablet bcb34d3df6d146e7b2406dafa071fd52 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:07.260823  9755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e6a4d52c8045909369ffe63bfc03dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.261641  9752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839d06ab83a14f179212ace3780771f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.262111  9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d0271039c54d29bb678ff19e90a76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.263690 10016 consensus_queue.cc:1048] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:07.264808  9901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839d06ab83a14f179212ace3780771f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.266978  9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d0271039c54d29bb678ff19e90a76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.269016  9751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17ab55de9cb48ea8add7a3b93294673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.272372  9896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb34d3df6d146e7b2406dafa071fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.276968  9903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36e6a4d52c8045909369ffe63bfc03dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.285075  9958 raft_consensus.cc:359] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:07.285303  9963 consensus_queue.cc:260] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:07.285966  9958 raft_consensus.cc:385] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.286316  9958 raft_consensus.cc:740] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.287189  9958 consensus_queue.cc:260] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:07.288452 10016 raft_consensus.cc:493] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.288964 10016 raft_consensus.cc:515] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:07.292382 10016 leader_election.cc:290] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:07.295083  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f57279c5dc4c9a8a1d2c4a65a1c167" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:07.287915  9963 ts_tablet_manager.cc:1434] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.001s
I20260709 13:03:07.304476  9748 tablet_service.cc:1511] Processing CreateTablet for tablet 0396d5b67f85469b9963a11345ace667 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:07.311040  9748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0396d5b67f85469b9963a11345ace667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.310745  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f57279c5dc4c9a8a1d2c4a65a1c167" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:07.311708  9690 raft_consensus.cc:3060] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.319370  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f57279c5dc4c9a8a1d2c4a65a1c167" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:07.320307  9839 raft_consensus.cc:2393] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in current term 1: Already voted for candidate 8557220d7e6a4ccbbef222e80a5584a5 in this term.
I20260709 13:03:07.316547  9963 tablet_bootstrap.cc:492] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:07.308117  9964 leader_election.cc:290] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:07.323724  9656 leader_election.cc:304] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:07.326820  9674 tablet_service.cc:1511] Processing CreateTablet for tablet e17ab55de9cb48ea8add7a3b93294673 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:07.327133  9678 tablet_service.cc:1511] Processing CreateTablet for tablet bcb34d3df6d146e7b2406dafa071fd52 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:07.328321  9674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17ab55de9cb48ea8add7a3b93294673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.329814  9823 tablet_service.cc:1511] Processing CreateTablet for tablet 0396d5b67f85469b9963a11345ace667 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:07.331288  9823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0396d5b67f85469b9963a11345ace667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.332878 10010 raft_consensus.cc:493] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.333406 10010 raft_consensus.cc:515] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.335552 10010 leader_election.cc:290] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:07.327975  9828 tablet_service.cc:1511] Processing CreateTablet for tablet bcb34d3df6d146e7b2406dafa071fd52 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:07.337080  9828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb34d3df6d146e7b2406dafa071fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.184623  9972 raft_consensus.cc:515] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
W20260709 13:03:07.363224  9636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:07.331664  9690 raft_consensus.cc:2468] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:07.380091  9829 tablet_service.cc:1511] Processing CreateTablet for tablet fa904b1a1a63492ca9d5820c1984c7e8 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:07.380702  9899 tablet_service.cc:1511] Processing CreateTablet for tablet 0396d5b67f85469b9963a11345ace667 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:07.381531  9829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa904b1a1a63492ca9d5820c1984c7e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.382076  9899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0396d5b67f85469b9963a11345ace667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.382756  9959 tablet_bootstrap.cc:492] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:07.383283  9959 ts_tablet_manager.cc:1403] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.484s	user 0.025s	sys 0.018s
I20260709 13:03:07.384986  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceffadfaf404425f90705c5a6e0e60bc" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:07.385725  9689 raft_consensus.cc:2468] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:07.387167  9731 leader_election.cc:304] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:07.388113 10010 raft_consensus.cc:2804] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:07.388473 10010 raft_consensus.cc:493] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.388823 10010 raft_consensus.cc:3060] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.395438  9747 tablet_service.cc:1511] Processing CreateTablet for tablet 1359e0d2d58948c199c04b275867bffd (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:07.397122  9747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1359e0d2d58948c199c04b275867bffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.403491 10010 raft_consensus.cc:515] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.407212  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e792dd7473944b79554c8d6ad554fab" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:07.407944  9765 raft_consensus.cc:3060] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.413702  9676 tablet_service.cc:1511] Processing CreateTablet for tablet 1359e0d2d58948c199c04b275867bffd (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:07.365144  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceffadfaf404425f90705c5a6e0e60bc" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:07.416628  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e792dd7473944b79554c8d6ad554fab" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:07.463514  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceffadfaf404425f90705c5a6e0e60bc" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:07.444367  9958 ts_tablet_manager.cc:1434] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.375s	user 0.007s	sys 0.002s
I20260709 13:03:07.466702  9689 raft_consensus.cc:3060] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.467222  9972 leader_election.cc:290] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:07.469247  9839 raft_consensus.cc:2468] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:07.468443  9958 tablet_bootstrap.cc:492] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:07.378707  9678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb34d3df6d146e7b2406dafa071fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.375483 10016 raft_consensus.cc:2749] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:07.488834  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceffadfaf404425f90705c5a6e0e60bc" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:07.489830  9837 raft_consensus.cc:3060] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.490751  9963 tablet_bootstrap.cc:654] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:07.492167  9575 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 79954.8us
I20260709 13:03:07.506851  9676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1359e0d2d58948c199c04b275867bffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.511806  9837 raft_consensus.cc:2468] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:07.463091  9959 raft_consensus.cc:359] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:07.466535  9912 raft_consensus.cc:3060] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.512522  9959 raft_consensus.cc:385] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.528803  9959 raft_consensus.cc:740] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.530040  9959 consensus_queue.cc:260] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:07.533638  9959 ts_tablet_manager.cc:1434] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.150s	user 0.008s	sys 0.000s
I20260709 13:03:07.534811  9959 tablet_bootstrap.cc:492] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:07.504966 10010 leader_election.cc:290] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:07.521994  9826 tablet_service.cc:1511] Processing CreateTablet for tablet 1359e0d2d58948c199c04b275867bffd (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:07.545578  9826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1359e0d2d58948c199c04b275867bffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.527171  9731 leader_election.cc:304] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:07.556336 10010 raft_consensus.cc:2804] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:07.558859  9958 tablet_bootstrap.cc:654] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.562836  9961 tablet_bootstrap.cc:654] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.556244  9765 raft_consensus.cc:2468] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:07.567791  9654 leader_election.cc:304] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:07.568693  9912 raft_consensus.cc:2468] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:07.568914 10016 raft_consensus.cc:2804] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:07.569525 10016 raft_consensus.cc:697] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:07.570946 10016 consensus_queue.cc:237] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:07.575155  9679 tablet_service.cc:1511] Processing CreateTablet for tablet e8d49a0a0c7c4fc4bd734945246961cc (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:07.577045  9679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8d49a0a0c7c4fc4bd734945246961cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.582252  9959 tablet_bootstrap.cc:654] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.554894  9689 raft_consensus.cc:2468] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
W20260709 13:03:07.620048  9572 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.196:36227, user_credentials={real_user=slave}} blocked reactor thread for 134915us
I20260709 13:03:07.624339  9898 tablet_service.cc:1511] Processing CreateTablet for tablet 26c146a1db6843fc81be490f926d3137 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:07.625991  9898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c146a1db6843fc81be490f926d3137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.630290  9902 tablet_service.cc:1511] Processing CreateTablet for tablet e8d49a0a0c7c4fc4bd734945246961cc (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:07.631973  9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8d49a0a0c7c4fc4bd734945246961cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.638478  9979 raft_consensus.cc:493] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.639344  9979 raft_consensus.cc:515] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:07.642714  9979 leader_election.cc:290] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:07.644899  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7422f3d4e364cb68af3b39f23fd94bf" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:07.645653  9765 raft_consensus.cc:2468] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:07.646533  9676 tablet_service.cc:1511] Processing CreateTablet for tablet 26c146a1db6843fc81be490f926d3137 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:07.648278  9676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c146a1db6843fc81be490f926d3137. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:07.663618  9573 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:44623, user_credentials={real_user=slave}} blocked reactor thread for 72639.5us
I20260709 13:03:07.664888  9826 tablet_service.cc:1511] Processing CreateTablet for tablet 26c146a1db6843fc81be490f926d3137 (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:07.666570  9826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c146a1db6843fc81be490f926d3137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.667397  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7422f3d4e364cb68af3b39f23fd94bf" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
W20260709 13:03:07.655913  9731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35769, user_credentials={real_user=slave}} blocked reactor thread for 94196.8us
I20260709 13:03:07.671001  9755 tablet_service.cc:1511] Processing CreateTablet for tablet e8d49a0a0c7c4fc4bd734945246961cc (DEFAULT_TABLE table=test-workload [id=d340c3b2c0af46259e1607370a52d125]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:07.672345  9755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8d49a0a0c7c4fc4bd734945246961cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.674970  9963 tablet_bootstrap.cc:492] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:07.675594  9963 ts_tablet_manager.cc:1403] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.359s	user 0.016s	sys 0.008s
I20260709 13:03:07.676791  9877 leader_election.cc:304] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:07.677758  9979 raft_consensus.cc:2804] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:07.678170  9979 raft_consensus.cc:493] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.678490  9979 raft_consensus.cc:3060] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:07.685536  9879 leader_election.cc:343] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.662855 10010 raft_consensus.cc:697] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:07.722863  9958 tablet_bootstrap.cc:492] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:07.723591  9958 ts_tablet_manager.cc:1403] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.255s	user 0.024s	sys 0.017s
I20260709 13:03:07.725656 10010 consensus_queue.cc:237] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.726799  9958 raft_consensus.cc:359] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.727681  9958 raft_consensus.cc:385] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.738370  9959 tablet_bootstrap.cc:492] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:07.739198  9959 ts_tablet_manager.cc:1403] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.205s	user 0.016s	sys 0.011s
I20260709 13:03:07.733433  9958 raft_consensus.cc:740] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.741765  9958 consensus_queue.cc:260] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.747128  9959 raft_consensus.cc:359] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:07.751070  9958 ts_tablet_manager.cc:1434] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:03:07.753636  9958 tablet_bootstrap.cc:492] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:07.748370  9959 raft_consensus.cc:385] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.760130  9963 raft_consensus.cc:359] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:07.761037  9963 raft_consensus.cc:385] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.761440  9963 raft_consensus.cc:740] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.762080  9961 tablet_bootstrap.cc:492] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:07.765273  9961 ts_tablet_manager.cc:1403] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.534s	user 0.046s	sys 0.032s
I20260709 13:03:07.768697  9961 raft_consensus.cc:359] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.769423  9961 raft_consensus.cc:385] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.769730  9961 raft_consensus.cc:740] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.770473  9961 consensus_queue.cc:260] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.772877  9961 ts_tablet_manager.cc:1434] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:07.774076  9961 tablet_bootstrap.cc:492] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:07.778463  9588 catalog_manager.cc:5697] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.780107  9587 catalog_manager.cc:5697] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.781133  9961 tablet_bootstrap.cc:654] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.784433  9994 consensus_queue.cc:1048] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:07.772917  9585 catalog_manager.cc:5697] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.796813  9963 consensus_queue.cc:260] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:07.763091  9959 raft_consensus.cc:740] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.805933  9959 consensus_queue.cc:260] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:07.827944  9958 tablet_bootstrap.cc:654] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.827718  9964 consensus_queue.cc:1048] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:07.823987  9963 ts_tablet_manager.cc:1434] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.148s	user 0.011s	sys 0.001s
I20260709 13:03:07.838496  9959 ts_tablet_manager.cc:1434] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.099s	user 0.013s	sys 0.000s
I20260709 13:03:07.840130  9959 tablet_bootstrap.cc:492] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:07.844007  9963 tablet_bootstrap.cc:492] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:07.853636  9963 tablet_bootstrap.cc:654] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.853679  9979 raft_consensus.cc:515] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:07.859385  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7422f3d4e364cb68af3b39f23fd94bf" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:07.860095  9764 raft_consensus.cc:3060] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.860800  9979 leader_election.cc:290] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:07.860714  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7422f3d4e364cb68af3b39f23fd94bf" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
W20260709 13:03:07.863086  9879 leader_election.cc:343] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.860121  9961 tablet_bootstrap.cc:492] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:07.866313  9961 ts_tablet_manager.cc:1403] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.043s
I20260709 13:03:07.869309  9959 tablet_bootstrap.cc:654] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.870970  9961 raft_consensus.cc:359] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:07.871997  9961 raft_consensus.cc:385] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.877411  9961 raft_consensus.cc:740] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.877434  9690 raft_consensus.cc:3060] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.878100  9764 raft_consensus.cc:2468] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:07.878577  9961 consensus_queue.cc:260] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:07.880421  9877 leader_election.cc:304] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:07.881985  9994 raft_consensus.cc:2804] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:07.882531  9994 raft_consensus.cc:697] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:07.883813  9994 consensus_queue.cc:237] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:07.882500  9961 ts_tablet_manager.cc:1434] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.003s
I20260709 13:03:07.894035  9958 tablet_bootstrap.cc:492] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:07.894464  9958 ts_tablet_manager.cc:1403] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.019s
I20260709 13:03:07.899641  9958 raft_consensus.cc:359] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:07.902002  9963 tablet_bootstrap.cc:492] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:07.905251  9961 tablet_bootstrap.cc:492] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:07.905980  9959 tablet_bootstrap.cc:492] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:07.906560  9959 ts_tablet_manager.cc:1403] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.011s
I20260709 13:03:07.902837  9963 ts_tablet_manager.cc:1403] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.008s
I20260709 13:03:07.910053  9959 raft_consensus.cc:359] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:07.910888  9959 raft_consensus.cc:385] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.911221  9959 raft_consensus.cc:740] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.907545  9958 raft_consensus.cc:385] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.912117  9959 consensus_queue.cc:260] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:07.912765  9958 raft_consensus.cc:740] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.912443  9963 raft_consensus.cc:359] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.913911  9963 raft_consensus.cc:385] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.913763  9958 consensus_queue.cc:260] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:07.914353  9963 raft_consensus.cc:740] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.915187  9959 ts_tablet_manager.cc:1434] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:03:07.915886  9958 ts_tablet_manager.cc:1434] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:03:07.920676  9958 tablet_bootstrap.cc:492] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:07.919420  9963 consensus_queue.cc:260] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.924963  9959 tablet_bootstrap.cc:492] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:07.926149  9961 tablet_bootstrap.cc:654] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.927897  9963 ts_tablet_manager.cc:1434] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:03:07.929744  9963 tablet_bootstrap.cc:492] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:07.934129  9961 tablet_bootstrap.cc:492] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:07.934755  9961 ts_tablet_manager.cc:1403] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 13:03:07.936383  9963 tablet_bootstrap.cc:654] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.938011  9961 raft_consensus.cc:359] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.939390  9961 raft_consensus.cc:385] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.939682  9961 raft_consensus.cc:740] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.940441  9961 consensus_queue.cc:260] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.942745  9961 ts_tablet_manager.cc:1434] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:07.944063  9961 tablet_bootstrap.cc:492] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:07.947280  9959 tablet_bootstrap.cc:654] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.950559  9961 tablet_bootstrap.cc:654] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.956833  9958 tablet_bootstrap.cc:654] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.964010  9961 tablet_bootstrap.cc:492] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:07.964605  9961 ts_tablet_manager.cc:1403] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.002s
I20260709 13:03:07.965905  9958 tablet_bootstrap.cc:492] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:07.966445  9958 ts_tablet_manager.cc:1403] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.000s
I20260709 13:03:07.967522  9961 raft_consensus.cc:359] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:07.968254  9961 raft_consensus.cc:385] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.968446  9959 tablet_bootstrap.cc:492] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:07.968528  9961 raft_consensus.cc:740] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.969017  9959 ts_tablet_manager.cc:1403] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.005s
I20260709 13:03:07.969527  9958 raft_consensus.cc:359] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.969439  9961 consensus_queue.cc:260] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:07.970283  9958 raft_consensus.cc:385] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.970585  9958 raft_consensus.cc:740] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.971282  9958 consensus_queue.cc:260] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.972031  9961 ts_tablet_manager.cc:1434] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:07.971909  9959 raft_consensus.cc:359] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:07.972668  9959 raft_consensus.cc:385] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.972963  9959 raft_consensus.cc:740] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.973096  9961 tablet_bootstrap.cc:492] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:07.973269  9958 ts_tablet_manager.cc:1434] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:07.974308  9958 tablet_bootstrap.cc:492] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:07.975625  9963 tablet_bootstrap.cc:492] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:07.976140  9963 ts_tablet_manager.cc:1403] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.047s	user 0.004s	sys 0.015s
I20260709 13:03:07.979337  9963 raft_consensus.cc:359] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.979986  9961 tablet_bootstrap.cc:654] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.980012  9958 tablet_bootstrap.cc:654] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.980172  9963 raft_consensus.cc:385] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.980926  9963 raft_consensus.cc:740] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.981704 10053 raft_consensus.cc:493] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.981817  9963 consensus_queue.cc:260] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.982362 10053 raft_consensus.cc:515] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:07.984944  9963 ts_tablet_manager.cc:1434] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 13:03:07.986068  9963 tablet_bootstrap.cc:492] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:07.987517  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df3f52d3b03462987204a034f95a927" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:07.988075  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df3f52d3b03462987204a034f95a927" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:07.989140  9877 leader_election.cc:343] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.989770 10053 leader_election.cc:290] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
W20260709 13:03:07.990564  9879 leader_election.cc:343] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.990499 10030 consensus_queue.cc:1048] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:07.991163  9879 leader_election.cc:304] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:07.992760  9963 tablet_bootstrap.cc:654] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.996217  9959 consensus_queue.cc:260] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:07.997179 10010 raft_consensus.cc:493] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.998418  9959 ts_tablet_manager.cc:1434] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:03:07.998170 10010 raft_consensus.cc:515] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:07.999424  9959 tablet_bootstrap.cc:492] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:07.996197 10053 raft_consensus.cc:2749] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:08.004963 10008 raft_consensus.cc:493] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.005543 10008 raft_consensus.cc:515] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.008162 10008 leader_election.cc:290] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:08.010301  9959 tablet_bootstrap.cc:654] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.013036  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f0ca4181d94a888b1dd8f39485828c" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:08.013940  9690 raft_consensus.cc:2468] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
I20260709 13:03:08.017817  9805 leader_election.cc:304] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:08.019547 10030 consensus_queue.cc:1048] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:08.020208 10010 leader_election.cc:290] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:08.020454  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeb40161a4049b8a9b37f9cadfdc50f" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:08.021092  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeb40161a4049b8a9b37f9cadfdc50f" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:08.021170  9838 raft_consensus.cc:2468] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:08.023204  9731 leader_election.cc:304] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:08.024670  9690 raft_consensus.cc:2468] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:08.027833 10010 raft_consensus.cc:2804] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:08.028106 10008 raft_consensus.cc:2804] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:08.028815 10010 raft_consensus.cc:493] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.029023 10008 raft_consensus.cc:493] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.029533 10010 raft_consensus.cc:3060] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.034678 10008 raft_consensus.cc:3060] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.034193  9586 catalog_manager.cc:5697] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.053772  9961 tablet_bootstrap.cc:492] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
W20260709 13:03:08.084839  9805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 67181.4us
I20260709 13:03:08.088483  9963 tablet_bootstrap.cc:492] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:08.085147  9958 tablet_bootstrap.cc:492] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:08.089059  9963 ts_tablet_manager.cc:1403] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.103s	user 0.036s	sys 0.064s
I20260709 13:03:08.089150  9959 tablet_bootstrap.cc:492] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:08.089231  9958 ts_tablet_manager.cc:1403] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.115s	user 0.018s	sys 0.007s
I20260709 13:03:08.089943  9959 ts_tablet_manager.cc:1403] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.014s
I20260709 13:03:08.091922  9963 raft_consensus.cc:359] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.092695  9963 raft_consensus.cc:385] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.092965  9963 raft_consensus.cc:740] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.093676  9963 consensus_queue.cc:260] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.088900 10010 raft_consensus.cc:515] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.097855  9963 ts_tablet_manager.cc:1434] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:08.101292  9963 tablet_bootstrap.cc:492] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:08.101625 10053 raft_consensus.cc:493] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.101785  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeb40161a4049b8a9b37f9cadfdc50f" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:08.102454  9690 raft_consensus.cc:3060] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.102334 10053 raft_consensus.cc:515] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.086274  9961 ts_tablet_manager.cc:1403] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.113s	user 0.008s	sys 0.011s
I20260709 13:03:08.108130  9963 tablet_bootstrap.cc:654] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.097476  9958 raft_consensus.cc:359] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.108907  9958 raft_consensus.cc:385] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.109833  9958 raft_consensus.cc:740] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.113413  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ddf7a725a64a6e9c3c1ede3c67402d" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:08.109894  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ddf7a725a64a6e9c3c1ede3c67402d" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:08.115087 10008 raft_consensus.cc:515] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
W20260709 13:03:08.116251  9879 leader_election.cc:343] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:08.118801  9879 leader_election.cc:343] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.117152  9961 raft_consensus.cc:359] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.119585  9961 raft_consensus.cc:385] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.121167  9961 raft_consensus.cc:740] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.119403  9879 leader_election.cc:304] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:08.122052  9964 raft_consensus.cc:2749] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:08.122572 10008 leader_election.cc:290] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:08.114190  9958 consensus_queue.cc:260] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.110558 10053 leader_election.cc:290] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:08.124752  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f0ca4181d94a888b1dd8f39485828c" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:08.125319  9958 ts_tablet_manager.cc:1434] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:03:08.125442  9689 raft_consensus.cc:3060] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.126540  9958 tablet_bootstrap.cc:492] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:08.122092  9961 consensus_queue.cc:260] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.094076  9959 raft_consensus.cc:359] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.141932  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f0ca4181d94a888b1dd8f39485828c" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:08.164860  9959 raft_consensus.cc:385] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.155263 10008 raft_consensus.cc:493] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.165026  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeb40161a4049b8a9b37f9cadfdc50f" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:08.165298  9959 raft_consensus.cc:740] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.165759  9838 raft_consensus.cc:3060] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.165510 10008 raft_consensus.cc:515] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.166167  9959 consensus_queue.cc:260] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.149966  9963 tablet_bootstrap.cc:492] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:08.168843  9763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7422f3d4e364cb68af3b39f23fd94bf" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:08.165160  9764 raft_consensus.cc:2468] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
I20260709 13:03:08.169759  9763 raft_consensus.cc:2393] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 451c871fd36f4d95a76b62d041aa7b60 in current term 1: Already voted for candidate 8557220d7e6a4ccbbef222e80a5584a5 in this term.
I20260709 13:03:08.170322 10008 leader_election.cc:290] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:08.168442  9959 ts_tablet_manager.cc:1434] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.001s
I20260709 13:03:08.142349  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f0ca4181d94a888b1dd8f39485828c" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:08.163059 10034 raft_consensus.cc:493] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.172420 10034 raft_consensus.cc:515] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.131476  9690 raft_consensus.cc:2468] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:08.169179  9963 ts_tablet_manager.cc:1403] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.068s	user 0.023s	sys 0.022s
I20260709 13:03:08.169350  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7422f3d4e364cb68af3b39f23fd94bf" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:08.174583  9961 ts_tablet_manager.cc:1434] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.001s
I20260709 13:03:08.175240  9802 leader_election.cc:304] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:08.175575  9961 tablet_bootstrap.cc:492] T 52ab365fb7404f4d88cf7333834d27c5 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:08.177007 10008 raft_consensus.cc:3060] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.176834  9963 raft_consensus.cc:359] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.177693  9963 raft_consensus.cc:385] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.178828  9963 raft_consensus.cc:740] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.174813 10034 leader_election.cc:290] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:08.134238  9689 raft_consensus.cc:2468] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:08.179663  9963 consensus_queue.cc:260] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.181151  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df3f52d3b03462987204a034f95a927" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:08.183281  9765 raft_consensus.cc:3060] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.183348  9912 raft_consensus.cc:2468] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:08.184859  9728 leader_election.cc:304] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:08.185426  9805 leader_election.cc:304] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:08.185817 10034 raft_consensus.cc:2804] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:08.186260 10034 raft_consensus.cc:493] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.186355  9963 ts_tablet_manager.cc:1434] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:03:08.188566  9958 tablet_bootstrap.cc:654] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.182614  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df3f52d3b03462987204a034f95a927" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:08.191776  9690 raft_consensus.cc:2468] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:08.186513 10069 raft_consensus.cc:2804] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:08.187538  9963 tablet_bootstrap.cc:492] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:08.194411  9961 tablet_bootstrap.cc:654] T 52ab365fb7404f4d88cf7333834d27c5 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.172857  9959 tablet_bootstrap.cc:492] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:08.198212 10008 raft_consensus.cc:2749] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:08.181324  9731 leader_election.cc:304] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:08.199271  9963 tablet_bootstrap.cc:654] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.199307 10042 raft_consensus.cc:2804] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:08.200681 10042 raft_consensus.cc:697] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:08.201583 10042 consensus_queue.cc:237] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.204056  9958 tablet_bootstrap.cc:492] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:08.204617  9958 ts_tablet_manager.cc:1403] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.000s
I20260709 13:03:08.186676 10034 raft_consensus.cc:3060] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.207435  9958 raft_consensus.cc:359] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.208151  9958 raft_consensus.cc:385] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.208423  9958 raft_consensus.cc:740] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.163821 10010 leader_election.cc:290] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:08.136183 10040 consensus_queue.cc:1048] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:08.214643 10040 raft_consensus.cc:493] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.215291 10040 raft_consensus.cc:515] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.181831  9838 raft_consensus.cc:2468] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:08.210449  9958 consensus_queue.cc:260] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.217859  9765 raft_consensus.cc:2468] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:08.219347  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ab365fb7404f4d88cf7333834d27c5" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:08.230923  9958 ts_tablet_manager.cc:1434] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:03:08.231281  9912 raft_consensus.cc:2468] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:08.219027  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ab365fb7404f4d88cf7333834d27c5" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:08.232944  9728 leader_election.cc:304] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
W20260709 13:03:08.233767  9731 leader_election.cc:343] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.226863  9963 tablet_bootstrap.cc:492] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:08.234987  9963 ts_tablet_manager.cc:1403] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.011s
I20260709 13:03:08.235649  9959 tablet_bootstrap.cc:654] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.238775  9963 raft_consensus.cc:359] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.239576  9963 raft_consensus.cc:385] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.239856  9963 raft_consensus.cc:740] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.240410  9961 tablet_bootstrap.cc:492] T 52ab365fb7404f4d88cf7333834d27c5 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:08.220157 10040 leader_election.cc:290] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:08.240983  9961 ts_tablet_manager.cc:1403] T 52ab365fb7404f4d88cf7333834d27c5 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.009s
I20260709 13:03:08.240670  9963 consensus_queue.cc:260] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.243490  9961 raft_consensus.cc:359] T 52ab365fb7404f4d88cf7333834d27c5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.244035  9961 raft_consensus.cc:385] T 52ab365fb7404f4d88cf7333834d27c5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.244028  9963 ts_tablet_manager.cc:1434] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:08.244479  9961 raft_consensus.cc:740] T 52ab365fb7404f4d88cf7333834d27c5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.226903 10034 raft_consensus.cc:515] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.245956  9963 tablet_bootstrap.cc:492] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:08.249150  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df3f52d3b03462987204a034f95a927" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:08.249571  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df3f52d3b03462987204a034f95a927" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:08.249847  9690 raft_consensus.cc:3060] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.250208  9912 raft_consensus.cc:3060] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.257941  9963 tablet_bootstrap.cc:654] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.258047  9912 raft_consensus.cc:2468] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:08.245270  9961 consensus_queue.cc:260] T 52ab365fb7404f4d88cf7333834d27c5 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.259699  9728 leader_election.cc:304] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:08.234375 10042 raft_consensus.cc:2804] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:08.261862  9961 ts_tablet_manager.cc:1434] T 52ab365fb7404f4d88cf7333834d27c5 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:03:08.263012 10034 leader_election.cc:290] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:08.261997 10042 raft_consensus.cc:493] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.238775  9587 catalog_manager.cc:5697] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.269320 10042 raft_consensus.cc:3060] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.263473  9961 tablet_bootstrap.cc:492] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:08.269969  9690 raft_consensus.cc:2468] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:08.278218 10034 raft_consensus.cc:2804] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:08.279639 10034 raft_consensus.cc:697] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:08.291009 10034 consensus_queue.cc:237] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.280762 10010 consensus_queue.cc:1048] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:08.294767 10053 consensus_queue.cc:1048] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:08.310941 10069 raft_consensus.cc:697] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:08.313766 10069 consensus_queue.cc:237] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.321130 10042 raft_consensus.cc:515] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.325266  9958 tablet_bootstrap.cc:492] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:08.331693 10042 leader_election.cc:290] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:08.341632 10053 consensus_queue.cc:1048] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:08.337021  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ab365fb7404f4d88cf7333834d27c5" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:08.336491  9961 tablet_bootstrap.cc:654] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.343608  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ab365fb7404f4d88cf7333834d27c5" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:08.348254  9958 tablet_bootstrap.cc:654] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.353802  9837 raft_consensus.cc:3060] T 52ab365fb7404f4d88cf7333834d27c5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.356238 10073 raft_consensus.cc:493] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.357010 10073 raft_consensus.cc:515] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.353580  9912 raft_consensus.cc:3060] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.369123  9963 tablet_bootstrap.cc:492] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:08.371134  9963 ts_tablet_manager.cc:1403] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.125s	user 0.042s	sys 0.036s
I20260709 13:03:08.385267  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b14229f08e4078b2e335de63179868" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:08.371951 10008 raft_consensus.cc:493] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:08.387650  9802 leader_election.cc:343] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.388183 10008 raft_consensus.cc:515] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.391111 10008 leader_election.cc:290] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:08.392066  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ddf7a725a64a6e9c3c1ede3c67402d" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:08.394738  9963 raft_consensus.cc:359] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.396689  9963 raft_consensus.cc:385] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.397095  9963 raft_consensus.cc:740] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.393292 10073 leader_election.cc:290] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:08.399412  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b14229f08e4078b2e335de63179868" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:08.395602  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ddf7a725a64a6e9c3c1ede3c67402d" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:08.401115  9805 leader_election.cc:343] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.401440  9690 raft_consensus.cc:2468] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
I20260709 13:03:08.401610  9805 leader_election.cc:304] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:08.403232  9805 leader_election.cc:304] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:08.404354 10073 raft_consensus.cc:2749] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:08.397879  9913 raft_consensus.cc:2468] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
I20260709 13:03:08.405095 10073 raft_consensus.cc:2804] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:08.398495  9963 consensus_queue.cc:260] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.409087  9963 ts_tablet_manager.cc:1434] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:03:08.405655 10073 raft_consensus.cc:493] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.410828 10073 raft_consensus.cc:3060] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.411588  9959 tablet_bootstrap.cc:492] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:08.412137  9959 ts_tablet_manager.cc:1403] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.240s	user 0.018s	sys 0.013s
I20260709 13:03:08.414352  9963 tablet_bootstrap.cc:492] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:08.415053  9959 raft_consensus.cc:359] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.416018  9959 raft_consensus.cc:385] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.416296  9959 raft_consensus.cc:740] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.417261  9959 consensus_queue.cc:260] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.419736  9837 raft_consensus.cc:2468] T 52ab365fb7404f4d88cf7333834d27c5 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:08.420861  9958 tablet_bootstrap.cc:492] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:08.421209  9731 leader_election.cc:304] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:08.421592 10073 raft_consensus.cc:515] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.422282 10078 raft_consensus.cc:2804] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:08.422814  9959 ts_tablet_manager.cc:1434] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:03:08.422777 10078 raft_consensus.cc:697] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:08.423727 10073 leader_election.cc:290] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:08.424288  9958 ts_tablet_manager.cc:1403] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.099s	user 0.024s	sys 0.012s
I20260709 13:03:08.427142  9958 raft_consensus.cc:359] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.423928  9959 tablet_bootstrap.cc:492] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:08.430429  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ddf7a725a64a6e9c3c1ede3c67402d" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:08.423811 10078 consensus_queue.cc:237] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.431221  9913 raft_consensus.cc:3060] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.433864  9959 tablet_bootstrap.cc:654] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:08.436707  9636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:08.438314  9912 raft_consensus.cc:2468] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:08.438623  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ddf7a725a64a6e9c3c1ede3c67402d" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:08.439246  9963 tablet_bootstrap.cc:654] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.436734  9958 raft_consensus.cc:385] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.440938  9958 raft_consensus.cc:740] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.439316  9690 raft_consensus.cc:3060] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.444875  9964 raft_consensus.cc:493] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.445391  9964 raft_consensus.cc:515] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.441953  9958 consensus_queue.cc:260] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.448171  9958 ts_tablet_manager.cc:1434] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:03:08.449247  9958 tablet_bootstrap.cc:492] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:08.452066  9964 leader_election.cc:290] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:08.453217  9588 catalog_manager.cc:5697] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.453830  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de10962da0124f0eb699ad981d76d6f4" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:08.456830  9765 raft_consensus.cc:2468] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:08.458494  9877 leader_election.cc:304] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:08.458652  9690 raft_consensus.cc:2468] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:08.459455  9979 raft_consensus.cc:2804] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:08.459877  9805 leader_election.cc:304] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:08.464116  9961 tablet_bootstrap.cc:492] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:08.464959  9961 ts_tablet_manager.cc:1403] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.202s	user 0.030s	sys 0.010s
I20260709 13:03:08.455861  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de10962da0124f0eb699ad981d76d6f4" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:08.468175  9879 leader_election.cc:343] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.460074  9979 raft_consensus.cc:493] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.469187  9979 raft_consensus.cc:3060] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.464313  9913 raft_consensus.cc:2468] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:08.455518  9958 tablet_bootstrap.cc:654] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.474088  9585 catalog_manager.cc:5697] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.482805 10073 raft_consensus.cc:2804] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:08.483848 10073 raft_consensus.cc:697] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:08.477519  9961 raft_consensus.cc:359] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.485940  9961 raft_consensus.cc:385] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.486321  9961 raft_consensus.cc:740] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.487190  9961 consensus_queue.cc:260] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.485145 10073 consensus_queue.cc:237] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.488472  9959 tablet_bootstrap.cc:492] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:08.489042  9959 ts_tablet_manager.cc:1403] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.004s
I20260709 13:03:08.490938  9961 ts_tablet_manager.cc:1434] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:03:08.491956  9961 tablet_bootstrap.cc:492] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:08.494849  9979 raft_consensus.cc:515] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.491995  9959 raft_consensus.cc:359] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.496250  9959 raft_consensus.cc:385] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.496507  9959 raft_consensus.cc:740] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.496992  9958 tablet_bootstrap.cc:492] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:08.497493  9958 ts_tablet_manager.cc:1403] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.000s
I20260709 13:03:08.497334  9959 consensus_queue.cc:260] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.497870  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de10962da0124f0eb699ad981d76d6f4" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
W20260709 13:03:08.499402  9879 leader_election.cc:343] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.499476  9959 ts_tablet_manager.cc:1434] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:03:08.500315  9958 raft_consensus.cc:359] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.501027  9958 raft_consensus.cc:385] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.501441  9959 tablet_bootstrap.cc:492] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:08.501559  9963 tablet_bootstrap.cc:492] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:08.503118  9963 ts_tablet_manager.cc:1403] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.089s	user 0.016s	sys 0.018s
I20260709 13:03:08.504789  9961 tablet_bootstrap.cc:654] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.501449  9958 raft_consensus.cc:740] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.508206  9959 tablet_bootstrap.cc:654] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.508421 10030 raft_consensus.cc:493] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.508635  9958 consensus_queue.cc:260] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.508987 10030 raft_consensus.cc:515] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.510785 10078 raft_consensus.cc:493] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.511329 10078 raft_consensus.cc:515] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.512233  9958 ts_tablet_manager.cc:1434] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:03:08.509321  9979 leader_election.cc:290] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:08.513285  9958 tablet_bootstrap.cc:492] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:08.512555  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492d90625d5e4006b85a116618e1ebdd" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:08.511922  9963 raft_consensus.cc:359] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.514660  9963 raft_consensus.cc:385] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.514968  9963 raft_consensus.cc:740] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.514987  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ee1293277e45038d5f7e4289589ded" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
W20260709 13:03:08.515488  9656 leader_election.cc:343] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.515784  9837 raft_consensus.cc:2468] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:08.515955  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ee1293277e45038d5f7e4289589ded" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:08.511106 10030 leader_election.cc:290] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:08.517139  9731 leader_election.cc:304] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:08.513634 10078 leader_election.cc:290] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:08.516884  9963 consensus_queue.cc:260] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.518115  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de10962da0124f0eb699ad981d76d6f4" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
W20260709 13:03:08.518203  9728 leader_election.cc:343] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.519066  9765 raft_consensus.cc:3060] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.520913  9963 ts_tablet_manager.cc:1434] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 13:03:08.521890  9963 tablet_bootstrap.cc:492] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:08.518127 10042 raft_consensus.cc:2804] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:08.524065  9959 tablet_bootstrap.cc:492] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:08.524335 10042 raft_consensus.cc:493] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.524644  9959 ts_tablet_manager.cc:1403] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.001s
I20260709 13:03:08.524833 10042 raft_consensus.cc:3060] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.525566  9958 tablet_bootstrap.cc:654] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.527607  9963 tablet_bootstrap.cc:654] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.527541  9959 raft_consensus.cc:359] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.529382  9959 raft_consensus.cc:385] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.529695  9959 raft_consensus.cc:740] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.529953  9763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492d90625d5e4006b85a116618e1ebdd" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:08.530325  9961 tablet_bootstrap.cc:492] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:08.530839  9961 ts_tablet_manager.cc:1403] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.039s	user 0.005s	sys 0.005s
I20260709 13:03:08.530494  9959 consensus_queue.cc:260] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.532563  9959 ts_tablet_manager.cc:1434] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 13:03:08.533469  9959 tablet_bootstrap.cc:492] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
W20260709 13:03:08.533578  9654 leader_election.cc:343] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.533558  9961 raft_consensus.cc:359] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.534430  9654 leader_election.cc:304] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:08.535487 10030 raft_consensus.cc:2749] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:08.537375  9958 tablet_bootstrap.cc:492] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:08.537925  9958 ts_tablet_manager.cc:1403] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 13:03:08.540185  9959 tablet_bootstrap.cc:654] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.540674  9958 raft_consensus.cc:359] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.541455  9958 raft_consensus.cc:385] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.541719  9958 raft_consensus.cc:740] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.542553  9958 consensus_queue.cc:260] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.545634  9958 ts_tablet_manager.cc:1434] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:08.547127  9958 tablet_bootstrap.cc:492] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:08.551997  9959 tablet_bootstrap.cc:492] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:08.548243  9586 catalog_manager.cc:5697] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.553996  9958 tablet_bootstrap.cc:654] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.570591  9765 raft_consensus.cc:2468] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:08.574077  9586 catalog_manager.cc:5697] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.575387  9877 leader_election.cc:304] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:08.576894  9979 raft_consensus.cc:2804] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:08.577144  9959 ts_tablet_manager.cc:1403] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.009s
I20260709 13:03:08.577661  9979 raft_consensus.cc:697] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:08.579762  9979 consensus_queue.cc:237] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.534439  9961 raft_consensus.cc:385] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.585769  9961 raft_consensus.cc:740] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.556468 10042 raft_consensus.cc:515] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.589648  9961 consensus_queue.cc:260] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.581085  9959 raft_consensus.cc:359] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.593135  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ee1293277e45038d5f7e4289589ded" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:08.596774  9837 raft_consensus.cc:3060] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.597162 10073 raft_consensus.cc:493] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.597925  9963 tablet_bootstrap.cc:492] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:08.597675 10073 raft_consensus.cc:515] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.598438  9963 ts_tablet_manager.cc:1403] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.077s	user 0.024s	sys 0.018s
I20260709 13:03:08.599989 10073 leader_election.cc:290] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:08.594739  9958 tablet_bootstrap.cc:492] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:08.601380  9963 raft_consensus.cc:359] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.601703  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1663fd19784f6db7ea0fddb0fefb4c" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:08.603456  9690 raft_consensus.cc:2468] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
I20260709 13:03:08.604051  9837 raft_consensus.cc:2468] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:08.603469  9958 ts_tablet_manager.cc:1403] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.008s
I20260709 13:03:08.593941  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ee1293277e45038d5f7e4289589ded" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:08.604838  9913 raft_consensus.cc:3060] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.605022  9805 leader_election.cc:304] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:08.606225 10073 raft_consensus.cc:2804] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:08.607605 10073 raft_consensus.cc:493] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.607559  9958 raft_consensus.cc:359] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.608266 10073 raft_consensus.cc:3060] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.608533  9958 raft_consensus.cc:385] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.608817 10042 leader_election.cc:290] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:08.608999  9958 raft_consensus.cc:740] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.609694  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1663fd19784f6db7ea0fddb0fefb4c" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:08.610312  9958 consensus_queue.cc:260] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.617028  9958 ts_tablet_manager.cc:1434] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:03:08.611198  9961 ts_tablet_manager.cc:1434] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.000s
I20260709 13:03:08.611126  9963 raft_consensus.cc:385] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.612952  9913 raft_consensus.cc:2468] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:08.613739  9731 leader_election.cc:304] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:08.616452 10073 raft_consensus.cc:515] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.618204  9961 tablet_bootstrap.cc:492] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:08.618415  9963 raft_consensus.cc:740] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.620514  9963 consensus_queue.cc:260] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.621985 10078 raft_consensus.cc:2804] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:08.622550 10078 raft_consensus.cc:697] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:08.622814  9963 ts_tablet_manager.cc:1434] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:03:08.622977 10073 leader_election.cc:290] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:08.623579  9765 raft_consensus.cc:2468] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
I20260709 13:03:08.623418 10078 consensus_queue.cc:237] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.625202  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1663fd19784f6db7ea0fddb0fefb4c" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:08.625969  9690 raft_consensus.cc:3060] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.618204  9958 tablet_bootstrap.cc:492] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:08.628037  9963 tablet_bootstrap.cc:492] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:08.628787 10030 raft_consensus.cc:493] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.629288 10030 raft_consensus.cc:515] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.631870 10030 leader_election.cc:290] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:08.633498  9958 tablet_bootstrap.cc:654] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.635435  9763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1663fd19784f6db7ea0fddb0fefb4c" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:08.635977  9763 raft_consensus.cc:3060] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.612773  9959 raft_consensus.cc:385] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.638347  9959 raft_consensus.cc:740] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.639338  9959 consensus_queue.cc:260] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.641422  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a2118bc9914ddda2630ddb688ebaa9" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:08.644809  9961 tablet_bootstrap.cc:654] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:08.645841  9654 leader_election.cc:343] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.648062  9763 raft_consensus.cc:2468] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:08.650377  9958 tablet_bootstrap.cc:492] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:08.651088  9958 ts_tablet_manager.cc:1403] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:03:08.653250  9803 leader_election.cc:304] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:08.654399 10073 raft_consensus.cc:2804] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:08.654888 10073 raft_consensus.cc:697] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:08.655685 10073 consensus_queue.cc:237] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.656013  9585 catalog_manager.cc:5697] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.657164  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a2118bc9914ddda2630ddb688ebaa9" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:08.641480  9959 ts_tablet_manager.cc:1434] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.001s
W20260709 13:03:08.658665  9653 leader_election.cc:343] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.659201  9959 tablet_bootstrap.cc:492] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:08.659130  9653 leader_election.cc:304] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:08.660362 10102 raft_consensus.cc:2749] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:08.667912  9690 raft_consensus.cc:2468] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:08.673895 10079 raft_consensus.cc:493] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.674537 10079 raft_consensus.cc:515] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.681458  9963 tablet_bootstrap.cc:654] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.685271 10079 leader_election.cc:290] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:08.694188  9961 tablet_bootstrap.cc:492] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:08.694859  9961 ts_tablet_manager.cc:1403] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.007s
I20260709 13:03:08.685024  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0495f84dcd455a878471b702e53cdd" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:08.698114  9913 raft_consensus.cc:2468] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:08.676635  9958 raft_consensus.cc:359] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.699620  9728 leader_election.cc:304] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:08.700174  9958 raft_consensus.cc:385] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.700665 10042 raft_consensus.cc:2804] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:08.701326 10042 raft_consensus.cc:493] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.701682 10042 raft_consensus.cc:3060] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.679770  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0495f84dcd455a878471b702e53cdd" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
W20260709 13:03:08.704610  9731 leader_election.cc:343] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.707067  9961 raft_consensus.cc:359] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.708338  9961 raft_consensus.cc:385] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.708873  9961 raft_consensus.cc:740] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.700610  9958 raft_consensus.cc:740] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.710793  9958 consensus_queue.cc:260] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.714056  9958 ts_tablet_manager.cc:1434] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.063s	user 0.011s	sys 0.000s
I20260709 13:03:08.715381  9958 tablet_bootstrap.cc:492] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:08.716033  9959 tablet_bootstrap.cc:654] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.719817  9963 tablet_bootstrap.cc:492] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:08.720395  9963 ts_tablet_manager.cc:1403] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.093s	user 0.023s	sys 0.018s
I20260709 13:03:08.717290 10042 raft_consensus.cc:515] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.717293  9961 consensus_queue.cc:260] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.726461  9961 ts_tablet_manager.cc:1434] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 13:03:08.727063  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0495f84dcd455a878471b702e53cdd" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:08.727435  9961 tablet_bootstrap.cc:492] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
W20260709 13:03:08.728695  9731 leader_election.cc:343] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.728899 10042 leader_election.cc:290] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:08.729807  9963 raft_consensus.cc:359] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.734059  9963 raft_consensus.cc:385] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.734324  9963 raft_consensus.cc:740] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.735076  9963 consensus_queue.cc:260] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.735158  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0495f84dcd455a878471b702e53cdd" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:08.736060  9913 raft_consensus.cc:3060] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.727783  9958 tablet_bootstrap.cc:654] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.741149  9963 ts_tablet_manager.cc:1434] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:03:08.742404  9963 tablet_bootstrap.cc:492] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:08.752638  9979 raft_consensus.cc:493] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.753470  9979 raft_consensus.cc:515] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.759408  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64e505f3a594381a9e50a8030c33783" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:08.760502  9963 tablet_bootstrap.cc:654] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:08.762135  9879 leader_election.cc:343] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.763139  9979 leader_election.cc:290] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:08.780356 10073 consensus_queue.cc:1048] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:08.788920 10078 raft_consensus.cc:493] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.789500 10078 raft_consensus.cc:515] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.791929 10078 leader_election.cc:290] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:08.795207  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492d90625d5e4006b85a116618e1ebdd" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:08.795955  9689 raft_consensus.cc:2468] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:08.800766  9731 leader_election.cc:304] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:08.801211  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492d90625d5e4006b85a116618e1ebdd" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:08.801694 10078 consensus_queue.cc:1048] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:08.803275 10078 raft_consensus.cc:2804] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:08.803663 10078 raft_consensus.cc:493] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.804028 10078 raft_consensus.cc:3060] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.801908  9838 raft_consensus.cc:2468] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:08.807991  9587 catalog_manager.cc:5697] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.813601 10078 raft_consensus.cc:515] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:08.823359 10042 consensus_queue.cc:1048] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:08.829559  9979 raft_consensus.cc:493] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.830541  9979 raft_consensus.cc:515] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.849011  9961 tablet_bootstrap.cc:700] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60: Time spent opening tablet: real 0.114s	user 0.003s	sys 0.001s
I20260709 13:03:08.850008  9961 tablet_bootstrap.cc:654] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:08.869488  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b14229f08e4078b2e335de63179868" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:08.870324  9838 raft_consensus.cc:2468] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:08.871889  9879 leader_election.cc:304] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:08.872366  9958 tablet_bootstrap.cc:492] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:08.872920  9958 ts_tablet_manager.cc:1403] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.158s	user 0.038s	sys 0.032s
I20260709 13:03:08.872805  9964 raft_consensus.cc:2804] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:08.873378  9964 raft_consensus.cc:493] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.873819  9964 raft_consensus.cc:3060] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.875617 10078 leader_election.cc:290] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:08.884346 10073 consensus_queue.cc:1048] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:08.886219  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492d90625d5e4006b85a116618e1ebdd" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:08.890839 10040 raft_consensus.cc:493] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.891985  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64e505f3a594381a9e50a8030c33783" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:08.891635 10040 raft_consensus.cc:515] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.895912 10040 leader_election.cc:290] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:08.898479  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492d90625d5e4006b85a116618e1ebdd" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:08.897830  9584 catalog_manager.cc:5697] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.899261  9690 raft_consensus.cc:3060] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:08.899451  9879 leader_election.cc:343] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.898191  9688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a2118bc9914ddda2630ddb688ebaa9" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:08.900164  9879 leader_election.cc:304] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:08.901706  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a2118bc9914ddda2630ddb688ebaa9" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:08.902966 10053 raft_consensus.cc:2749] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:08.903800  9728 leader_election.cc:343] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:08.890967  9839 raft_consensus.cc:3060] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.901733  9688 raft_consensus.cc:2468] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:08.912460  9731 leader_election.cc:304] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:08.915474  9979 leader_election.cc:290] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:08.917512  9688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b14229f08e4078b2e335de63179868" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:08.918346  9688 raft_consensus.cc:2468] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:08.919445  9690 raft_consensus.cc:2468] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:08.922685 10078 consensus_queue.cc:1048] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:08.923446 10079 raft_consensus.cc:2804] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:08.923960 10079 raft_consensus.cc:493] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.924361 10079 raft_consensus.cc:3060] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.925941  9958 raft_consensus.cc:359] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.926692  9958 raft_consensus.cc:385] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:08.926949  9958 raft_consensus.cc:740] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:08.927860 10102 raft_consensus.cc:493] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.928629 10102 raft_consensus.cc:515] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.924329  9731 leader_election.cc:304] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:08.935240 10102 leader_election.cc:290] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:08.935446  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de10962da0124f0eb699ad981d76d6f4" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:08.937143  9765 raft_consensus.cc:2393] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in current term 1: Already voted for candidate 8557220d7e6a4ccbbef222e80a5584a5 in this term.
I20260709 13:03:08.937619  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de10962da0124f0eb699ad981d76d6f4" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:08.940078  9653 leader_election.cc:304] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:08.941691 10008 consensus_queue.cc:1048] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:08.942570 10102 raft_consensus.cc:3060] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:08.956501 10078 raft_consensus.cc:2804] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:08.957311 10078 raft_consensus.cc:697] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:08.963570  9958 consensus_queue.cc:260] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:08.997200  9964 raft_consensus.cc:515] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:08.965689 10079 raft_consensus.cc:515] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:08.975715  9913 raft_consensus.cc:2468] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:08.977886 10042 consensus_queue.cc:1048] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:03:08.977042 10053 consensus_queue.cc:1048] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:03:09.020952  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b14229f08e4078b2e335de63179868" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:09.021965  9837 raft_consensus.cc:3060] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.033268 10079 leader_election.cc:290] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:09.035912  9909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a2118bc9914ddda2630ddb688ebaa9" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:09.015045  9959 tablet_bootstrap.cc:492] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:09.039567  9959 ts_tablet_manager.cc:1403] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.381s	user 0.024s	sys 0.090s
I20260709 13:03:08.976034 10078 consensus_queue.cc:237] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:09.058233  9958 ts_tablet_manager.cc:1434] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.182s	user 0.016s	sys 0.027s
I20260709 13:03:09.059201  9958 tablet_bootstrap.cc:492] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:09.068686  9963 tablet_bootstrap.cc:492] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:09.069139  9963 ts_tablet_manager.cc:1403] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.327s	user 0.056s	sys 0.093s
I20260709 13:03:09.074189  9959 raft_consensus.cc:359] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.075867  9959 raft_consensus.cc:385] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:09.051975  9731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 123014us
I20260709 13:03:09.076329  9959 raft_consensus.cc:740] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.080309  9959 consensus_queue.cc:260] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.092175  9959 ts_tablet_manager.cc:1434] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 13:03:09.068478  9964 leader_election.cc:290] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:09.085141  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b14229f08e4078b2e335de63179868" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:09.089527  9839 raft_consensus.cc:2468] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:09.111347  9687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a2118bc9914ddda2630ddb688ebaa9" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:09.128121 10078 consensus_queue.cc:1048] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:09.127529  9958 tablet_bootstrap.cc:654] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:09.104888  9728 leader_election.cc:343] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.108395  9689 raft_consensus.cc:3060] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.153522  9963 raft_consensus.cc:359] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.156229  9963 raft_consensus.cc:385] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.156672  9963 raft_consensus.cc:740] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.140648  9687 raft_consensus.cc:3060] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.143574 10102 raft_consensus.cc:2749] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:09.164280  9963 consensus_queue.cc:260] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
W20260709 13:03:09.158589  9728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:36227, user_credentials={real_user=slave}} blocked reactor thread for 55955.9us
I20260709 13:03:09.176107  9961 tablet_bootstrap.cc:492] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:09.176911  9961 ts_tablet_manager.cc:1403] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.450s	user 0.029s	sys 0.058s
I20260709 13:03:09.178678  9728 leader_election.cc:304] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:09.180774 10119 raft_consensus.cc:2804] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:09.181298 10119 raft_consensus.cc:697] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:09.182183 10119 consensus_queue.cc:237] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:09.209244  9837 raft_consensus.cc:2468] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:09.211314  9961 raft_consensus.cc:359] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.212105  9961 raft_consensus.cc:385] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.212514  9961 raft_consensus.cc:740] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.213822  9961 consensus_queue.cc:260] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.216746  9959 tablet_bootstrap.cc:492] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:09.212203 10073 consensus_queue.cc:1048] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:03:09.218983 10073 consensus_queue.cc:1048] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:09.217027  9961 ts_tablet_manager.cc:1434] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 13:03:09.200572  9687 raft_consensus.cc:2468] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:09.207736  9689 raft_consensus.cc:2468] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:09.220801  9961 tablet_bootstrap.cc:492] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:09.250056  9959 tablet_bootstrap.cc:654] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.240854 10079 consensus_queue.cc:1048] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:03:09.249188  9879 leader_election.cc:304] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:09.269496  9979 raft_consensus.cc:2804] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:09.270238  9979 raft_consensus.cc:697] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:09.271381  9979 consensus_queue.cc:237] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.277848  9963 ts_tablet_manager.cc:1434] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.208s	user 0.029s	sys 0.011s
I20260709 13:03:09.279850  9963 tablet_bootstrap.cc:492] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:09.282706 10127 consensus_queue.cc:1048] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 13:03:09.289783  9961 tablet_bootstrap.cc:654] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.301777 10123 consensus_queue.cc:1048] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:09.302191  9731 leader_election.cc:304] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:09.303887 10079 raft_consensus.cc:2804] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:09.304394 10079 raft_consensus.cc:697] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:09.304692 10116 consensus_queue.cc:1048] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:09.305626 10079 consensus_queue.cc:237] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
W20260709 13:03:09.292274  9803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:44623, user_credentials={real_user=slave}} blocked reactor thread for 75888.1us
I20260709 13:03:09.296921 10119 consensus_queue.cc:1048] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:03:09.336452  9958 tablet_bootstrap.cc:492] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:09.337414  9958 ts_tablet_manager.cc:1403] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.278s	user 0.019s	sys 0.000s
I20260709 13:03:09.353302  9963 tablet_bootstrap.cc:654] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.362591  9584 catalog_manager.cc:5697] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.384840  9959 tablet_bootstrap.cc:492] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:09.385430  9959 ts_tablet_manager.cc:1403] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.169s	user 0.016s	sys 0.000s
I20260709 13:03:09.388439  9959 raft_consensus.cc:359] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.389163  9959 raft_consensus.cc:385] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.389439  9959 raft_consensus.cc:740] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.390101  9959 consensus_queue.cc:260] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.390584 10132 raft_consensus.cc:493] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.391345 10132 raft_consensus.cc:515] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.418607  9959 ts_tablet_manager.cc:1434] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 13:03:09.431125  9958 raft_consensus.cc:359] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.431710  9958 raft_consensus.cc:385] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.431937  9958 raft_consensus.cc:740] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.433817  9958 consensus_queue.cc:260] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.438804 10132 leader_election.cc:290] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:09.429672  9964 raft_consensus.cc:493] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.445353 10117 raft_consensus.cc:493] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.445962 10117 raft_consensus.cc:515] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:09.452950  9958 ts_tablet_manager.cc:1434] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.115s	user 0.006s	sys 0.002s
I20260709 13:03:09.454097  9958 tablet_bootstrap.cc:492] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:09.459013  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b95221ddfd49cca2e58073915a692a" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:09.464322 10117 leader_election.cc:290] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:09.464812  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b95221ddfd49cca2e58073915a692a" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:09.471041  9959 tablet_bootstrap.cc:492] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
W20260709 13:03:09.489239  9654 leader_election.cc:343] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.494374  9961 tablet_bootstrap.cc:492] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:09.494964  9961 ts_tablet_manager.cc:1403] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.274s	user 0.024s	sys 0.014s
I20260709 13:03:09.496989  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048c260ea0264cacbc43596c71ecb9d4" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:09.499547  9961 raft_consensus.cc:359] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.500308  9961 raft_consensus.cc:385] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.500622  9961 raft_consensus.cc:740] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.501973  9961 consensus_queue.cc:260] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
W20260709 13:03:09.509334  9728 leader_election.cc:343] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.509776 10128 raft_consensus.cc:493] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.513347 10128 raft_consensus.cc:515] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.456609  9964 raft_consensus.cc:515] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.514225 10079 raft_consensus.cc:493] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.514802 10079 raft_consensus.cc:515] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.515625 10128 leader_election.cc:290] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:09.515857  9964 leader_election.cc:290] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:09.516803  9911 raft_consensus.cc:2468] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:09.518277  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ec003b8fb0423eae15b72ac88ce69f" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:09.518373  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b95221ddfd49cca2e58073915a692a" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:09.518622  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e983261153492e83602412c376fa6f" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:09.520840  9688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e983261153492e83602412c376fa6f" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:09.522567  9731 leader_election.cc:343] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.517791 10079 leader_election.cc:290] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:09.523845  9688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b95221ddfd49cca2e58073915a692a" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:09.524626  9802 leader_election.cc:343] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.524534  9688 raft_consensus.cc:2468] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:09.525882  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048c260ea0264cacbc43596c71ecb9d4" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:09.529659  9963 tablet_bootstrap.cc:492] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:09.530434  9963 ts_tablet_manager.cc:1403] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.251s	user 0.012s	sys 0.006s
I20260709 13:03:09.532126  9958 tablet_bootstrap.cc:654] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:09.532244  9877 leader_election.cc:343] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.533849  9961 ts_tablet_manager.cc:1434] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:03:09.534720  9961 tablet_bootstrap.cc:492] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:09.535867 10116 consensus_queue.cc:1048] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:09.536361  9731 leader_election.cc:343] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.536940  9731 leader_election.cc:304] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:09.537506  9879 leader_election.cc:304] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:09.539839  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ec003b8fb0423eae15b72ac88ce69f" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:09.538764  9964 raft_consensus.cc:2804] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:09.541003  9964 raft_consensus.cc:493] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.541378  9964 raft_consensus.cc:3060] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:09.541499  9805 leader_election.cc:343] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.541880  9653 leader_election.cc:304] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:09.542143  9805 leader_election.cc:304] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:09.543152 10128 raft_consensus.cc:2749] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:09.543690 10136 raft_consensus.cc:2804] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:09.544166 10136 raft_consensus.cc:493] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.544775 10136 raft_consensus.cc:3060] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.548784  9959 tablet_bootstrap.cc:654] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.538789 10116 raft_consensus.cc:2749] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:09.549474  9728 leader_election.cc:343] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.556092  9963 raft_consensus.cc:359] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.556871  9963 raft_consensus.cc:385] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.557230  9963 raft_consensus.cc:740] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.557977  9963 consensus_queue.cc:260] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.560351  9963 ts_tablet_manager.cc:1434] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 13:03:09.553968  9728 leader_election.cc:304] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:09.561414  9963 tablet_bootstrap.cc:492] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:09.561448 10116 raft_consensus.cc:2749] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:09.569092  9963 tablet_bootstrap.cc:654] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.584089 10136 raft_consensus.cc:515] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.589432  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b95221ddfd49cca2e58073915a692a" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:09.588129 10136 leader_election.cc:290] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:09.596837  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b95221ddfd49cca2e58073915a692a" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
W20260709 13:03:09.600778  9654 leader_election.cc:343] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:09.611323  9731 consensus_peers.cc:597] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 -> Peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Couldn't send request to peer 451c871fd36f4d95a76b62d041aa7b60. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.605135 10116 consensus_queue.cc:1048] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:09.622725  9959 tablet_bootstrap.cc:492] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:09.623281  9959 ts_tablet_manager.cc:1403] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.152s	user 0.012s	sys 0.012s
I20260709 13:03:09.624441  9961 tablet_bootstrap.cc:654] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.638691  9958 tablet_bootstrap.cc:492] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:09.639283  9958 ts_tablet_manager.cc:1403] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.185s	user 0.013s	sys 0.021s
I20260709 13:03:09.640244  9963 tablet_bootstrap.cc:492] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:09.640849  9963 ts_tablet_manager.cc:1403] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.080s	user 0.036s	sys 0.013s
W20260709 13:03:09.643290  9636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:09.645052 10136 raft_consensus.cc:493] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.645618 10136 raft_consensus.cc:515] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.646065  9963 raft_consensus.cc:359] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.646639  9963 raft_consensus.cc:385] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.646833  9963 raft_consensus.cc:740] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.647899 10136 leader_election.cc:290] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:09.647400  9963 consensus_queue.cc:260] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.648741  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64e505f3a594381a9e50a8030c33783" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:09.649020  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64e505f3a594381a9e50a8030c33783" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:09.649549  9837 raft_consensus.cc:2468] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:09.649812  9912 raft_consensus.cc:2468] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:09.651063  9963 ts_tablet_manager.cc:1434] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:09.651002  9656 leader_election.cc:304] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:09.652273  9963 tablet_bootstrap.cc:492] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:09.654522  9959 raft_consensus.cc:359] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.655282  9959 raft_consensus.cc:385] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.655539 10136 raft_consensus.cc:2804] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:09.656075 10136 raft_consensus.cc:493] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.656430 10136 raft_consensus.cc:3060] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.658982  9963 tablet_bootstrap.cc:654] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.661960  9958 raft_consensus.cc:359] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:09.663523  9958 raft_consensus.cc:385] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.663926  9958 raft_consensus.cc:740] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.665086  9958 consensus_queue.cc:260] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:09.615567  9964 raft_consensus.cc:515] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.668607  9911 raft_consensus.cc:2393] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in current term 1: Already voted for candidate 8557220d7e6a4ccbbef222e80a5584a5 in this term.
I20260709 13:03:09.669910  9961 tablet_bootstrap.cc:492] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:09.670459  9961 ts_tablet_manager.cc:1403] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.000s
I20260709 13:03:09.670598  9653 leader_election.cc:304] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:09.673472 10030 raft_consensus.cc:2749] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:09.674046  9686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b95221ddfd49cca2e58073915a692a" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:09.675316  9686 raft_consensus.cc:2393] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8557220d7e6a4ccbbef222e80a5584a5 in current term 1: Already voted for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in this term.
I20260709 13:03:09.676529  9958 ts_tablet_manager.cc:1434] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 13:03:09.675503  9961 raft_consensus.cc:359] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:09.655586  9959 raft_consensus.cc:740] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.677323  9961 raft_consensus.cc:385] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.677901  9961 raft_consensus.cc:740] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.678308  9958 tablet_bootstrap.cc:492] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:09.679497  9961 consensus_queue.cc:260] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:09.687858  9961 ts_tablet_manager.cc:1434] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 13:03:09.689527  9961 tablet_bootstrap.cc:492] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:09.688936  9959 consensus_queue.cc:260] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.690544  9958 tablet_bootstrap.cc:654] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.692092  9964 leader_election.cc:290] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:09.693498  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b95221ddfd49cca2e58073915a692a" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
W20260709 13:03:09.695154  9877 leader_election.cc:343] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.695619  9877 leader_election.cc:304] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:09.695863  9587 catalog_manager.cc:5697] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.703402  9963 tablet_bootstrap.cc:492] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:09.704407  9961 tablet_bootstrap.cc:654] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.705917  9963 ts_tablet_manager.cc:1403] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.016s
I20260709 13:03:09.708796  9963 raft_consensus.cc:359] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.704813 10136 raft_consensus.cc:515] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.711097 10136 leader_election.cc:290] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:09.711694  9963 raft_consensus.cc:385] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.712080  9963 raft_consensus.cc:740] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.712879  9963 consensus_queue.cc:260] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.715243  9963 ts_tablet_manager.cc:1434] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:03:09.715615  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64e505f3a594381a9e50a8030c33783" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:09.716234  9837 raft_consensus.cc:3060] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.716357  9963 tablet_bootstrap.cc:492] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:09.723634  9963 tablet_bootstrap.cc:654] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.726774  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64e505f3a594381a9e50a8030c33783" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:09.727530  9911 raft_consensus.cc:3060] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.728487  9837 raft_consensus.cc:2468] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:09.730517  9656 leader_election.cc:304] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:09.731995  9959 ts_tablet_manager.cc:1434] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.003s
I20260709 13:03:09.733188  9959 tablet_bootstrap.cc:492] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:09.734375 10136 raft_consensus.cc:2804] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:09.734930 10136 raft_consensus.cc:697] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:09.735764 10136 consensus_queue.cc:237] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.736783 10123 raft_consensus.cc:2749] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:09.739881  9911 raft_consensus.cc:2468] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:09.743722  9958 tablet_bootstrap.cc:492] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:09.744292  9958 ts_tablet_manager.cc:1403] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.005s
I20260709 13:03:09.747135  9958 raft_consensus.cc:359] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:09.748175  9958 raft_consensus.cc:385] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.748548  9958 raft_consensus.cc:740] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.750577  9958 consensus_queue.cc:260] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:09.750838 10116 consensus_queue.cc:1048] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:09.752875  9958 ts_tablet_manager.cc:1434] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:09.753854  9958 tablet_bootstrap.cc:492] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:09.760622  9958 tablet_bootstrap.cc:654] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.762072 10123 consensus_queue.cc:1048] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:09.769512 10116 raft_consensus.cc:493] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.772267 10116 raft_consensus.cc:515] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:09.774616  9959 tablet_bootstrap.cc:654] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.775331  9686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfed6059cc642b290ce15a921704fc4" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:09.776284  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfed6059cc642b290ce15a921704fc4" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
W20260709 13:03:09.776924  9731 leader_election.cc:343] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:09.777988  9731 leader_election.cc:343] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.778435  9731 leader_election.cc:304] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:09.779238 10078 raft_consensus.cc:2749] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:09.780230 10116 leader_election.cc:290] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:09.784562  9961 tablet_bootstrap.cc:492] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:09.785175  9961 ts_tablet_manager.cc:1403] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.096s	user 0.028s	sys 0.008s
I20260709 13:03:09.788024  9961 raft_consensus.cc:359] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:09.788803  9961 raft_consensus.cc:385] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.789124  9961 raft_consensus.cc:740] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.789852  9961 consensus_queue.cc:260] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:09.805029  9961 ts_tablet_manager.cc:1434] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:03:09.805682 10116 consensus_queue.cc:1048] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:09.805090  9588 catalog_manager.cc:5697] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.806180  9961 tablet_bootstrap.cc:492] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:09.807896 10131 raft_consensus.cc:493] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.808429 10131 raft_consensus.cc:515] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:09.808310  9588 catalog_manager.cc:5697] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.809844 10123 raft_consensus.cc:493] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.810348 10123 raft_consensus.cc:515] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.810743 10131 leader_election.cc:290] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:09.812253  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0495f84dcd455a878471b702e53cdd" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:09.812408  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0495f84dcd455a878471b702e53cdd" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:09.812549 10123 leader_election.cc:290] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:09.820353  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a2118bc9914ddda2630ddb688ebaa9" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:09.823020  9912 raft_consensus.cc:3060] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.832149  9961 tablet_bootstrap.cc:654] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.824910  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a2118bc9914ddda2630ddb688ebaa9" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:09.819183  9802 leader_election.cc:304] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:09.828594 10120 consensus_queue.cc:1048] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:03:09.839999 10127 raft_consensus.cc:2749] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:09.840955  9877 leader_election.cc:304] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:09.842837  9961 tablet_bootstrap.cc:492] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:09.843336  9961 ts_tablet_manager.cc:1403] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 13:03:09.842590  9584 catalog_manager.cc:5697] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.853590  9961 raft_consensus.cc:359] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.855108  9961 raft_consensus.cc:385] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.855851  9961 raft_consensus.cc:740] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.858076  9961 consensus_queue.cc:260] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.861763  9961 ts_tablet_manager.cc:1434] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:03:09.865759  9961 tablet_bootstrap.cc:492] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:09.867281  9963 tablet_bootstrap.cc:492] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:09.867969  9963 ts_tablet_manager.cc:1403] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.152s	user 0.029s	sys 0.013s
I20260709 13:03:09.870078 10123 raft_consensus.cc:2749] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:09.875437  9959 tablet_bootstrap.cc:492] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:09.876075  9959 ts_tablet_manager.cc:1403] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.143s	user 0.018s	sys 0.023s
I20260709 13:03:09.876367 10116 consensus_queue.cc:1048] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:09.878997  9961 tablet_bootstrap.cc:654] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.879433  9959 raft_consensus.cc:359] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.880226  9959 raft_consensus.cc:385] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.880550  9959 raft_consensus.cc:740] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.881356  9959 consensus_queue.cc:260] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.884106  9959 ts_tablet_manager.cc:1434] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:03:09.885176  9959 tablet_bootstrap.cc:492] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:09.892015  9959 tablet_bootstrap.cc:654] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.901484  9963 raft_consensus.cc:359] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:09.902127  9963 raft_consensus.cc:385] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.902316  9963 raft_consensus.cc:740] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.903739  9963 consensus_queue.cc:260] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:09.904489  9958 tablet_bootstrap.cc:492] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:09.905066  9958 ts_tablet_manager.cc:1403] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.002s
I20260709 13:03:09.905895  9963 ts_tablet_manager.cc:1434] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:03:09.905964  9961 tablet_bootstrap.cc:492] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:09.906648  9961 ts_tablet_manager.cc:1403] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.015s
I20260709 13:03:09.907065  9963 tablet_bootstrap.cc:492] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:09.909668  9961 raft_consensus.cc:359] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:09.910435  9961 raft_consensus.cc:385] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.910699  9961 raft_consensus.cc:740] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.911415  9961 consensus_queue.cc:260] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:09.913040  9961 ts_tablet_manager.cc:1434] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:09.907793  9958 raft_consensus.cc:359] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.914172  9958 raft_consensus.cc:385] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.914376  9961 tablet_bootstrap.cc:492] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:09.914547  9958 raft_consensus.cc:740] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.915545  9958 consensus_queue.cc:260] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.918213  9958 ts_tablet_manager.cc:1434] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:03:09.930929  9963 tablet_bootstrap.cc:654] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.931177 10120 raft_consensus.cc:493] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.945394  9958 tablet_bootstrap.cc:492] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:09.945339 10120 raft_consensus.cc:515] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.948014 10120 leader_election.cc:290] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:09.953527  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e983261153492e83602412c376fa6f" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:09.954907  9765 raft_consensus.cc:2468] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:09.956453  9877 leader_election.cc:304] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:09.934087  9959 tablet_bootstrap.cc:492] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:09.957959 10030 raft_consensus.cc:493] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.958082  9959 ts_tablet_manager.cc:1403] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.000s
I20260709 13:03:09.958652 10030 raft_consensus.cc:515] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.961282  9964 raft_consensus.cc:493] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.961829 10124 raft_consensus.cc:2804] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:09.962252 10124 raft_consensus.cc:493] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.962599 10124 raft_consensus.cc:3060] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.962924  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d42567f00fd44cabc99c217e4df31d8" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:09.965102  9836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d42567f00fd44cabc99c217e4df31d8" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
W20260709 13:03:09.965835  9653 leader_election.cc:343] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:09.966266  9836 raft_consensus.cc:2468] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:09.961879  9964 raft_consensus.cc:515] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.970794  9656 leader_election.cc:304] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:09.972887 10136 raft_consensus.cc:2804] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:09.973383 10136 raft_consensus.cc:493] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.973773 10136 raft_consensus.cc:3060] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.976816  9836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ec003b8fb0423eae15b72ac88ce69f" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:09.977550  9836 raft_consensus.cc:2468] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:09.978924  9686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ec003b8fb0423eae15b72ac88ce69f" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:09.979933  9686 raft_consensus.cc:2468] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:09.980659  9879 leader_election.cc:304] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:09.981019  9963 tablet_bootstrap.cc:492] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:09.981720  9963 ts_tablet_manager.cc:1403] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.075s	user 0.021s	sys 0.000s
I20260709 13:03:09.960973 10030 leader_election.cc:290] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:09.984869 10123 raft_consensus.cc:2804] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:09.985507 10123 raft_consensus.cc:493] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.970798  9958 tablet_bootstrap.cc:654] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.986543 10123 raft_consensus.cc:3060] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.985762 10136 raft_consensus.cc:515] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:09.977651  9964 leader_election.cc:290] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:09.990293  9836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d42567f00fd44cabc99c217e4df31d8" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:09.990958  9836 raft_consensus.cc:3060] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.992781  9963 raft_consensus.cc:359] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:09.942603  9961 tablet_bootstrap.cc:654] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.993603  9963 raft_consensus.cc:385] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.994500  9963 raft_consensus.cc:740] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.961583  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e983261153492e83602412c376fa6f" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:09.995208  9963 consensus_queue.cc:260] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:10.002420  9959 raft_consensus.cc:359] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.003655  9963 ts_tablet_manager.cc:1434] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 13:03:10.004159 10136 leader_election.cc:290] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:10.003872  9959 raft_consensus.cc:385] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.005028  9963 tablet_bootstrap.cc:492] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:10.005352  9959 raft_consensus.cc:740] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.008127  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d42567f00fd44cabc99c217e4df31d8" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
W20260709 13:03:10.010262  9653 leader_election.cc:343] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.011507  9958 tablet_bootstrap.cc:492] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:10.012034  9958 ts_tablet_manager.cc:1403] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.067s	user 0.007s	sys 0.013s
I20260709 13:03:10.013222  9963 tablet_bootstrap.cc:654] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.014882  9958 raft_consensus.cc:359] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.015658  9958 raft_consensus.cc:385] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.015985  9958 raft_consensus.cc:740] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.007170  9959 consensus_queue.cc:260] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.018360  9836 raft_consensus.cc:2468] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:10.018649  9958 consensus_queue.cc:260] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.021019  9656 leader_election.cc:304] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:10.021518  9958 ts_tablet_manager.cc:1434] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:03:10.021709  9959 ts_tablet_manager.cc:1434] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.002s
I20260709 13:03:10.022729  9959 tablet_bootstrap.cc:492] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:10.022568 10136 raft_consensus.cc:2804] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:10.023144  9958 tablet_bootstrap.cc:492] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:10.023524 10136 raft_consensus.cc:697] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:10.024451 10136 consensus_queue.cc:237] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:10.036520  9963 tablet_bootstrap.cc:492] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:10.037226  9963 ts_tablet_manager.cc:1403] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.007s
I20260709 13:03:10.038138 10124 raft_consensus.cc:515] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:10.040946  9963 raft_consensus.cc:359] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:10.041682  9963 raft_consensus.cc:385] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.041978  9963 raft_consensus.cc:740] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.043569  9959 tablet_bootstrap.cc:654] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.042762  9963 consensus_queue.cc:260] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:10.045558  9961 tablet_bootstrap.cc:492] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:10.045773  9963 ts_tablet_manager.cc:1434] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:10.046095  9961 ts_tablet_manager.cc:1403] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.132s	user 0.015s	sys 0.006s
I20260709 13:03:10.046980  9963 tablet_bootstrap.cc:492] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:10.047791 10124 leader_election.cc:290] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:10.049374  9961 raft_consensus.cc:359] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.053000  9961 raft_consensus.cc:385] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.053472  9961 raft_consensus.cc:740] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.054488  9961 consensus_queue.cc:260] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.001607  9690 raft_consensus.cc:2468] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:10.060523  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e983261153492e83602412c376fa6f" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:10.061228  9765 raft_consensus.cc:3060] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.061501  9963 tablet_bootstrap.cc:654] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.067229  9686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e983261153492e83602412c376fa6f" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:10.078040 10079 raft_consensus.cc:493] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.078759 10079 raft_consensus.cc:515] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:10.081640 10079 leader_election.cc:290] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:10.083504  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b95221ddfd49cca2e58073915a692a" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:10.084811  9912 raft_consensus.cc:2393] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 837fad20523b4348b68f0a1e1af12404 in current term 1: Already voted for candidate 8557220d7e6a4ccbbef222e80a5584a5 in this term.
I20260709 13:03:10.094411 10117 raft_consensus.cc:493] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.101027 10117 raft_consensus.cc:515] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.103639 10136 raft_consensus.cc:493] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.061904 10123 raft_consensus.cc:515] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:10.104311 10136 raft_consensus.cc:515] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.104729  9836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36b261dca1448a8976c337d0adca949" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:10.105502  9836 raft_consensus.cc:2468] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:10.106509 10123 leader_election.cc:290] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:10.106722 10136 leader_election.cc:290] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:10.107800  9961 ts_tablet_manager.cc:1434] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:03:10.107993  9688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ec003b8fb0423eae15b72ac88ce69f" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:10.108641  9688 raft_consensus.cc:3060] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.108940  9961 tablet_bootstrap.cc:492] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:10.109107  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ec003b8fb0423eae15b72ac88ce69f" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:10.103554 10117 leader_election.cc:290] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:10.109889  9837 raft_consensus.cc:3060] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.110471  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b95221ddfd49cca2e58073915a692a" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:10.111375  9690 raft_consensus.cc:2393] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 837fad20523b4348b68f0a1e1af12404 in current term 1: Already voted for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in this term.
I20260709 13:03:10.098573  9587 catalog_manager.cc:5697] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:10.113881  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb824343684771b7c7042727a90e40" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
W20260709 13:03:10.115877  9656 leader_election.cc:343] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.108395  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36b261dca1448a8976c337d0adca949" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:10.118348  9961 tablet_bootstrap.cc:654] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.126700  9958 tablet_bootstrap.cc:654] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.128325  9836 raft_consensus.cc:3060] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.124083  9688 raft_consensus.cc:2468] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:10.124122  9731 leader_election.cc:304] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
W20260709 13:03:10.141037  9728 leader_election.cc:343] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.144761  9763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb824343684771b7c7042727a90e40" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:10.143770 10117 raft_consensus.cc:2804] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:10.144994  9879 leader_election.cc:304] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:10.174250 10136 raft_consensus.cc:493] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.217171  9961 tablet_bootstrap.cc:492] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:10.217722  9961 ts_tablet_manager.cc:1403] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.109s	user 0.017s	sys 0.014s
I20260709 13:03:10.218411 10123 raft_consensus.cc:2804] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:10.218962 10123 raft_consensus.cc:697] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:10.215453 10117 raft_consensus.cc:493] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.150928  9765 raft_consensus.cc:2468] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:10.221118  9961 raft_consensus.cc:359] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.216032  9763 raft_consensus.cc:2468] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:10.223452  9963 tablet_bootstrap.cc:492] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:10.223961  9963 ts_tablet_manager.cc:1403] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.177s	user 0.015s	sys 0.014s
I20260709 13:03:10.224118  9959 tablet_bootstrap.cc:492] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:10.224956  9959 ts_tablet_manager.cc:1403] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.202s	user 0.043s	sys 0.080s
I20260709 13:03:10.157033  9731 leader_election.cc:304] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:10.219817 10123 consensus_queue.cc:237] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
W20260709 13:03:10.220924  9879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 76340us
I20260709 13:03:10.222173  9961 raft_consensus.cc:385] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.217458 10136 raft_consensus.cc:515] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:10.227758  9961 raft_consensus.cc:740] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.221355 10117 raft_consensus.cc:3060] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.228672  9961 consensus_queue.cc:260] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.230613 10136 leader_election.cc:290] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:10.231148  9961 ts_tablet_manager.cc:1434] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:03:10.232218  9961 tablet_bootstrap.cc:492] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:10.232997  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53ce2e48bf64a4cac0e42aed1e3ac61" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
W20260709 13:03:10.234479  9653 leader_election.cc:343] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.227572  9959 raft_consensus.cc:359] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:10.237334  9959 raft_consensus.cc:385] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.237668  9959 raft_consensus.cc:740] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.238852  9877 leader_election.cc:304] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:10.239374  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53ce2e48bf64a4cac0e42aed1e3ac61" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:10.240038  9961 tablet_bootstrap.cc:654] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.240420 10124 raft_consensus.cc:2804] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:10.240974 10124 raft_consensus.cc:697] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:10.241101  9654 leader_election.cc:304] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:10.242161 10124 consensus_queue.cc:237] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
W20260709 13:03:10.244971  9731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 88150.7us
I20260709 13:03:10.242882  9959 consensus_queue.cc:260] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:10.244899 10079 raft_consensus.cc:3060] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.248740  9961 tablet_bootstrap.cc:492] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:10.217571  9837 raft_consensus.cc:2468] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:10.249250  9961 ts_tablet_manager.cc:1403] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:03:10.252241  9961 raft_consensus.cc:359] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:10.252960  9961 raft_consensus.cc:385] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.253211  9961 raft_consensus.cc:740] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.253901  9961 consensus_queue.cc:260] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:10.254470 10127 raft_consensus.cc:493] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.255402 10127 raft_consensus.cc:515] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.255806  9961 ts_tablet_manager.cc:1434] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:10.256860  9961 tablet_bootstrap.cc:492] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:10.260005  9959 ts_tablet_manager.cc:1434] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.003s
I20260709 13:03:10.261190  9959 tablet_bootstrap.cc:492] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:10.262391 10030 consensus_queue.cc:1048] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:10.263450  9961 tablet_bootstrap.cc:654] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.265921  9588 catalog_manager.cc:5697] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.267083 10030 raft_consensus.cc:2804] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:10.274650 10030 raft_consensus.cc:493] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.274996  9961 tablet_bootstrap.cc:492] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:10.275154 10030 raft_consensus.cc:3060] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.275548  9961 ts_tablet_manager.cc:1403] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:03:10.282195  9961 raft_consensus.cc:359] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.283314 10131 raft_consensus.cc:493] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.283870 10131 raft_consensus.cc:515] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.286037  9959 tablet_bootstrap.cc:654] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.286216 10131 leader_election.cc:290] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:10.282943  9961 raft_consensus.cc:385] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.287985  9961 raft_consensus.cc:740] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.288841  9961 consensus_queue.cc:260] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.290498  9763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048c260ea0264cacbc43596c71ecb9d4" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:10.291872  9763 raft_consensus.cc:2468] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
I20260709 13:03:10.271512 10127 leader_election.cc:290] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:10.271873  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048c260ea0264cacbc43596c71ecb9d4" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:10.290720 10189 consensus_queue.cc:1048] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:03:10.293264  9803 leader_election.cc:304] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:10.290825  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfed6059cc642b290ce15a921704fc4" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:10.296161  9765 raft_consensus.cc:2468] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
I20260709 13:03:10.296782 10131 raft_consensus.cc:2804] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:10.297264 10131 raft_consensus.cc:493] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.297783 10131 raft_consensus.cc:3060] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.298264  9803 leader_election.cc:304] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
W20260709 13:03:10.265626  9654 leader_election.cc:343] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.291343  9961 ts_tablet_manager.cc:1434] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:03:10.300364 10127 raft_consensus.cc:2804] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:10.301040 10127 raft_consensus.cc:493] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.301816  9654 leader_election.cc:304] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:10.227355  9963 raft_consensus.cc:359] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:10.302649  9963 raft_consensus.cc:385] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.301362  9961 tablet_bootstrap.cc:492] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:10.304298  9688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfed6059cc642b290ce15a921704fc4" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:10.306274  9805 leader_election.cc:343] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.293167  9911 raft_consensus.cc:2468] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
I20260709 13:03:10.302748 10189 raft_consensus.cc:2749] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:10.272008 10079 raft_consensus.cc:2749] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:10.301991 10127 raft_consensus.cc:3060] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.312412  9961 tablet_bootstrap.cc:654] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.312919  9963 raft_consensus.cc:740] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.317615  9963 consensus_queue.cc:260] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:10.320148  9963 ts_tablet_manager.cc:1434] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.002s
I20260709 13:03:10.323958  9963 tablet_bootstrap.cc:492] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:10.300009  9959 tablet_bootstrap.cc:492] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:10.328565  9959 ts_tablet_manager.cc:1403] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.003s
I20260709 13:03:10.332700  9959 raft_consensus.cc:359] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.333552  9959 raft_consensus.cc:385] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.334076  9959 raft_consensus.cc:740] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.336087  9959 consensus_queue.cc:260] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.319957 10131 raft_consensus.cc:515] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.366828  9959 ts_tablet_manager.cc:1434] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:03:10.367720  9959 tablet_bootstrap.cc:492] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:10.388499  9963 tablet_bootstrap.cc:654] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.378440 10117 raft_consensus.cc:515] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.398715 10117 leader_election.cc:290] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:10.406153  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36b261dca1448a8976c337d0adca949" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:10.406872  9911 raft_consensus.cc:3060] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.407717 10127 raft_consensus.cc:515] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.425467  9587 catalog_manager.cc:5697] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.430997  9958 tablet_bootstrap.cc:492] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:10.431640  9958 ts_tablet_manager.cc:1403] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.409s	user 0.021s	sys 0.008s
I20260709 13:03:10.432376  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36b261dca1448a8976c337d0adca949" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:10.433154  9837 raft_consensus.cc:3060] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.435103  9961 tablet_bootstrap.cc:492] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:10.435642  9961 ts_tablet_manager.cc:1403] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.135s	user 0.027s	sys 0.012s
I20260709 13:03:10.394176 10030 raft_consensus.cc:515] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.466559 10131 leader_election.cc:290] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:10.482547 10131 raft_consensus.cc:493] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.483276 10030 leader_election.cc:290] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:10.483153 10131 raft_consensus.cc:515] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.468024  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048c260ea0264cacbc43596c71ecb9d4" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:10.486315  9913 raft_consensus.cc:3060] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.451650 10201 raft_consensus.cc:493] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.487960 10201 raft_consensus.cc:515] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:10.488931 10131 leader_election.cc:290] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:10.489817  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb824343684771b7c7042727a90e40" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:10.490394 10201 leader_election.cc:290] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:10.490562  9765 raft_consensus.cc:3060] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.448629 10120 raft_consensus.cc:493] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.491585 10120 raft_consensus.cc:515] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:10.493058  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165514a80df44205b5aee88c4509ba6e" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:10.493695 10120 leader_election.cc:290] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:10.495795  9959 tablet_bootstrap.cc:654] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:10.495581  9653 leader_election.cc:343] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.496523  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb824343684771b7c7042727a90e40" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:10.497714  9835 raft_consensus.cc:3060] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.501091  9909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf0dc7bcfe41e58f7c298165f4d2b5" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:10.502302  9911 raft_consensus.cc:2468] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
W20260709 13:03:10.503119  9802 leader_election.cc:343] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.504643  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d42567f00fd44cabc99c217e4df31d8" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:10.505497  9838 raft_consensus.cc:2393] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8557220d7e6a4ccbbef222e80a5584a5 in current term 1: Already voted for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in this term.
I20260709 13:03:10.508255  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d42567f00fd44cabc99c217e4df31d8" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:10.509662  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165514a80df44205b5aee88c4509ba6e" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:10.509785  9909 raft_consensus.cc:3060] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.510787  9838 raft_consensus.cc:2468] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:10.519085  9656 leader_election.cc:304] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:10.521327  9879 leader_election.cc:304] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:10.530731  9913 raft_consensus.cc:2468] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:10.533501  9802 leader_election.cc:304] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:10.534670 10199 raft_consensus.cc:2804] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:10.535303 10199 raft_consensus.cc:697] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:10.535812 10189 raft_consensus.cc:2804] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:10.535724  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfed6059cc642b290ce15a921704fc4" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:10.536453 10189 raft_consensus.cc:493] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.537017 10189 raft_consensus.cc:3060] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.537890 10136 consensus_queue.cc:1048] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:10.536979 10120 raft_consensus.cc:2749] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:10.542778  9805 leader_election.cc:343] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.533666 10127 leader_election.cc:290] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:10.536298 10199 consensus_queue.cc:237] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.539227  9835 raft_consensus.cc:2468] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
W20260709 13:03:10.554997 10192 log.cc:927] Time spent T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:03:10.559417  9961 raft_consensus.cc:359] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.570760  9961 raft_consensus.cc:385] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.574571  9961 raft_consensus.cc:740] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.575403  9961 consensus_queue.cc:260] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.532383  9837 raft_consensus.cc:2468] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:10.579298  9961 ts_tablet_manager.cc:1434] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.143s	user 0.008s	sys 0.000s
I20260709 13:03:10.532383  9765 raft_consensus.cc:2468] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:10.595178  9958 raft_consensus.cc:359] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:10.596638  9958 raft_consensus.cc:385] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.570410  9728 leader_election.cc:304] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:10.598265  9958 raft_consensus.cc:740] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
W20260709 13:03:10.597963  9653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:36227, user_credentials={real_user=slave}} blocked reactor thread for 60536.5us
W20260709 13:03:10.609612  9728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:36227, user_credentials={real_user=slave}} blocked reactor thread for 52663.6us
I20260709 13:03:10.611209 10116 raft_consensus.cc:2804] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:10.611725 10116 raft_consensus.cc:697] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:10.612659 10116 consensus_queue.cc:237] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:10.613184  9958 consensus_queue.cc:260] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:10.617027  9963 tablet_bootstrap.cc:492] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:10.617782  9963 ts_tablet_manager.cc:1403] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.294s	user 0.016s	sys 0.006s
I20260709 13:03:10.596853  9656 leader_election.cc:304] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:10.622229 10030 raft_consensus.cc:2804] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:10.622882 10030 raft_consensus.cc:697] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:10.623936 10030 consensus_queue.cc:237] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.627013  9964 consensus_queue.cc:1048] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:10.644234  9763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf0dc7bcfe41e58f7c298165f4d2b5" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
W20260709 13:03:10.647768  9803 leader_election.cc:343] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.648300  9803 leader_election.cc:304] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:10.649272  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048c260ea0264cacbc43596c71ecb9d4" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:10.649925  9765 raft_consensus.cc:3060] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.651970  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfed6059cc642b290ce15a921704fc4" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:10.652709  9762 raft_consensus.cc:3060] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.657133 10203 raft_consensus.cc:2749] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:10.659785 10201 consensus_queue.cc:1048] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:10.667795  9958 ts_tablet_manager.cc:1434] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.236s	user 0.009s	sys 0.001s
I20260709 13:03:10.669291  9958 tablet_bootstrap.cc:492] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:10.684459  9961 tablet_bootstrap.cc:492] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:10.685658  9959 tablet_bootstrap.cc:492] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:10.686126  9959 ts_tablet_manager.cc:1403] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.319s	user 0.011s	sys 0.009s
I20260709 13:03:10.682466 10079 raft_consensus.cc:493] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.694240 10079 raft_consensus.cc:515] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:10.699157  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53ce2e48bf64a4cac0e42aed1e3ac61" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:10.701432  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53ce2e48bf64a4cac0e42aed1e3ac61" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:10.702239  9690 raft_consensus.cc:2468] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:10.703151 10120 consensus_queue.cc:1048] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:10.671522 10189 raft_consensus.cc:515] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:10.717586  9731 leader_election.cc:304] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:10.718935 10117 raft_consensus.cc:2804] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:10.719489 10117 raft_consensus.cc:493] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.719844 10117 raft_consensus.cc:3060] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.696406 10079 leader_election.cc:290] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
W20260709 13:03:10.725168  9728 leader_election.cc:343] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.753324  9958 tablet_bootstrap.cc:654] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.738749  9959 raft_consensus.cc:359] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:10.762950  9959 raft_consensus.cc:385] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.763422  9959 raft_consensus.cc:740] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.764983 10189 leader_election.cc:290] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:10.765285  9959 consensus_queue.cc:260] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:10.771404  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165514a80df44205b5aee88c4509ba6e" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:10.772437  9959 ts_tablet_manager.cc:1434] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.001s
I20260709 13:03:10.728907  9964 consensus_queue.cc:1048] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
W20260709 13:03:10.773375  9653 leader_election.cc:343] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.773675  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165514a80df44205b5aee88c4509ba6e" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:10.774096  9963 raft_consensus.cc:359] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.774796  9963 raft_consensus.cc:385] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.775101  9963 raft_consensus.cc:740] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.774435  9838 raft_consensus.cc:3060] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.775816  9963 consensus_queue.cc:260] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.777534  9588 catalog_manager.cc:5697] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.773572  9959 tablet_bootstrap.cc:492] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:10.771624  9961 tablet_bootstrap.cc:654] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.786087  9963 ts_tablet_manager.cc:1434] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.168s	user 0.007s	sys 0.001s
I20260709 13:03:10.794186  9690 raft_consensus.cc:3060] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.796454  9959 tablet_bootstrap.cc:654] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.799364  9765 raft_consensus.cc:2468] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:10.727285  9762 raft_consensus.cc:2468] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:10.732210  9585 catalog_manager.cc:5697] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.833523  9963 tablet_bootstrap.cc:492] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:10.785239 10117 raft_consensus.cc:515] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:10.847996  9838 raft_consensus.cc:2468] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:10.850476  9656 leader_election.cc:304] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:10.851729 10030 raft_consensus.cc:2804] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:10.852258 10030 raft_consensus.cc:697] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:10.853693 10198 raft_consensus.cc:493] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.853489 10030 consensus_queue.cc:237] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:10.854223 10198 raft_consensus.cc:515] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.864428  9686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47136b305fde43d8b8b8af12cecd9750" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:10.867226 10189 raft_consensus.cc:493] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.867770 10189 raft_consensus.cc:515] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
W20260709 13:03:10.868806  9805 leader_election.cc:343] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.870368 10189 leader_election.cc:290] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:10.871503  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfed6059cc642b290ce15a921704fc4" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:10.871507  9803 leader_election.cc:304] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:10.874945 10127 raft_consensus.cc:2804] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:10.878870  9762 raft_consensus.cc:2393] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in current term 1: Already voted for candidate 451c871fd36f4d95a76b62d041aa7b60 in this term.
I20260709 13:03:10.879154 10127 raft_consensus.cc:697] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:10.880121 10127 consensus_queue.cc:237] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:10.881882  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfed6059cc642b290ce15a921704fc4" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:10.883132  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47136b305fde43d8b8b8af12cecd9750" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:10.856480 10198 leader_election.cc:290] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
W20260709 13:03:10.892210  9803 leader_election.cc:343] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.892933  9803 leader_election.cc:304] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:10.898144  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53ce2e48bf64a4cac0e42aed1e3ac61" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:10.909543 10198 raft_consensus.cc:2749] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:10.935022 10123 consensus_queue.cc:1048] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:10.929214  9911 raft_consensus.cc:3060] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.941603 10117 leader_election.cc:290] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:10.923772  9654 leader_election.cc:304] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:10.961406 10030 raft_consensus.cc:3060] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:10.979933  9961 tablet_bootstrap.cc:492] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:10.980492  9961 ts_tablet_manager.cc:1403] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.296s	user 0.044s	sys 0.046s
I20260709 13:03:10.985978  9959 tablet_bootstrap.cc:492] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:10.986547  9959 ts_tablet_manager.cc:1403] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.213s	user 0.014s	sys 0.050s
I20260709 13:03:10.991353  9911 raft_consensus.cc:2468] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
W20260709 13:03:10.968050  9654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:44623, user_credentials={real_user=slave}} blocked reactor thread for 57110.3us
I20260709 13:03:10.992481  9963 tablet_bootstrap.cc:654] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.993319  9728 leader_election.cc:304] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:10.994465 10119 raft_consensus.cc:2804] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:10.995074 10119 raft_consensus.cc:697] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:10.996035 10119 consensus_queue.cc:237] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.000139  9959 raft_consensus.cc:359] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.001546  9959 raft_consensus.cc:385] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.001984  9959 raft_consensus.cc:740] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
W20260709 13:03:10.984084 10211 log.cc:927] Time spent T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5: Append to log took a long time: real 0.107s	user 0.002s	sys 0.000s
I20260709 13:03:11.001726  9958 tablet_bootstrap.cc:492] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:11.007090  9958 ts_tablet_manager.cc:1403] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.338s	user 0.020s	sys 0.015s
I20260709 13:03:11.002902  9959 consensus_queue.cc:260] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
W20260709 13:03:11.009874 10214 log.cc:927] Time spent T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:03:11.011034  9959 ts_tablet_manager.cc:1434] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 13:03:11.012167  9959 tablet_bootstrap.cc:492] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:11.016939  9687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53ce2e48bf64a4cac0e42aed1e3ac61" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:11.017733  9687 raft_consensus.cc:3060] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.034359  9958 raft_consensus.cc:359] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.035246  9958 raft_consensus.cc:385] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.035583  9958 raft_consensus.cc:740] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.036417  9958 consensus_queue.cc:260] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.038142  9958 ts_tablet_manager.cc:1434] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:03:11.039124  9958 tablet_bootstrap.cc:492] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
W20260709 13:03:11.042167  9636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:11.042912 10030 raft_consensus.cc:2749] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.042436  9586 catalog_manager.cc:5697] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.045079 10131 consensus_queue.cc:1048] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:11.046412  9958 tablet_bootstrap.cc:654] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.055972 10079 consensus_queue.cc:1048] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:11.057740  9959 tablet_bootstrap.cc:654] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.060163  9961 raft_consensus.cc:359] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.061056  9961 raft_consensus.cc:385] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.061405  9961 raft_consensus.cc:740] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.068956  9961 consensus_queue.cc:260] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.080425  9961 ts_tablet_manager.cc:1434] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.000s
I20260709 13:03:11.105309  9963 tablet_bootstrap.cc:492] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:11.106343  9963 ts_tablet_manager.cc:1403] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.273s	user 0.022s	sys 0.005s
I20260709 13:03:11.112381  9963 raft_consensus.cc:359] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.114794  9963 raft_consensus.cc:385] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.115185  9963 raft_consensus.cc:740] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.123811  9961 tablet_bootstrap.cc:492] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:11.113337 10201 consensus_queue.cc:1048] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:03:11.139241  9963 consensus_queue.cc:260] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.162431  9958 tablet_bootstrap.cc:492] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:11.163049  9958 ts_tablet_manager.cc:1403] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.124s	user 0.034s	sys 0.029s
I20260709 13:03:11.163949  9587 catalog_manager.cc:5697] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.187116  9958 raft_consensus.cc:359] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.187911  9958 raft_consensus.cc:385] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.188199  9958 raft_consensus.cc:740] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
W20260709 13:03:11.167234  9731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35769, user_credentials={real_user=slave}} blocked reactor thread for 72621us
I20260709 13:03:11.201905  9958 consensus_queue.cc:260] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.204809  9959 tablet_bootstrap.cc:492] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:11.205425  9959 ts_tablet_manager.cc:1403] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.193s	user 0.023s	sys 0.016s
I20260709 13:03:11.206262  9963 ts_tablet_manager.cc:1434] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.099s	user 0.034s	sys 0.024s
I20260709 13:03:11.207298  9963 tablet_bootstrap.cc:492] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:11.210906  9958 ts_tablet_manager.cc:1434] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:03:11.212401 10198 raft_consensus.cc:493] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.213016 10198 raft_consensus.cc:515] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.215296 10198 leader_election.cc:290] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:11.215744  9961 tablet_bootstrap.cc:654] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.216799  9958 tablet_bootstrap.cc:492] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:11.224179  9958 tablet_bootstrap.cc:654] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:11.206439  9877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:44623, user_credentials={real_user=slave}} blocked reactor thread for 75113.9us
I20260709 13:03:11.232939  9588 catalog_manager.cc:5697] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.206784 10199 consensus_queue.cc:1048] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:03:11.245755  9686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5370a6691486895274f9b937bbb1e" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:11.248786  9805 leader_election.cc:343] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.251698  9586 catalog_manager.cc:5697] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.268389  9963 tablet_bootstrap.cc:654] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.278239  9959 raft_consensus.cc:359] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.279063  9959 raft_consensus.cc:385] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.279330  9959 raft_consensus.cc:740] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.279991  9959 consensus_queue.cc:260] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.284996  9961 tablet_bootstrap.cc:492] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:11.285537  9961 ts_tablet_manager.cc:1403] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.162s	user 0.008s	sys 0.009s
I20260709 13:03:11.287325  9687 raft_consensus.cc:2468] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:11.289686 10234 consensus_queue.cc:1048] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:03:11.288269  9961 raft_consensus.cc:359] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.291082  9961 raft_consensus.cc:385] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.291401  9961 raft_consensus.cc:740] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.292090  9961 consensus_queue.cc:260] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.309990  9961 ts_tablet_manager.cc:1434] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:03:11.311517  9961 tablet_bootstrap.cc:492] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:11.323367  9959 ts_tablet_manager.cc:1434] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.000s
I20260709 13:03:11.328832  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5370a6691486895274f9b937bbb1e" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:11.333042 10199 raft_consensus.cc:493] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.356006  9961 tablet_bootstrap.cc:654] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.352387 10199 raft_consensus.cc:515] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.360715 10199 leader_election.cc:290] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:11.361955  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4079962b0054d1c828d8ab946214dfa" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:11.362110 10117 consensus_queue.cc:1048] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:11.363570  9805 leader_election.cc:343] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.368053  9959 tablet_bootstrap.cc:492] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:11.368048 10227 raft_consensus.cc:493] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.368878 10227 raft_consensus.cc:515] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.371047 10227 leader_election.cc:290] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:11.371277  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4079962b0054d1c828d8ab946214dfa" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
W20260709 13:03:11.375160  9803 leader_election.cc:343] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.375658  9803 leader_election.cc:304] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:11.376315  9958 tablet_bootstrap.cc:492] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:11.377044  9958 ts_tablet_manager.cc:1403] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.165s	user 0.012s	sys 0.021s
I20260709 13:03:11.377744 10127 raft_consensus.cc:2749] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.380463  9958 raft_consensus.cc:359] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.385720  9958 raft_consensus.cc:385] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.386052  9958 raft_consensus.cc:740] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.384253  9963 tablet_bootstrap.cc:492] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:11.387153  9963 ts_tablet_manager.cc:1403] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.180s	user 0.020s	sys 0.015s
W20260709 13:03:11.387481  9802 leader_election.cc:343] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.387977  9802 leader_election.cc:304] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:11.389277  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b95221ddfd49cca2e58073915a692a" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:11.390003  9762 raft_consensus.cc:2468] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:11.390399 10198 raft_consensus.cc:2749] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.390903 10227 raft_consensus.cc:493] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.383157  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b95221ddfd49cca2e58073915a692a" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:11.391561 10227 raft_consensus.cc:515] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.391539  9877 leader_election.cc:304] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:11.392375  9690 raft_consensus.cc:2468] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:11.404011  9963 raft_consensus.cc:359] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.407162  9963 raft_consensus.cc:385] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.408166 10199 consensus_queue.cc:1048] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:11.408696  9963 raft_consensus.cc:740] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.409997 10227 leader_election.cc:290] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:11.411356  9963 consensus_queue.cc:260] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.414108  9958 consensus_queue.cc:260] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.415225  9963 ts_tablet_manager.cc:1434] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:03:11.416982  9836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165514a80df44205b5aee88c4509ba6e" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:11.417657  9687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165514a80df44205b5aee88c4509ba6e" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:11.418345  9836 raft_consensus.cc:2393] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8557220d7e6a4ccbbef222e80a5584a5 in current term 1: Already voted for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in this term.
I20260709 13:03:11.420809  9879 leader_election.cc:304] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:11.421135  9963 tablet_bootstrap.cc:492] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:11.430095 10240 raft_consensus.cc:3060] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.434551  9963 tablet_bootstrap.cc:654] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.415225 10227 raft_consensus.cc:2804] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:11.435856 10227 raft_consensus.cc:493] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.436244 10227 raft_consensus.cc:3060] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.442561  9959 tablet_bootstrap.cc:654] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.445343  9958 ts_tablet_manager.cc:1434] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.001s
I20260709 13:03:11.446453  9958 tablet_bootstrap.cc:492] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:11.447193 10227 raft_consensus.cc:515] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.455118 10236 raft_consensus.cc:493] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.455880 10236 raft_consensus.cc:515] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.464522 10239 consensus_queue.cc:1048] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:11.465320  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f858210936a4559a877f1628213432c" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
W20260709 13:03:11.467089  9653 leader_election.cc:343] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.470429  9961 tablet_bootstrap.cc:492] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:11.470957  9961 ts_tablet_manager.cc:1403] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.160s	user 0.017s	sys 0.008s
I20260709 13:03:11.468781 10189 raft_consensus.cc:493] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.479422 10189 raft_consensus.cc:515] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.481830 10189 leader_election.cc:290] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:11.483230  9836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5370a6691486895274f9b937bbb1e" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:11.484298  9836 raft_consensus.cc:2468] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:11.472523 10239 raft_consensus.cc:493] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.492779  9909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5370a6691486895274f9b937bbb1e" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:11.493120  9656 leader_election.cc:304] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:11.495443  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f858210936a4559a877f1628213432c" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:11.502977  9762 raft_consensus.cc:2468] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:11.503144 10234 raft_consensus.cc:2804] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:11.503918 10234 raft_consensus.cc:493] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.504329 10234 raft_consensus.cc:3060] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.464491 10236 leader_election.cc:290] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:11.503923 10127 consensus_queue.cc:1048] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:03:11.507958  9653 leader_election.cc:343] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.511040 10236 consensus_queue.cc:1048] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:11.505858  9654 leader_election.cc:304] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:11.518301 10189 raft_consensus.cc:2804] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:11.518807 10189 raft_consensus.cc:493] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.519332 10189 raft_consensus.cc:3060] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.501865 10239 raft_consensus.cc:515] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.522513 10227 leader_election.cc:290] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:11.523841  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b95221ddfd49cca2e58073915a692a" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:11.524649  9762 raft_consensus.cc:3060] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.524783  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b95221ddfd49cca2e58073915a692a" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
W20260709 13:03:11.525223 10252 log.cc:927] Time spent T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:03:11.525509  9690 raft_consensus.cc:3060] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.532958  9762 raft_consensus.cc:2468] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 2.
I20260709 13:03:11.534089  9961 raft_consensus.cc:359] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.534449  9877 leader_election.cc:304] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:11.536301 10235 raft_consensus.cc:493] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.536505 10227 raft_consensus.cc:2804] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:11.537114 10227 raft_consensus.cc:697] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:11.536975 10235 raft_consensus.cc:515] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.539368  9686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47136b305fde43d8b8b8af12cecd9750" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:11.539377 10235 leader_election.cc:290] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:11.540683  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf0dc7bcfe41e58f7c298165f4d2b5" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:11.541086 10239 leader_election.cc:290] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:11.541462  9839 raft_consensus.cc:2468] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:11.541985  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47136b305fde43d8b8b8af12cecd9750" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:11.535207 10240 raft_consensus.cc:2749] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.542784  9835 raft_consensus.cc:2468] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:11.544626  9731 leader_election.cc:304] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:11.545885  9731 leader_election.cc:304] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:11.547029 10223 raft_consensus.cc:2804] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:11.547183 10117 raft_consensus.cc:2804] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:11.548198 10117 raft_consensus.cc:493] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.548627 10117 raft_consensus.cc:3060] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.536295 10234 raft_consensus.cc:515] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.550276 10236 consensus_queue.cc:1048] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:11.549757  9731 leader_election.cc:343] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.547428 10223 raft_consensus.cc:493] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.553020  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5370a6691486895274f9b937bbb1e" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:11.553341 10223 raft_consensus.cc:3060] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.553759  9835 raft_consensus.cc:3060] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.547637  9909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf0dc7bcfe41e58f7c298165f4d2b5" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:11.556113  9909 raft_consensus.cc:2468] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:11.559618  9963 tablet_bootstrap.cc:492] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:11.565090  9963 ts_tablet_manager.cc:1403] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.144s	user 0.028s	sys 0.024s
I20260709 13:03:11.573642 10234 leader_election.cc:290] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:11.574817  9958 tablet_bootstrap.cc:654] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.578594 10117 raft_consensus.cc:515] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.538077 10227 consensus_queue.cc:237] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.535392  9959 tablet_bootstrap.cc:492] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:11.570931  9835 raft_consensus.cc:2468] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:11.573009  9909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5370a6691486895274f9b937bbb1e" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:11.579479  9963 raft_consensus.cc:359] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.581239 10223 raft_consensus.cc:515] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.594349 10223 leader_election.cc:290] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:11.596633 10189 raft_consensus.cc:515] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.600464 10189 leader_election.cc:290] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:11.605530  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf0dc7bcfe41e58f7c298165f4d2b5" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:11.605944  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf0dc7bcfe41e58f7c298165f4d2b5" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:11.606518  9912 raft_consensus.cc:3060] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.607721  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f858210936a4559a877f1628213432c" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:11.587016  9686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47136b305fde43d8b8b8af12cecd9750" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:11.609068  9764 raft_consensus.cc:3060] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.587478  9959 ts_tablet_manager.cc:1403] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.220s	user 0.010s	sys 0.006s
I20260709 13:03:11.590545  9963 raft_consensus.cc:385] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.588400  9656 leader_election.cc:304] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:11.590258  9958 tablet_bootstrap.cc:492] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:11.613513  9963 raft_consensus.cc:740] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.613976  9958 ts_tablet_manager.cc:1403] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.168s	user 0.016s	sys 0.002s
I20260709 13:03:11.614491 10234 raft_consensus.cc:2804] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:11.615063 10234 raft_consensus.cc:697] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:11.587572  9961 raft_consensus.cc:385] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.616768  9961 raft_consensus.cc:740] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
W20260709 13:03:11.614800  9653 leader_election.cc:343] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.588079  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47136b305fde43d8b8b8af12cecd9750" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:11.619944  9835 raft_consensus.cc:3060] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.620792  9909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f858210936a4559a877f1628213432c" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:11.621973  9959 raft_consensus.cc:359] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.622644  9959 raft_consensus.cc:385] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.623006  9959 raft_consensus.cc:740] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.567982  9690 raft_consensus.cc:2468] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 2.
I20260709 13:03:11.606549  9838 raft_consensus.cc:3060] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.625982  9958 raft_consensus.cc:359] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.626667  9958 raft_consensus.cc:385] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.627040  9958 raft_consensus.cc:740] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.627754  9958 consensus_queue.cc:260] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.628559  9963 consensus_queue.cc:260] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.616081 10234 consensus_queue.cc:237] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.630834  9963 ts_tablet_manager.cc:1434] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:03:11.631747  9963 tablet_bootstrap.cc:492] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:11.632732  9686 raft_consensus.cc:3060] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.633162  9958 ts_tablet_manager.cc:1434] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:03:11.634143  9958 tablet_bootstrap.cc:492] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:11.634977 10119 consensus_queue.cc:1048] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:11.636951  9653 leader_election.cc:343] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.636847  9959 consensus_queue.cc:260] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.639576  9959 ts_tablet_manager.cc:1434] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 13:03:11.640568  9959 tablet_bootstrap.cc:492] T 752cedead4aa452ba24e59e59abfccfc P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:11.645008  9838 raft_consensus.cc:2468] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:11.617658  9961 consensus_queue.cc:260] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.661664  9961 ts_tablet_manager.cc:1434] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.190s	user 0.005s	sys 0.004s
I20260709 13:03:11.662106 10120 raft_consensus.cc:493] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.662657 10120 raft_consensus.cc:515] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.663306  9961 tablet_bootstrap.cc:492] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:11.666615  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f858210936a4559a877f1628213432c" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:11.667977  9731 leader_election.cc:304] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:11.669103 10239 raft_consensus.cc:2804] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:11.669853 10239 raft_consensus.cc:697] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:11.670739 10239 consensus_queue.cc:237] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.671286  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f858210936a4559a877f1628213432c" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:11.672427  9690 raft_consensus.cc:2393] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8557220d7e6a4ccbbef222e80a5584a5 in current term 1: Already voted for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in this term.
I20260709 13:03:11.674256 10120 leader_election.cc:290] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:11.585492 10117 leader_election.cc:290] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:11.643122  9912 raft_consensus.cc:2468] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:11.652815  9958 tablet_bootstrap.cc:654] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.656076  9959 tablet_bootstrap.cc:654] T 752cedead4aa452ba24e59e59abfccfc P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.656481  9835 raft_consensus.cc:2468] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:11.679427  9731 leader_election.cc:304] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:11.673736  9879 leader_election.cc:304] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:11.680230 10117 raft_consensus.cc:2804] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:11.650444  9764 raft_consensus.cc:2468] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:11.683214  9964 raft_consensus.cc:3060] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.684248  9686 raft_consensus.cc:2468] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:11.684973  9586 catalog_manager.cc:5697] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.688761  9963 tablet_bootstrap.cc:654] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.696141 10198 raft_consensus.cc:493] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.696758 10198 raft_consensus.cc:515] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.682920  9654 leader_election.cc:304] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:11.699589 10201 raft_consensus.cc:2804] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:11.700224 10201 raft_consensus.cc:697] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:11.701143 10201 consensus_queue.cc:237] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.692785  9961 tablet_bootstrap.cc:654] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.692977 10117 raft_consensus.cc:697] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:11.702688 10223 raft_consensus.cc:493] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.703229 10223 raft_consensus.cc:515] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.702980 10117 consensus_queue.cc:237] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.705389 10223 leader_election.cc:290] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:11.706259  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752cedead4aa452ba24e59e59abfccfc" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:11.706979  9835 raft_consensus.cc:2468] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:11.708222  9731 leader_election.cc:304] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:11.709802 10119 raft_consensus.cc:2804] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:11.710232 10119 raft_consensus.cc:493] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.710608 10119 raft_consensus.cc:3060] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.709924  9588 catalog_manager.cc:5697] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 0 to 2, leader changed from <none> to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.711252  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752cedead4aa452ba24e59e59abfccfc" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:11.714295  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752cedead4aa452ba24e59e59abfccfc" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
W20260709 13:03:11.715509  9728 leader_election.cc:343] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.716739  9963 tablet_bootstrap.cc:492] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:11.717265  9963 ts_tablet_manager.cc:1403] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.086s	user 0.009s	sys 0.001s
W20260709 13:03:11.717137  9802 leader_election.cc:343] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.717623 10198 leader_election.cc:290] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:11.721036  9963 raft_consensus.cc:359] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.721793  9963 raft_consensus.cc:385] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.721302 10119 raft_consensus.cc:515] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.725090  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752cedead4aa452ba24e59e59abfccfc" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:11.725976  9764 raft_consensus.cc:2393] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 451c871fd36f4d95a76b62d041aa7b60 in current term 1: Already voted for candidate 837fad20523b4348b68f0a1e1af12404 in this term.
I20260709 13:03:11.726249  9959 tablet_bootstrap.cc:492] T 752cedead4aa452ba24e59e59abfccfc P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:11.726797  9959 ts_tablet_manager.cc:1403] T 752cedead4aa452ba24e59e59abfccfc P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.000s
I20260709 13:03:11.726891  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752cedead4aa452ba24e59e59abfccfc" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:11.727138  9803 leader_election.cc:304] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:11.727553  9835 raft_consensus.cc:3060] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.727845  9961 tablet_bootstrap.cc:492] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:11.728628  9961 ts_tablet_manager.cc:1403] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.002s
I20260709 13:03:11.731491  9961 raft_consensus.cc:359] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.732132  9961 raft_consensus.cc:385] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.735390  9959 raft_consensus.cc:359] T 752cedead4aa452ba24e59e59abfccfc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.736209  9959 raft_consensus.cc:385] T 752cedead4aa452ba24e59e59abfccfc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.736485  9959 raft_consensus.cc:740] T 752cedead4aa452ba24e59e59abfccfc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.722101  9963 raft_consensus.cc:740] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.737798  9958 tablet_bootstrap.cc:492] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:11.738343  9958 ts_tablet_manager.cc:1403] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.104s	user 0.008s	sys 0.002s
I20260709 13:03:11.739815  9963 consensus_queue.cc:260] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.741995  9585 catalog_manager.cc:5697] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.743633  9963 ts_tablet_manager.cc:1434] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:03:11.744663  9963 tablet_bootstrap.cc:492] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:11.732415  9961 raft_consensus.cc:740] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.748967  9961 consensus_queue.cc:260] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.751179  9961 ts_tablet_manager.cc:1434] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 13:03:11.752230  9961 tablet_bootstrap.cc:492] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:11.750034  9958 raft_consensus.cc:359] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.756086  9964 raft_consensus.cc:2749] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.757085  9959 consensus_queue.cc:260] T 752cedead4aa452ba24e59e59abfccfc P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.759321  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752cedead4aa452ba24e59e59abfccfc" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:11.764853  9912 raft_consensus.cc:3060] T 752cedead4aa452ba24e59e59abfccfc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.765756  9963 tablet_bootstrap.cc:654] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.769825  9961 tablet_bootstrap.cc:654] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.756963  9835 raft_consensus.cc:2468] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:11.775687 10198 raft_consensus.cc:2749] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.776500  9731 leader_election.cc:304] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:11.776954  9586 catalog_manager.cc:5697] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.777885 10117 raft_consensus.cc:2804] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:11.778977 10117 raft_consensus.cc:697] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:11.780097 10117 consensus_queue.cc:237] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.763005 10119 leader_election.cc:290] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:11.754349  9958 raft_consensus.cc:385] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.783759  9958 raft_consensus.cc:740] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.784878  9958 consensus_queue.cc:260] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.790361  9958 ts_tablet_manager.cc:1434] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.052s	user 0.003s	sys 0.006s
I20260709 13:03:11.790269  9588 catalog_manager.cc:5697] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.791862  9958 tablet_bootstrap.cc:492] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:11.774484  9912 raft_consensus.cc:2468] T 752cedead4aa452ba24e59e59abfccfc P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:11.802258  9959 ts_tablet_manager.cc:1434] T 752cedead4aa452ba24e59e59abfccfc P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.075s	user 0.010s	sys 0.001s
I20260709 13:03:11.803747  9959 tablet_bootstrap.cc:492] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:11.804303  9961 tablet_bootstrap.cc:492] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:11.804515  9958 tablet_bootstrap.cc:654] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.804858  9961 ts_tablet_manager.cc:1403] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.010s
I20260709 13:03:11.811115  9959 tablet_bootstrap.cc:654] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.811483  9963 tablet_bootstrap.cc:492] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:11.812206  9963 ts_tablet_manager.cc:1403] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.009s
I20260709 13:03:11.808485  9961 raft_consensus.cc:359] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.817619  9961 raft_consensus.cc:385] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.818020  9961 raft_consensus.cc:740] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.818717  9963 raft_consensus.cc:359] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.819792  9963 raft_consensus.cc:385] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.820057  9963 raft_consensus.cc:740] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.821139  9961 consensus_queue.cc:260] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.826316  9958 tablet_bootstrap.cc:492] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:11.826882  9958 ts_tablet_manager.cc:1403] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.010s
I20260709 13:03:11.830947  9958 raft_consensus.cc:359] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.831656  9958 raft_consensus.cc:385] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.831921  9958 raft_consensus.cc:740] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.832806  9958 consensus_queue.cc:260] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.835566  9958 ts_tablet_manager.cc:1434] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 13:03:11.836504  9958 tablet_bootstrap.cc:492] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:11.842489  9958 tablet_bootstrap.cc:654] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.850514  9959 tablet_bootstrap.cc:492] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:11.854956  9961 ts_tablet_manager.cc:1434] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 13:03:11.856077  9961 tablet_bootstrap.cc:492] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:11.856158  9958 tablet_bootstrap.cc:492] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:11.856690  9958 ts_tablet_manager.cc:1403] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.006s
I20260709 13:03:11.856858  9963 consensus_queue.cc:260] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.859081  9963 ts_tablet_manager.cc:1434] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:03:11.859534  9958 raft_consensus.cc:359] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.860246  9958 raft_consensus.cc:385] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.860493  9958 raft_consensus.cc:740] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.861387  9958 consensus_queue.cc:260] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.865015  9958 ts_tablet_manager.cc:1434] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:11.866295  9958 tablet_bootstrap.cc:492] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:11.866961  9959 ts_tablet_manager.cc:1403] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.005s
I20260709 13:03:11.867431  9963 tablet_bootstrap.cc:492] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:11.870649  9959 raft_consensus.cc:359] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.876354  9959 raft_consensus.cc:385] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.876833  9959 raft_consensus.cc:740] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.877970  9961 tablet_bootstrap.cc:654] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.877797  9959 consensus_queue.cc:260] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.878994  9963 tablet_bootstrap.cc:654] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.881064  9959 ts_tablet_manager.cc:1434] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:03:11.840772  9588 catalog_manager.cc:5697] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.875185  9958 tablet_bootstrap.cc:654] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.885839  9959 tablet_bootstrap.cc:492] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:11.893118  9959 tablet_bootstrap.cc:654] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.901003 10119 raft_consensus.cc:493] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.902031 10119 raft_consensus.cc:515] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:11.909265 10119 leader_election.cc:290] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:11.910362  9961 tablet_bootstrap.cc:492] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:11.911011  9961 ts_tablet_manager.cc:1403] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.055s	user 0.026s	sys 0.012s
I20260709 13:03:11.911753  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c560f6bb9c4ebfa538d60759ae2739" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
W20260709 13:03:11.914155  9728 leader_election.cc:343] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.914212  9961 raft_consensus.cc:359] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.922215  9961 raft_consensus.cc:385] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.922518  9961 raft_consensus.cc:740] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.923350  9958 tablet_bootstrap.cc:492] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:11.924060  9958 ts_tablet_manager.cc:1403] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.003s
I20260709 13:03:11.923357  9961 consensus_queue.cc:260] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.926079  9961 ts_tablet_manager.cc:1434] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:03:11.926856  9958 raft_consensus.cc:359] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.927914  9687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c560f6bb9c4ebfa538d60759ae2739" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:11.928145  9958 raft_consensus.cc:385] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.928732  9958 raft_consensus.cc:740] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.928848  9687 raft_consensus.cc:2468] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:11.929843 10198 raft_consensus.cc:493] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.930446 10198 raft_consensus.cc:515] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:11.931375  9731 leader_election.cc:304] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:11.929497  9958 consensus_queue.cc:260] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.933552 10223 raft_consensus.cc:2804] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:11.933990 10223 raft_consensus.cc:493] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.934253  9958 ts_tablet_manager.cc:1434] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:03:11.934464 10223 raft_consensus.cc:3060] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.938603  9958 tablet_bootstrap.cc:492] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:11.939363 10198 leader_election.cc:290] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:11.940068 10199 raft_consensus.cc:493] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.940618 10199 raft_consensus.cc:515] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:11.941390  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e878af3a78b443b8f7eb3a54f069a57" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:11.942375  9764 raft_consensus.cc:2468] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
I20260709 13:03:11.942705  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e878af3a78b443b8f7eb3a54f069a57" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:11.943426 10199 leader_election.cc:290] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:11.944227  9803 leader_election.cc:304] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:11.945518 10127 raft_consensus.cc:2804] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:11.945917 10127 raft_consensus.cc:493] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.946254 10127 raft_consensus.cc:3060] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:11.947412  9802 leader_election.cc:343] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.948326  9687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd42823bee8f4722a5f2b15fc1a3dac5" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:11.949425  9687 raft_consensus.cc:2468] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
I20260709 13:03:11.950462 10235 raft_consensus.cc:493] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.950982 10235 raft_consensus.cc:515] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:11.951157  9805 leader_election.cc:304] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:11.951333  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd42823bee8f4722a5f2b15fc1a3dac5" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:11.952664  9958 tablet_bootstrap.cc:654] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:11.952873  9802 leader_election.cc:343] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.953949 10199 raft_consensus.cc:2804] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:11.954362 10199 raft_consensus.cc:493] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.954704 10199 raft_consensus.cc:3060] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.959779  9961 tablet_bootstrap.cc:492] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:11.989202 10235 leader_election.cc:290] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:11.990900  9687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4079962b0054d1c828d8ab946214dfa" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:12.004092  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4079962b0054d1c828d8ab946214dfa" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:12.001834 10127 raft_consensus.cc:515] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:12.005334  9835 raft_consensus.cc:2468] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:12.009696 10127 leader_election.cc:290] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:12.010242  9963 tablet_bootstrap.cc:492] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:12.010679  9961 tablet_bootstrap.cc:654] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.010828  9963 ts_tablet_manager.cc:1403] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.144s	user 0.030s	sys 0.013s
I20260709 13:03:12.013687 10199 raft_consensus.cc:515] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:12.018419  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e878af3a78b443b8f7eb3a54f069a57" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
W20260709 13:03:12.021729  9805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 70672.9us
W20260709 13:03:12.023142  9802 leader_election.cc:343] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.025849  9959 tablet_bootstrap.cc:492] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:12.026087 10199 leader_election.cc:290] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:12.026618  9959 ts_tablet_manager.cc:1403] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.141s	user 0.019s	sys 0.002s
I20260709 13:03:12.026882  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd42823bee8f4722a5f2b15fc1a3dac5" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
W20260709 13:03:12.028543  9802 leader_election.cc:343] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.028873 10223 raft_consensus.cc:515] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:12.030251  9959 raft_consensus.cc:359] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:12.031065  9959 raft_consensus.cc:385] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.031395  9959 raft_consensus.cc:740] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.032238  9959 consensus_queue.cc:260] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:12.025506  9963 raft_consensus.cc:359] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:12.033279  9963 raft_consensus.cc:385] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.033721  9963 raft_consensus.cc:740] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.034639  9963 consensus_queue.cc:260] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:12.037523  9963 ts_tablet_manager.cc:1434] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:03:12.037983  9961 tablet_bootstrap.cc:492] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:12.038358 10223 leader_election.cc:290] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:12.039388  9961 ts_tablet_manager.cc:1403] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.080s	user 0.020s	sys 0.018s
I20260709 13:03:12.037537  9958 tablet_bootstrap.cc:492] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:12.038544  9963 tablet_bootstrap.cc:492] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:12.040088  9959 ts_tablet_manager.cc:1434] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:03:12.040439  9958 ts_tablet_manager.cc:1403] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.102s	user 0.022s	sys 0.020s
I20260709 13:03:12.041256  9959 tablet_bootstrap.cc:492] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:12.103384  9686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd42823bee8f4722a5f2b15fc1a3dac5" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:12.109257  9686 raft_consensus.cc:3060] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:12.120158  9731 leader_election.cc:343] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.126309  9731 leader_election.cc:304] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:12.149773  9958 raft_consensus.cc:359] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:12.150967  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c560f6bb9c4ebfa538d60759ae2739" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
W20260709 13:03:12.154007  9728 leader_election.cc:343] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.151032  9958 raft_consensus.cc:385] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.136277  9687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c560f6bb9c4ebfa538d60759ae2739" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:12.160282 10116 raft_consensus.cc:2804] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:12.165715  9958 raft_consensus.cc:740] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.179555  9912 raft_consensus.cc:3060] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.176793 10116 raft_consensus.cc:493] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.181257 10116 raft_consensus.cc:3060] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.198566  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e878af3a78b443b8f7eb3a54f069a57" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:12.200665  9961 raft_consensus.cc:359] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:12.217024  9961 raft_consensus.cc:385] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.217270  9961 raft_consensus.cc:740] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.225943  9687 raft_consensus.cc:3060] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.228335  9764 raft_consensus.cc:3060] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.232511 10280 raft_consensus.cc:493] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.233600 10280 raft_consensus.cc:515] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:12.240541  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b91b2a3a4a24086b9e05f782ee36615" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:12.214123  9958 consensus_queue.cc:260] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:12.251780  9961 consensus_queue.cc:260] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:12.261616  9688 raft_consensus.cc:1275] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Refusing update from remote peer 8557220d7e6a4ccbbef222e80a5584a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:12.275207  9688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b91b2a3a4a24086b9e05f782ee36615" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:12.277447 10237 raft_consensus.cc:493] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.278213 10237 raft_consensus.cc:515] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
W20260709 13:03:12.251721  9731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35769, user_credentials={real_user=slave}} blocked reactor thread for 125645us
I20260709 13:03:12.301244  9765 raft_consensus.cc:1275] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 8557220d7e6a4ccbbef222e80a5584a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:03:12.287806  9805 leader_election.cc:343] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.309211 10234 consensus_queue.cc:1048] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:12.313756  9802 leader_election.cc:343] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.316044  9963 tablet_bootstrap.cc:654] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.316148 10226 raft_consensus.cc:493] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.317080 10226 raft_consensus.cc:515] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:12.308102  9958 ts_tablet_manager.cc:1434] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.267s	user 0.008s	sys 0.005s
I20260709 13:03:12.322286  9961 ts_tablet_manager.cc:1434] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.282s	user 0.010s	sys 0.002s
I20260709 13:03:12.326406 10227 consensus_queue.cc:1048] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:12.327934  9686 raft_consensus.cc:2468] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:12.328415 10284 consensus_queue.cc:1048] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:12.326349  9961 tablet_bootstrap.cc:492] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:12.338933 10237 leader_election.cc:290] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:12.332283 10280 leader_election.cc:290] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:12.353467  9805 leader_election.cc:304] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:12.354592 10116 raft_consensus.cc:515] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:12.355309 10243 consensus_queue.cc:1048] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:12.355834  9802 leader_election.cc:304] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:12.360493 10116 leader_election.cc:290] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:12.374825  9687 raft_consensus.cc:2468] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:12.368613 10199 raft_consensus.cc:2749] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:12.377153  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:12.348829 10236 consensus_queue.cc:1048] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:03:12.366212 10280 raft_consensus.cc:2804] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:12.392424 10235 consensus_queue.cc:1048] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:12.394208 10201 consensus_queue.cc:1048] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:03:12.396039 10236 consensus_queue.cc:1048] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:03:12.378279  9802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:36227, user_credentials={real_user=slave}} blocked reactor thread for 73602.6us
I20260709 13:03:12.406894  9731 leader_election.cc:304] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:12.408414  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
W20260709 13:03:12.418143  9805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 64221.7us
I20260709 13:03:12.412801 10280 raft_consensus.cc:697] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:12.435081  9959 tablet_bootstrap.cc:654] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.438083 10240 raft_consensus.cc:493] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.438750 10240 raft_consensus.cc:515] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:12.439852  9963 tablet_bootstrap.cc:492] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:12.433830 10235 raft_consensus.cc:2804] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:12.447005 10235 raft_consensus.cc:697] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:12.447168  9688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4079962b0054d1c828d8ab946214dfa" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:12.447849  9688 raft_consensus.cc:3060] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.448385 10235 consensus_queue.cc:237] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:12.449558 10240 leader_election.cc:290] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:12.452948  9836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd42823bee8f4722a5f2b15fc1a3dac5" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:12.454089 10226 leader_election.cc:290] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:12.456354  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd42823bee8f4722a5f2b15fc1a3dac5" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:12.457324  9690 raft_consensus.cc:2393] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8557220d7e6a4ccbbef222e80a5584a5 in current term 1: Already voted for candidate 451c871fd36f4d95a76b62d041aa7b60 in this term.
I20260709 13:03:12.460150  9963 ts_tablet_manager.cc:1403] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.422s	user 0.019s	sys 0.000s
I20260709 13:03:12.444271  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4079962b0054d1c828d8ab946214dfa" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:12.463426  9839 raft_consensus.cc:3060] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.466760  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5370a6691486895274f9b937bbb1e" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:12.470513  9958 tablet_bootstrap.cc:492] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:12.480100  9836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5370a6691486895274f9b937bbb1e" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:12.492233  9879 leader_election.cc:304] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:12.494730 10240 raft_consensus.cc:3060] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:12.501353  9731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 97582.1us
I20260709 13:03:12.502059  9879 leader_election.cc:304] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
W20260709 13:03:12.503768  9731 leader_election.cc:343] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.470813  9688 raft_consensus.cc:2468] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:12.474555  9963 raft_consensus.cc:359] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:12.477613 10239 consensus_queue.cc:1048] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.073s
I20260709 13:03:12.506384  9961 tablet_bootstrap.cc:654] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.511739  9963 raft_consensus.cc:385] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.512122  9963 raft_consensus.cc:740] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
W20260709 13:03:12.524986  9731 leader_election.cc:343] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.526010  9731 leader_election.cc:304] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:12.523865  9963 consensus_queue.cc:260] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:12.530220 10237 consensus_queue.cc:1048] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:12.532863 10280 consensus_queue.cc:237] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:12.534337 10116 consensus_queue.cc:1048] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:12.540829 10226 raft_consensus.cc:2749] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:12.530857 10239 raft_consensus.cc:2749] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:12.603222  9958 tablet_bootstrap.cc:654] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.585112  9839 raft_consensus.cc:2468] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:12.633167  9731 leader_election.cc:304] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:12.634564 10237 raft_consensus.cc:493] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.635325 10237 raft_consensus.cc:515] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:12.639886 10237 leader_election.cc:290] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:12.648166 10199 raft_consensus.cc:493] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.648857 10199 raft_consensus.cc:515] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:12.653664  9963 ts_tablet_manager.cc:1434] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.182s	user 0.008s	sys 0.000s
I20260709 13:03:12.654980 10240 raft_consensus.cc:2749] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:12.663154  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55fdf0e57b3341a1a01a23f13df81770" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:12.663486  9686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55fdf0e57b3341a1a01a23f13df81770" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:12.664000  9835 raft_consensus.cc:2468] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:12.653395 10239 raft_consensus.cc:2804] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:12.683840 10199 leader_election.cc:290] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:12.672161  9764 raft_consensus.cc:2468] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
W20260709 13:03:12.675869  9805 leader_election.cc:343] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.681991 10239 raft_consensus.cc:697] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:12.698774  9959 tablet_bootstrap.cc:492] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:12.706596 10239 consensus_queue.cc:237] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:12.708374  9803 leader_election.cc:304] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:12.710238 10201 raft_consensus.cc:493] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.710939 10201 raft_consensus.cc:515] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:12.713470 10201 leader_election.cc:290] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:12.712108  9686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55fdf0e57b3341a1a01a23f13df81770" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:12.715176  9961 tablet_bootstrap.cc:492] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:12.715782  9963 tablet_bootstrap.cc:492] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:12.716006  9961 ts_tablet_manager.cc:1403] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.392s	user 0.013s	sys 0.018s
I20260709 13:03:12.715279 10199 raft_consensus.cc:2804] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:12.716912 10199 raft_consensus.cc:697] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:12.717963 10199 consensus_queue.cc:237] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:12.736977  9961 raft_consensus.cc:359] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:12.737967  9961 raft_consensus.cc:385] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.738273  9961 raft_consensus.cc:740] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.749661  9959 ts_tablet_manager.cc:1403] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.709s	user 0.042s	sys 0.064s
W20260709 13:03:12.759635  9731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35769, user_credentials={real_user=slave}} blocked reactor thread for 64126.5us
I20260709 13:03:12.763558  9731 leader_election.cc:304] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:12.774879  9961 consensus_queue.cc:260] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:12.768146 10116 raft_consensus.cc:2804] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:12.787186 10116 raft_consensus.cc:493] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.804975 10116 raft_consensus.cc:3060] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.811678  9963 tablet_bootstrap.cc:654] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.803478  9959 raft_consensus.cc:359] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:12.812947  9959 raft_consensus.cc:385] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.813264  9959 raft_consensus.cc:740] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.828328  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55fdf0e57b3341a1a01a23f13df81770" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:12.831035  9958 tablet_bootstrap.cc:492] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:12.832291  9958 ts_tablet_manager.cc:1403] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.362s	user 0.011s	sys 0.010s
I20260709 13:03:12.838085  9959 consensus_queue.cc:260] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
W20260709 13:03:12.841192  9656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35769, user_credentials={real_user=slave}} blocked reactor thread for 75034.7us
I20260709 13:03:12.844951  9961 ts_tablet_manager.cc:1434] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.128s	user 0.010s	sys 0.000s
I20260709 13:03:12.848363  9959 ts_tablet_manager.cc:1434] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.005s
I20260709 13:03:12.848582  9761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:12.849442  9761 raft_consensus.cc:2468] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:12.850026  9959 tablet_bootstrap.cc:492] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:12.850315  9961 tablet_bootstrap.cc:492] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:12.859875  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:12.860980  9958 raft_consensus.cc:359] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:12.862262  9958 raft_consensus.cc:385] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.862632  9958 raft_consensus.cc:740] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
W20260709 13:03:12.868376  9731 leader_election.cc:343] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.863456  9958 consensus_queue.cc:260] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:12.831821 10199 raft_consensus.cc:493] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.871039  9654 leader_election.cc:304] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:12.876202  9586 catalog_manager.cc:5697] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.868670 10119 consensus_queue.cc:1048] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
W20260709 13:03:12.912408 10293 log.cc:927] Time spent T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.005s
W20260709 13:03:12.925884  9654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:44623, user_credentials={real_user=slave}} blocked reactor thread for 55350.1us
I20260709 13:03:12.908159 10116 raft_consensus.cc:515] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:12.933573 10236 raft_consensus.cc:2804] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:12.934203 10236 raft_consensus.cc:493] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.934787 10236 raft_consensus.cc:3060] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.935097 10116 leader_election.cc:290] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
W20260709 13:03:12.926805  9656 leader_election.cc:343] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.963613  9959 tablet_bootstrap.cc:654] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.969913  9958 ts_tablet_manager.cc:1434] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.137s	user 0.009s	sys 0.000s
I20260709 13:03:12.971688  9958 tablet_bootstrap.cc:492] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:12.979473  9765 raft_consensus.cc:2393] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 451c871fd36f4d95a76b62d041aa7b60 in current term 1: Already voted for candidate 837fad20523b4348b68f0a1e1af12404 in this term.
W20260709 13:03:12.974887  9656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35769, user_credentials={real_user=slave}} blocked reactor thread for 86407us
W20260709 13:03:13.009080  9731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 46800.8us
I20260709 13:03:12.948930 10199 raft_consensus.cc:515] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.035380  9963 tablet_bootstrap.cc:492] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:13.036224  9963 ts_tablet_manager.cc:1403] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.321s	user 0.017s	sys 0.040s
I20260709 13:03:13.040439  9963 raft_consensus.cc:359] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:13.041626  9963 raft_consensus.cc:385] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.042049  9963 raft_consensus.cc:740] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.039964  9834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55fdf0e57b3341a1a01a23f13df81770" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:13.069600 10280 consensus_queue.cc:1048] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:13.070013  9834 raft_consensus.cc:3060] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.042745  9963 consensus_queue.cc:260] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
W20260709 13:03:13.075218  9728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:36227, user_credentials={real_user=slave}} blocked reactor thread for 113423us
I20260709 13:03:13.089895  9963 ts_tablet_manager.cc:1434] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 13:03:13.102360 10199 leader_election.cc:290] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:13.110837  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d0bc42f3174047b43f78e52fcfbd04" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:13.114562  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d0bc42f3174047b43f78e52fcfbd04" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:13.087649  9803 leader_election.cc:304] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:13.122124  9686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55fdf0e57b3341a1a01a23f13df81770" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:13.123301 10280 consensus_queue.cc:1048] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:13.123728  9802 leader_election.cc:343] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.126004  9961 tablet_bootstrap.cc:654] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:13.127138  9803 leader_election.cc:343] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.140187  9803 leader_election.cc:304] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:13.141760 10280 raft_consensus.cc:2749] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.127601  9958 tablet_bootstrap.cc:654] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:13.131275 10321 log.cc:927] Time spent T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404: Append to log took a long time: real 0.122s	user 0.000s	sys 0.002s
I20260709 13:03:13.133430 10236 raft_consensus.cc:515] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.149538 10236 leader_election.cc:290] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:13.156014  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
W20260709 13:03:13.158134  9656 leader_election.cc:343] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.165827  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:13.167176  9765 raft_consensus.cc:3060] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:13.167938  9731 leader_election.cc:343] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.160564  9959 tablet_bootstrap.cc:492] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:13.173679  9959 ts_tablet_manager.cc:1403] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.324s	user 0.026s	sys 0.012s
I20260709 13:03:13.174197  9963 tablet_bootstrap.cc:492] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:13.178872  9834 raft_consensus.cc:2468] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:13.179615 10198 raft_consensus.cc:2749] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.183900 10318 consensus_queue.cc:1048] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:13.189456  9731 leader_election.cc:304] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:13.193665 10239 raft_consensus.cc:2804] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:13.195849 10239 raft_consensus.cc:697] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:13.196875 10239 consensus_queue.cc:237] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.214545  9959 raft_consensus.cc:359] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:13.215597  9959 raft_consensus.cc:385] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.215969  9959 raft_consensus.cc:740] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.235041  9765 raft_consensus.cc:2468] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:13.239446 10237 consensus_queue.cc:1048] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:13.247941  9910 raft_consensus.cc:3060] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.251055  9963 tablet_bootstrap.cc:654] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.253211  9654 leader_election.cc:304] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:13.255262 10234 raft_consensus.cc:2804] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:13.255512 10030 raft_consensus.cc:493] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.255959 10234 raft_consensus.cc:697] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:13.256138 10030 raft_consensus.cc:515] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
W20260709 13:03:13.258626  9636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:13.258791 10030 leader_election.cc:290] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
W20260709 13:03:13.259433  9728 consensus_peers.cc:597] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 -> Peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Couldn't send request to peer 8557220d7e6a4ccbbef222e80a5584a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.239367  9959 consensus_queue.cc:260] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:13.262254 10234 consensus_queue.cc:237] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.262830  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a88ee2ae1f4e17826b23090e31bf02" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
W20260709 13:03:13.270462  9653 leader_election.cc:343] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.271646 10237 raft_consensus.cc:493] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.272760  9958 tablet_bootstrap.cc:492] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:13.276455  9958 ts_tablet_manager.cc:1403] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.305s	user 0.028s	sys 0.016s
I20260709 13:03:13.284020 10235 consensus_queue.cc:1048] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:13.285362  9959 ts_tablet_manager.cc:1434] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.111s	user 0.007s	sys 0.004s
I20260709 13:03:13.288753 10199 consensus_queue.cc:1048] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:13.295915  9958 raft_consensus.cc:359] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.298425  9958 raft_consensus.cc:385] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.298911  9958 raft_consensus.cc:740] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.301100  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a88ee2ae1f4e17826b23090e31bf02" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:13.279542 10237 raft_consensus.cc:515] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:13.314083  9958 consensus_queue.cc:260] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.308015  9959 tablet_bootstrap.cc:492] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:13.335922 10240 raft_consensus.cc:493] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.336500 10240 raft_consensus.cc:515] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.341624 10199 consensus_queue.cc:1048] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:13.344853  9958 ts_tablet_manager.cc:1434] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.068s	user 0.010s	sys 0.000s
I20260709 13:03:13.346262  9958 tablet_bootstrap.cc:492] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:13.350651 10240 leader_election.cc:290] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:13.351862  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e878af3a78b443b8f7eb3a54f069a57" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:13.362890  9958 tablet_bootstrap.cc:654] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.367348  9963 tablet_bootstrap.cc:492] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:13.368120  9963 ts_tablet_manager.cc:1403] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.214s	user 0.005s	sys 0.017s
I20260709 13:03:13.350088  9765 raft_consensus.cc:2468] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:13.370218  9761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e878af3a78b443b8f7eb3a54f069a57" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:13.379129  9877 leader_election.cc:304] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:13.381732  9909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a88ee2ae1f4e17826b23090e31bf02" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:13.383212 10237 leader_election.cc:290] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:13.384893  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a88ee2ae1f4e17826b23090e31bf02" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:13.385694  9689 raft_consensus.cc:2468] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
W20260709 13:03:13.383486  9728 leader_election.cc:343] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.386322  9959 tablet_bootstrap.cc:654] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.386289  9963 raft_consensus.cc:359] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:13.387636  9963 raft_consensus.cc:385] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.387919  9963 raft_consensus.cc:740] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.386965 10243 raft_consensus.cc:2749] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:13.391881  9731 leader_election.cc:304] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:13.392999  9963 consensus_queue.cc:260] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:13.397820  9963 ts_tablet_manager.cc:1434] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:03:13.399045  9963 tablet_bootstrap.cc:492] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:13.402479 10240 raft_consensus.cc:493] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.404803  9961 tablet_bootstrap.cc:492] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:13.405578  9961 ts_tablet_manager.cc:1403] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.559s	user 0.033s	sys 0.025s
I20260709 13:03:13.410974 10318 raft_consensus.cc:493] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.411669  9654 leader_election.cc:304] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:13.411577 10318 raft_consensus.cc:515] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.413776 10318 leader_election.cc:290] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:13.415339 10234 raft_consensus.cc:2804] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:13.415819 10234 raft_consensus.cc:493] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.416180 10234 raft_consensus.cc:3060] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.418445  9961 raft_consensus.cc:359] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.415654  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4213d5ed7d5428aa77410084c68a98b" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:13.400765 10237 raft_consensus.cc:2804] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:13.420823 10237 raft_consensus.cc:493] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:13.421154  9731 leader_election.cc:343] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.421458 10237 raft_consensus.cc:3060] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.404606 10240 raft_consensus.cc:515] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:13.431730 10240 leader_election.cc:290] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:13.436072  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4213d5ed7d5428aa77410084c68a98b" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:13.419834  9961 raft_consensus.cc:385] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.443725  9961 raft_consensus.cc:740] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.453877  9963 tablet_bootstrap.cc:654] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.461398  9961 consensus_queue.cc:260] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.456692 10234 raft_consensus.cc:515] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:13.470861  9959 tablet_bootstrap.cc:492] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:13.471158 10234 leader_election.cc:290] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:13.471483  9959 ts_tablet_manager.cc:1403] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.164s	user 0.017s	sys 0.018s
I20260709 13:03:13.472723  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a88ee2ae1f4e17826b23090e31bf02" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:13.472882  9909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a88ee2ae1f4e17826b23090e31bf02" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:13.474414  9958 tablet_bootstrap.cc:492] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:13.474946  9958 ts_tablet_manager.cc:1403] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.129s	user 0.032s	sys 0.019s
W20260709 13:03:13.475831  9653 leader_election.cc:343] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.476657  9959 raft_consensus.cc:359] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
W20260709 13:03:13.468555  9879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 60179us
I20260709 13:03:13.477435  9959 raft_consensus.cc:385] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.477854  9959 raft_consensus.cc:740] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.477669  9958 raft_consensus.cc:359] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.478648  9958 raft_consensus.cc:385] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.479000  9958 raft_consensus.cc:740] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.479035  9959 consensus_queue.cc:260] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:13.479902  9958 consensus_queue.cc:260] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
W20260709 13:03:13.481556  9728 leader_election.cc:343] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.481701  9761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c560f6bb9c4ebfa538d60759ae2739" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:13.482187  9728 leader_election.cc:304] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:13.483963  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c560f6bb9c4ebfa538d60759ae2739" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:13.485661  9959 ts_tablet_manager.cc:1434] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:03:13.486111 10117 raft_consensus.cc:2749] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.486967  9959 tablet_bootstrap.cc:492] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:13.483960  9958 ts_tablet_manager.cc:1434] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:03:13.492170  9958 tablet_bootstrap.cc:492] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:13.492076 10237 raft_consensus.cc:515] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:13.485752  9961 ts_tablet_manager.cc:1434] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.001s
I20260709 13:03:13.494370  9961 tablet_bootstrap.cc:492] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:13.494956  9959 tablet_bootstrap.cc:654] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.499289  9958 tablet_bootstrap.cc:654] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.490501  9879 leader_election.cc:304] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:13.501328  9765 raft_consensus.cc:2393] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in current term 1: Already voted for candidate 837fad20523b4348b68f0a1e1af12404 in this term.
I20260709 13:03:13.502465 10120 raft_consensus.cc:2749] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.504565 10237 leader_election.cc:290] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:13.505128  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a88ee2ae1f4e17826b23090e31bf02" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:13.505776  9910 raft_consensus.cc:3060] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.500420  9961 tablet_bootstrap.cc:654] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.509438  9654 leader_election.cc:304] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:13.509897  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a88ee2ae1f4e17826b23090e31bf02" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:13.510604 10234 raft_consensus.cc:2749] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.516628  9910 raft_consensus.cc:2468] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:13.518142  9728 leader_election.cc:304] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:13.519569 10117 raft_consensus.cc:2804] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:13.520078 10117 raft_consensus.cc:697] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:13.520923 10117 consensus_queue.cc:237] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:13.526775  9958 tablet_bootstrap.cc:492] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:13.527567  9958 ts_tablet_manager.cc:1403] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.008s
I20260709 13:03:13.531536  9958 raft_consensus.cc:359] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.533522  9689 raft_consensus.cc:2393] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 837fad20523b4348b68f0a1e1af12404 in current term 1: Already voted for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in this term.
I20260709 13:03:13.537937  9959 tablet_bootstrap.cc:492] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:13.538533  9959 ts_tablet_manager.cc:1403] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.004s
I20260709 13:03:13.541318  9959 raft_consensus.cc:359] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.542049  9959 raft_consensus.cc:385] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.543467  9958 raft_consensus.cc:385] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.544063  9958 raft_consensus.cc:740] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.543370  9587 catalog_manager.cc:5697] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.545344  9958 consensus_queue.cc:260] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.549000 10235 raft_consensus.cc:493] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.549548 10235 raft_consensus.cc:515] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.551970 10235 leader_election.cc:290] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:13.553109  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d0bc42f3174047b43f78e52fcfbd04" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:13.553606 10234 raft_consensus.cc:493] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.554190 10234 raft_consensus.cc:515] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
W20260709 13:03:13.554605  9728 leader_election.cc:343] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.556008  9963 tablet_bootstrap.cc:492] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:13.542316  9959 raft_consensus.cc:740] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.556515  9963 ts_tablet_manager.cc:1403] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.158s	user 0.013s	sys 0.010s
I20260709 13:03:13.557156  9959 consensus_queue.cc:260] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.557421  9585 catalog_manager.cc:5697] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } }
I20260709 13:03:13.560223  9959 ts_tablet_manager.cc:1434] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 13:03:13.560840  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b91b2a3a4a24086b9e05f782ee36615" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:13.561432  9959 tablet_bootstrap.cc:492] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:13.561388  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b91b2a3a4a24086b9e05f782ee36615" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:13.561563  9838 raft_consensus.cc:2468] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:13.564304  9656 leader_election.cc:304] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:13.565032  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d0bc42f3174047b43f78e52fcfbd04" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
W20260709 13:03:13.565703  9653 leader_election.cc:343] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.565734  9838 raft_consensus.cc:2468] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:13.567416 10234 leader_election.cc:290] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:13.568759 10201 raft_consensus.cc:2804] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:13.569139 10201 raft_consensus.cc:493] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.569515 10201 raft_consensus.cc:3060] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.572350  9958 ts_tablet_manager.cc:1434] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:03:13.572937  9959 tablet_bootstrap.cc:654] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.574928  9731 leader_election.cc:304] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:13.575800 10117 raft_consensus.cc:2804] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:13.576179 10117 raft_consensus.cc:493] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.576514 10117 raft_consensus.cc:3060] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.576625  9585 catalog_manager.cc:5697] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.581672  9958 tablet_bootstrap.cc:492] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:13.586788  9961 tablet_bootstrap.cc:492] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:13.588964  9961 ts_tablet_manager.cc:1403] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.005s
I20260709 13:03:13.589152  9958 tablet_bootstrap.cc:654] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.588029  9963 raft_consensus.cc:359] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.592103  9963 raft_consensus.cc:385] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.587615 10117 raft_consensus.cc:515] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.592546  9963 raft_consensus.cc:740] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.593415  9963 consensus_queue.cc:260] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.595145  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d0bc42f3174047b43f78e52fcfbd04" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:13.595778  9838 raft_consensus.cc:3060] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.599287  9963 ts_tablet_manager.cc:1434] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:03:13.600445  9963 tablet_bootstrap.cc:492] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:13.607028  9958 tablet_bootstrap.cc:492] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:13.607191  9959 tablet_bootstrap.cc:492] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:13.607623  9958 ts_tablet_manager.cc:1403] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:03:13.607744  9959 ts_tablet_manager.cc:1403] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.006s
I20260709 13:03:13.609220  9909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d0bc42f3174047b43f78e52fcfbd04" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:13.609318  9584 catalog_manager.cc:5697] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:13.610991  9728 leader_election.cc:343] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.611712 10117 leader_election.cc:290] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:13.580430 10201 raft_consensus.cc:515] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:13.613113  9963 tablet_bootstrap.cc:654] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.615486  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b91b2a3a4a24086b9e05f782ee36615" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:13.616175  9839 raft_consensus.cc:3060] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.592254  9961 raft_consensus.cc:359] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.616712 10201 leader_election.cc:290] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:13.617379  9961 raft_consensus.cc:385] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.618288  9961 raft_consensus.cc:740] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.619333  9961 consensus_queue.cc:260] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.621634  9959 raft_consensus.cc:359] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:13.621760  9909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b91b2a3a4a24086b9e05f782ee36615" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:13.622505  9961 ts_tablet_manager.cc:1434] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:03:13.624145  9961 tablet_bootstrap.cc:492] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:13.624246  9958 raft_consensus.cc:359] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:13.629277  9958 raft_consensus.cc:385] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.629745  9958 raft_consensus.cc:740] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.630491  9958 consensus_queue.cc:260] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:13.633097  9961 tablet_bootstrap.cc:654] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.626516  9959 raft_consensus.cc:385] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.616103  9838 raft_consensus.cc:2468] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:13.635071  9959 raft_consensus.cc:740] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.635973  9959 consensus_queue.cc:260] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:13.637789  9958 ts_tablet_manager.cc:1434] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:03:13.639259  9958 tablet_bootstrap.cc:492] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:13.641395  9731 leader_election.cc:304] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:13.642030  9839 raft_consensus.cc:2468] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:13.644917  9959 ts_tablet_manager.cc:1434] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.004s
I20260709 13:03:13.651016  9909 raft_consensus.cc:3060] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.653469  9656 leader_election.cc:304] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:13.653887  9963 tablet_bootstrap.cc:492] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:13.672005 10201 raft_consensus.cc:2804] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:13.672154  9963 ts_tablet_manager.cc:1403] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.000s
I20260709 13:03:13.672748 10201 raft_consensus.cc:697] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:13.673911  9959 tablet_bootstrap.cc:492] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:13.673672 10201 consensus_queue.cc:237] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:13.675457  9963 raft_consensus.cc:359] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.644526 10235 raft_consensus.cc:2804] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:13.676214  9963 raft_consensus.cc:385] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.676424 10235 raft_consensus.cc:697] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:13.650193  9961 tablet_bootstrap.cc:492] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:13.677215  9961 ts_tablet_manager.cc:1403] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.003s
I20260709 13:03:13.677459 10235 consensus_queue.cc:237] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.680822  9961 raft_consensus.cc:359] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:13.681636  9961 raft_consensus.cc:385] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.681739  9959 tablet_bootstrap.cc:654] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.682086  9961 raft_consensus.cc:740] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.682969  9961 consensus_queue.cc:260] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:13.685859  9961 ts_tablet_manager.cc:1434] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:13.643002  9587 catalog_manager.cc:5697] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.687079  9961 tablet_bootstrap.cc:492] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:13.676537  9963 raft_consensus.cc:740] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.687966  9963 consensus_queue.cc:260] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.689169  9910 raft_consensus.cc:3060] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.690989  9963 ts_tablet_manager.cc:1434] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:03:13.660908  9958 tablet_bootstrap.cc:654] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.675771  9909 raft_consensus.cc:2468] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:13.695604  9961 tablet_bootstrap.cc:654] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.702312  9963 tablet_bootstrap.cc:492] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:13.717808  9587 catalog_manager.cc:5697] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.723374  9963 tablet_bootstrap.cc:654] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.734998 10127 raft_consensus.cc:493] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.735605 10127 raft_consensus.cc:515] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.740557  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2b7abebcdc4cbbac180a3762ad607b" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:13.741935  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2b7abebcdc4cbbac180a3762ad607b" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:13.742671  9689 raft_consensus.cc:2468] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
I20260709 13:03:13.742758 10285 consensus_queue.cc:1048] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:13.743643 10127 leader_election.cc:290] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
W20260709 13:03:13.745126  9803 leader_election.cc:343] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.750720  9805 leader_election.cc:304] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:13.751789 10127 raft_consensus.cc:2804] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:13.752341 10127 raft_consensus.cc:493] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.752777 10127 raft_consensus.cc:3060] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.765560  9961 tablet_bootstrap.cc:492] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:13.766242  9961 ts_tablet_manager.cc:1403] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.001s
I20260709 13:03:13.779629  9689 raft_consensus.cc:3060] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.765722 10285 raft_consensus.cc:493] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.788820  9958 tablet_bootstrap.cc:492] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:13.789402  9958 ts_tablet_manager.cc:1403] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.150s	user 0.015s	sys 0.002s
I20260709 13:03:13.784857 10285 raft_consensus.cc:515] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:13.795958  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dadd5ead404b82a843d64283e7f2a1" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
W20260709 13:03:13.797531  9728 leader_election.cc:343] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.801167 10285 leader_election.cc:290] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:13.792248  9958 raft_consensus.cc:359] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.802273  9958 raft_consensus.cc:385] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.802552  9958 raft_consensus.cc:740] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.803321  9958 consensus_queue.cc:260] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.805274  9687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dadd5ead404b82a843d64283e7f2a1" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:13.805882 10127 raft_consensus.cc:515] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.807049 10318 consensus_queue.cc:1048] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:13.811342  9731 leader_election.cc:343] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.811805  9731 leader_election.cc:304] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:13.812734 10235 raft_consensus.cc:2749] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.817073  9587 catalog_manager.cc:5697] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.824743 10127 leader_election.cc:290] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:13.825834  9688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2b7abebcdc4cbbac180a3762ad607b" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:13.827665  9688 raft_consensus.cc:3060] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.828258  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2b7abebcdc4cbbac180a3762ad607b" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:13.828929  9765 raft_consensus.cc:3060] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.828392  9959 tablet_bootstrap.cc:492] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:13.830499  9959 ts_tablet_manager.cc:1403] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.157s	user 0.027s	sys 0.013s
I20260709 13:03:13.826278  9588 catalog_manager.cc:5697] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.831019  9958 ts_tablet_manager.cc:1434] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:03:13.833923  9958 tablet_bootstrap.cc:492] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:13.836905  9961 raft_consensus.cc:359] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.837821  9961 raft_consensus.cc:385] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.838099  9961 raft_consensus.cc:740] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.835125  9959 raft_consensus.cc:359] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.845754  9959 raft_consensus.cc:385] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.846227  9959 raft_consensus.cc:740] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.849213  9959 consensus_queue.cc:260] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:13.853426  9961 consensus_queue.cc:260] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.867787  9961 ts_tablet_manager.cc:1434] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.001s
I20260709 13:03:13.878115  9765 raft_consensus.cc:2468] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:13.881155  9959 ts_tablet_manager.cc:1434] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.005s
I20260709 13:03:13.882180  9838 raft_consensus.cc:3060] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.884035  9803 leader_election.cc:304] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:13.891952  9961 tablet_bootstrap.cc:492] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:13.896270  9959 tablet_bootstrap.cc:492] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:13.889793 10127 raft_consensus.cc:2804] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:13.899822 10201 consensus_queue.cc:1048] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:13.908115 10280 raft_consensus.cc:493] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.908427  9688 raft_consensus.cc:2468] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:13.908776 10280 raft_consensus.cc:515] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:13.909533 10117 raft_consensus.cc:493] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.910112  9963 tablet_bootstrap.cc:492] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:13.910683  9963 ts_tablet_manager.cc:1403] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.209s	user 0.015s	sys 0.014s
I20260709 13:03:13.911098 10280 leader_election.cc:290] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:13.910199 10117 raft_consensus.cc:515] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:13.914680  9909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb34d3df6d146e7b2406dafa071fd52" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:13.915469 10117 leader_election.cc:290] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
W20260709 13:03:13.916914  9802 leader_election.cc:343] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.917814  9689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359e0d2d58948c199c04b275867bffd" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:13.919286  9731 leader_election.cc:343] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.933604  9961 tablet_bootstrap.cc:654] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.942785  9959 tablet_bootstrap.cc:654] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.943523 10127 raft_consensus.cc:697] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:13.951234  9963 raft_consensus.cc:359] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:13.971429  9963 raft_consensus.cc:385] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.973420  9963 raft_consensus.cc:740] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.974790  9963 consensus_queue.cc:260] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:13.979970  9963 ts_tablet_manager.cc:1434] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.069s	user 0.003s	sys 0.006s
I20260709 13:03:13.982066  9958 tablet_bootstrap.cc:654] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.956918  9687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb34d3df6d146e7b2406dafa071fd52" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:13.989984 10127 consensus_queue.cc:237] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:14.007091 10243 raft_consensus.cc:493] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.001649 10361 raft_consensus.cc:493] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.007627 10243 raft_consensus.cc:515] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:14.008751 10234 consensus_queue.cc:1048] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:14.006587  9963 tablet_bootstrap.cc:492] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:14.013083 10117 consensus_queue.cc:1048] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:14.014647  9805 leader_election.cc:343] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.015168  9805 leader_election.cc:304] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:14.017553 10280 raft_consensus.cc:2749] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:14.010186 10198 raft_consensus.cc:493] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.018307 10198 raft_consensus.cc:515] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:14.007788 10361 raft_consensus.cc:515] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:14.031680  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359e0d2d58948c199c04b275867bffd" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
W20260709 13:03:14.034380  9731 leader_election.cc:343] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.034848  9731 leader_election.cc:304] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:14.038244 10318 raft_consensus.cc:2749] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:14.039654 10243 leader_election.cc:290] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:14.044412  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4213d5ed7d5428aa77410084c68a98b" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:14.046391  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4213d5ed7d5428aa77410084c68a98b" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:14.046819 10198 leader_election.cc:290] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:14.047118  9765 raft_consensus.cc:2468] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:14.050108  9877 leader_election.cc:304] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:14.050484  9687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:14.051277 10243 raft_consensus.cc:2804] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:14.051664 10243 raft_consensus.cc:493] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.051887  9959 tablet_bootstrap.cc:492] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:14.052029 10243 raft_consensus.cc:3060] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.052469  9959 ts_tablet_manager.cc:1403] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.157s	user 0.012s	sys 0.023s
I20260709 13:03:14.055598  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:14.055737  9959 raft_consensus.cc:359] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:14.056807  9959 raft_consensus.cc:385] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.057209  9959 raft_consensus.cc:740] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.057963  9959 consensus_queue.cc:260] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:14.058274  9803 leader_election.cc:304] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:14.060046  9959 ts_tablet_manager.cc:1434] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:03:14.061342  9959 tablet_bootstrap.cc:492] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:14.062177  9835 raft_consensus.cc:2468] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:14.073686 10361 leader_election.cc:290] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:14.074507  9959 tablet_bootstrap.cc:654] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.077215  9909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4213d5ed7d5428aa77410084c68a98b" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:14.079450  9963 tablet_bootstrap.cc:654] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.081166  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4213d5ed7d5428aa77410084c68a98b" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:14.060114 10240 raft_consensus.cc:493] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.084713 10240 raft_consensus.cc:515] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:14.086990 10240 leader_election.cc:290] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:14.081995 10234 consensus_queue.cc:1048] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:14.088943  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d0bc42f3174047b43f78e52fcfbd04" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:14.089684  9911 raft_consensus.cc:3060] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.089959  9839 raft_consensus.cc:2393] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8557220d7e6a4ccbbef222e80a5584a5 in current term 1: Already voted for candidate 837fad20523b4348b68f0a1e1af12404 in this term.
I20260709 13:03:14.091022  9760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d0bc42f3174047b43f78e52fcfbd04" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:14.092816  9765 raft_consensus.cc:2468] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
I20260709 13:03:14.092996  9877 leader_election.cc:304] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:14.094872  9803 leader_election.cc:304] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:14.098585 10198 raft_consensus.cc:2804] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:14.099052 10198 raft_consensus.cc:493] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.099946 10198 raft_consensus.cc:3060] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.153534 10280 raft_consensus.cc:2749] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:14.172999 10243 raft_consensus.cc:515] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:14.216532  9963 tablet_bootstrap.cc:492] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:14.221427  9963 ts_tablet_manager.cc:1403] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.215s	user 0.027s	sys 0.025s
I20260709 13:03:14.229432  9959 tablet_bootstrap.cc:492] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:14.230243  9959 ts_tablet_manager.cc:1403] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.169s	user 0.016s	sys 0.007s
I20260709 13:03:14.267663  9958 tablet_bootstrap.cc:492] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:14.268263  9958 ts_tablet_manager.cc:1403] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.435s	user 0.018s	sys 0.008s
W20260709 13:03:14.226891 10368 log.cc:927] Time spent T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:03:14.275363  9909 raft_consensus.cc:2393] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 451c871fd36f4d95a76b62d041aa7b60 in current term 1: Already voted for candidate 8557220d7e6a4ccbbef222e80a5584a5 in this term.
I20260709 13:03:14.282591 10240 raft_consensus.cc:2749] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:14.286512  9961 tablet_bootstrap.cc:492] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:14.287067  9961 ts_tablet_manager.cc:1403] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.406s	user 0.017s	sys 0.006s
I20260709 13:03:14.291134  9588 catalog_manager.cc:5697] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:14.293968  9731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 83050.9us
I20260709 13:03:14.296491  9958 raft_consensus.cc:359] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:14.302227  9958 raft_consensus.cc:385] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.302533  9958 raft_consensus.cc:740] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.303210  9958 consensus_queue.cc:260] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:14.308862  9959 raft_consensus.cc:359] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:14.309525  9959 raft_consensus.cc:385] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.309759  9959 raft_consensus.cc:740] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.310295  9959 consensus_queue.cc:260] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:14.313798 10376 raft_consensus.cc:493] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.314918 10243 leader_election.cc:290] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:14.314638 10376 raft_consensus.cc:515] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:14.316068  9958 ts_tablet_manager.cc:1434] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:03:14.319437  9961 raft_consensus.cc:359] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:14.320227  9961 raft_consensus.cc:385] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.320497  9961 raft_consensus.cc:740] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.321415  9961 consensus_queue.cc:260] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:14.326627  9961 ts_tablet_manager.cc:1434] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:03:14.344491  9959 ts_tablet_manager.cc:1434] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.114s	user 0.007s	sys 0.001s
W20260709 13:03:14.371143  9731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 75410us
I20260709 13:03:14.372380  9958 tablet_bootstrap.cc:492] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:14.373584  9961 tablet_bootstrap.cc:492] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:14.353413  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4213d5ed7d5428aa77410084c68a98b" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:14.347332 10198 raft_consensus.cc:515] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:14.396788  9959 tablet_bootstrap.cc:492] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:14.420296  9838 raft_consensus.cc:2393] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8557220d7e6a4ccbbef222e80a5584a5 in current term 1: Already voted for candidate 451c871fd36f4d95a76b62d041aa7b60 in this term.
I20260709 13:03:14.408914 10376 leader_election.cc:290] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:14.436175  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4213d5ed7d5428aa77410084c68a98b" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:14.436895  9765 raft_consensus.cc:3060] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:14.444818 10371 log.cc:927] Time spent T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:03:14.433439  9688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17ab55de9cb48ea8add7a3b93294673" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:14.425279 10384 raft_consensus.cc:493] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.449209  9765 raft_consensus.cc:2468] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:14.455657 10384 raft_consensus.cc:515] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:14.457120  9963 raft_consensus.cc:359] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:14.457876  9963 raft_consensus.cc:385] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.458166  9963 raft_consensus.cc:740] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.458853  9963 consensus_queue.cc:260] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:14.423040 10388 consensus_queue.cc:1048] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260709 13:03:14.475616  9963 ts_tablet_manager.cc:1434] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.253s	user 0.009s	sys 0.000s
W20260709 13:03:14.476976  9879 leader_election.cc:343] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.483922  9760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4213d5ed7d5428aa77410084c68a98b" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:14.485095  9760 raft_consensus.cc:2393] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 451c871fd36f4d95a76b62d041aa7b60 in current term 1: Already voted for candidate 8557220d7e6a4ccbbef222e80a5584a5 in this term.
I20260709 13:03:14.494655  9961 tablet_bootstrap.cc:654] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:14.495579  9654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:44623, user_credentials={real_user=slave}} blocked reactor thread for 92259.8us
I20260709 13:03:14.454232 10198 leader_election.cc:290] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:14.520628  9958 tablet_bootstrap.cc:654] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.497644 10285 consensus_queue.cc:1048] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:03:14.517158  9877 leader_election.cc:304] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:14.549399  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17ab55de9cb48ea8add7a3b93294673" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:14.565547  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dadd5ead404b82a843d64283e7f2a1" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:14.571022  9959 tablet_bootstrap.cc:654] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.574204  9963 tablet_bootstrap.cc:492] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:14.562282 10360 raft_consensus.cc:2804] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:14.575048 10360 raft_consensus.cc:697] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:14.575917 10360 consensus_queue.cc:237] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
W20260709 13:03:14.585054  9636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:03:14.554304  9877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:44623, user_credentials={real_user=slave}} blocked reactor thread for 57257.8us
I20260709 13:03:14.592253 10384 leader_election.cc:290] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:14.598037  9761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dadd5ead404b82a843d64283e7f2a1" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:14.598807  9761 raft_consensus.cc:2468] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:14.616312  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4213d5ed7d5428aa77410084c68a98b" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
W20260709 13:03:14.616707  9877 leader_election.cc:343] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.617178  9877 leader_election.cc:304] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:14.618139 10120 raft_consensus.cc:2749] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:14.618811  9653 leader_election.cc:343] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.638362  9963 tablet_bootstrap.cc:654] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.646106  9654 leader_election.cc:304] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:14.668323 10117 consensus_queue.cc:1048] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:14.669903 10240 raft_consensus.cc:493] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.670423 10240 raft_consensus.cc:515] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:14.702391  9690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839d06ab83a14f179212ace3780771f2" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:14.663283 10198 consensus_queue.cc:1048] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 13:03:14.631757 10384 consensus_queue.cc:1048] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260709 13:03:14.666752 10389 raft_consensus.cc:2804] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:14.672499 10240 leader_election.cc:290] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:14.724835 10381 raft_consensus.cc:493] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.725626 10381 raft_consensus.cc:515] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
W20260709 13:03:14.729059  9879 leader_election.cc:343] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.707103 10389 raft_consensus.cc:493] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.740749  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839d06ab83a14f179212ace3780771f2" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:14.756491  9958 tablet_bootstrap.cc:492] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:14.757326  9958 ts_tablet_manager.cc:1403] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.414s	user 0.020s	sys 0.006s
I20260709 13:03:14.737138 10389 raft_consensus.cc:3060] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.738162 10381 leader_election.cc:290] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:14.760845  9684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa904b1a1a63492ca9d5820c1984c7e8" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:14.790759  9731 leader_election.cc:343] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.797864 10362 raft_consensus.cc:493] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.798462 10362 raft_consensus.cc:515] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:14.794236  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa904b1a1a63492ca9d5820c1984c7e8" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:14.802874  9838 raft_consensus.cc:2468] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:14.804409  9959 tablet_bootstrap.cc:492] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:14.805022  9959 ts_tablet_manager.cc:1403] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.415s	user 0.020s	sys 0.013s
I20260709 13:03:14.807850  9959 raft_consensus.cc:359] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:14.808555  9959 raft_consensus.cc:385] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.808840  9959 raft_consensus.cc:740] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.809463  9959 consensus_queue.cc:260] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:14.813663  9963 tablet_bootstrap.cc:492] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:14.814239  9963 ts_tablet_manager.cc:1403] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.240s	user 0.048s	sys 0.010s
I20260709 13:03:14.817378  9959 ts_tablet_manager.cc:1434] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.006s
I20260709 13:03:14.818888  9802 leader_election.cc:304] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5
W20260709 13:03:14.820777  9877 leader_election.cc:343] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.820910 10280 raft_consensus.cc:2749] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:14.821416  9877 leader_election.cc:304] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:14.822600 10240 raft_consensus.cc:2749] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:14.826805  9958 raft_consensus.cc:359] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:14.820972  9963 raft_consensus.cc:359] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:14.827596  9958 raft_consensus.cc:385] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.827950  9963 raft_consensus.cc:385] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.828334  9963 raft_consensus.cc:740] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.829146  9963 consensus_queue.cc:260] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:14.838086 10362 leader_election.cc:290] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:14.839360  9731 leader_election.cc:304] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:14.841334 10397 raft_consensus.cc:2804] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:14.841753 10397 raft_consensus.cc:493] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.842063 10397 raft_consensus.cc:3060] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.842201 10127 consensus_queue.cc:1048] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:14.843317  9963 ts_tablet_manager.cc:1434] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:03:14.844507  9963 tablet_bootstrap.cc:492] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:14.845113  9761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa904b1a1a63492ca9d5820c1984c7e8" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:14.832291  9587 catalog_manager.cc:5697] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.849327 10389 raft_consensus.cc:515] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:14.852937  9958 raft_consensus.cc:740] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.853892  9958 consensus_queue.cc:260] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:14.855715  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dadd5ead404b82a843d64283e7f2a1" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:14.856837 10389 leader_election.cc:290] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
W20260709 13:03:14.860705  9653 leader_election.cc:343] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.862119  9963 tablet_bootstrap.cc:654] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.865717  9959 tablet_bootstrap.cc:492] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:14.869846  9961 tablet_bootstrap.cc:492] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:14.870426  9961 ts_tablet_manager.cc:1403] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.514s	user 0.024s	sys 0.035s
I20260709 13:03:14.877561  9961 raft_consensus.cc:359] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:14.878424  9961 raft_consensus.cc:385] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.880272  9686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa904b1a1a63492ca9d5820c1984c7e8" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:14.881085  9686 raft_consensus.cc:2468] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
I20260709 13:03:14.880653  9961 raft_consensus.cc:740] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.885870  9961 consensus_queue.cc:260] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:14.890420  9961 ts_tablet_manager.cc:1434] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:03:14.891588  9961 tablet_bootstrap.cc:492] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:14.898582 10389 raft_consensus.cc:493] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.899484 10389 raft_consensus.cc:515] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:14.903880  9834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d0271039c54d29bb678ff19e90a76a" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:14.905059  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d0271039c54d29bb678ff19e90a76a" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
W20260709 13:03:14.905644  9656 leader_election.cc:343] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:14.908489  9728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:36227, user_credentials={real_user=slave}} blocked reactor thread for 50947.5us
W20260709 13:03:14.909564  9731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35769, user_credentials={real_user=slave}} blocked reactor thread for 49480us
I20260709 13:03:14.918087  9958 ts_tablet_manager.cc:1434] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.160s	user 0.003s	sys 0.004s
W20260709 13:03:14.918642  9653 leader_election.cc:343] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.920178  9959 tablet_bootstrap.cc:654] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.921844  9805 leader_election.cc:304] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:14.919380  9653 leader_election.cc:304] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:14.934520  9958 tablet_bootstrap.cc:492] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:14.930470 10198 raft_consensus.cc:2804] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:14.943706 10198 raft_consensus.cc:493] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.944155 10198 raft_consensus.cc:3060] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.927891 10384 raft_consensus.cc:2749] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:14.927171 10389 leader_election.cc:290] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:14.960991  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dadd5ead404b82a843d64283e7f2a1" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:14.961716  9765 raft_consensus.cc:3060] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.969283  9963 tablet_bootstrap.cc:492] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:14.969970  9963 ts_tablet_manager.cc:1403] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.126s	user 0.018s	sys 0.010s
I20260709 13:03:14.985384  9961 tablet_bootstrap.cc:654] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.991137 10388 raft_consensus.cc:493] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.991956 10388 raft_consensus.cc:515] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:14.995062 10388 leader_election.cc:290] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:15.002883  9765 raft_consensus.cc:2468] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:15.005175 10397 raft_consensus.cc:515] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:15.002907  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839d06ab83a14f179212ace3780771f2" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:15.009533  9654 leader_election.cc:304] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:15.015434  9963 raft_consensus.cc:359] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.016088  9963 raft_consensus.cc:385] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.016350  9963 raft_consensus.cc:740] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.022917  9963 consensus_queue.cc:260] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.027583  9963 ts_tablet_manager.cc:1434] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.001s
I20260709 13:03:15.028898  9963 tablet_bootstrap.cc:492] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:15.020998 10384 raft_consensus.cc:2804] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.038276  9687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839d06ab83a14f179212ace3780771f2" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:15.041347  9731 leader_election.cc:343] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.041567 10397 leader_election.cc:290] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:15.042423  9761 raft_consensus.cc:2393] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 451c871fd36f4d95a76b62d041aa7b60 in current term 1: Already voted for candidate 837fad20523b4348b68f0a1e1af12404 in this term.
I20260709 13:03:15.043134 10384 raft_consensus.cc:697] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:15.044379 10384 consensus_queue.cc:237] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.044771  9834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa904b1a1a63492ca9d5820c1984c7e8" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:15.047431  9687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa904b1a1a63492ca9d5820c1984c7e8" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:15.048161  9687 raft_consensus.cc:3060] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.056113  9687 raft_consensus.cc:2468] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:15.018287  9910 raft_consensus.cc:2468] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:15.058980  9728 leader_election.cc:304] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:15.064165 10117 raft_consensus.cc:2804] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.065310  9958 tablet_bootstrap.cc:654] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.065429 10117 raft_consensus.cc:493] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.065925 10117 raft_consensus.cc:3060] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.070751  9731 leader_election.cc:304] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:15.080487  9959 tablet_bootstrap.cc:492] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:15.073745 10388 raft_consensus.cc:2804] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.085168 10394 raft_consensus.cc:493] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.085368 10388 raft_consensus.cc:697] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:15.085309  9959 ts_tablet_manager.cc:1403] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.267s	user 0.028s	sys 0.002s
I20260709 13:03:15.052574 10198 raft_consensus.cc:515] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:15.086650 10388 consensus_queue.cc:237] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:15.086177 10394 raft_consensus.cc:515] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.112437  9834 raft_consensus.cc:2393] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 837fad20523b4348b68f0a1e1af12404 in current term 1: Already voted for candidate 451c871fd36f4d95a76b62d041aa7b60 in this term.
I20260709 13:03:15.117072  9684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa904b1a1a63492ca9d5820c1984c7e8" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:15.118185  9684 raft_consensus.cc:2393] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 451c871fd36f4d95a76b62d041aa7b60 in current term 1: Already voted for candidate 837fad20523b4348b68f0a1e1af12404 in this term.
I20260709 13:03:15.117072  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa904b1a1a63492ca9d5820c1984c7e8" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:15.121407  9803 leader_election.cc:304] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:15.122490 10362 raft_consensus.cc:2749] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.125798  9959 raft_consensus.cc:359] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.126613  9959 raft_consensus.cc:385] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.126906  9959 raft_consensus.cc:740] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.127637  9959 consensus_queue.cc:260] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.129709 10394 leader_election.cc:290] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:15.133579  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef635d06ca2448f098dadbba833fa52c" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:15.114972 10198 leader_election.cc:290] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:15.139931  9584 catalog_manager.cc:5697] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.138253  9961 tablet_bootstrap.cc:492] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:15.136565  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef635d06ca2448f098dadbba833fa52c" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:15.144636 10375 consensus_queue.cc:1048] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:15.145332  9961 ts_tablet_manager.cc:1403] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.254s	user 0.022s	sys 0.029s
I20260709 13:03:15.145386  9910 raft_consensus.cc:2468] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:15.142218  9838 raft_consensus.cc:2468] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:15.147410  9656 leader_election.cc:304] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:15.148229  9961 raft_consensus.cc:359] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.149169  9961 raft_consensus.cc:385] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.149415 10390 raft_consensus.cc:2804] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.149576  9961 raft_consensus.cc:740] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.149895 10390 raft_consensus.cc:493] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.150166  9963 tablet_bootstrap.cc:654] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.150323 10390 raft_consensus.cc:3060] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.150545  9961 consensus_queue.cc:260] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.152438  9961 ts_tablet_manager.cc:1434] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:03:15.153820  9961 tablet_bootstrap.cc:492] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:15.153576 10117 raft_consensus.cc:515] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.155607 10117 leader_election.cc:290] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:15.156327  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839d06ab83a14f179212ace3780771f2" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:15.157076  9910 raft_consensus.cc:3060] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.164332  9961 tablet_bootstrap.cc:654] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.172159  9684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839d06ab83a14f179212ace3780771f2" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:15.172741 10240 consensus_queue.cc:1048] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:15.175843  9731 leader_election.cc:343] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.190363  9910 raft_consensus.cc:2468] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:15.190948  9959 ts_tablet_manager.cc:1434] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.100s	user 0.004s	sys 0.003s
I20260709 13:03:15.191672  9728 leader_election.cc:304] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:15.192318  9959 tablet_bootstrap.cc:492] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:15.193740 10388 raft_consensus.cc:2804] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.194478 10388 raft_consensus.cc:697] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:15.197041 10388 consensus_queue.cc:237] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.198772  9963 tablet_bootstrap.cc:492] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:15.199343  9963 ts_tablet_manager.cc:1403] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.171s	user 0.010s	sys 0.000s
I20260709 13:03:15.204449  9958 tablet_bootstrap.cc:492] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:15.211202  9961 tablet_bootstrap.cc:492] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:15.211833  9961 ts_tablet_manager.cc:1403] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.003s
I20260709 13:03:15.205071  9958 ts_tablet_manager.cc:1403] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.276s	user 0.014s	sys 0.005s
I20260709 13:03:15.218323  9958 raft_consensus.cc:359] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.219018  9958 raft_consensus.cc:385] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.219290  9958 raft_consensus.cc:740] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.220104  9958 consensus_queue.cc:260] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.222329  9958 ts_tablet_manager.cc:1434] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:03:15.227046  9961 raft_consensus.cc:359] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.227945  9961 raft_consensus.cc:385] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.227718 10390 raft_consensus.cc:515] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.228256  9961 raft_consensus.cc:740] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.228996  9961 consensus_queue.cc:260] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.231249  9961 ts_tablet_manager.cc:1434] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.005s
I20260709 13:03:15.232460  9961 tablet_bootstrap.cc:492] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:15.223428  9958 tablet_bootstrap.cc:492] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:15.248240  9963 raft_consensus.cc:359] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.249002  9963 raft_consensus.cc:385] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.249260  9963 raft_consensus.cc:740] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.249951  9963 consensus_queue.cc:260] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.258431 10375 raft_consensus.cc:493] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.259200 10375 raft_consensus.cc:515] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.259691  9961 tablet_bootstrap.cc:654] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.261793 10375 leader_election.cc:290] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:15.262820  9834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0396d5b67f85469b9963a11345ace667" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:15.264254  9958 tablet_bootstrap.cc:654] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:15.264967  9879 leader_election.cc:343] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.270094  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0396d5b67f85469b9963a11345ace667" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
W20260709 13:03:15.271732  9877 leader_election.cc:343] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.272318  9877 leader_election.cc:304] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:15.272042  9584 catalog_manager.cc:5697] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:15.273604  9961 tablet_bootstrap.cc:492] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:15.273947  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef635d06ca2448f098dadbba833fa52c" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:15.285235  9961 ts_tablet_manager.cc:1403] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.008s
I20260709 13:03:15.285403  9910 raft_consensus.cc:3060] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.288008  9961 raft_consensus.cc:359] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.288754  9961 raft_consensus.cc:385] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.289005  9961 raft_consensus.cc:740] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.289681  9961 consensus_queue.cc:260] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.292003  9958 tablet_bootstrap.cc:492] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:15.292526  9958 ts_tablet_manager.cc:1403] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.004s
I20260709 13:03:15.295442  9958 raft_consensus.cc:359] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.296128  9958 raft_consensus.cc:385] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.296401  9958 raft_consensus.cc:740] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.296483  9961 ts_tablet_manager.cc:1434] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:03:15.297153  9958 consensus_queue.cc:260] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.297699  9910 raft_consensus.cc:2468] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:15.275386 10390 leader_election.cc:290] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:15.277088  9963 ts_tablet_manager.cc:1434] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.000s
I20260709 13:03:15.299541  9958 ts_tablet_manager.cc:1434] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:03:15.299646  9963 tablet_bootstrap.cc:492] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:15.300520  9958 tablet_bootstrap.cc:492] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:15.301743  9653 leader_election.cc:304] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:15.277611  9959 tablet_bootstrap.cc:654] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.302654 10384 raft_consensus.cc:2804] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.303175 10384 raft_consensus.cc:697] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:15.304021 10384 consensus_queue.cc:237] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.278155  9834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef635d06ca2448f098dadbba833fa52c" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:15.305490  9834 raft_consensus.cc:3060] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.307017  9958 tablet_bootstrap.cc:654] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.274945  9584 catalog_manager.cc:5697] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.279778 10376 raft_consensus.cc:2749] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.280169 10280 raft_consensus.cc:493] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.309834 10280 raft_consensus.cc:515] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.313105  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d0271039c54d29bb678ff19e90a76a" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:15.313340  9684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d0271039c54d29bb678ff19e90a76a" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:15.313972  9684 raft_consensus.cc:2468] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 0.
W20260709 13:03:15.314613  9802 leader_election.cc:343] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.315187  9805 leader_election.cc:304] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:15.316023 10198 raft_consensus.cc:2804] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.316365 10198 raft_consensus.cc:493] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.316741 10198 raft_consensus.cc:3060] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.319425  9958 tablet_bootstrap.cc:492] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:15.319964  9958 ts_tablet_manager.cc:1403] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:03:15.322793  9958 raft_consensus.cc:359] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.323511  9958 raft_consensus.cc:385] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.323787  9958 raft_consensus.cc:740] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.324378  9958 consensus_queue.cc:260] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.326699  9958 ts_tablet_manager.cc:1434] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:03:15.326880 10280 leader_election.cc:290] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:15.327596  9958 tablet_bootstrap.cc:492] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404: Bootstrap starting.
I20260709 13:03:15.328464 10198 raft_consensus.cc:515] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.333822 10117 raft_consensus.cc:493] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.335275  9684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d0271039c54d29bb678ff19e90a76a" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:15.335578 10117 raft_consensus.cc:515] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.335791  9958 tablet_bootstrap.cc:654] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.335867  9684 raft_consensus.cc:3060] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.316401  9834 raft_consensus.cc:2468] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:15.339293 10117 leader_election.cc:290] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:15.341552  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17ab55de9cb48ea8add7a3b93294673" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:15.342214  9912 raft_consensus.cc:2468] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:15.343616 10117 raft_consensus.cc:493] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.340760  9685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17ab55de9cb48ea8add7a3b93294673" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:15.345021  9963 tablet_bootstrap.cc:654] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.344233 10117 raft_consensus.cc:515] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.343659  9728 leader_election.cc:304] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:15.348676 10388 raft_consensus.cc:2804] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.349062 10388 raft_consensus.cc:493] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.349398 10388 raft_consensus.cc:3060] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.352443  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0396d5b67f85469b9963a11345ace667" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:15.353310  9958 tablet_bootstrap.cc:492] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404: No bootstrap required, opened a new log
I20260709 13:03:15.353250  9837 raft_consensus.cc:2468] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:15.353857  9958 ts_tablet_manager.cc:1403] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.003s
I20260709 13:03:15.354553  9731 leader_election.cc:304] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:15.334590  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d0271039c54d29bb678ff19e90a76a" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:15.355418 10379 raft_consensus.cc:2804] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:15.355509  9731 leader_election.cc:343] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.355947 10379 raft_consensus.cc:493] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:15.356216  9802 leader_election.cc:343] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.356330 10379 raft_consensus.cc:3060] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.354593  9963 tablet_bootstrap.cc:492] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:15.333999 10198 leader_election.cc:290] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:15.339646  9961 tablet_bootstrap.cc:492] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:15.357256 10117 leader_election.cc:290] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:15.334558  9587 catalog_manager.cc:5697] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:15.357591  9959 tablet_bootstrap.cc:492] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:15.377646  9959 ts_tablet_manager.cc:1403] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.186s	user 0.012s	sys 0.000s
I20260709 13:03:15.381036  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0396d5b67f85469b9963a11345ace667" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:15.381847  9910 raft_consensus.cc:2468] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
I20260709 13:03:15.383559  9959 raft_consensus.cc:359] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.384400  9959 raft_consensus.cc:385] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.384814  9959 raft_consensus.cc:740] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.386875  9961 tablet_bootstrap.cc:654] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.387197  9959 consensus_queue.cc:260] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.366132  9958 raft_consensus.cc:359] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.390781  9958 raft_consensus.cc:385] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.390952  9959 ts_tablet_manager.cc:1434] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:03:15.366787  9684 raft_consensus.cc:2468] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:15.391129  9958 raft_consensus.cc:740] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.366981 10379 raft_consensus.cc:515] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.376048  9963 ts_tablet_manager.cc:1403] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.000s
I20260709 13:03:15.392241  9805 leader_election.cc:304] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:15.393432 10361 raft_consensus.cc:2804] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.393934 10361 raft_consensus.cc:697] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:15.394224  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0396d5b67f85469b9963a11345ace667" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:15.394896  9837 raft_consensus.cc:3060] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.394771 10361 consensus_queue.cc:237] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.394668  9963 raft_consensus.cc:359] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:15.398407  9963 raft_consensus.cc:385] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.370541 10388 raft_consensus.cc:515] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.398748  9963 raft_consensus.cc:740] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.401343  9963 consensus_queue.cc:260] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:15.402930 10388 leader_election.cc:290] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:15.403683  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17ab55de9cb48ea8add7a3b93294673" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:15.404417  9912 raft_consensus.cc:3060] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.405010  9961 tablet_bootstrap.cc:492] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:15.405491  9961 ts_tablet_manager.cc:1403] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.002s
I20260709 13:03:15.408447  9961 raft_consensus.cc:359] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:15.409593  9961 raft_consensus.cc:385] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.409866  9961 raft_consensus.cc:740] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.403683  9963 ts_tablet_manager.cc:1434] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:03:15.410817  9685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17ab55de9cb48ea8add7a3b93294673" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:15.412199  9963 tablet_bootstrap.cc:492] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:15.410820  9961 consensus_queue.cc:260] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:15.415257  9961 ts_tablet_manager.cc:1434] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:15.416741  9961 tablet_bootstrap.cc:492] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60: Bootstrap starting.
I20260709 13:03:15.420212  9963 tablet_bootstrap.cc:654] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.421170 10379 leader_election.cc:290] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:15.422318  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0396d5b67f85469b9963a11345ace667" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:15.423100  9910 raft_consensus.cc:3060] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:15.425905  9731 leader_election.cc:343] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.426923  9961 tablet_bootstrap.cc:654] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.429323  9958 consensus_queue.cc:260] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.408231  9837 raft_consensus.cc:2468] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:15.431046 10384 raft_consensus.cc:493] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.431741 10384 raft_consensus.cc:515] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:15.436017  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359e0d2d58948c199c04b275867bffd" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:15.436866  9765 raft_consensus.cc:2468] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:15.445691  9912 raft_consensus.cc:2468] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:15.446851  9654 leader_election.cc:304] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:15.454414  9958 ts_tablet_manager.cc:1434] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404: Time spent starting tablet: real 0.100s	user 0.003s	sys 0.005s
I20260709 13:03:15.445057  9731 leader_election.cc:304] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:15.457309 10117 raft_consensus.cc:2804] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.457824 10117 raft_consensus.cc:697] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:15.457345  9728 leader_election.cc:304] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:15.463261  9959 tablet_bootstrap.cc:492] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:15.458535 10117 consensus_queue.cc:237] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.439545 10384 leader_election.cc:290] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:15.465186 10393 raft_consensus.cc:2804] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.481650 10393 raft_consensus.cc:493] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.482229 10393 raft_consensus.cc:3060] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.485845  9834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359e0d2d58948c199c04b275867bffd" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:15.488520  9834 raft_consensus.cc:2468] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:15.463295 10390 raft_consensus.cc:493] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.490362 10390 raft_consensus.cc:515] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.499614 10397 raft_consensus.cc:493] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.500604 10397 raft_consensus.cc:515] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.501752  9584 catalog_manager.cc:5697] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.502765 10397 leader_election.cc:290] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:15.499833  9910 raft_consensus.cc:2468] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:15.503564  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8d49a0a0c7c4fc4bd734945246961cc" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
W20260709 13:03:15.505223  9728 leader_election.cc:343] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.505839  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839d06ab83a14f179212ace3780771f2" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:15.506927  9912 raft_consensus.cc:2393] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in current term 1: Already voted for candidate 837fad20523b4348b68f0a1e1af12404 in this term.
I20260709 13:03:15.509399 10390 leader_election.cc:290] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:15.510386  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839d06ab83a14f179212ace3780771f2" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:15.512121  9684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8d49a0a0c7c4fc4bd734945246961cc" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:15.513522  9654 leader_election.cc:304] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:15.515609 10384 raft_consensus.cc:3060] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:15.516882  9731 leader_election.cc:343] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.517372  9731 leader_election.cc:304] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:15.518108 10385 raft_consensus.cc:2749] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.465082 10379 raft_consensus.cc:2804] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.523443  9959 tablet_bootstrap.cc:654] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.523785 10379 raft_consensus.cc:697] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:15.541649 10379 consensus_queue.cc:237] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.543032 10385 consensus_queue.cc:1048] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:15.556429  9963 tablet_bootstrap.cc:492] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:15.560802 10393 raft_consensus.cc:515] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:15.561650 10395 consensus_queue.cc:1048] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:15.562790 10397 consensus_queue.cc:1048] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:15.560515  9963 ts_tablet_manager.cc:1403] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.149s	user 0.017s	sys 0.007s
I20260709 13:03:15.575711  9959 tablet_bootstrap.cc:492] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:15.577617  9959 ts_tablet_manager.cc:1403] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.117s	user 0.009s	sys 0.005s
I20260709 13:03:15.586733  9963 raft_consensus.cc:359] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.587548  9963 raft_consensus.cc:385] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.587837  9963 raft_consensus.cc:740] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.589450  9963 consensus_queue.cc:260] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:15.599609  9760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359e0d2d58948c199c04b275867bffd" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:15.600376  9760 raft_consensus.cc:3060] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.588457 10384 raft_consensus.cc:2749] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.617660  9961 tablet_bootstrap.cc:492] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60: No bootstrap required, opened a new log
I20260709 13:03:15.618395  9961 ts_tablet_manager.cc:1403] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60: Time spent bootstrapping tablet: real 0.202s	user 0.024s	sys 0.035s
I20260709 13:03:15.620069  9911 raft_consensus.cc:3060] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.620853 10393 leader_election.cc:290] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:15.621536  9961 raft_consensus.cc:359] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.622277  9961 raft_consensus.cc:385] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.622553  9961 raft_consensus.cc:740] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.623917  9961 consensus_queue.cc:260] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.626133  9961 ts_tablet_manager.cc:1434] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:15.641790  9963 ts_tablet_manager.cc:1434] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.069s	user 0.000s	sys 0.007s
I20260709 13:03:15.649148  9834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359e0d2d58948c199c04b275867bffd" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:15.649885  9834 raft_consensus.cc:3060] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.650375  9963 tablet_bootstrap.cc:492] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:15.653034  9586 catalog_manager.cc:5697] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.655264  9586 catalog_manager.cc:5697] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:15.673559  9959 raft_consensus.cc:359] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.674355  9959 raft_consensus.cc:385] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.674645  9959 raft_consensus.cc:740] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.675504 10361 raft_consensus.cc:493] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:15.676338  9636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:15.676021 10361 raft_consensus.cc:515] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.682839  9760 raft_consensus.cc:2468] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:15.684652  9654 leader_election.cc:304] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:15.687287 10384 raft_consensus.cc:2804] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.687572 10390 consensus_queue.cc:1048] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:15.676630  9959 consensus_queue.cc:260] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.689014 10378 raft_consensus.cc:493] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.690234 10378 raft_consensus.cc:515] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.693192  9963 tablet_bootstrap.cc:654] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.693665  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb34d3df6d146e7b2406dafa071fd52" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:15.695259  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e6a4d52c8045909369ffe63bfc03dc" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:15.696099  9835 raft_consensus.cc:2468] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 0.
W20260709 13:03:15.697921  9802 leader_election.cc:343] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.687914 10384 raft_consensus.cc:697] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:15.700135 10378 leader_election.cc:290] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:15.701261 10280 raft_consensus.cc:493] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.694394  9959 ts_tablet_manager.cc:1434] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.116s	user 0.006s	sys 0.001s
I20260709 13:03:15.704098 10280 raft_consensus.cc:515] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.705390  9731 leader_election.cc:304] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:15.708446  9959 tablet_bootstrap.cc:492] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:15.700935 10384 consensus_queue.cc:237] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:15.719286  9684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c146a1db6843fc81be490f926d3137" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:15.723572  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c146a1db6843fc81be490f926d3137" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:15.709049 10361 leader_election.cc:290] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:15.709857 10280 leader_election.cc:290] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:15.693733  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e6a4d52c8045909369ffe63bfc03dc" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:15.710983 10379 raft_consensus.cc:2804] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:15.733081  9802 leader_election.cc:343] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:15.733712  9805 leader_election.cc:343] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.734315  9805 leader_election.cc:304] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5
W20260709 13:03:15.735550  9728 leader_election.cc:343] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.735414 10198 raft_consensus.cc:2749] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.743021  9834 raft_consensus.cc:2468] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:15.721936  9685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb34d3df6d146e7b2406dafa071fd52" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:15.729159 10379 raft_consensus.cc:493] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.747205 10379 raft_consensus.cc:3060] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:15.747714  9805 leader_election.cc:343] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.748258  9805 leader_election.cc:304] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:15.749006 10198 raft_consensus.cc:2749] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.753557 10378 consensus_queue.cc:1048] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:15.756204 10379 raft_consensus.cc:515] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.758567 10379 leader_election.cc:290] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:15.762244  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e6a4d52c8045909369ffe63bfc03dc" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
W20260709 13:03:15.764154  9728 leader_election.cc:343] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.765652  9834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e6a4d52c8045909369ffe63bfc03dc" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:15.766337  9959 tablet_bootstrap.cc:654] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.766546  9834 raft_consensus.cc:3060] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.798269  9963 tablet_bootstrap.cc:492] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:15.798908  9963 ts_tablet_manager.cc:1403] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.149s	user 0.009s	sys 0.023s
I20260709 13:03:15.809232 10376 raft_consensus.cc:493] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.809849 10376 raft_consensus.cc:515] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.816515  9684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d0271039c54d29bb678ff19e90a76a" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:15.817451  9684 raft_consensus.cc:2393] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8557220d7e6a4ccbbef222e80a5584a5 in current term 1: Already voted for candidate 451c871fd36f4d95a76b62d041aa7b60 in this term.
I20260709 13:03:15.820847 10376 leader_election.cc:290] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:15.820742  9584 catalog_manager.cc:5697] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.821578  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d0271039c54d29bb678ff19e90a76a" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:15.823347  9879 leader_election.cc:304] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:15.829015 10240 raft_consensus.cc:3060] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.835043 10385 consensus_queue.cc:1048] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:15.836473 10240 raft_consensus.cc:2749] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.842877  9959 tablet_bootstrap.cc:492] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:15.843549  9959 ts_tablet_manager.cc:1403] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.140s	user 0.022s	sys 0.026s
I20260709 13:03:15.845034  9963 raft_consensus.cc:359] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.846094  9963 raft_consensus.cc:385] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.845088  9834 raft_consensus.cc:2468] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:15.848664  9731 leader_election.cc:304] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:15.849299  9959 raft_consensus.cc:359] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.849776 10385 raft_consensus.cc:2804] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.850185  9959 raft_consensus.cc:385] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.850602  9959 raft_consensus.cc:740] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.851439  9959 consensus_queue.cc:260] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.846447  9963 raft_consensus.cc:740] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.850355 10385 raft_consensus.cc:697] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:15.857545  9963 consensus_queue.cc:260] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.862917  9963 ts_tablet_manager.cc:1434] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.002s
I20260709 13:03:15.863013  9959 ts_tablet_manager.cc:1434] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 13:03:15.864254  9959 tablet_bootstrap.cc:492] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:15.871758  9959 tablet_bootstrap.cc:654] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.866987 10385 consensus_queue.cc:237] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:15.877923  9963 tablet_bootstrap.cc:492] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:15.895753  9963 tablet_bootstrap.cc:654] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.909571  9587 catalog_manager.cc:5697] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 0 to 1, leader changed from <none> to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.921347 10390 consensus_queue.cc:1048] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:15.922194 10384 consensus_queue.cc:1048] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:15.929447 10318 consensus_queue.cc:1048] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:15.942914  9963 tablet_bootstrap.cc:492] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:15.942912  9959 tablet_bootstrap.cc:492] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:15.943977  9959 ts_tablet_manager.cc:1403] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.008s
I20260709 13:03:15.943533  9963 ts_tablet_manager.cc:1403] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.009s
I20260709 13:03:15.946849  9959 raft_consensus.cc:359] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.947571  9959 raft_consensus.cc:385] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.947854  9959 raft_consensus.cc:740] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.950686 10198 consensus_queue.cc:1048] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:15.953758  9959 consensus_queue.cc:260] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.956281  9959 ts_tablet_manager.cc:1434] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:03:15.957738  9959 tablet_bootstrap.cc:492] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:15.963454  9963 raft_consensus.cc:359] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.964270  9963 raft_consensus.cc:385] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.964550  9963 raft_consensus.cc:740] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.965288  9963 consensus_queue.cc:260] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:15.971350  9959 tablet_bootstrap.cc:654] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.987098 10388 consensus_queue.cc:1048] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:15.987658  9963 ts_tablet_manager.cc:1434] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:03:15.995203  9963 tablet_bootstrap.cc:492] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:16.002128  9963 tablet_bootstrap.cc:654] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.003211 10240 raft_consensus.cc:493] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.003788 10240 raft_consensus.cc:515] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:16.005949 10240 leader_election.cc:290] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:16.012935  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e6a4d52c8045909369ffe63bfc03dc" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:16.012948 10198 consensus_queue.cc:1048] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:16.015944  9834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36e6a4d52c8045909369ffe63bfc03dc" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:16.017590  9834 raft_consensus.cc:2393] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8557220d7e6a4ccbbef222e80a5584a5 in current term 1: Already voted for candidate 837fad20523b4348b68f0a1e1af12404 in this term.
I20260709 13:03:16.027779  9879 leader_election.cc:304] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:16.029170 10376 raft_consensus.cc:3060] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.053392  9959 tablet_bootstrap.cc:492] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:16.053234 10390 raft_consensus.cc:493] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.053946 10390 raft_consensus.cc:515] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:16.056054 10390 leader_election.cc:290] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:16.061324  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17ab55de9cb48ea8add7a3b93294673" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:16.062166  9959 ts_tablet_manager.cc:1403] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.105s	user 0.022s	sys 0.017s
I20260709 13:03:16.065843  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17ab55de9cb48ea8add7a3b93294673" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:16.065986  9959 raft_consensus.cc:359] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:16.067332  9959 raft_consensus.cc:385] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.062175  9912 raft_consensus.cc:2393] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in current term 1: Already voted for candidate 837fad20523b4348b68f0a1e1af12404 in this term.
I20260709 13:03:16.067819  9959 raft_consensus.cc:740] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.068813  9959 consensus_queue.cc:260] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:16.073655  9959 ts_tablet_manager.cc:1434] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:03:16.074874  9959 tablet_bootstrap.cc:492] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5: Bootstrap starting.
I20260709 13:03:16.073691  9653 leader_election.cc:304] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:16.077201 10393 raft_consensus.cc:3060] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.111390  9959 tablet_bootstrap.cc:654] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.130162 10393 raft_consensus.cc:2749] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:16.142724 10378 consensus_queue.cc:1048] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:16.147100  9959 tablet_bootstrap.cc:492] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5: No bootstrap required, opened a new log
I20260709 13:03:16.147703  9959 ts_tablet_manager.cc:1403] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.012s
I20260709 13:03:16.150364 10376 raft_consensus.cc:2749] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:16.156865 10384 raft_consensus.cc:493] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.157480 10384 raft_consensus.cc:515] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:16.160673  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb34d3df6d146e7b2406dafa071fd52" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:16.160928 10384 leader_election.cc:290] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:16.161370  9835 raft_consensus.cc:2468] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:16.163791  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb34d3df6d146e7b2406dafa071fd52" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:16.164521  9912 raft_consensus.cc:2468] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:16.163821  9656 leader_election.cc:304] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:16.169838 10391 raft_consensus.cc:2804] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:16.170231 10391 raft_consensus.cc:493] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.170568 10391 raft_consensus.cc:3060] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.175169  9963 tablet_bootstrap.cc:492] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83: No bootstrap required, opened a new log
I20260709 13:03:16.168172 10384 consensus_queue.cc:1048] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:03:16.175900  9963 ts_tablet_manager.cc:1403] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.181s	user 0.026s	sys 0.019s
I20260709 13:03:16.177162  9959 raft_consensus.cc:359] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:16.177968  9959 raft_consensus.cc:385] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.178246  9959 raft_consensus.cc:740] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.178869  9959 consensus_queue.cc:260] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:16.180998  9959 ts_tablet_manager.cc:1434] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:03:16.190436 10391 raft_consensus.cc:515] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:16.193933 10385 consensus_queue.cc:1048] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:16.196637  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb34d3df6d146e7b2406dafa071fd52" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:16.197330  9912 raft_consensus.cc:3060] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.194006  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb34d3df6d146e7b2406dafa071fd52" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:16.202150  9835 raft_consensus.cc:3060] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.205546  9963 raft_consensus.cc:359] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:16.206380  9963 raft_consensus.cc:385] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.206673  9963 raft_consensus.cc:740] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.207605  9963 consensus_queue.cc:260] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:16.211153  9912 raft_consensus.cc:2468] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:16.212839  9963 ts_tablet_manager.cc:1434] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.002s
I20260709 13:03:16.218276 10391 leader_election.cc:290] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:16.221160 10391 consensus_queue.cc:1048] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:16.221310  9653 leader_election.cc:304] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:16.236958 10393 raft_consensus.cc:2804] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:16.237555 10393 raft_consensus.cc:697] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:16.245121 10393 consensus_queue.cc:237] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:16.273547  9835 raft_consensus.cc:2468] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:16.290230  9586 catalog_manager.cc:5697] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:16.320060 10385 consensus_queue.cc:1048] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.322891 10388 consensus_queue.cc:1048] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.352854 10393 raft_consensus.cc:493] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.353418 10393 raft_consensus.cc:515] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:16.355581 10393 leader_election.cc:290] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:16.356946  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c146a1db6843fc81be490f926d3137" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:16.357205  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c146a1db6843fc81be490f926d3137" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:16.357709  9910 raft_consensus.cc:2468] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:16.357884  9837 raft_consensus.cc:2468] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 0.
I20260709 13:03:16.359193  9653 leader_election.cc:304] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:16.359992 10384 raft_consensus.cc:2804] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:16.360353 10384 raft_consensus.cc:493] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.360715 10384 raft_consensus.cc:3060] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.366590 10384 raft_consensus.cc:515] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:16.368398 10384 leader_election.cc:290] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:16.369277  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c146a1db6843fc81be490f926d3137" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:16.369513  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c146a1db6843fc81be490f926d3137" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:16.369910  9837 raft_consensus.cc:3060] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.370115  9910 raft_consensus.cc:3060] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.376116  9837 raft_consensus.cc:2468] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:16.376521  9910 raft_consensus.cc:2468] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 1.
I20260709 13:03:16.377401  9656 leader_election.cc:304] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:16.378302 10201 raft_consensus.cc:2804] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:16.378832 10201 raft_consensus.cc:697] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:16.379622 10201 consensus_queue.cc:237] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:16.396404  9586 catalog_manager.cc:5697] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:16.407624 10447 raft_consensus.cc:493] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.408138 10447 raft_consensus.cc:515] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:16.410020 10447 leader_election.cc:290] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:16.410573  9685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8d49a0a0c7c4fc4bd734945246961cc" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:16.411055  9760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8d49a0a0c7c4fc4bd734945246961cc" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:16.411490  9685 raft_consensus.cc:2468] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:16.411772  9760 raft_consensus.cc:2468] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 0.
I20260709 13:03:16.412791  9879 leader_election.cc:304] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:16.413437 10447 raft_consensus.cc:2804] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:16.413826 10447 raft_consensus.cc:493] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.414073 10447 raft_consensus.cc:3060] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.420014 10447 raft_consensus.cc:515] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:16.422814 10447 leader_election.cc:290] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:16.423041  9760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8d49a0a0c7c4fc4bd734945246961cc" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:16.423883  9760 raft_consensus.cc:3060] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.425323  9685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8d49a0a0c7c4fc4bd734945246961cc" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:16.426009  9685 raft_consensus.cc:3060] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.431877  9760 raft_consensus.cc:2468] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:16.433692  9877 leader_election.cc:304] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:16.437335  9685 raft_consensus.cc:2468] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:16.439182 10447 raft_consensus.cc:2804] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:16.439877 10447 raft_consensus.cc:697] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:16.440773 10447 consensus_queue.cc:237] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:16.451068  9586 catalog_manager.cc:5697] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.643076 10201 consensus_queue.cc:1048] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:16.655901 10393 consensus_queue.cc:1048] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.868800 10447 consensus_queue.cc:1048] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.885860 10447 consensus_queue.cc:1048] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:16.944041 10201 consensus_queue.cc:1048] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.950703 10201 consensus_queue.cc:1048] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:17.513633   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:03:17.532512  9731 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:17.538269  9731 consensus_peers.cc:597] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.567456   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:17.568526   431 tablet_replica.cc:333] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.569625   431 raft_consensus.cc:2243] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.570176   431 raft_consensus.cc:2272] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.574924   431 tablet_replica.cc:333] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.575793   431 raft_consensus.cc:2243] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:03:17.576457  9731 consensus_peers.cc:597] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.576843   431 raft_consensus.cc:2272] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:17.577150  9731 consensus_peers.cc:597] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.578979   431 tablet_replica.cc:333] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.579738   431 raft_consensus.cc:2243] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.580263   431 raft_consensus.cc:2272] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.582358   431 tablet_replica.cc:333] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.583056   431 raft_consensus.cc:2243] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.583523   431 raft_consensus.cc:2272] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.585588   431 tablet_replica.cc:333] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.586270   431 raft_consensus.cc:2243] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.586757   431 raft_consensus.cc:2272] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.588531   431 tablet_replica.cc:333] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.589182   431 raft_consensus.cc:2243] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:17.590044   431 raft_consensus.cc:2272] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.593281   431 tablet_replica.cc:333] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.594179   431 raft_consensus.cc:2243] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.594758   431 raft_consensus.cc:2272] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.596948   431 tablet_replica.cc:333] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.597585   431 raft_consensus.cc:2243] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.598006   431 raft_consensus.cc:2272] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.600687   431 tablet_replica.cc:333] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.601639   431 raft_consensus.cc:2243] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.602208   431 raft_consensus.cc:2272] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.604758   431 tablet_replica.cc:333] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
W20260709 13:03:17.605804  9805 consensus_peers.cc:597] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.605852   431 raft_consensus.cc:2243] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:03:17.606511  9879 consensus_peers.cc:597] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.607185   431 raft_consensus.cc:2272] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.610046   431 tablet_replica.cc:333] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.611119   431 raft_consensus.cc:2243] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.611729   431 raft_consensus.cc:2272] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.614418   431 tablet_replica.cc:333] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.615209   431 raft_consensus.cc:2243] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.615731   431 raft_consensus.cc:2272] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:17.616803  9731 consensus_peers.cc:597] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.618209   431 tablet_replica.cc:333] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.619112   431 raft_consensus.cc:2243] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.619633   431 raft_consensus.cc:2272] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:17.621431  9731 consensus_peers.cc:597] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.622315   431 tablet_replica.cc:333] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
W20260709 13:03:17.622962  9879 consensus_peers.cc:597] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.623172   431 raft_consensus.cc:2243] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.623792   431 raft_consensus.cc:2272] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.626559   431 tablet_replica.cc:333] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.627094   431 raft_consensus.cc:2243] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:17.627981   431 raft_consensus.cc:2272] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.630359   431 tablet_replica.cc:333] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.631153   431 raft_consensus.cc:2243] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:17.631978   431 raft_consensus.cc:2272] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:17.633543  9731 consensus_peers.cc:597] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.634176   431 tablet_replica.cc:333] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.634869   431 raft_consensus.cc:2243] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.635344   431 raft_consensus.cc:2272] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.638186   431 tablet_replica.cc:333] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.638832   431 raft_consensus.cc:2243] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:17.639742   431 raft_consensus.cc:2272] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.642266   431 tablet_replica.cc:333] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.642845   431 raft_consensus.cc:2243] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:17.643615   431 raft_consensus.cc:2272] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.645815   431 tablet_replica.cc:333] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.646535   431 raft_consensus.cc:2243] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.647104   431 raft_consensus.cc:2272] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.649603   431 tablet_replica.cc:333] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.650233   431 raft_consensus.cc:2243] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.650710   431 raft_consensus.cc:2272] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.653050   431 tablet_replica.cc:333] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.653666   431 raft_consensus.cc:2243] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.654098   431 raft_consensus.cc:2272] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.656445   431 tablet_replica.cc:333] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.657092   431 raft_consensus.cc:2243] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:17.657938   431 raft_consensus.cc:2272] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.660362   431 tablet_replica.cc:333] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.661128   431 raft_consensus.cc:2243] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:17.662150   431 raft_consensus.cc:2272] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.664958   431 tablet_replica.cc:333] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
W20260709 13:03:17.665642  9731 consensus_peers.cc:597] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.665726   431 raft_consensus.cc:2243] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.666605   431 raft_consensus.cc:2272] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.668848   431 tablet_replica.cc:333] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.669519   431 raft_consensus.cc:2243] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.670028   431 raft_consensus.cc:2272] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.672652   431 tablet_replica.cc:333] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.673503   431 raft_consensus.cc:2243] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.674062   431 raft_consensus.cc:2272] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:17.674857  9731 consensus_peers.cc:597] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.676905   431 tablet_replica.cc:333] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.677834   431 raft_consensus.cc:2243] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:17.679621  9731 consensus_peers.cc:597] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.679865   431 raft_consensus.cc:2272] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.682600   431 tablet_replica.cc:333] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.683378   431 raft_consensus.cc:2243] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.683892   431 raft_consensus.cc:2272] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.686327   431 tablet_replica.cc:333] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.686939   431 raft_consensus.cc:2243] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:17.687687   431 raft_consensus.cc:2272] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.689507   431 tablet_replica.cc:333] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.690129   431 raft_consensus.cc:2243] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.690665   431 raft_consensus.cc:2272] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.693163   431 tablet_replica.cc:333] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.693823   431 raft_consensus.cc:2243] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.694346   431 raft_consensus.cc:2272] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.697018   431 tablet_replica.cc:333] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.697751   431 raft_consensus.cc:2243] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:17.698832   431 raft_consensus.cc:2272] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.701347   431 tablet_replica.cc:333] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.701970   431 raft_consensus.cc:2243] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.702389   431 raft_consensus.cc:2272] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.705427   431 tablet_replica.cc:333] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.706204   431 raft_consensus.cc:2243] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.706786   431 raft_consensus.cc:2272] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:17.707841  9805 consensus_peers.cc:597] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.709657   431 tablet_replica.cc:333] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.710554   431 raft_consensus.cc:2243] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.711102   431 raft_consensus.cc:2272] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.713544   431 tablet_replica.cc:333] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.714160   431 raft_consensus.cc:2243] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.714665   431 raft_consensus.cc:2272] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.716810   431 tablet_replica.cc:333] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.717433   431 raft_consensus.cc:2243] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.717994   431 raft_consensus.cc:2272] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.721292   431 tablet_replica.cc:333] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.722069   431 raft_consensus.cc:2243] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:17.723166   431 raft_consensus.cc:2272] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:17.723845  9805 consensus_peers.cc:597] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:17.723991  9879 consensus_peers.cc:597] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.726033   431 tablet_replica.cc:333] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.727056   431 raft_consensus.cc:2243] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:17.728091   431 raft_consensus.cc:2272] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:17.728103  9731 consensus_peers.cc:597] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.731325   431 tablet_replica.cc:333] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.732275   431 raft_consensus.cc:2243] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.732903   431 raft_consensus.cc:2272] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:17.735918  9731 consensus_peers.cc:597] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.736160   431 tablet_replica.cc:333] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.737315   431 raft_consensus.cc:2243] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:17.738600   431 raft_consensus.cc:2272] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:17.740286  9879 consensus_peers.cc:597] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.741400   431 tablet_replica.cc:333] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.742096   431 raft_consensus.cc:2243] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.742630   431 raft_consensus.cc:2272] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.746335   431 tablet_replica.cc:333] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.746955   431 raft_consensus.cc:2243] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.747428   431 raft_consensus.cc:2272] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.749863   431 tablet_replica.cc:333] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83: stopping tablet replica
I20260709 13:03:17.750382   431 raft_consensus.cc:2243] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:17.751408   431 raft_consensus.cc:2272] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:17.762431  9731 consensus_peers.cc:597] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:17.778518  9879 consensus_peers.cc:597] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:17.785784  9731 consensus_peers.cc:597] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:17.793056  9731 consensus_peers.cc:597] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.848544   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:17.861418  9805 consensus_peers.cc:597] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.924314   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:17.934326 10485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:17.940024 10486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:17.945561   431 server_base.cc:1061] running on GCE node
W20260709 13:03:17.945638 10488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:17.952890   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:17.953246   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:17.953521   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602197953503 us; error 0 us; skew 500 ppm
I20260709 13:03:17.954289   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:17.958750   431 webserver.cc:533] Webserver started at http://127.0.107.193:44105/ using document root <none> and password file <none>
I20260709 13:03:17.959820   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:17.960107   431 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:03:17.962723  9805 consensus_peers.cc:597] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:17.966648  9805 consensus_peers.cc:597] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:17.967219   431 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:17.996796 10496 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:17.997817   431 fs_manager.cc:730] Time spent opening block manager: real 0.022s	user 0.006s	sys 0.005s
I20260709 13:03:17.998220   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-0-root
uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
format_stamp: "Formatted at 2026-07-09 13:03:04 on dist-test-slave-c08m"
I20260709 13:03:17.998734   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601889622018-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:03:18.006163  9879 consensus_peers.cc:597] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:18.007007  9879 consensus_peers.cc:597] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:18.020905   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:18.022670   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:18.024765   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:03:18.032508  9879 consensus_peers.cc:597] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:18.034252 10504 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:03:18.087117  9731 consensus_peers.cc:597] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:18.098191  9805 consensus_peers.cc:597] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:18.374073   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:03:18.374541   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.343s	user 0.013s	sys 0.000s
I20260709 13:03:18.374953   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:03:18.380925 10504 tablet_bootstrap.cc:492] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:18.394552 10504 tablet_bootstrap.cc:492] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:18.395323 10504 tablet_bootstrap.cc:492] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:18.395936 10504 ts_tablet_manager.cc:1403] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:03:18.397907 10504 raft_consensus.cc:359] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:18.398576 10504 raft_consensus.cc:740] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.399292 10504 consensus_queue.cc:260] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:18.420861 10504 ts_tablet_manager.cc:1434] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 13:03:18.422148 10504 tablet_bootstrap.cc:492] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:18.438941 10504 tablet_bootstrap.cc:492] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:18.440124 10504 tablet_bootstrap.cc:492] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:18.440832 10504 ts_tablet_manager.cc:1403] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:03:18.443595 10504 raft_consensus.cc:359] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:18.444418 10504 raft_consensus.cc:740] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.445272 10504 consensus_queue.cc:260] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:18.447232 10504 ts_tablet_manager.cc:1434] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:18.448027 10504 tablet_bootstrap.cc:492] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:18.463141 10504 tablet_bootstrap.cc:492] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:18.463954 10504 tablet_bootstrap.cc:492] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:18.464515 10504 ts_tablet_manager.cc:1403] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:03:18.466527 10504 raft_consensus.cc:359] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:18.467530 10504 raft_consensus.cc:740] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.468278 10504 consensus_queue.cc:260] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:18.470536 10504 ts_tablet_manager.cc:1434] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:18.471359 10504 tablet_bootstrap.cc:492] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:18.492110 10504 tablet_bootstrap.cc:492] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:18.493507 10504 tablet_bootstrap.cc:492] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:18.494524 10504 ts_tablet_manager.cc:1403] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:03:18.498277 10504 raft_consensus.cc:359] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:18.499567 10504 raft_consensus.cc:740] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.501814 10504 consensus_queue.cc:260] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:18.504522 10504 ts_tablet_manager.cc:1434] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:03:18.505610 10504 tablet_bootstrap.cc:492] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:18.551534 10504 tablet_bootstrap.cc:492] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:18.552832 10504 tablet_bootstrap.cc:492] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:18.553880 10504 ts_tablet_manager.cc:1403] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.012s
I20260709 13:03:18.553894 10388 raft_consensus.cc:493] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.554996 10388 raft_consensus.cc:515] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:18.557291 10388 leader_election.cc:290] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:18.561414  9837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
W20260709 13:03:18.590397  9731 leader_election.cc:336] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:18.731051  9731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 140718us
I20260709 13:03:18.765605 10480 raft_consensus.cc:493] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.766175 10480 raft_consensus.cc:515] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:18.769498 10480 leader_election.cc:290] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:18.775121 10469 raft_consensus.cc:493] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.775730 10469 raft_consensus.cc:515] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:18.777957 10469 leader_election.cc:290] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:18.829659   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:03:18.849925   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.475s	user 0.320s	sys 0.010s
I20260709 13:03:18.871534  9731 leader_election.cc:304] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:18.863171 10480 raft_consensus.cc:493] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.871572 10521 raft_consensus.cc:493] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.887507 10521 raft_consensus.cc:515] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:18.890437 10521 leader_election.cc:290] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:18.884567 10518 raft_consensus.cc:493] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.891424 10518 raft_consensus.cc:515] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:18.896813 10507 raft_consensus.cc:493] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.897773 10507 raft_consensus.cc:515] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:18.900393 10507 leader_election.cc:290] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:18.900981 10480 raft_consensus.cc:515] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:18.557358 10504 raft_consensus.cc:359] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:18.903959 10480 leader_election.cc:290] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:18.904202 10504 raft_consensus.cc:740] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.905371 10504 consensus_queue.cc:260] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:18.906203 10518 leader_election.cc:290] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:18.906775 10480 raft_consensus.cc:493] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.907284 10480 raft_consensus.cc:515] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:18.908212 10504 ts_tablet_manager.cc:1434] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.354s	user 0.012s	sys 0.000s
I20260709 13:03:18.909332 10504 tablet_bootstrap.cc:492] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:18.914620 10388 raft_consensus.cc:2749] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.903134 10507 raft_consensus.cc:493] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.917906 10507 raft_consensus.cc:515] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:18.921262 10507 leader_election.cc:290] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:18.921568 10480 leader_election.cc:290] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:18.922518 10494 raft_consensus.cc:493] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.923169 10494 raft_consensus.cc:515] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:18.925602 10494 leader_election.cc:290] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:18.930502 10527 raft_consensus.cc:493] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.931777  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb824343684771b7c7042727a90e40" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:18.933122 10522 raft_consensus.cc:493] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.933714 10522 raft_consensus.cc:515] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:18.936017 10522 leader_election.cc:290] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:18.936815 10505 raft_consensus.cc:493] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.937371 10505 raft_consensus.cc:515] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:18.939527 10505 leader_election.cc:290] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
W20260709 13:03:18.945567  9805 leader_election.cc:336] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:18.949151  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359e0d2d58948c199c04b275867bffd" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:18.949903  9838 raft_consensus.cc:2468] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:18.951275  9763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359e0d2d58948c199c04b275867bffd" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:18.952003  9763 raft_consensus.cc:2468] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:18.952793  9731 leader_election.cc:304] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:18.954723 10521 raft_consensus.cc:2804] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.955106 10521 raft_consensus.cc:493] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.955459 10521 raft_consensus.cc:3060] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.957585 10376 raft_consensus.cc:493] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.958305 10376 raft_consensus.cc:515] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:18.960938 10376 leader_election.cc:290] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:18.931067 10527 raft_consensus.cc:515] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:18.962121  9765 raft_consensus.cc:2468] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:18.961999  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e792dd7473944b79554c8d6ad554fab" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:18.969357 10527 leader_election.cc:290] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:18.970314  9907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dadd5ead404b82a843d64283e7f2a1" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:18.971133  9907 raft_consensus.cc:2468] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:18.973519  9834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb824343684771b7c7042727a90e40" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:18.974628  9834 raft_consensus.cc:2468] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:18.979328  9731 leader_election.cc:304] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:18.936517 10522 raft_consensus.cc:493] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.982920 10519 raft_consensus.cc:2804] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.983656 10522 raft_consensus.cc:515] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:18.985966 10522 leader_election.cc:290] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:18.983685 10519 raft_consensus.cc:493] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.987008 10519 raft_consensus.cc:3060] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.980969  9803 leader_election.cc:304] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:18.993060 10521 raft_consensus.cc:515] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:18.994659  9803 leader_election.cc:304] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:19.000545 10518 raft_consensus.cc:2804] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.000972 10518 raft_consensus.cc:493] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:18.995223 10505 raft_consensus.cc:2804] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.001349 10518 raft_consensus.cc:3060] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.001613 10505 raft_consensus.cc:493] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.002013 10505 raft_consensus.cc:3060] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.998219 10525 raft_consensus.cc:493] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.004902 10525 raft_consensus.cc:515] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.007908 10525 leader_election.cc:290] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.008842 10520 raft_consensus.cc:493] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.009431 10520 raft_consensus.cc:515] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.004942 10506 raft_consensus.cc:493] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.010704 10506 raft_consensus.cc:515] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.011888 10520 leader_election.cc:290] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
W20260709 13:03:18.999235  9805 leader_election.cc:336] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.013267  9805 leader_election.cc:336] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.015190 10506 leader_election.cc:290] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.016734 10519 raft_consensus.cc:515] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:19.018267 10524 raft_consensus.cc:493] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.029191 10505 raft_consensus.cc:515] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:19.029340 10524 raft_consensus.cc:515] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.031657 10505 leader_election.cc:290] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:19.031766 10524 leader_election.cc:290] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:19.021993  9908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef635d06ca2448f098dadbba833fa52c" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:19.032984  9908 raft_consensus.cc:2468] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:19.020450 10521 leader_election.cc:290] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:19.024750 10522 raft_consensus.cc:493] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.038275  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c146a1db6843fc81be490f926d3137" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
W20260709 13:03:19.025950  9805 leader_election.cc:336] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.039003  9913 raft_consensus.cc:2468] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:19.028640  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b91b2a3a4a24086b9e05f782ee36615" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:19.039932  9912 raft_consensus.cc:2468] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
W20260709 13:03:19.023172  9731 leader_election.cc:336] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.037077  9908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64e505f3a594381a9e50a8030c33783" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:19.038199 10522 raft_consensus.cc:515] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:19.026919  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d42567f00fd44cabc99c217e4df31d8" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:19.040973  9908 raft_consensus.cc:2468] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:19.041285  9911 raft_consensus.cc:2468] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
W20260709 13:03:19.042124  9731 leader_election.cc:336] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.036481 10519 leader_election.cc:290] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:19.042985 10522 leader_election.cc:290] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
W20260709 13:03:19.043155  9731 leader_election.cc:336] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.051234  9838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165514a80df44205b5aee88c4509ba6e" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:19.048964 10518 raft_consensus.cc:515] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:19.051573  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64e505f3a594381a9e50a8030c33783" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:19.063180  9839 raft_consensus.cc:2468] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:19.065554  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb824343684771b7c7042727a90e40" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:19.066434  9762 raft_consensus.cc:2393] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 451c871fd36f4d95a76b62d041aa7b60 in current term 2: Already voted for candidate 837fad20523b4348b68f0a1e1af12404 in this term.
I20260709 13:03:19.052863 10524 raft_consensus.cc:493] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.068871 10494 raft_consensus.cc:493] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.069018 10524 raft_consensus.cc:515] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.069394 10494 raft_consensus.cc:515] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.071225 10524 leader_election.cc:290] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.071429 10494 leader_election.cc:290] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:19.053444  9835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c146a1db6843fc81be490f926d3137" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:19.072341  9835 raft_consensus.cc:2468] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:19.049878  9761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:19.053596  9834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb34d3df6d146e7b2406dafa071fd52" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:19.073319  9761 raft_consensus.cc:2468] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:19.055158  9833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359e0d2d58948c199c04b275867bffd" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:19.074965  9833 raft_consensus.cc:2393] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 837fad20523b4348b68f0a1e1af12404 in current term 2: Already voted for candidate 451c871fd36f4d95a76b62d041aa7b60 in this term.
I20260709 13:03:19.074656  9803 leader_election.cc:304] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:19.057165  9836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb824343684771b7c7042727a90e40" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:19.076503 10531 raft_consensus.cc:2804] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.076874 10520 raft_consensus.cc:493] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
W20260709 13:03:19.079213  9731 leader_election.cc:336] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.079900  9731 leader_election.cc:336] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.079329 10520 raft_consensus.cc:515] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
W20260709 13:03:19.080230  9879 leader_election.cc:336] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.076535  9836 raft_consensus.cc:2393] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 837fad20523b4348b68f0a1e1af12404 in current term 2: Already voted for candidate 451c871fd36f4d95a76b62d041aa7b60 in this term.
I20260709 13:03:19.049530  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359e0d2d58948c199c04b275867bffd" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:19.081797  9765 raft_consensus.cc:2393] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 451c871fd36f4d95a76b62d041aa7b60 in current term 2: Already voted for candidate 837fad20523b4348b68f0a1e1af12404 in this term.
I20260709 13:03:19.082767 10520 leader_election.cc:290] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.083112  9731 leader_election.cc:304] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:19.091452 10494 raft_consensus.cc:2749] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.092077 10518 leader_election.cc:290] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:19.093647  9731 leader_election.cc:304] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
W20260709 13:03:19.078364  9805 leader_election.cc:336] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.058746  9728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:36227, user_credentials={real_user=slave}} blocked reactor thread for 83095.3us
W20260709 13:03:19.095286  9805 leader_election.cc:336] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.096168  9805 leader_election.cc:336] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.051615  9802 leader_election.cc:304] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
W20260709 13:03:19.097177  9802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:36227, user_credentials={real_user=slave}} blocked reactor thread for 45665.4us
W20260709 13:03:19.097610  9731 leader_election.cc:336] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.098421  9802 leader_election.cc:304] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:19.099555  9802 leader_election.cc:304] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:19.099884 10522 raft_consensus.cc:2804] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.059715 10504 tablet_bootstrap.cc:492] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:19.100328 10522 raft_consensus.cc:493] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.083766  9879 leader_election.cc:304] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:19.083770 10531 raft_consensus.cc:493] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.094616 10494 raft_consensus.cc:2749] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.100759 10522 raft_consensus.cc:3060] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.101051 10531 raft_consensus.cc:3060] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.101290 10504 tablet_bootstrap.cc:492] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:19.102147 10504 ts_tablet_manager.cc:1403] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.193s	user 0.019s	sys 0.001s
I20260709 13:03:19.105927 10506 raft_consensus.cc:2804] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.106417 10506 raft_consensus.cc:493] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.106789 10506 raft_consensus.cc:3060] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.108569 10469 raft_consensus.cc:493] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.108685 10505 raft_consensus.cc:2804] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.109434 10505 raft_consensus.cc:493] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.109417 10469 raft_consensus.cc:515] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.110041 10505 raft_consensus.cc:3060] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.110282  9802 leader_election.cc:304] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:19.111640  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5370a6691486895274f9b937bbb1e" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:19.111887 10469 leader_election.cc:290] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.112303  9911 raft_consensus.cc:2468] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:19.112924 10524 raft_consensus.cc:2749] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.113565 10520 raft_consensus.cc:2804] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.113978 10520 raft_consensus.cc:493] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
W20260709 13:03:19.114058  9879 leader_election.cc:336] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.114362 10520 raft_consensus.cc:3060] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:19.114638  9879 leader_election.cc:336] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.115124  9879 leader_election.cc:336] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.115528  9879 leader_election.cc:336] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.117285  9802 leader_election.cc:304] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:19.117920 10494 raft_consensus.cc:493] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.118628 10494 raft_consensus.cc:515] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.118844 10505 raft_consensus.cc:515] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.119015  9802 leader_election.cc:304] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:19.118945  9836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef635d06ca2448f098dadbba833fa52c" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:19.118014 10522 raft_consensus.cc:515] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.096361  9728 leader_election.cc:304] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
W20260709 13:03:19.120198  9805 leader_election.cc:336] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.120678  9805 leader_election.cc:304] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
W20260709 13:03:19.116326  9879 leader_election.cc:336] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.122164  9836 raft_consensus.cc:2393] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8557220d7e6a4ccbbef222e80a5584a5 in current term 2: Already voted for candidate 451c871fd36f4d95a76b62d041aa7b60 in this term.
I20260709 13:03:19.120680 10519 raft_consensus.cc:2804] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.123306 10519 raft_consensus.cc:493] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.123459 10509 raft_consensus.cc:493] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.124013 10509 raft_consensus.cc:515] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.126348 10509 leader_election.cc:290] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.128727  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad36487cbe42f3adf25a44fa2b1b62" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:19.129004  9908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e792dd7473944b79554c8d6ad554fab" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:19.129043  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad36487cbe42f3adf25a44fa2b1b62" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:19.129580  9762 raft_consensus.cc:2468] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:19.129863  9912 raft_consensus.cc:2468] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:19.129874  9908 raft_consensus.cc:2468] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:19.130825  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f858210936a4559a877f1628213432c" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:19.132136  9728 leader_election.cc:304] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:19.132407  9877 leader_election.cc:304] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:19.133111 10494 leader_election.cc:290] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.133368 10479 raft_consensus.cc:2804] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.133805 10479 raft_consensus.cc:493] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.134142 10479 raft_consensus.cc:3060] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.135756 10524 raft_consensus.cc:2804] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.136173 10524 raft_consensus.cc:493] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.136865 10469 raft_consensus.cc:2804] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.136955  9764 raft_consensus.cc:2468] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 1.
I20260709 13:03:19.137379 10469 raft_consensus.cc:493] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.136546 10524 raft_consensus.cc:3060] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.137944 10469 raft_consensus.cc:3060] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.142030 10479 raft_consensus.cc:515] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.144761 10504 raft_consensus.cc:359] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.145660 10504 raft_consensus.cc:740] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:19.145793  9728 leader_election.cc:304] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:19.148494 10509 raft_consensus.cc:2804] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.148936 10509 raft_consensus.cc:493] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.149380 10509 raft_consensus.cc:3060] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.149516 10519 raft_consensus.cc:3060] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.149847 10505 leader_election.cc:290] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.150039 10524 raft_consensus.cc:515] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.150957 10505 raft_consensus.cc:2749] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.146590 10504 consensus_queue.cc:260] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.147647 10522 leader_election.cc:290] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.144634 10531 raft_consensus.cc:515] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:19.153564  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f858210936a4559a877f1628213432c" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:19.154259  9911 raft_consensus.cc:2468] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:19.155174 10531 leader_election.cc:290] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:19.156101  9877 leader_election.cc:304] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:19.156256  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:19.156939 10480 raft_consensus.cc:2804] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.157083  9764 raft_consensus.cc:3060] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.157397 10480 raft_consensus.cc:493] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.157799 10480 raft_consensus.cc:3060] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.158353  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad36487cbe42f3adf25a44fa2b1b62" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
W20260709 13:03:19.160743  9731 leader_election.cc:336] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.164750  9908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef635d06ca2448f098dadbba833fa52c" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
W20260709 13:03:19.165077  9731 leader_election.cc:336] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.165395  9908 raft_consensus.cc:3060] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.162817  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb34d3df6d146e7b2406dafa071fd52" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:19.166494  9912 raft_consensus.cc:2468] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:19.166380 10520 raft_consensus.cc:515] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.164137  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b91b2a3a4a24086b9e05f782ee36615" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:19.167393  9913 raft_consensus.cc:3060] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.164783 10518 raft_consensus.cc:2804] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.167187 10480 raft_consensus.cc:515] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.169054 10518 raft_consensus.cc:493] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.169505 10518 raft_consensus.cc:3060] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.170476 10480 leader_election.cc:290] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:19.171622 10519 raft_consensus.cc:515] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.156618 10504 ts_tablet_manager.cc:1434] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:03:19.173352 10504 tablet_bootstrap.cc:492] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:19.173741  9911 raft_consensus.cc:2393] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 837fad20523b4348b68f0a1e1af12404 in current term 2: Already voted for candidate 8557220d7e6a4ccbbef222e80a5584a5 in this term.
I20260709 13:03:19.176359 10524 leader_election.cc:290] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:19.158509 10479 leader_election.cc:290] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.178615  9879 leader_election.cc:304] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:19.182013 10507 raft_consensus.cc:2749] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:19.182360  9731 leader_election.cc:336] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.186733 10469 raft_consensus.cc:515] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.191026  9913 raft_consensus.cc:2468] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 2.
I20260709 13:03:19.181138 10506 raft_consensus.cc:515] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.198045 10506 leader_election.cc:290] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.186071  9764 raft_consensus.cc:2468] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 2.
I20260709 13:03:19.202773  9803 leader_election.cc:304] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:19.203578  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c146a1db6843fc81be490f926d3137" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:19.204030  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d42567f00fd44cabc99c217e4df31d8" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:19.204900  9912 raft_consensus.cc:3060] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.204965  9911 raft_consensus.cc:3060] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.205353 10509 raft_consensus.cc:515] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.207988 10509 leader_election.cc:290] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
W20260709 13:03:19.201074  9731 leader_election.cc:336] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.208688 10469 leader_election.cc:290] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.211273 10518 raft_consensus.cc:515] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.192633 10520 leader_election.cc:290] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.192564 10519 leader_election.cc:290] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.214094  9911 raft_consensus.cc:2468] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 2.
I20260709 13:03:19.217018  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64e505f3a594381a9e50a8030c33783" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:19.221508  9913 raft_consensus.cc:3060] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.222282  9912 raft_consensus.cc:2468] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 2.
I20260709 13:03:19.223084  9802 leader_election.cc:304] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:19.223937 10522 raft_consensus.cc:2804] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.216161  9908 raft_consensus.cc:2468] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 2.
I20260709 13:03:19.183194  9879 leader_election.cc:304] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:19.216931 10518 leader_election.cc:290] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.218876 10469 raft_consensus.cc:2804] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.225353  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dadd5ead404b82a843d64283e7f2a1" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:19.225492  9879 leader_election.cc:304] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:19.226186  9910 raft_consensus.cc:3060] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.226590 10507 raft_consensus.cc:2764] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:03:19.225951 10469 raft_consensus.cc:697] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:19.227015  9879 leader_election.cc:304] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:19.228006 10505 raft_consensus.cc:493] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
W20260709 13:03:19.220479  9731 leader_election.cc:336] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.228154 10507 raft_consensus.cc:2749] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.228003 10469 consensus_queue.cc:237] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:19.230983  9908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e792dd7473944b79554c8d6ad554fab" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:19.232028  9908 raft_consensus.cc:3060] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:19.228349  9879 leader_election.cc:336] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.234090  9879 leader_election.cc:336] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.228762 10505 raft_consensus.cc:515] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
W20260709 13:03:19.237026  9805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 116880us
W20260709 13:03:19.237707  9805 leader_election.cc:336] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.238626 10505 leader_election.cc:290] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.239152  9910 raft_consensus.cc:2468] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 2.
I20260709 13:03:19.224330 10522 raft_consensus.cc:493] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.243117  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad36487cbe42f3adf25a44fa2b1b62" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:19.243333  9728 leader_election.cc:304] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:19.244114  9765 raft_consensus.cc:2393] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8557220d7e6a4ccbbef222e80a5584a5 in current term 2: Already voted for candidate 837fad20523b4348b68f0a1e1af12404 in this term.
I20260709 13:03:19.244043  9908 raft_consensus.cc:2468] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 2.
I20260709 13:03:19.245154 10509 raft_consensus.cc:2804] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.245271  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f858210936a4559a877f1628213432c" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:19.245713 10509 raft_consensus.cc:493] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.246131 10509 raft_consensus.cc:3060] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.247100  9728 leader_election.cc:304] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:19.248100 10519 raft_consensus.cc:2749] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.250474  9728 leader_election.cc:304] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:19.251492 10519 raft_consensus.cc:2804] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.251971 10519 raft_consensus.cc:697] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 2 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:19.232100 10504 tablet_bootstrap.cc:492] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:19.252810 10519 consensus_queue.cc:237] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.255084 10522 raft_consensus.cc:3060] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:19.260757  9879 leader_election.cc:336] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.253299 10504 tablet_bootstrap.cc:492] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:19.262786 10509 raft_consensus.cc:515] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.263617 10504 ts_tablet_manager.cc:1403] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.011s
I20260709 13:03:19.264246  9764 raft_consensus.cc:2393] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8557220d7e6a4ccbbef222e80a5584a5 in current term 2: Already voted for candidate 837fad20523b4348b68f0a1e1af12404 in this term.
I20260709 13:03:19.264927  9913 raft_consensus.cc:2468] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 2.
I20260709 13:03:19.265120 10509 leader_election.cc:290] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.265537 10524 raft_consensus.cc:2764] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:03:19.223963  9802 leader_election.cc:304] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:19.271636 10505 raft_consensus.cc:2804] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.281292 10505 raft_consensus.cc:697] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:19.267872 10504 raft_consensus.cc:359] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:19.282196 10505 consensus_queue.cc:237] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.282656 10504 raft_consensus.cc:740] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
W20260709 13:03:19.272742  9731 leader_election.cc:336] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.271714  9802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:36227, user_credentials={real_user=slave}} blocked reactor thread for 47835.2us
I20260709 13:03:19.287555  9802 leader_election.cc:304] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:19.288401 10469 raft_consensus.cc:2804] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.289091 10469 raft_consensus.cc:697] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:19.289891  9836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5370a6691486895274f9b937bbb1e" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:19.290053 10469 consensus_queue.cc:237] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.291174  9836 raft_consensus.cc:2393] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8557220d7e6a4ccbbef222e80a5584a5 in current term 2: Already voted for candidate 451c871fd36f4d95a76b62d041aa7b60 in this term.
I20260709 13:03:19.294543  9802 leader_election.cc:304] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
W20260709 13:03:19.295814  9805 leader_election.cc:336] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.296285  9805 leader_election.cc:304] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
W20260709 13:03:19.287644  9879 leader_election.cc:336] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.297111  9879 leader_election.cc:336] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.298038  9802 leader_election.cc:304] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:19.302088  9879 leader_election.cc:304] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:19.303174 10524 raft_consensus.cc:2749] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.306334 10531 raft_consensus.cc:2804] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.306928 10518 raft_consensus.cc:2749] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.277854  9588 catalog_manager.cc:5697] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 1 to 2, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.311117 10522 raft_consensus.cc:515] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.313911 10522 leader_election.cc:290] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
W20260709 13:03:19.305908  9805 leader_election.cc:336] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.316708 10518 raft_consensus.cc:2804] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.317025 10531 raft_consensus.cc:697] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:19.317297 10518 raft_consensus.cc:697] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:19.318241 10518 consensus_queue.cc:237] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.318353 10531 consensus_queue.cc:237] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.324209  9802 leader_election.cc:304] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:19.327987 10506 raft_consensus.cc:2804] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.328748 10506 raft_consensus.cc:697] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:19.331558 10506 consensus_queue.cc:237] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.269562  9728 leader_election.cc:304] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:19.337298  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5370a6691486895274f9b937bbb1e" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:19.337989  9913 raft_consensus.cc:3060] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.337996 10519 raft_consensus.cc:2804] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.339207  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165514a80df44205b5aee88c4509ba6e" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:19.339823  9910 raft_consensus.cc:2468] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 1.
I20260709 13:03:19.341248 10519 raft_consensus.cc:697] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 2 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:19.341611  9586 catalog_manager.cc:5697] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 1 to 2, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.345822  9913 raft_consensus.cc:2468] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 2.
W20260709 13:03:19.341807  9728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:36227, user_credentials={real_user=slave}} blocked reactor thread for 72334.8us
I20260709 13:03:19.341958  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb34d3df6d146e7b2406dafa071fd52" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:19.346967  9910 raft_consensus.cc:3060] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.350086  9879 leader_election.cc:304] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60
I20260709 13:03:19.347805  9802 leader_election.cc:304] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:19.352068 10480 raft_consensus.cc:2749] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.346232 10519 consensus_queue.cc:237] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.354374  9802 leader_election.cc:304] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:19.357249 10518 raft_consensus.cc:2804] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:19.357822 10518 raft_consensus.cc:493] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:19.357230  9877 leader_election.cc:304] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:19.352903 10504 consensus_queue.cc:260] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:19.358541 10518 raft_consensus.cc:3060] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.359045 10480 raft_consensus.cc:2749] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.360304  9877 leader_election.cc:304] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:19.362875 10480 raft_consensus.cc:2749] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.363705 10505 raft_consensus.cc:2804] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.366597  9910 raft_consensus.cc:2468] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 2.
I20260709 13:03:19.368204  9802 leader_election.cc:304] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:19.372830 10469 raft_consensus.cc:2804] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.373385 10469 raft_consensus.cc:697] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:19.369463 10505 raft_consensus.cc:697] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:19.374305 10469 consensus_queue.cc:237] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.374696 10505 consensus_queue.cc:237] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.375654  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f858210936a4559a877f1628213432c" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:19.376433  9913 raft_consensus.cc:2393] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 837fad20523b4348b68f0a1e1af12404 in current term 2: Already voted for candidate 8557220d7e6a4ccbbef222e80a5584a5 in this term.
I20260709 13:03:19.378877 10504 ts_tablet_manager.cc:1434] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.115s	user 0.006s	sys 0.001s
I20260709 13:03:19.379945 10504 tablet_bootstrap.cc:492] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
W20260709 13:03:19.382440  9805 leader_election.cc:336] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.385378  9728 leader_election.cc:304] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5
W20260709 13:03:19.387997  9805 leader_election.cc:336] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.389186 10479 raft_consensus.cc:2749] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:03:19.389541  9805 leader_election.cc:336] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.390399  9805 leader_election.cc:336] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.391261  9805 leader_election.cc:336] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.391908  9805 leader_election.cc:336] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.392520  9805 leader_election.cc:336] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.393184  9805 leader_election.cc:336] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.393883  9805 leader_election.cc:336] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:19.396320 10541 log.cc:927] Time spent T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:03:19.399673 10518 raft_consensus.cc:515] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
W20260709 13:03:19.407552  9805 leader_election.cc:336] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.413848 10518 leader_election.cc:290] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:19.415840  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165514a80df44205b5aee88c4509ba6e" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:19.418520  9913 raft_consensus.cc:3060] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:19.421602  9805 leader_election.cc:336] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:19.442166  9913 raft_consensus.cc:2468] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 2.
I20260709 13:03:19.443544  9802 leader_election.cc:304] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:19.475390 10505 raft_consensus.cc:2804] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.476018 10505 raft_consensus.cc:697] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:19.485011 10505 consensus_queue.cc:237] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.526980 10504 tablet_bootstrap.cc:492] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:19.528069 10504 tablet_bootstrap.cc:492] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:19.528782 10504 ts_tablet_manager.cc:1403] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.149s	user 0.026s	sys 0.019s
I20260709 13:03:19.555987 10504 raft_consensus.cc:359] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.556974 10504 raft_consensus.cc:740] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:19.557897  9586 catalog_manager.cc:5697] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 1 to 2, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.558079 10504 consensus_queue.cc:260] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.561276 10504 ts_tablet_manager.cc:1434] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:03:19.563134 10504 tablet_bootstrap.cc:492] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:19.564677  9588 catalog_manager.cc:5697] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 1 to 2, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.566426  9588 catalog_manager.cc:5697] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 1 to 2, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.570785  9588 catalog_manager.cc:5697] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 1 to 2, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.584276  9588 catalog_manager.cc:5697] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 1 to 2, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.591284 10504 tablet_bootstrap.cc:492] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:19.590481  9588 catalog_manager.cc:5697] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 1 to 2, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.592605 10504 tablet_bootstrap.cc:492] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:19.593429 10504 ts_tablet_manager.cc:1403] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.004s
I20260709 13:03:19.593103  9588 catalog_manager.cc:5697] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 1 to 2, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.595021  9588 catalog_manager.cc:5697] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 1 to 2, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.597039 10504 raft_consensus.cc:359] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.596937  9588 catalog_manager.cc:5697] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 1 to 2, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.598062 10504 raft_consensus.cc:740] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:19.599220 10504 consensus_queue.cc:260] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.601995 10504 ts_tablet_manager.cc:1434] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:19.602878 10504 tablet_bootstrap.cc:492] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:19.606592 10511 raft_consensus.cc:493] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.607272 10511 raft_consensus.cc:515] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:19.624084 10511 leader_election.cc:290] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:19.625468 10511 raft_consensus.cc:493] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.626228 10511 raft_consensus.cc:515] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:19.634166 10504 tablet_bootstrap.cc:492] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:19.635197 10504 tablet_bootstrap.cc:492] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:19.635876 10504 ts_tablet_manager.cc:1403] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.004s
I20260709 13:03:19.635571 10511 leader_election.cc:290] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
W20260709 13:03:19.644176  9786 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3180 after lost signal to thread 434
W20260709 13:03:19.645936  9786 debug-util.cc:398] Leaking SignalData structure 0x7b08002c28a0 after lost signal to thread 9622
W20260709 13:03:19.650993  9786 debug-util.cc:398] Leaking SignalData structure 0x7b08003e3700 after lost signal to thread 9937
I20260709 13:03:19.652763 10504 raft_consensus.cc:359] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.653621 10504 raft_consensus.cc:740] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:19.655400 10504 consensus_queue.cc:260] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.659320 10504 ts_tablet_manager.cc:1434] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.004s
I20260709 13:03:19.667090  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa904b1a1a63492ca9d5820c1984c7e8" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:19.667503  9765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeb40161a4049b8a9b37f9cadfdc50f" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:19.670447 10504 tablet_bootstrap.cc:492] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:19.676966  9765 raft_consensus.cc:1275] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 451c871fd36f4d95a76b62d041aa7b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:19.679136 10518 consensus_queue.cc:1048] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:19.687023  9833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa904b1a1a63492ca9d5820c1984c7e8" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:19.689159  9836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffeb40161a4049b8a9b37f9cadfdc50f" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:19.696910 10501 leader_election.cc:304] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:19.702111 10595 raft_consensus.cc:2749] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.703172 10501 leader_election.cc:304] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:19.705920 10595 raft_consensus.cc:2749] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.709338 10504 tablet_bootstrap.cc:492] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:19.716085 10504 tablet_bootstrap.cc:492] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:19.717024 10504 ts_tablet_manager.cc:1403] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.057s	user 0.026s	sys 0.008s
I20260709 13:03:19.720471 10504 raft_consensus.cc:359] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.721436 10504 raft_consensus.cc:740] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
W20260709 13:03:19.721688  9805 consensus_peers.cc:597] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:19.722301  9805 consensus_peers.cc:597] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:19.722491 10504 consensus_queue.cc:260] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:19.725842 10504 ts_tablet_manager.cc:1434] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:19.727001 10504 tablet_bootstrap.cc:492] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:19.738905  9913 raft_consensus.cc:1275] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Refusing update from remote peer 451c871fd36f4d95a76b62d041aa7b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:19.740487 10531 consensus_queue.cc:1048] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:19.744082  9805 consensus_peers.cc:597] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:19.747714 10595 raft_consensus.cc:493] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.748449 10595 raft_consensus.cc:515] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:19.752619  9833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ddf7a725a64a6e9c3c1ede3c67402d" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:19.753569  9912 raft_consensus.cc:1275] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Refusing update from remote peer 451c871fd36f4d95a76b62d041aa7b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:19.759392 10595 leader_election.cc:290] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:19.759438 10531 consensus_queue.cc:1048] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:19.796128 10504 tablet_bootstrap.cc:492] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:19.797120 10504 tablet_bootstrap.cc:492] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:19.797757 10504 ts_tablet_manager.cc:1403] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.010s
I20260709 13:03:19.809137  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ddf7a725a64a6e9c3c1ede3c67402d" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:19.810959  9910 raft_consensus.cc:1275] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Refusing update from remote peer 451c871fd36f4d95a76b62d041aa7b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:19.811160 10498 leader_election.cc:304] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:19.812867 10595 raft_consensus.cc:2749] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:19.800127 10504 raft_consensus.cc:359] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:19.814342 10531 consensus_queue.cc:1048] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:19.814885 10504 raft_consensus.cc:740] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:19.815892 10504 consensus_queue.cc:260] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:19.819033 10504 ts_tablet_manager.cc:1434] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:03:19.820171 10504 tablet_bootstrap.cc:492] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:19.834283   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:32917
I20260709 13:03:19.834544 10622 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:32917 every 8 connection(s)
I20260709 13:03:19.848696  9910 raft_consensus.cc:1275] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Refusing update from remote peer 837fad20523b4348b68f0a1e1af12404: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:19.852397 10494 consensus_queue.cc:1048] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:03:20.096864  9908 raft_consensus.cc:1275] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Refusing update from remote peer 451c871fd36f4d95a76b62d041aa7b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.122721 10595 raft_consensus.cc:493] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.123458 10595 raft_consensus.cc:515] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:20.132635  9912 raft_consensus.cc:1275] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Refusing update from remote peer 837fad20523b4348b68f0a1e1af12404: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.154615 10527 consensus_queue.cc:1048] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:20.160835 10506 consensus_queue.cc:1048] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:20.166672 10595 leader_election.cc:290] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:20.168131 10504 tablet_bootstrap.cc:492] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:20.179157 10504 tablet_bootstrap.cc:492] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:20.180115 10504 ts_tablet_manager.cc:1403] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.360s	user 0.019s	sys 0.015s
I20260709 13:03:20.193171 10504 raft_consensus.cc:359] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:20.194607 10504 raft_consensus.cc:740] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.195856 10504 consensus_queue.cc:260] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:20.209705 10504 ts_tablet_manager.cc:1434] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:03:20.211385 10504 tablet_bootstrap.cc:492] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
W20260709 13:03:20.216336  9728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:36227, user_credentials={real_user=slave}} blocked reactor thread for 62683.8us
I20260709 13:03:20.226194  9764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8d49a0a0c7c4fc4bd734945246961cc" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
W20260709 13:03:20.300356  9805 consensus_peers.cc:597] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:20.303725 10504 tablet_bootstrap.cc:492] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:20.312166 10504 tablet_bootstrap.cc:492] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:20.313299 10504 ts_tablet_manager.cc:1403] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.010s
I20260709 13:03:20.315955 10504 raft_consensus.cc:359] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:20.316749 10504 raft_consensus.cc:740] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.317437 10504 consensus_queue.cc:260] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
W20260709 13:03:20.318671  9805 consensus_peers.cc:597] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:20.321527  9805 consensus_peers.cc:597] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:20.324132  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8d49a0a0c7c4fc4bd734945246961cc" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:20.327317  9909 raft_consensus.cc:1275] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Refusing update from remote peer 451c871fd36f4d95a76b62d041aa7b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.328256 10504 ts_tablet_manager.cc:1434] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:03:20.329250  9909 raft_consensus.cc:1275] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Refusing update from remote peer 451c871fd36f4d95a76b62d041aa7b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:03:20.329838  9805 consensus_peers.cc:597] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:20.330129 10504 tablet_bootstrap.cc:492] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:20.336668  9911 raft_consensus.cc:1275] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Refusing update from remote peer 451c871fd36f4d95a76b62d041aa7b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:03:20.337450  9805 consensus_peers.cc:597] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:20.340801  9805 consensus_peers.cc:597] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:20.349215  9911 raft_consensus.cc:1275] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Refusing update from remote peer 451c871fd36f4d95a76b62d041aa7b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.350885 10624 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33941
I20260709 13:03:20.351357 10624 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:20.352269 10624 heartbeater.cc:507] Master 127.0.107.254:33941 requested a full tablet report, sending...
I20260709 13:03:20.363122 10504 tablet_bootstrap.cc:492] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:20.370052 10504 tablet_bootstrap.cc:492] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:20.370827 10504 ts_tablet_manager.cc:1403] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.003s
I20260709 13:03:20.377935 10518 consensus_queue.cc:1048] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:20.379992 10518 consensus_queue.cc:1048] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:20.389503 10506 consensus_queue.cc:1048] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:20.402551 10504 raft_consensus.cc:359] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:20.403811 10504 raft_consensus.cc:740] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.404422 10639 consensus_queue.cc:1048] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:20.437425 10504 consensus_queue.cc:260] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:20.452036 10504 ts_tablet_manager.cc:1434] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
W20260709 13:03:20.465730  9731 consensus_peers.cc:597] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:20.482777  9588 ts_manager.cc:194] Re-registered known tserver with Master: 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:20.488188 10504 tablet_bootstrap.cc:492] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:20.491425 10498 leader_election.cc:304] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83; no voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:20.503348 10651 raft_consensus.cc:2749] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:20.513175  9731 consensus_peers.cc:597] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:20.522722  9731 consensus_peers.cc:597] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:20.524609  9731 consensus_peers.cc:597] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:20.526417  9731 consensus_peers.cc:597] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:20.543421  9731 consensus_peers.cc:597] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:20.543943  9805 consensus_peers.cc:597] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:20.544447  9731 consensus_peers.cc:597] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:20.544747  9805 consensus_peers.cc:597] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:20.546095  9805 consensus_peers.cc:597] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:20.551719 10577 raft_consensus.cc:3060] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:20.555692  9805 consensus_peers.cc:597] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:20.565448 10504 tablet_bootstrap.cc:492] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:03:20.564898  9731 consensus_peers.cc:597] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:20.570533 10504 tablet_bootstrap.cc:492] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:20.576748 10504 ts_tablet_manager.cc:1403] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.089s	user 0.005s	sys 0.024s
I20260709 13:03:20.579494 10504 raft_consensus.cc:359] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:20.580255 10504 raft_consensus.cc:740] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.581007 10504 consensus_queue.cc:260] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:20.583284 10504 ts_tablet_manager.cc:1434] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:20.587980 10504 tablet_bootstrap.cc:492] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
W20260709 13:03:20.576508  9731 consensus_peers.cc:597] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:20.617035 10574 raft_consensus.cc:3060] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:20.648648  9588 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34636
I20260709 13:03:20.654264 10504 tablet_bootstrap.cc:492] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:20.655172 10624 heartbeater.cc:499] Master 127.0.107.254:33941 was elected leader, sending a full tablet report...
I20260709 13:03:20.655450 10504 tablet_bootstrap.cc:492] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:20.656759 10504 ts_tablet_manager.cc:1403] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.069s	user 0.022s	sys 0.019s
W20260709 13:03:20.658422  9879 consensus_peers.cc:597] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:20.659528 10504 raft_consensus.cc:359] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:20.660653 10504 raft_consensus.cc:740] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
W20260709 13:03:20.660926  9879 consensus_peers.cc:597] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:20.661677 10504 consensus_queue.cc:260] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:20.663909 10504 ts_tablet_manager.cc:1434] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:20.664746 10504 tablet_bootstrap.cc:492] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:20.685043 10504 tablet_bootstrap.cc:492] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:20.686088 10504 tablet_bootstrap.cc:492] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:20.686853 10504 ts_tablet_manager.cc:1403] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 13:03:20.689589 10504 raft_consensus.cc:359] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:20.690431 10504 raft_consensus.cc:740] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.691334 10504 consensus_queue.cc:260] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:20.693563 10504 ts_tablet_manager.cc:1434] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:20.694448 10504 tablet_bootstrap.cc:492] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
W20260709 13:03:20.748349  9879 consensus_peers.cc:597] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:20.768070  9879 consensus_peers.cc:597] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:20.785123 10504 tablet_bootstrap.cc:492] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:20.786289 10504 tablet_bootstrap.cc:492] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:20.787024 10504 ts_tablet_manager.cc:1403] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.093s	user 0.031s	sys 0.034s
I20260709 13:03:20.790419 10504 raft_consensus.cc:359] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:20.795790 10504 raft_consensus.cc:740] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.797819 10504 consensus_queue.cc:260] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
W20260709 13:03:20.800704  9731 consensus_peers.cc:597] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:20.801808 10504 ts_tablet_manager.cc:1434] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:03:20.802989 10504 tablet_bootstrap.cc:492] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:20.830416 10504 tablet_bootstrap.cc:492] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:20.831562 10504 tablet_bootstrap.cc:492] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:20.832441 10479 raft_consensus.cc:493] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.833140 10479 raft_consensus.cc:515] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:20.835769 10479 leader_election.cc:290] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:20.836575 10504 ts_tablet_manager.cc:1403] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.004s
I20260709 13:03:20.839612 10504 raft_consensus.cc:359] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:20.840377 10504 raft_consensus.cc:740] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.841177 10504 consensus_queue.cc:260] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:20.843511 10504 ts_tablet_manager.cc:1434] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:20.843463  9836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb824343684771b7c7042727a90e40" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60" is_pre_election: true
I20260709 13:03:20.844332  9836 raft_consensus.cc:2468] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 2.
I20260709 13:03:20.844620 10504 tablet_bootstrap.cc:492] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:20.848429 10577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb824343684771b7c7042727a90e40" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:20.849267 10577 raft_consensus.cc:2468] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:20.854234  9731 leader_election.cc:304] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:20.855237 10644 raft_consensus.cc:2804] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:20.856266 10644 raft_consensus.cc:493] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.856706 10644 raft_consensus.cc:3060] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.859349 10632 raft_consensus.cc:493] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.860203 10632 raft_consensus.cc:515] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:20.863996 10632 leader_election.cc:290] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:20.865590  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359e0d2d58948c199c04b275867bffd" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404" is_pre_election: true
I20260709 13:03:20.866632  9762 raft_consensus.cc:2468] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 2.
I20260709 13:03:20.866679 10574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359e0d2d58948c199c04b275867bffd" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
W20260709 13:03:20.868273  9805 leader_election.cc:343] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:20.871979  9803 leader_election.cc:304] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:20.873257 10632 raft_consensus.cc:2804] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:20.873700 10632 raft_consensus.cc:493] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.874069 10632 raft_consensus.cc:3060] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.875835 10644 raft_consensus.cc:515] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:20.880643 10574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb824343684771b7c7042727a90e40" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:20.881461 10574 raft_consensus.cc:3060] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.883706 10644 leader_election.cc:290] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 3 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:20.885367  9836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb824343684771b7c7042727a90e40" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:20.886032  9836 raft_consensus.cc:3060] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:20.886137  9731 consensus_peers.cc:597] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:20.886900 10632 raft_consensus.cc:515] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:20.890045 10579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359e0d2d58948c199c04b275867bffd" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
W20260709 13:03:20.891716  9805 leader_election.cc:343] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:20.891873 10574 raft_consensus.cc:2468] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 3.
I20260709 13:03:20.893003 10632 leader_election.cc:290] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 3 election: Requested vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:20.893411  9731 leader_election.cc:304] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:20.893965  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359e0d2d58948c199c04b275867bffd" candidate_uuid: "451c871fd36f4d95a76b62d041aa7b60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:20.894691  9762 raft_consensus.cc:3060] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:20.895341 10641 raft_consensus.cc:2804] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:20.896045 10641 raft_consensus.cc:697] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 3 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:20.900324  9836 raft_consensus.cc:2468] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 3.
I20260709 13:03:20.903024  9762 raft_consensus.cc:2468] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 451c871fd36f4d95a76b62d041aa7b60 in term 3.
I20260709 13:03:20.905062  9803 leader_election.cc:304] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 837fad20523b4348b68f0a1e1af12404; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:20.906873 10639 raft_consensus.cc:2804] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:20.907408 10639 raft_consensus.cc:697] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 3 LEADER]: Becoming Leader. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:20.908243 10639 consensus_queue.cc:237] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:20.911154 10504 tablet_bootstrap.cc:492] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:20.912293 10504 tablet_bootstrap.cc:492] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:20.913178 10504 ts_tablet_manager.cc:1403] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.069s	user 0.023s	sys 0.015s
I20260709 13:03:20.897223 10641 consensus_queue.cc:237] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:20.916235 10504 raft_consensus.cc:359] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:20.917415 10504 raft_consensus.cc:740] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:20.918694 10504 consensus_queue.cc:260] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:20.939471  9586 catalog_manager.cc:5697] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 reported cstate change: term changed from 1 to 3, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "451c871fd36f4d95a76b62d041aa7b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:20.946811 10504 ts_tablet_manager.cc:1434] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:03:20.947970 10504 tablet_bootstrap.cc:492] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:20.948418  9584 catalog_manager.cc:5697] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 1 to 3, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:21.005900  9803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:44623, user_credentials={real_user=slave}} blocked reactor thread for 51601.3us
I20260709 13:03:21.013252 10641 raft_consensus.cc:493] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.013798 10641 raft_consensus.cc:515] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.016197 10641 leader_election.cc:290] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:21.020164  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f858210936a4559a877f1628213432c" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:21.025017  9912 raft_consensus.cc:2468] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 2.
I20260709 13:03:21.035035  9728 leader_election.cc:304] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:21.040169 10574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f858210936a4559a877f1628213432c" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:21.041254 10574 raft_consensus.cc:2468] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:21.048774 10641 raft_consensus.cc:2804] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:21.049273 10641 raft_consensus.cc:493] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.049609 10641 raft_consensus.cc:3060] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.050979 10504 tablet_bootstrap.cc:492] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.052067 10504 tablet_bootstrap.cc:492] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:21.052831 10504 ts_tablet_manager.cc:1403] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.105s	user 0.016s	sys 0.002s
I20260709 13:03:21.058516 10641 raft_consensus.cc:515] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.062438 10641 leader_election.cc:290] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 3 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:21.062963  9912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f858210936a4559a877f1628213432c" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:21.063598  9912 raft_consensus.cc:3060] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.068173 10574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f858210936a4559a877f1628213432c" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:21.068961 10574 raft_consensus.cc:3060] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.069693 10479 raft_consensus.cc:493] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.070292 10479 raft_consensus.cc:515] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.072693 10479 leader_election.cc:290] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:21.074208  9913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad36487cbe42f3adf25a44fa2b1b62" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5" is_pre_election: true
I20260709 13:03:21.074934  9913 raft_consensus.cc:2468] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 2.
I20260709 13:03:21.075362 10579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad36487cbe42f3adf25a44fa2b1b62" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" is_pre_election: true
I20260709 13:03:21.076092 10579 raft_consensus.cc:2468] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 1.
I20260709 13:03:21.077296  9728 leader_election.cc:304] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:21.078547  9912 raft_consensus.cc:2468] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 3.
I20260709 13:03:21.079600 10479 raft_consensus.cc:2804] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:21.080098 10479 raft_consensus.cc:493] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.079813 10504 raft_consensus.cc:359] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:21.080543 10479 raft_consensus.cc:3060] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.081002 10504 raft_consensus.cc:740] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.081960 10504 consensus_queue.cc:260] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:21.084417 10504 ts_tablet_manager.cc:1434] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:03:21.085312  9728 leader_election.cc:304] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:21.086654 10635 raft_consensus.cc:2804] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:21.087180 10635 raft_consensus.cc:697] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 3 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:21.085340 10504 tablet_bootstrap.cc:492] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:21.090528 10635 consensus_queue.cc:237] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.102411 10479 raft_consensus.cc:515] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.105002 10479 leader_election.cc:290] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 3 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917)
I20260709 13:03:21.106179  9911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad36487cbe42f3adf25a44fa2b1b62" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:21.106525 10579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad36487cbe42f3adf25a44fa2b1b62" candidate_uuid: "837fad20523b4348b68f0a1e1af12404" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
I20260709 13:03:21.106923  9911 raft_consensus.cc:3060] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.107297 10579 raft_consensus.cc:3060] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.115075  9911 raft_consensus.cc:2468] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 3.
I20260709 13:03:21.117899  9728 leader_election.cc:304] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837fad20523b4348b68f0a1e1af12404, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:21.119158 10494 raft_consensus.cc:2804] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:21.119721 10494 raft_consensus.cc:697] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 3 LEADER]: Becoming Leader. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:21.117871 10579 raft_consensus.cc:2468] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 3.
I20260709 13:03:21.120649 10494 consensus_queue.cc:237] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.126382 10574 raft_consensus.cc:2468] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 837fad20523b4348b68f0a1e1af12404 in term 3.
I20260709 13:03:21.134706  9586 catalog_manager.cc:5697] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 1 to 3, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:21.153486  9805 consensus_peers.cc:597] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:21.166471 10504 tablet_bootstrap.cc:492] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.168251 10504 tablet_bootstrap.cc:492] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:21.169359 10504 ts_tablet_manager.cc:1403] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.084s	user 0.022s	sys 0.010s
I20260709 13:03:21.173465 10504 raft_consensus.cc:359] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.174211 10504 raft_consensus.cc:740] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.174890 10504 consensus_queue.cc:260] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.177201 10504 ts_tablet_manager.cc:1434] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:21.178023 10504 tablet_bootstrap.cc:492] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:21.218559  9586 catalog_manager.cc:5697] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 reported cstate change: term changed from 1 to 3, leader changed from 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193) to 837fad20523b4348b68f0a1e1af12404 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "837fad20523b4348b68f0a1e1af12404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.224781 10504 tablet_bootstrap.cc:492] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.225905 10504 tablet_bootstrap.cc:492] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:21.226579 10504 ts_tablet_manager.cc:1403] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.000s
I20260709 13:03:21.229620 10504 raft_consensus.cc:359] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.230614 10504 raft_consensus.cc:740] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.231719 10504 consensus_queue.cc:260] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.233450 10504 ts_tablet_manager.cc:1434] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:21.234364 10504 tablet_bootstrap.cc:492] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:21.254168 10504 tablet_bootstrap.cc:492] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.257552 10504 tablet_bootstrap.cc:492] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:21.258378 10504 ts_tablet_manager.cc:1403] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.003s
I20260709 13:03:21.261201 10504 raft_consensus.cc:359] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:21.262001 10504 raft_consensus.cc:740] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.262905 10504 consensus_queue.cc:260] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:21.264649 10504 ts_tablet_manager.cc:1434] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:21.265437 10504 tablet_bootstrap.cc:492] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:21.358758 10504 tablet_bootstrap.cc:492] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.359721 10504 tablet_bootstrap.cc:492] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:21.360430 10504 ts_tablet_manager.cc:1403] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.095s	user 0.038s	sys 0.039s
I20260709 13:03:21.363128 10504 raft_consensus.cc:359] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:21.363833 10504 raft_consensus.cc:740] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.366945 10504 consensus_queue.cc:260] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:21.370306 10504 ts_tablet_manager.cc:1434] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:03:21.371173 10504 tablet_bootstrap.cc:492] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:21.385581  9833 raft_consensus.cc:1275] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 3 FOLLOWER]: Refusing update from remote peer 837fad20523b4348b68f0a1e1af12404: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:21.387212 10644 consensus_queue.cc:1048] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.388854 10504 tablet_bootstrap.cc:492] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.390195 10504 tablet_bootstrap.cc:492] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:21.390765 10504 ts_tablet_manager.cc:1403] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 13:03:21.393396 10504 raft_consensus.cc:359] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:21.394182 10504 raft_consensus.cc:740] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.395169 10504 consensus_queue.cc:260] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:21.398051 10504 ts_tablet_manager.cc:1434] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:21.398865 10504 tablet_bootstrap.cc:492] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:21.417572 10574 raft_consensus.cc:3060] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.451941 10504 tablet_bootstrap.cc:492] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.453889 10504 tablet_bootstrap.cc:492] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:21.454639  9764 raft_consensus.cc:1275] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Refusing update from remote peer 451c871fd36f4d95a76b62d041aa7b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:21.454653 10504 ts_tablet_manager.cc:1403] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.056s	user 0.022s	sys 0.003s
I20260709 13:03:21.463812 10632 consensus_queue.cc:1048] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:21.474910 10504 raft_consensus.cc:359] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:21.475632 10504 raft_consensus.cc:740] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.481643 10504 consensus_queue.cc:260] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:21.483856 10504 ts_tablet_manager.cc:1434] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.000s
I20260709 13:03:21.484764 10504 tablet_bootstrap.cc:492] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:21.489660 10579 raft_consensus.cc:1275] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Refusing update from remote peer 837fad20523b4348b68f0a1e1af12404: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:21.491953 10644 consensus_queue.cc:1048] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.503073 10579 raft_consensus.cc:3060] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.518216 10504 tablet_bootstrap.cc:492] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.519367 10504 tablet_bootstrap.cc:492] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:21.520097 10504 ts_tablet_manager.cc:1403] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.003s
I20260709 13:03:21.522892 10504 raft_consensus.cc:359] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:21.523597 10504 raft_consensus.cc:740] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.524260 10504 consensus_queue.cc:260] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:21.526422 10504 ts_tablet_manager.cc:1434] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:21.527264 10504 tablet_bootstrap.cc:492] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:21.588807 10579 raft_consensus.cc:1275] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Refusing update from remote peer 451c871fd36f4d95a76b62d041aa7b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:21.597973 10581 raft_consensus.cc:1275] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Refusing update from remote peer 837fad20523b4348b68f0a1e1af12404: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:21.599617 10632 consensus_queue.cc:1048] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:21.605897 10494 consensus_queue.cc:1048] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:03:21.613394 10581 raft_consensus.cc:3060] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.629278  9912 raft_consensus.cc:1275] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Refusing update from remote peer 837fad20523b4348b68f0a1e1af12404: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:21.634806 10479 consensus_queue.cc:1048] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.651192 10504 tablet_bootstrap.cc:492] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.652415 10504 tablet_bootstrap.cc:492] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:21.667532 10504 ts_tablet_manager.cc:1403] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.140s	user 0.018s	sys 0.011s
I20260709 13:03:21.687530 10504 raft_consensus.cc:359] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:21.688242 10504 raft_consensus.cc:740] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.688898 10504 consensus_queue.cc:260] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:21.698462 10504 ts_tablet_manager.cc:1434] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.000s
I20260709 13:03:21.699416 10504 tablet_bootstrap.cc:492] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:21.717576  9913 raft_consensus.cc:1275] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Refusing update from remote peer 837fad20523b4348b68f0a1e1af12404: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:21.725104 10579 raft_consensus.cc:3060] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.734920 10578 raft_consensus.cc:3060] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.743889 10703 consensus_queue.cc:1048] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:21.770848 10571 raft_consensus.cc:1275] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Refusing update from remote peer 837fad20523b4348b68f0a1e1af12404: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:21.786504 10704 consensus_queue.cc:1048] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:21.835975 10504 tablet_bootstrap.cc:492] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.837302 10504 tablet_bootstrap.cc:492] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:21.838071 10504 ts_tablet_manager.cc:1403] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.139s	user 0.022s	sys 0.032s
I20260709 13:03:21.840528 10504 raft_consensus.cc:359] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.841349 10504 raft_consensus.cc:740] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.842272 10504 consensus_queue.cc:260] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.844619 10504 ts_tablet_manager.cc:1434] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:21.845719 10504 tablet_bootstrap.cc:492] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:21.869446 10504 tablet_bootstrap.cc:492] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.870512 10504 tablet_bootstrap.cc:492] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:21.871210 10504 ts_tablet_manager.cc:1403] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.007s
I20260709 13:03:21.873517 10504 raft_consensus.cc:359] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.874078 10504 raft_consensus.cc:740] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.874650 10504 consensus_queue.cc:260] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.876883 10504 ts_tablet_manager.cc:1434] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:03:21.878319 10504 tablet_bootstrap.cc:492] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:21.899760 10504 tablet_bootstrap.cc:492] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.900869 10504 tablet_bootstrap.cc:492] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:21.901623 10504 ts_tablet_manager.cc:1403] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.011s
I20260709 13:03:21.904711 10504 raft_consensus.cc:359] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.905479 10504 raft_consensus.cc:740] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.906190 10504 consensus_queue.cc:260] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.908998 10504 ts_tablet_manager.cc:1434] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:03:21.909896 10504 tablet_bootstrap.cc:492] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:21.929008 10504 tablet_bootstrap.cc:492] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.930243 10504 tablet_bootstrap.cc:492] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:21.932511 10504 ts_tablet_manager.cc:1403] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:03:21.934976 10504 raft_consensus.cc:359] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.935849 10504 raft_consensus.cc:740] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.937043 10504 consensus_queue.cc:260] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:21.939013 10504 ts_tablet_manager.cc:1434] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:21.940266 10504 tablet_bootstrap.cc:492] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:22.067967 10504 tablet_bootstrap.cc:492] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.069016 10504 tablet_bootstrap.cc:492] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:22.070384 10504 ts_tablet_manager.cc:1403] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.130s	user 0.029s	sys 0.016s
I20260709 13:03:22.073212 10504 raft_consensus.cc:359] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:22.073877 10504 raft_consensus.cc:740] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.074635 10504 consensus_queue.cc:260] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:22.076881 10504 ts_tablet_manager.cc:1434] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:22.077935 10504 tablet_bootstrap.cc:492] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:22.099483 10504 tablet_bootstrap.cc:492] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.100430 10504 tablet_bootstrap.cc:492] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:22.101213 10504 ts_tablet_manager.cc:1403] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 13:03:22.102950 10504 raft_consensus.cc:359] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:22.103458 10504 raft_consensus.cc:740] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.104099 10504 consensus_queue.cc:260] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:22.105895 10504 ts_tablet_manager.cc:1434] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:22.106842 10504 tablet_bootstrap.cc:492] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:22.126709 10504 tablet_bootstrap.cc:492] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.128901 10504 tablet_bootstrap.cc:492] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:22.129662 10504 ts_tablet_manager.cc:1403] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:03:22.132473 10504 raft_consensus.cc:359] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:22.133266 10504 raft_consensus.cc:740] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.133973 10504 consensus_queue.cc:260] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:22.136541 10504 ts_tablet_manager.cc:1434] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:03:22.142508 10504 tablet_bootstrap.cc:492] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
W20260709 13:03:22.160183  9805 consensus_peers.cc:597] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:22.162266 10578 raft_consensus.cc:3060] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.162953 10504 tablet_bootstrap.cc:492] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.163964 10504 tablet_bootstrap.cc:492] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:22.164667 10504 ts_tablet_manager.cc:1403] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:03:22.172274 10504 raft_consensus.cc:359] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:22.173214 10504 raft_consensus.cc:740] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.174108 10504 consensus_queue.cc:260] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:22.176805 10504 ts_tablet_manager.cc:1434] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:03:22.177917 10504 tablet_bootstrap.cc:492] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:22.205493 10504 tablet_bootstrap.cc:492] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.208712 10504 tablet_bootstrap.cc:492] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:22.210240 10504 ts_tablet_manager.cc:1403] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.005s
I20260709 13:03:22.214504 10504 raft_consensus.cc:359] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:22.215312 10504 raft_consensus.cc:740] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.216130 10504 consensus_queue.cc:260] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:22.218791 10504 ts_tablet_manager.cc:1434] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:03:22.219699 10504 tablet_bootstrap.cc:492] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:22.237591 10504 tablet_bootstrap.cc:492] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.238909 10504 tablet_bootstrap.cc:492] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:22.239766 10504 ts_tablet_manager.cc:1403] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 13:03:22.242609 10504 raft_consensus.cc:359] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:22.243436 10504 raft_consensus.cc:740] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.244524 10504 consensus_queue.cc:260] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:22.247007 10504 ts_tablet_manager.cc:1434] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:22.247982 10504 tablet_bootstrap.cc:492] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:22.301435 10504 tablet_bootstrap.cc:492] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.302533 10504 tablet_bootstrap.cc:492] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:22.303532 10504 ts_tablet_manager.cc:1403] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.031s
I20260709 13:03:22.306260 10504 raft_consensus.cc:359] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:22.307108 10504 raft_consensus.cc:740] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.307814 10504 consensus_queue.cc:260] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:22.314481 10504 ts_tablet_manager.cc:1434] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:03:22.315412 10504 tablet_bootstrap.cc:492] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
W20260709 13:03:22.324265  9731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:35769, user_credentials={real_user=slave}} blocked reactor thread for 63070.9us
I20260709 13:03:22.347791 10504 tablet_bootstrap.cc:492] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.348953 10504 tablet_bootstrap.cc:492] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:22.349774 10504 ts_tablet_manager.cc:1403] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.011s
I20260709 13:03:22.352397 10504 raft_consensus.cc:359] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:22.353122 10504 raft_consensus.cc:740] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.353849 10504 consensus_queue.cc:260] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:22.356190 10504 ts_tablet_manager.cc:1434] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:22.357062 10504 tablet_bootstrap.cc:492] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:22.378563 10504 tablet_bootstrap.cc:492] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.449020 10504 tablet_bootstrap.cc:492] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:22.452172 10504 ts_tablet_manager.cc:1403] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.007s
W20260709 13:03:22.522825  9805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 49373.6us
I20260709 13:03:22.546705 10579 raft_consensus.cc:3060] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.583978 10581 raft_consensus.cc:3060] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.603408 10504 raft_consensus.cc:359] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:22.606822 10504 raft_consensus.cc:740] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
W20260709 13:03:22.617204  9731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:32917, user_credentials={real_user=slave}} blocked reactor thread for 76593.2us
I20260709 13:03:22.619236 10577 raft_consensus.cc:3060] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.626742 10504 consensus_queue.cc:260] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:22.650485 10504 ts_tablet_manager.cc:1434] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.149s	user 0.010s	sys 0.001s
I20260709 13:03:22.651979 10504 tablet_bootstrap.cc:492] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
W20260709 13:03:22.662832  9805 consensus_peers.cc:597] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:22.809479 10577 raft_consensus.cc:3060] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.950907 10504 tablet_bootstrap.cc:492] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.957577 10504 tablet_bootstrap.cc:492] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:22.959537 10504 ts_tablet_manager.cc:1403] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.308s	user 0.027s	sys 0.002s
I20260709 13:03:22.964170 10504 raft_consensus.cc:359] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:22.976740 10504 raft_consensus.cc:740] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.984133 10504 consensus_queue.cc:260] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:22.989158 10504 ts_tablet_manager.cc:1434] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 13:03:22.992908 10504 tablet_bootstrap.cc:492] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap starting.
I20260709 13:03:23.040820 10504 tablet_bootstrap.cc:492] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:23.041891 10504 tablet_bootstrap.cc:492] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Bootstrap complete.
I20260709 13:03:23.042677 10504 ts_tablet_manager.cc:1403] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.003s
I20260709 13:03:23.045396 10504 raft_consensus.cc:359] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:23.046191 10504 raft_consensus.cc:740] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.046878 10504 consensus_queue.cc:260] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:23.049300 10504 ts_tablet_manager.cc:1434] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:30.018728   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:30.096464  9839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e2b7abebcdc4cbbac180a3762ad607b"
dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
mode: GRACEFUL
new_leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:37462
I20260709 13:03:30.097469  9839 raft_consensus.cc:606] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Received request to transfer leadership to TS 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:30.101464  9839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a"
dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
mode: GRACEFUL
new_leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:37462
I20260709 13:03:30.102234  9839 raft_consensus.cc:606] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Received request to transfer leadership to TS 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:30.106487  9839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d42567f00fd44cabc99c217e4df31d8"
dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
mode: GRACEFUL
new_leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:37462
I20260709 13:03:30.107402  9839 raft_consensus.cc:606] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Received request to transfer leadership to TS 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:30.123325  9762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60ee1293277e45038d5f7e4289589ded"
dest_uuid: "837fad20523b4348b68f0a1e1af12404"
mode: GRACEFUL
new_leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
 from {username='slave'} at 127.0.0.1:57970
I20260709 13:03:30.123960  9762 raft_consensus.cc:606] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Received request to transfer leadership to TS 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:30.126896  9839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dfed6059cc642b290ce15a921704fc4"
dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
mode: GRACEFUL
new_leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:37462
I20260709 13:03:30.127754  9839 raft_consensus.cc:606] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Received request to transfer leadership to TS 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:30.129216   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:30.130936   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:30.148159 10760 raft_consensus.cc:993] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60: : Instructing follower 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:30.148985 10506 raft_consensus.cc:1081] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Signalling peer 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:30.151300 10571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dfed6059cc642b290ce15a921704fc4"
dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:41034
I20260709 13:03:30.151938 10571 raft_consensus.cc:493] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:30.152369 10571 raft_consensus.cc:3060] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.160161 10571 raft_consensus.cc:515] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:30.161830 10571 leader_election.cc:290] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:30.162812  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfed6059cc642b290ce15a921704fc4" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:30.163236  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfed6059cc642b290ce15a921704fc4" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:30.163602  9762 raft_consensus.cc:3060] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.163825  9839 raft_consensus.cc:3055] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:30.164160  9839 raft_consensus.cc:740] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:30.165057  9839 consensus_queue.cc:260] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:30.166792  9839 raft_consensus.cc:3060] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.170981  9762 raft_consensus.cc:2468] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:30.172412 10499 leader_election.cc:304] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:30.174382  9839 raft_consensus.cc:2468] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:30.176858 10762 raft_consensus.cc:2804] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:30.178531 10762 raft_consensus.cc:697] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:30.179534 10762 consensus_queue.cc:237] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:30.194229  9586 catalog_manager.cc:5697] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 1 to 2, leader changed from 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195) to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:30.230746 10506 raft_consensus.cc:993] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60: : Instructing follower 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:30.231323 10760 raft_consensus.cc:1081] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Signalling peer 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:30.232923 10571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e2b7abebcdc4cbbac180a3762ad607b"
dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:41034
I20260709 13:03:30.233409 10571 raft_consensus.cc:493] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:30.233763 10571 raft_consensus.cc:3060] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.241024 10571 raft_consensus.cc:515] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:30.242947 10571 leader_election.cc:290] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:30.243810  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2b7abebcdc4cbbac180a3762ad607b" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:30.244064  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2b7abebcdc4cbbac180a3762ad607b" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:30.244443  9762 raft_consensus.cc:3060] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.244680  9839 raft_consensus.cc:3055] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:30.245143  9839 raft_consensus.cc:740] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:30.245925  9839 consensus_queue.cc:260] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:30.247347  9839 raft_consensus.cc:3060] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.251962  9762 raft_consensus.cc:2468] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:30.253269 10499 leader_election.cc:304] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:30.254155 10762 raft_consensus.cc:2804] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:30.254596 10762 raft_consensus.cc:697] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:30.254601  9839 raft_consensus.cc:2468] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:30.255630 10762 consensus_queue.cc:237] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:30.269083  9586 catalog_manager.cc:5697] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 1 to 2, leader changed from 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195) to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:30.376802 10751 raft_consensus.cc:993] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404: : Instructing follower 8557220d7e6a4ccbbef222e80a5584a5 to start an election
I20260709 13:03:30.377486 10756 raft_consensus.cc:1081] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Signalling peer 8557220d7e6a4ccbbef222e80a5584a5 to start an election
I20260709 13:03:30.379004  9910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60ee1293277e45038d5f7e4289589ded"
dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:03:30.379433  9910 raft_consensus.cc:493] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:30.379663  9910 raft_consensus.cc:3060] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.385113  9910 raft_consensus.cc:515] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:30.387135  9910 leader_election.cc:290] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:30.388131  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ee1293277e45038d5f7e4289589ded" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:30.388193  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ee1293277e45038d5f7e4289589ded" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:30.389060  9839 raft_consensus.cc:3060] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.389357  9762 raft_consensus.cc:3055] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:30.389714  9762 raft_consensus.cc:740] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:30.390405  9762 consensus_queue.cc:260] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:30.391781  9762 raft_consensus.cc:3060] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.395460  9839 raft_consensus.cc:2468] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 2.
I20260709 13:03:30.396955  9879 leader_election.cc:304] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:30.397982 10755 raft_consensus.cc:2804] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:30.398365  9762 raft_consensus.cc:2468] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 2.
I20260709 13:03:30.400288 10755 raft_consensus.cc:697] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:30.401499 10755 consensus_queue.cc:237] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:30.411888  9586 catalog_manager.cc:5697] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 1 to 2, leader changed from 837fad20523b4348b68f0a1e1af12404 (127.0.107.194) to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:30.430291 10506 raft_consensus.cc:993] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60: : Instructing follower 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:30.430881 10760 raft_consensus.cc:1081] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Signalling peer 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:30.432425 10577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a"
dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:41034
I20260709 13:03:30.433152 10577 raft_consensus.cc:493] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:30.433452 10577 raft_consensus.cc:3060] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.440511 10577 raft_consensus.cc:515] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:30.442561 10577 leader_election.cc:290] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 3 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:30.443392  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:30.444031  9762 raft_consensus.cc:3060] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.444314  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2169bc2b2ef940d0a49aeb2d93d1db5a" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:30.444908  9839 raft_consensus.cc:3055] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:30.445219  9839 raft_consensus.cc:740] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:30.447398  9839 consensus_queue.cc:260] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:30.453927  9839 raft_consensus.cc:3060] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.461189  9839 raft_consensus.cc:2468] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 3.
I20260709 13:03:30.462266 10506 raft_consensus.cc:993] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60: : Instructing follower 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:30.462821 10506 raft_consensus.cc:1081] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Signalling peer 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:30.464537 10501 leader_election.cc:304] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:30.465183 10571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d42567f00fd44cabc99c217e4df31d8"
dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:41034
I20260709 13:03:30.466045 10571 raft_consensus.cc:493] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:30.465910 10762 raft_consensus.cc:2804] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:30.466583 10571 raft_consensus.cc:3060] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.466859 10762 raft_consensus.cc:697] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:30.467877 10762 consensus_queue.cc:237] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:30.465353  9762 raft_consensus.cc:2468] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 3.
I20260709 13:03:30.478384 10571 raft_consensus.cc:515] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:30.484184 10571 leader_election.cc:290] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 3 election: Requested vote from peers 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769), 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227)
I20260709 13:03:30.485200  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d42567f00fd44cabc99c217e4df31d8" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:30.485247  9909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d42567f00fd44cabc99c217e4df31d8" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:30.487031  9909 raft_consensus.cc:3060] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.486567  9839 raft_consensus.cc:3055] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:30.488083  9839 raft_consensus.cc:740] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 451c871fd36f4d95a76b62d041aa7b60, State: Running, Role: LEADER
I20260709 13:03:30.490060  9839 consensus_queue.cc:260] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:30.491504  9839 raft_consensus.cc:3060] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.495436  9909 raft_consensus.cc:2468] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 3.
I20260709 13:03:30.496989 10498 leader_election.cc:304] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:30.496516  9586 catalog_manager.cc:5697] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 2 to 3, leader changed from 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195) to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:30.497960 10762 raft_consensus.cc:2804] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:30.499174  9839 raft_consensus.cc:2468] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 3.
I20260709 13:03:30.498683 10762 raft_consensus.cc:697] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:30.500406 10762 consensus_queue.cc:237] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } }
I20260709 13:03:30.517664  9586 catalog_manager.cc:5697] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 2 to 3, leader changed from 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195) to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:30.641098  9834 raft_consensus.cc:1275] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:30.642235 10762 consensus_queue.cc:1048] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:30.653218  9765 raft_consensus.cc:1275] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:30.658349  9834 raft_consensus.cc:1275] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:30.660475 10763 consensus_queue.cc:1048] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:30.662388 10763 consensus_queue.cc:1048] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:30.693256  9765 raft_consensus.cc:1275] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:30.696388 10763 consensus_queue.cc:1048] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:30.804119  9765 raft_consensus.cc:1275] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 8557220d7e6a4ccbbef222e80a5584a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:30.805773 10770 consensus_queue.cc:1048] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:30.822131  9839 raft_consensus.cc:1275] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Refusing update from remote peer 8557220d7e6a4ccbbef222e80a5584a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:30.823613 10785 consensus_queue.cc:1048] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:30.941545  9762 raft_consensus.cc:1275] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:30.942924 10763 consensus_queue.cc:1048] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:30.949241  9839 raft_consensus.cc:1275] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 3 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:30.950546 10763 consensus_queue.cc:1048] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:30.961894  9834 raft_consensus.cc:1275] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 3 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:30.968293 10788 consensus_queue.cc:1048] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:30.975435  9909 raft_consensus.cc:1275] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:30.976790 10762 consensus_queue.cc:1048] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:31.132516   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:31.181874   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:31.221655  9762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00d0bc42f3174047b43f78e52fcfbd04"
dest_uuid: "837fad20523b4348b68f0a1e1af12404"
mode: GRACEFUL
new_leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
 from {username='slave'} at 127.0.0.1:57970
I20260709 13:03:31.222509  9762 raft_consensus.cc:606] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Received request to transfer leadership to TS 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:31.226706  9762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38dadd5ead404b82a843d64283e7f2a1"
dest_uuid: "837fad20523b4348b68f0a1e1af12404"
mode: GRACEFUL
new_leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:57970
I20260709 13:03:31.227314  9762 raft_consensus.cc:606] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 2 LEADER]: Received request to transfer leadership to TS 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:31.231487  9762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e792dd7473944b79554c8d6ad554fab"
dest_uuid: "837fad20523b4348b68f0a1e1af12404"
mode: GRACEFUL
new_leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:57970
I20260709 13:03:31.232084  9762 raft_consensus.cc:606] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 2 LEADER]: Received request to transfer leadership to TS 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:31.235669  9762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceffadfaf404425f90705c5a6e0e60bc"
dest_uuid: "837fad20523b4348b68f0a1e1af12404"
mode: GRACEFUL
new_leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:57970
I20260709 13:03:31.236306  9762 raft_consensus.cc:606] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Received request to transfer leadership to TS 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:31.238993  9762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7fb824343684771b7c7042727a90e40"
dest_uuid: "837fad20523b4348b68f0a1e1af12404"
mode: GRACEFUL
new_leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:57970
I20260709 13:03:31.239814  9762 raft_consensus.cc:606] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 3 LEADER]: Received request to transfer leadership to TS 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:31.245602   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:31.247803   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:31.320365 10756 raft_consensus.cc:993] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404: : Instructing follower 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:31.320981 10793 raft_consensus.cc:1081] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 2 LEADER]: Signalling peer 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:31.322616 10577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38dadd5ead404b82a843d64283e7f2a1"
dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:03:31.323308 10577 raft_consensus.cc:493] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:31.323691 10577 raft_consensus.cc:3060] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.328795 10577 raft_consensus.cc:515] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:31.331116  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dadd5ead404b82a843d64283e7f2a1" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:31.331434  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38dadd5ead404b82a843d64283e7f2a1" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:31.331763  9910 raft_consensus.cc:3060] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.332115  9762 raft_consensus.cc:3055] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:31.331223 10577 leader_election.cc:290] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 3 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:31.332435  9762 raft_consensus.cc:740] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:31.333369  9762 consensus_queue.cc:260] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:31.334549  9762 raft_consensus.cc:3060] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.337538  9910 raft_consensus.cc:2468] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 3.
I20260709 13:03:31.338785 10498 leader_election.cc:304] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:31.339478 10790 raft_consensus.cc:2804] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:31.339939 10790 raft_consensus.cc:697] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:31.340695  9762 raft_consensus.cc:2468] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 3.
I20260709 13:03:31.341176 10790 consensus_queue.cc:237] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:31.355578  9586 catalog_manager.cc:5697] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 2 to 3, leader changed from 837fad20523b4348b68f0a1e1af12404 (127.0.107.194) to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.406819 10793 raft_consensus.cc:993] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404: : Instructing follower 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:31.407367 10793 raft_consensus.cc:1081] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Signalling peer 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:31.408893 10577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ceffadfaf404425f90705c5a6e0e60bc"
dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:03:31.409483 10577 raft_consensus.cc:493] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:31.409823 10577 raft_consensus.cc:3060] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.415831 10577 raft_consensus.cc:515] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:31.418447 10577 leader_election.cc:290] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:31.418881  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceffadfaf404425f90705c5a6e0e60bc" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:31.419446  9762 raft_consensus.cc:3055] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:31.419890  9762 raft_consensus.cc:740] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:31.420109  9834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceffadfaf404425f90705c5a6e0e60bc" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:31.420684  9762 consensus_queue.cc:260] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:31.421839  9762 raft_consensus.cc:3060] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.420699  9834 raft_consensus.cc:3060] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.431982  9762 raft_consensus.cc:2468] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:31.433250 10499 leader_election.cc:304] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404; no voters: 
I20260709 13:03:31.434113 10790 raft_consensus.cc:2804] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:31.434679 10790 raft_consensus.cc:697] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:31.435591  9834 raft_consensus.cc:2468] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:31.435650 10790 consensus_queue.cc:237] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:31.452057  9588 catalog_manager.cc:5697] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 1 to 2, leader changed from 837fad20523b4348b68f0a1e1af12404 (127.0.107.194) to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.558709 10756 raft_consensus.cc:993] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404: : Instructing follower 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:31.559175 10793 raft_consensus.cc:1081] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 2 LEADER]: Signalling peer 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:31.560649 10579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e792dd7473944b79554c8d6ad554fab"
dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:03:31.561122 10579 raft_consensus.cc:493] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:31.561403 10579 raft_consensus.cc:3060] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.566128 10579 raft_consensus.cc:515] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:31.567716 10579 leader_election.cc:290] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 3 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:31.568804  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e792dd7473944b79554c8d6ad554fab" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:31.569414  9762 raft_consensus.cc:3055] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:31.569696  9762 raft_consensus.cc:740] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:31.570363  9762 consensus_queue.cc:260] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:31.571365  9762 raft_consensus.cc:3060] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.572359  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e792dd7473944b79554c8d6ad554fab" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:31.574678  9910 raft_consensus.cc:3060] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.584544  9910 raft_consensus.cc:2468] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 3.
I20260709 13:03:31.584774  9762 raft_consensus.cc:2468] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 3.
I20260709 13:03:31.585969 10498 leader_election.cc:304] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:31.587359 10801 raft_consensus.cc:2804] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:31.587882 10801 raft_consensus.cc:697] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:31.588783 10801 consensus_queue.cc:237] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:31.599977 10727 raft_consensus.cc:993] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404: : Instructing follower 8557220d7e6a4ccbbef222e80a5584a5 to start an election
I20260709 13:03:31.600482 10756 raft_consensus.cc:1081] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Signalling peer 8557220d7e6a4ccbbef222e80a5584a5 to start an election
I20260709 13:03:31.600759  9588 catalog_manager.cc:5697] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 2 to 3, leader changed from 837fad20523b4348b68f0a1e1af12404 (127.0.107.194) to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.602721  9910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00d0bc42f3174047b43f78e52fcfbd04"
dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:03:31.603317  9910 raft_consensus.cc:493] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:31.603555  9910 raft_consensus.cc:3060] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.610324  9910 raft_consensus.cc:515] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:31.612382  9910 leader_election.cc:290] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:31.613122  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d0bc42f3174047b43f78e52fcfbd04" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:31.613344  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d0bc42f3174047b43f78e52fcfbd04" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:31.613830  9762 raft_consensus.cc:3055] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:31.614140  9839 raft_consensus.cc:3060] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.614498  9762 raft_consensus.cc:740] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:31.615451  9762 consensus_queue.cc:260] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:31.616377  9762 raft_consensus.cc:3060] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.619498  9839 raft_consensus.cc:2468] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 2.
I20260709 13:03:31.620772  9879 leader_election.cc:304] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:31.621551 10785 raft_consensus.cc:2804] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:31.622396  9762 raft_consensus.cc:2468] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 2.
I20260709 13:03:31.623629 10785 raft_consensus.cc:697] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:31.624536 10785 consensus_queue.cc:237] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:31.635911  9588 catalog_manager.cc:5697] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 1 to 2, leader changed from 837fad20523b4348b68f0a1e1af12404 (127.0.107.194) to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:31.647115 10756 raft_consensus.cc:993] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404: : Instructing follower 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:31.647641 10793 raft_consensus.cc:1081] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 3 LEADER]: Signalling peer 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:31.656893 10579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7fb824343684771b7c7042727a90e40"
dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:03:31.657438 10579 raft_consensus.cc:493] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:31.657744 10579 raft_consensus.cc:3060] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.664229 10579 raft_consensus.cc:515] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:31.667145  9834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb824343684771b7c7042727a90e40" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:31.667869  9834 raft_consensus.cc:3060] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.667291  9761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7fb824343684771b7c7042727a90e40" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:31.671839  9761 raft_consensus.cc:3055] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:31.672217  9761 raft_consensus.cc:740] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:31.673168  9761 consensus_queue.cc:260] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:31.673796  9834 raft_consensus.cc:2468] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 4.
I20260709 13:03:31.674578  9761 raft_consensus.cc:3060] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.666646 10579 leader_election.cc:290] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 4 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:31.674997 10501 leader_election.cc:304] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:31.676267 10801 raft_consensus.cc:2804] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:31.677047 10801 raft_consensus.cc:697] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 4 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:31.677799 10801 consensus_queue.cc:237] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:31.684993  9761 raft_consensus.cc:2468] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 4.
I20260709 13:03:31.694716  9588 catalog_manager.cc:5697] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 3 to 4, leader changed from 837fad20523b4348b68f0a1e1af12404 (127.0.107.194) to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.906872  9910 raft_consensus.cc:1275] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:31.908182 10801 consensus_queue.cc:1048] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:31.921900  9761 raft_consensus.cc:1275] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:31.924153 10801 consensus_queue.cc:1048] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:31.937469  9762 raft_consensus.cc:1275] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:31.939446 10801 consensus_queue.cc:1048] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:31.956965  9834 raft_consensus.cc:1275] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:31.959869 10762 consensus_queue.cc:1048] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:32.089628  9761 raft_consensus.cc:1275] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 4 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:32.090900 10790 consensus_queue.cc:1048] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:32.101087  9834 raft_consensus.cc:1275] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 4 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:32.103016 10790 consensus_queue.cc:1048] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:32.141886  9761 raft_consensus.cc:1275] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 8557220d7e6a4ccbbef222e80a5584a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:32.143172 10785 consensus_queue.cc:1048] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:32.157881  9834 raft_consensus.cc:1275] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Refusing update from remote peer 8557220d7e6a4ccbbef222e80a5584a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:32.162047 10817 consensus_queue.cc:1048] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:32.215559  9910 raft_consensus.cc:1275] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:32.217137 10790 consensus_queue.cc:1048] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:32.219851  9761 raft_consensus.cc:1275] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:32.222043 10790 consensus_queue.cc:1048] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:32.248837   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:32.305027   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:32.343021  9761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fbf0dc7bcfe41e58f7c298165f4d2b5"
dest_uuid: "837fad20523b4348b68f0a1e1af12404"
mode: GRACEFUL
new_leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
 from {username='slave'} at 127.0.0.1:57970
I20260709 13:03:32.343763  9761 raft_consensus.cc:606] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Received request to transfer leadership to TS 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:32.346622  9761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44eaceee580a4f8c8edd343f46ce1b32"
dest_uuid: "837fad20523b4348b68f0a1e1af12404"
mode: GRACEFUL
new_leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:57970
I20260709 13:03:32.347154  9761 raft_consensus.cc:606] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Received request to transfer leadership to TS 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:32.350039  9761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55fdf0e57b3341a1a01a23f13df81770"
dest_uuid: "837fad20523b4348b68f0a1e1af12404"
mode: GRACEFUL
new_leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:57970
I20260709 13:03:32.350680  9761 raft_consensus.cc:606] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Received request to transfer leadership to TS 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:32.353780  9761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e53ce2e48bf64a4cac0e42aed1e3ac61"
dest_uuid: "837fad20523b4348b68f0a1e1af12404"
mode: GRACEFUL
new_leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:57970
I20260709 13:03:32.354427  9761 raft_consensus.cc:606] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Received request to transfer leadership to TS 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:32.357318  9761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f36b261dca1448a8976c337d0adca949"
dest_uuid: "837fad20523b4348b68f0a1e1af12404"
mode: GRACEFUL
new_leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
 from {username='slave'} at 127.0.0.1:57970
I20260709 13:03:32.358052  9761 raft_consensus.cc:606] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Received request to transfer leadership to TS 8557220d7e6a4ccbbef222e80a5584a5
I20260709 13:03:32.359397   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:32.361083   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:32.504310 10727 raft_consensus.cc:993] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404: : Instructing follower 8557220d7e6a4ccbbef222e80a5584a5 to start an election
I20260709 13:03:32.504990 10821 raft_consensus.cc:1081] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Signalling peer 8557220d7e6a4ccbbef222e80a5584a5 to start an election
I20260709 13:03:32.506536  9910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fbf0dc7bcfe41e58f7c298165f4d2b5"
dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:03:32.506786 10821 raft_consensus.cc:993] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404: : Instructing follower 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:32.507328  9910 raft_consensus.cc:493] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:32.507436 10821 raft_consensus.cc:1081] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Signalling peer 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:32.507939  9910 raft_consensus.cc:3060] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.510426 10577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44eaceee580a4f8c8edd343f46ce1b32"
dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:03:32.511171 10577 raft_consensus.cc:493] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:32.511636 10577 raft_consensus.cc:3060] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.519856 10577 raft_consensus.cc:515] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:32.518144  9910 raft_consensus.cc:515] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:32.579749  9910 leader_election.cc:290] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:32.610553 10577 leader_election.cc:290] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:32.623322  9834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf0dc7bcfe41e58f7c298165f4d2b5" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:32.625201  9834 raft_consensus.cc:3060] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.623387  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbf0dc7bcfe41e58f7c298165f4d2b5" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:32.632967  9762 raft_consensus.cc:3055] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:32.633359  9762 raft_consensus.cc:740] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:32.641458  9833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44eaceee580a4f8c8edd343f46ce1b32" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:32.642409  9833 raft_consensus.cc:3060] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.634832  9762 consensus_queue.cc:260] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:32.647068  9762 raft_consensus.cc:3060] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.650110 10821 raft_consensus.cc:993] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404: : Instructing follower 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:32.651041 10821 raft_consensus.cc:1081] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Signalling peer 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:32.661458  9761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44eaceee580a4f8c8edd343f46ce1b32" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:32.662428  9761 raft_consensus.cc:3055] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:32.662849  9761 raft_consensus.cc:740] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:32.664805  9761 consensus_queue.cc:260] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:32.698403  9761 raft_consensus.cc:3060] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.711911  9833 raft_consensus.cc:2468] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:32.731534  9762 raft_consensus.cc:2468] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 2.
I20260709 13:03:32.741803  9834 raft_consensus.cc:2468] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 2.
I20260709 13:03:32.750852 10577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55fdf0e57b3341a1a01a23f13df81770"
dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:03:32.751526  9879 leader_election.cc:304] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:32.751833 10577 raft_consensus.cc:493] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:32.766496 10577 raft_consensus.cc:3060] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.766785 10817 raft_consensus.cc:2804] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:32.767833 10817 raft_consensus.cc:697] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:32.769353 10817 consensus_queue.cc:237] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:32.773864 10501 leader_election.cc:304] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:32.775339 10790 raft_consensus.cc:2804] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:32.776022 10790 raft_consensus.cc:697] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:32.779927 10790 consensus_queue.cc:237] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:32.782270 10821 raft_consensus.cc:993] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404: : Instructing follower 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:32.785269 10821 raft_consensus.cc:1081] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Signalling peer 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:32.814678 10578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e53ce2e48bf64a4cac0e42aed1e3ac61"
dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:03:32.815502 10578 raft_consensus.cc:493] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:32.816113 10578 raft_consensus.cc:3060] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.846233 10577 raft_consensus.cc:515] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:32.853294 10577 leader_election.cc:290] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:32.855875  9833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55fdf0e57b3341a1a01a23f13df81770" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:32.856885  9761 raft_consensus.cc:2468] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
W20260709 13:03:32.863101  9879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35769, user_credentials={real_user=slave}} blocked reactor thread for 116378us
I20260709 13:03:32.867445  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55fdf0e57b3341a1a01a23f13df81770" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:32.863797  9833 raft_consensus.cc:3060] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.896992  9586 catalog_manager.cc:5697] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 1 to 2, leader changed from 837fad20523b4348b68f0a1e1af12404 (127.0.107.194) to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:32.868470  9762 raft_consensus.cc:3055] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:32.915545  9762 raft_consensus.cc:740] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:32.920409  9588 catalog_manager.cc:5697] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 1 to 2, leader changed from 837fad20523b4348b68f0a1e1af12404 (127.0.107.194) to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:32.926192  9762 consensus_queue.cc:260] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:32.944068 10578 raft_consensus.cc:515] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:32.963727 10571 raft_consensus.cc:1240] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Rejecting Update request from peer 837fad20523b4348b68f0a1e1af12404 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:32.946190  9762 raft_consensus.cc:3060] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.948572 10821 raft_consensus.cc:993] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404: : Instructing follower 8557220d7e6a4ccbbef222e80a5584a5 to start an election
I20260709 13:03:32.971086 10828 consensus_queue.cc:1059] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:32.972811 10829 raft_consensus.cc:1081] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Signalling peer 8557220d7e6a4ccbbef222e80a5584a5 to start an election
I20260709 13:03:32.975672 10834 raft_consensus.cc:3055] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:32.976421 10834 raft_consensus.cc:740] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:32.978834 10834 consensus_queue.cc:260] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:32.980517 10834 raft_consensus.cc:3060] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.980383  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53ce2e48bf64a4cac0e42aed1e3ac61" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:32.981374  9910 raft_consensus.cc:3060] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.985211 10578 leader_election.cc:290] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:32.986032  9833 raft_consensus.cc:2468] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:32.999145  9909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f36b261dca1448a8976c337d0adca949"
dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:03:33.000257  9909 raft_consensus.cc:493] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:33.000988  9909 raft_consensus.cc:3060] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.999168 10501 leader_election.cc:304] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 451c871fd36f4d95a76b62d041aa7b60; no voters: 
I20260709 13:03:33.002413 10826 raft_consensus.cc:2804] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.002974 10826 raft_consensus.cc:697] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:33.004472 10826 consensus_queue.cc:237] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } }
I20260709 13:03:32.990698  9762 raft_consensus.cc:2468] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:33.009483  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53ce2e48bf64a4cac0e42aed1e3ac61" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:33.003831  9910 raft_consensus.cc:2468] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:33.018548  9762 raft_consensus.cc:2468] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:33.018674 10498 leader_election.cc:304] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:33.019979 10826 raft_consensus.cc:2804] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.020473 10826 raft_consensus.cc:697] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:33.023015 10826 consensus_queue.cc:237] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:33.027146  9909 raft_consensus.cc:515] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:33.030813  9909 leader_election.cc:290] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: Requested vote from peers 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623), 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769)
I20260709 13:03:33.033849  9839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36b261dca1448a8976c337d0adca949" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "451c871fd36f4d95a76b62d041aa7b60"
I20260709 13:03:33.034741  9839 raft_consensus.cc:3060] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.048076  9761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36b261dca1448a8976c337d0adca949" candidate_uuid: "8557220d7e6a4ccbbef222e80a5584a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:33.048939  9761 raft_consensus.cc:3055] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.049293  9761 raft_consensus.cc:740] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:33.050314  9761 consensus_queue.cc:260] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:33.052016  9761 raft_consensus.cc:3060] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.053647  9839 raft_consensus.cc:2468] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 2.
I20260709 13:03:33.055122  9879 leader_election.cc:304] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 451c871fd36f4d95a76b62d041aa7b60, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:33.056018 10832 raft_consensus.cc:2804] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.056525 10832 raft_consensus.cc:697] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 LEADER]: Becoming Leader. State: Replica: 8557220d7e6a4ccbbef222e80a5584a5, State: Running, Role: LEADER
I20260709 13:03:33.058012 10832 consensus_queue.cc:237] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } }
I20260709 13:03:33.059980  9761 raft_consensus.cc:2468] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8557220d7e6a4ccbbef222e80a5584a5 in term 2.
I20260709 13:03:33.061347  9586 catalog_manager.cc:5697] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 1 to 2, leader changed from 837fad20523b4348b68f0a1e1af12404 (127.0.107.194) to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.063555  9586 catalog_manager.cc:5697] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 1 to 2, leader changed from 837fad20523b4348b68f0a1e1af12404 (127.0.107.194) to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.070955  9588 catalog_manager.cc:5697] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 reported cstate change: term changed from 1 to 2, leader changed from 837fad20523b4348b68f0a1e1af12404 (127.0.107.194) to 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "8557220d7e6a4ccbbef222e80a5584a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.261620  9762 raft_consensus.cc:1275] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:33.263070 10826 consensus_queue.cc:1048] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:33.279246  9839 raft_consensus.cc:1275] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:33.281517 10762 consensus_queue.cc:1048] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:33.353444  9761 raft_consensus.cc:1275] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 8557220d7e6a4ccbbef222e80a5584a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:33.355010 10830 consensus_queue.cc:1048] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:33.362190   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:33.376739  9834 raft_consensus.cc:1275] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Refusing update from remote peer 8557220d7e6a4ccbbef222e80a5584a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:33.379184 10831 consensus_queue.cc:1048] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:33.416514  9761 raft_consensus.cc:1275] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:33.419878 10762 consensus_queue.cc:1048] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:33.438834  9839 raft_consensus.cc:1275] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:33.440676 10762 consensus_queue.cc:1048] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:33.448665   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:33.520196  9910 raft_consensus.cc:1275] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:33.521771 10855 consensus_queue.cc:1048] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:33.522846  9761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11c560f6bb9c4ebfa538d60759ae2739"
dest_uuid: "837fad20523b4348b68f0a1e1af12404"
mode: GRACEFUL
new_leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:57970
I20260709 13:03:33.523574  9761 raft_consensus.cc:606] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Received request to transfer leadership to TS 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:33.526218  9762 raft_consensus.cc:1275] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:33.527367 10855 consensus_queue.cc:1048] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:33.528103  9762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4df3f52d3b03462987204a034f95a927"
dest_uuid: "837fad20523b4348b68f0a1e1af12404"
mode: GRACEFUL
new_leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:57970
I20260709 13:03:33.528772  9762 raft_consensus.cc:606] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Received request to transfer leadership to TS 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:33.532519  9765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76a88ee2ae1f4e17826b23090e31bf02"
dest_uuid: "837fad20523b4348b68f0a1e1af12404"
mode: GRACEFUL
new_leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:57970
I20260709 13:03:33.533223  9765 raft_consensus.cc:606] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Received request to transfer leadership to TS 2bb23251eccc42b1ba4e8c3f8d97ea83
I20260709 13:03:33.535234   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:33.537271   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:33.572441  9762 raft_consensus.cc:1275] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 8557220d7e6a4ccbbef222e80a5584a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:33.574995 10817 consensus_queue.cc:1048] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:33.584941  9834 raft_consensus.cc:1275] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Refusing update from remote peer 8557220d7e6a4ccbbef222e80a5584a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:33.587674 10831 consensus_queue.cc:1048] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "451c871fd36f4d95a76b62d041aa7b60" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:33.711547 10828 raft_consensus.cc:993] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404: : Instructing follower 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:33.712095 10829 raft_consensus.cc:1081] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Signalling peer 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:33.713626 10578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11c560f6bb9c4ebfa538d60759ae2739"
dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:03:33.714305 10578 raft_consensus.cc:493] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:33.714685 10578 raft_consensus.cc:3060] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.720290 10578 raft_consensus.cc:515] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:33.721995 10578 leader_election.cc:290] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:33.722749  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c560f6bb9c4ebfa538d60759ae2739" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:33.722980  9761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c560f6bb9c4ebfa538d60759ae2739" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:33.723479  9910 raft_consensus.cc:3060] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.723556  9761 raft_consensus.cc:3055] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.723984  9761 raft_consensus.cc:740] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:33.724768  9761 consensus_queue.cc:260] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:33.725816  9761 raft_consensus.cc:3060] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.732097  9910 raft_consensus.cc:2468] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:33.733158  9761 raft_consensus.cc:2468] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:33.733799 10498 leader_election.cc:304] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:33.734977 10855 raft_consensus.cc:2804] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.735494 10855 raft_consensus.cc:697] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:33.736343 10855 consensus_queue.cc:237] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:33.749702  9587 catalog_manager.cc:5697] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 1 to 2, leader changed from 837fad20523b4348b68f0a1e1af12404 (127.0.107.194) to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.768481 10828 raft_consensus.cc:993] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404: : Instructing follower 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:33.769186 10829 raft_consensus.cc:1081] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Signalling peer 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:33.771188 10578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4df3f52d3b03462987204a034f95a927"
dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:03:33.771744 10578 raft_consensus.cc:493] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:33.772009 10578 raft_consensus.cc:3060] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.781248 10578 raft_consensus.cc:515] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:33.783802 10578 leader_election.cc:290] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:33.783938  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df3f52d3b03462987204a034f95a927" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:33.784683  9910 raft_consensus.cc:3060] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.785248  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df3f52d3b03462987204a034f95a927" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:33.785830  9762 raft_consensus.cc:3055] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.786013  9762 raft_consensus.cc:740] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:33.786546  9762 consensus_queue.cc:260] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:33.787345  9762 raft_consensus.cc:3060] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.790700  9910 raft_consensus.cc:2468] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:33.791895 10498 leader_election.cc:304] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:33.793056  9762 raft_consensus.cc:2468] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:33.793186 10855 raft_consensus.cc:2804] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.796720 10855 raft_consensus.cc:697] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:33.797663 10855 consensus_queue.cc:237] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:33.806952  9587 catalog_manager.cc:5697] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 1 to 2, leader changed from 837fad20523b4348b68f0a1e1af12404 (127.0.107.194) to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.919761 10829 raft_consensus.cc:993] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404: : Instructing follower 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:33.920289 10829 raft_consensus.cc:1081] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Signalling peer 2bb23251eccc42b1ba4e8c3f8d97ea83 to start an election
I20260709 13:03:33.922133 10578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76a88ee2ae1f4e17826b23090e31bf02"
dest_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83"
 from {username='slave'} at 127.0.0.1:41044
I20260709 13:03:33.922765 10578 raft_consensus.cc:493] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:33.923182 10578 raft_consensus.cc:3060] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.931031 10578 raft_consensus.cc:515] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:33.933737 10578 leader_election.cc:290] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Requested vote from peers 8557220d7e6a4ccbbef222e80a5584a5 (127.0.107.196:36227), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:33.934013  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a88ee2ae1f4e17826b23090e31bf02" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8557220d7e6a4ccbbef222e80a5584a5"
I20260709 13:03:33.935101  9910 raft_consensus.cc:3060] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.936622  9762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a88ee2ae1f4e17826b23090e31bf02" candidate_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "837fad20523b4348b68f0a1e1af12404"
I20260709 13:03:33.937301  9762 raft_consensus.cc:3055] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.937599  9762 raft_consensus.cc:740] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 837fad20523b4348b68f0a1e1af12404, State: Running, Role: LEADER
I20260709 13:03:33.938464  9762 consensus_queue.cc:260] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:33.939769  9762 raft_consensus.cc:3060] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.941917  9910 raft_consensus.cc:2468] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:33.942903 10498 leader_election.cc:304] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 8557220d7e6a4ccbbef222e80a5584a5; no voters: 
I20260709 13:03:33.943537 10855 raft_consensus.cc:2804] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.944157 10855 raft_consensus.cc:697] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb23251eccc42b1ba4e8c3f8d97ea83, State: Running, Role: LEADER
I20260709 13:03:33.945076 10855 consensus_queue.cc:237] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:33.946166  9762 raft_consensus.cc:2468] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb23251eccc42b1ba4e8c3f8d97ea83 in term 2.
I20260709 13:03:33.957772  9587 catalog_manager.cc:5697] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 reported cstate change: term changed from 1 to 2, leader changed from 837fad20523b4348b68f0a1e1af12404 (127.0.107.194) to 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.208935  9910 raft_consensus.cc:1275] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.210217 10762 consensus_queue.cc:1048] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.228679  9762 raft_consensus.cc:1275] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.233017 10790 consensus_queue.cc:1048] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.338853  9762 raft_consensus.cc:1275] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.340197 10790 consensus_queue.cc:1048] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:34.353819  9909 raft_consensus.cc:1275] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.355674 10790 consensus_queue.cc:1048] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.452118  9762 raft_consensus.cc:1275] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.453768 10762 consensus_queue.cc:1048] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.479970  9909 raft_consensus.cc:1275] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Refusing update from remote peer 2bb23251eccc42b1ba4e8c3f8d97ea83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.489153 10762 consensus_queue.cc:1048] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:34.538383   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:34.579166   431 tablet_server.cc:179] TabletServer@127.0.107.193:32917 shutting down...
W20260709 13:03:34.600203  9731 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 175 similar messages]
W20260709 13:03:34.614606  9805 consensus_peers.cc:597] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:34.616735  9731 consensus_peers.cc:597] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:34.622499  9731 consensus_peers.cc:597] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:34.633440  9805 consensus_peers.cc:597] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:34.635072  9731 consensus_peers.cc:597] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:34.635128  9805 consensus_peers.cc:597] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:34.636457  9805 consensus_peers.cc:597] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:34.638923  9805 consensus_peers.cc:597] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:34.644946  9879 consensus_peers.cc:597] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.645008   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:03:34.646148  9731 consensus_peers.cc:597] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.646973   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.648094   431 raft_consensus.cc:2243] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:34.648417  9879 consensus_peers.cc:597] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.648676   431 raft_consensus.cc:2272] T 2e1663fd19784f6db7ea0fddb0fefb4c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.651569   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.652314   431 raft_consensus.cc:2243] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.653228   431 raft_consensus.cc:2272] T 6dfed6059cc642b290ce15a921704fc4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.656615   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.657514   431 raft_consensus.cc:2243] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.659045   431 raft_consensus.cc:2272] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:34.662001  9879 consensus_peers.cc:597] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.662843   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.663556   431 raft_consensus.cc:2243] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.664391   431 raft_consensus.cc:2272] T 38dadd5ead404b82a843d64283e7f2a1 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.667243   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.667900   431 raft_consensus.cc:2243] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.668381   431 raft_consensus.cc:2272] T 73b95221ddfd49cca2e58073915a692a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.671444   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.672817   431 raft_consensus.cc:2243] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.673419   431 raft_consensus.cc:2272] T dd27b85a4d824953b7b73f36aff6acc9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:34.673585  9731 consensus_peers.cc:597] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.676466   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.677625   431 raft_consensus.cc:2243] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.678233   431 raft_consensus.cc:2272] T 492d90625d5e4006b85a116618e1ebdd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.680682   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.681501   431 raft_consensus.cc:2243] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.682444   431 raft_consensus.cc:2272] T 3e792dd7473944b79554c8d6ad554fab P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.685755   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:03:34.686024  9805 consensus_peers.cc:597] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.686858   431 raft_consensus.cc:2243] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.687542   431 raft_consensus.cc:2272] T 1359e0d2d58948c199c04b275867bffd P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.690255   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.691097   431 raft_consensus.cc:2243] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.691644   431 raft_consensus.cc:2272] T e3b14229f08e4078b2e335de63179868 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.694763   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.695748   431 raft_consensus.cc:2243] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.696844   431 raft_consensus.cc:2272] T 4d42567f00fd44cabc99c217e4df31d8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.699707   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.700460   431 raft_consensus.cc:2243] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.701649   431 raft_consensus.cc:2272] T ceffadfaf404425f90705c5a6e0e60bc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.704710   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.705386   431 raft_consensus.cc:2243] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.706388   431 raft_consensus.cc:2272] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.708896   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.709460   431 raft_consensus.cc:2243] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.710215   431 raft_consensus.cc:2272] T 76a88ee2ae1f4e17826b23090e31bf02 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.712989   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.713615   431 raft_consensus.cc:2243] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.714013   431 raft_consensus.cc:2272] T 165514a80df44205b5aee88c4509ba6e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.716293   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.717216   431 raft_consensus.cc:2243] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.717809   431 raft_consensus.cc:2272] T 15a2118bc9914ddda2630ddb688ebaa9 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.721329   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.722132   431 raft_consensus.cc:2243] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.722983   431 raft_consensus.cc:2272] T 4df3f52d3b03462987204a034f95a927 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.726218   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.726873   431 raft_consensus.cc:2243] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.727344   431 raft_consensus.cc:2272] T a0f0ca4181d94a888b1dd8f39485828c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.729846   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.730631   431 raft_consensus.cc:2243] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.731159   431 raft_consensus.cc:2272] T b64e505f3a594381a9e50a8030c33783 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.734221   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.734862   431 raft_consensus.cc:2243] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.735249   431 raft_consensus.cc:2272] T dd42823bee8f4722a5f2b15fc1a3dac5 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.737514   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.738059   431 raft_consensus.cc:2243] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.738447   431 raft_consensus.cc:2272] T 12b5370a6691486895274f9b937bbb1e P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.740468   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.741098   431 raft_consensus.cc:2243] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.741493   431 raft_consensus.cc:2272] T 5b91b2a3a4a24086b9e05f782ee36615 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.743541   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.744174   431 raft_consensus.cc:2243] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.744699   431 raft_consensus.cc:2272] T bcb34d3df6d146e7b2406dafa071fd52 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.748060   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.748888   431 raft_consensus.cc:2243] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.749459   431 raft_consensus.cc:2272] T ef635d06ca2448f098dadbba833fa52c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.752691   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.753693   431 raft_consensus.cc:2243] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.754518   431 raft_consensus.cc:2272] T 03e983261153492e83602412c376fa6f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:34.755908  9731 consensus_peers.cc:597] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.757786   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.758581   431 raft_consensus.cc:2243] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.759047   431 raft_consensus.cc:2272] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:34.759446  9879 consensus_peers.cc:597] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.761847   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.762849   431 raft_consensus.cc:2243] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.763391   431 raft_consensus.cc:2272] T 26c146a1db6843fc81be490f926d3137 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.765579   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.766191   431 raft_consensus.cc:2243] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.766911   431 raft_consensus.cc:2272] T 11c560f6bb9c4ebfa538d60759ae2739 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.769585   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.770190   431 raft_consensus.cc:2243] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.771000   431 raft_consensus.cc:2272] T 0e2b7abebcdc4cbbac180a3762ad607b P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.773794   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.774473   431 raft_consensus.cc:2243] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.774909   431 raft_consensus.cc:2272] T e17ab55de9cb48ea8add7a3b93294673 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.777591   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.778604   431 raft_consensus.cc:2243] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.779625   431 raft_consensus.cc:2272] T 55fdf0e57b3341a1a01a23f13df81770 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.782346   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.783160   431 raft_consensus.cc:2243] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.783680   431 raft_consensus.cc:2272] T 47136b305fde43d8b8b8af12cecd9750 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.787197   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.788043   431 raft_consensus.cc:2243] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.788619   431 raft_consensus.cc:2272] T dfad36487cbe42f3adf25a44fa2b1b62 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.791914   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.792708   431 raft_consensus.cc:2243] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:34.792980  9805 consensus_peers.cc:597] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.793248   431 raft_consensus.cc:2272] T d1d0271039c54d29bb678ff19e90a76a P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.795735   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.796727   431 raft_consensus.cc:2243] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.797708   431 raft_consensus.cc:2272] T 95ddf7a725a64a6e9c3c1ede3c67402d P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.800127   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.800918   431 raft_consensus.cc:2243] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.801419   431 raft_consensus.cc:2272] T de10962da0124f0eb699ad981d76d6f4 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.804991   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.805713   431 raft_consensus.cc:2243] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.806264   431 raft_consensus.cc:2272] T fa904b1a1a63492ca9d5820c1984c7e8 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.809502   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.810086   431 raft_consensus.cc:2243] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.810901   431 raft_consensus.cc:2272] T d7fb824343684771b7c7042727a90e40 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.813298   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.813951   431 raft_consensus.cc:2243] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.814389   431 raft_consensus.cc:2272] T e4079962b0054d1c828d8ab946214dfa P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.817560   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.818388   431 raft_consensus.cc:2243] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.819006   431 raft_consensus.cc:2272] T 3f858210936a4559a877f1628213432c P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.822173   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.822961   431 raft_consensus.cc:2243] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.823562   431 raft_consensus.cc:2272] T 12ec003b8fb0423eae15b72ac88ce69f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.827207   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.828276   431 raft_consensus.cc:2243] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:34.829398   431 raft_consensus.cc:2272] T 44eaceee580a4f8c8edd343f46ce1b32 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.833003   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.833746   431 raft_consensus.cc:2243] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.834913   431 raft_consensus.cc:2272] T 839d06ab83a14f179212ace3780771f2 P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:34.838372   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.839376   431 raft_consensus.cc:2243] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.839838   431 raft_consensus.cc:2272] T e8d49a0a0c7c4fc4bd734945246961cc P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:34.840605  9805 consensus_peers.cc:597] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.842844   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:34.843612   431 raft_consensus.cc:2243] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:34.844262   431 raft_consensus.cc:2272] T ffeb40161a4049b8a9b37f9cadfdc50f P 2bb23251eccc42b1ba4e8c3f8d97ea83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:34.850136  9731 consensus_peers.cc:597] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:34.863620  9805 consensus_peers.cc:597] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:34.870612  9879 consensus_peers.cc:597] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:34.876915  9879 consensus_peers.cc:597] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.919536   431 tablet_server.cc:196] TabletServer@127.0.107.193:32917 shutdown complete.
W20260709 13:03:34.935068  9805 consensus_peers.cc:597] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:34.935631  9879 consensus_peers.cc:597] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:34.982260  9731 consensus_peers.cc:597] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.003294  9879 consensus_peers.cc:597] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.017488   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:35.021379  9731 consensus_peers.cc:597] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.029160  9805 consensus_peers.cc:597] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.060514  9731 consensus_peers.cc:597] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.073171  9803 consensus_peers.cc:597] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.076192  9805 consensus_peers.cc:597] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.076993  9805 consensus_peers.cc:597] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Couldn't send request to peer 2bb23251eccc42b1ba4e8c3f8d97ea83. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.082687   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:35.084622   431 tablet_replica.cc:333] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.085811   431 raft_consensus.cc:2243] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.086962   431 raft_consensus.cc:2272] T 839d06ab83a14f179212ace3780771f2 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.089649   431 tablet_replica.cc:333] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.090497   431 raft_consensus.cc:2243] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.091544   431 raft_consensus.cc:2272] T fa904b1a1a63492ca9d5820c1984c7e8 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.094517   431 tablet_replica.cc:333] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.095819   431 raft_consensus.cc:2243] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.096387   431 raft_consensus.cc:2272] T 38dadd5ead404b82a843d64283e7f2a1 P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.101146   431 tablet_replica.cc:333] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.102046   431 raft_consensus.cc:2243] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.102635   431 raft_consensus.cc:2272] T e8d49a0a0c7c4fc4bd734945246961cc P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.105947   431 tablet_replica.cc:333] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.106873   431 raft_consensus.cc:2243] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.107486   431 raft_consensus.cc:2272] T f4213d5ed7d5428aa77410084c68a98b P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:35.108608  9877 consensus_peers.cc:597] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.110970   431 tablet_replica.cc:333] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.111908   431 raft_consensus.cc:2243] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.112484   431 raft_consensus.cc:2272] T 76a88ee2ae1f4e17826b23090e31bf02 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.117681   431 tablet_replica.cc:333] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.118713   431 raft_consensus.cc:2243] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.119822   431 raft_consensus.cc:2272] T e17ab55de9cb48ea8add7a3b93294673 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.122934   431 tablet_replica.cc:333] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.123818   431 raft_consensus.cc:2243] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.124385   431 raft_consensus.cc:2272] T 55fdf0e57b3341a1a01a23f13df81770 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.127112   431 tablet_replica.cc:333] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.127924   431 raft_consensus.cc:2243] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.128500   431 raft_consensus.cc:2272] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.131469   431 tablet_replica.cc:333] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.132334   431 raft_consensus.cc:2243] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.133490   431 raft_consensus.cc:2272] T e4079962b0054d1c828d8ab946214dfa P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.136889   431 tablet_replica.cc:333] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.137748   431 raft_consensus.cc:2243] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.138824   431 raft_consensus.cc:2272] T 752cedead4aa452ba24e59e59abfccfc P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.141712   431 tablet_replica.cc:333] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.142617   431 raft_consensus.cc:2243] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.143211   431 raft_consensus.cc:2272] T 00d0bc42f3174047b43f78e52fcfbd04 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.146062   431 tablet_replica.cc:333] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.146831   431 raft_consensus.cc:2243] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.147310   431 raft_consensus.cc:2272] T 8e878af3a78b443b8f7eb3a54f069a57 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.149572   431 tablet_replica.cc:333] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.150214   431 raft_consensus.cc:2243] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.151108   431 raft_consensus.cc:2272] T 3f858210936a4559a877f1628213432c P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.153323   431 tablet_replica.cc:333] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.153975   431 raft_consensus.cc:2243] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.154440   431 raft_consensus.cc:2272] T ceffadfaf404425f90705c5a6e0e60bc P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.157225   431 tablet_replica.cc:333] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.158093   431 raft_consensus.cc:2243] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.158617   431 raft_consensus.cc:2272] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.161507   431 tablet_replica.cc:333] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.162346   431 raft_consensus.cc:2243] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.162848   431 raft_consensus.cc:2272] T 73b95221ddfd49cca2e58073915a692a P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.165627   431 tablet_replica.cc:333] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.166386   431 raft_consensus.cc:2243] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.167040   431 raft_consensus.cc:2272] T 2e1663fd19784f6db7ea0fddb0fefb4c P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.169859   431 tablet_replica.cc:333] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.170737   431 raft_consensus.cc:2243] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.171173   431 raft_consensus.cc:2272] T 048c260ea0264cacbc43596c71ecb9d4 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.174350   431 tablet_replica.cc:333] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.174896   431 raft_consensus.cc:2243] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.175292   431 raft_consensus.cc:2272] T 6dfed6059cc642b290ce15a921704fc4 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.177841   431 tablet_replica.cc:333] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.178486   431 raft_consensus.cc:2243] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.178925   431 raft_consensus.cc:2272] T 0e2b7abebcdc4cbbac180a3762ad607b P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.181699   431 tablet_replica.cc:333] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.182261   431 raft_consensus.cc:2243] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.182677   431 raft_consensus.cc:2272] T 11c560f6bb9c4ebfa538d60759ae2739 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.185214   431 tablet_replica.cc:333] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.185892   431 raft_consensus.cc:2243] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.186312   431 raft_consensus.cc:2272] T f36b261dca1448a8976c337d0adca949 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.188651   431 tablet_replica.cc:333] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.189457   431 raft_consensus.cc:2243] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.190052   431 raft_consensus.cc:2272] T 03e983261153492e83602412c376fa6f P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.193320   431 tablet_replica.cc:333] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.194322   431 raft_consensus.cc:2243] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.194819   431 raft_consensus.cc:2272] T 4df3f52d3b03462987204a034f95a927 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.198796   431 tablet_replica.cc:333] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.199697   431 raft_consensus.cc:2243] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.200268   431 raft_consensus.cc:2272] T a0f0ca4181d94a888b1dd8f39485828c P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.203277   431 tablet_replica.cc:333] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.204072   431 raft_consensus.cc:2243] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.205178   431 raft_consensus.cc:2272] T 15a2118bc9914ddda2630ddb688ebaa9 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:35.205785  9877 consensus_peers.cc:597] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.208071   431 tablet_replica.cc:333] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.209026   431 raft_consensus.cc:2243] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.209679   431 raft_consensus.cc:2272] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:35.210835  9877 consensus_peers.cc:597] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.212479   431 tablet_replica.cc:333] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.213495   431 raft_consensus.cc:2243] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:03:35.213865  9877 consensus_peers.cc:597] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.214740   431 raft_consensus.cc:2272] T 492d90625d5e4006b85a116618e1ebdd P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.217510   431 tablet_replica.cc:333] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.218343   431 raft_consensus.cc:2243] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.218948   431 raft_consensus.cc:2272] T d7fb824343684771b7c7042727a90e40 P 837fad20523b4348b68f0a1e1af12404 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.222246   431 tablet_replica.cc:333] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.223130   431 raft_consensus.cc:2243] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.224511   431 raft_consensus.cc:2272] T 36e6a4d52c8045909369ffe63bfc03dc P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.228240   431 tablet_replica.cc:333] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.229444   431 raft_consensus.cc:2243] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.230106   431 raft_consensus.cc:2272] T 60ee1293277e45038d5f7e4289589ded P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.235491   431 tablet_replica.cc:333] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.236517   431 raft_consensus.cc:2243] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.237221   431 raft_consensus.cc:2272] T de10962da0124f0eb699ad981d76d6f4 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:35.237653  9803 consensus_peers.cc:597] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.240228   431 tablet_replica.cc:333] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.241308   431 raft_consensus.cc:2243] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.241837   431 raft_consensus.cc:2272] T df66a70431354160b6aa78186f21c43b P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.244799   431 tablet_replica.cc:333] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.245684   431 raft_consensus.cc:2243] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.246850   431 raft_consensus.cc:2272] T ffeb40161a4049b8a9b37f9cadfdc50f P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.249115   431 tablet_replica.cc:333] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.250404   431 raft_consensus.cc:2243] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.252066   431 raft_consensus.cc:2272] T 0396d5b67f85469b9963a11345ace667 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.255152   431 tablet_replica.cc:333] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.255978   431 raft_consensus.cc:2243] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.257006   431 raft_consensus.cc:2272] T 47136b305fde43d8b8b8af12cecd9750 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.259788   431 tablet_replica.cc:333] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.260571   431 raft_consensus.cc:2243] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.261672   431 raft_consensus.cc:2272] T 52ab365fb7404f4d88cf7333834d27c5 P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.263967   431 tablet_replica.cc:333] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.264827   431 raft_consensus.cc:2243] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.265655   431 raft_consensus.cc:2272] T 9d0495f84dcd455a878471b702e53cdd P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.268138   431 tablet_replica.cc:333] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.268882   431 raft_consensus.cc:2243] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.269758   431 raft_consensus.cc:2272] T dfad36487cbe42f3adf25a44fa2b1b62 P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:35.271826  9877 consensus_peers.cc:597] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.272934   431 tablet_replica.cc:333] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.273799   431 raft_consensus.cc:2243] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.274441   431 raft_consensus.cc:2272] T 1359e0d2d58948c199c04b275867bffd P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.277631   431 tablet_replica.cc:333] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.278530   431 raft_consensus.cc:2243] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.279255   431 raft_consensus.cc:2272] T b7422f3d4e364cb68af3b39f23fd94bf P 837fad20523b4348b68f0a1e1af12404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.283041   431 tablet_replica.cc:333] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.283746   431 raft_consensus.cc:2243] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.284746   431 raft_consensus.cc:2272] T 3e792dd7473944b79554c8d6ad554fab P 837fad20523b4348b68f0a1e1af12404 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.288105   431 tablet_replica.cc:333] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404: stopping tablet replica
I20260709 13:03:35.288784   431 raft_consensus.cc:2243] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.289342   431 raft_consensus.cc:2272] T 44eaceee580a4f8c8edd343f46ce1b32 P 837fad20523b4348b68f0a1e1af12404 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:35.294232  9877 consensus_peers.cc:597] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.323300  9877 consensus_peers.cc:597] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.325614  9803 consensus_peers.cc:597] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.359743  9877 consensus_peers.cc:597] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.373488  9877 connection.cc:573] client connection to 127.0.107.194:44623 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:03:35.374022  9877 consensus_peers.cc:597] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.416385   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:03:35.436834  9877 consensus_peers.cc:597] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:44623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.443696  9803 consensus_peers.cc:597] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:44623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.464082  9803 consensus_peers.cc:597] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:44623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.486969  9877 consensus_peers.cc:597] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Couldn't send request to peer 837fad20523b4348b68f0a1e1af12404. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:44623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.514505   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:03:35.542151  9879 consensus_peers.cc:597] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Couldn't send request to peer 451c871fd36f4d95a76b62d041aa7b60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.566782   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:35.567659   431 tablet_replica.cc:333] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.568665   431 raft_consensus.cc:2243] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.569703   431 raft_consensus.cc:2272] T d1d0271039c54d29bb678ff19e90a76a P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.572019   431 tablet_replica.cc:333] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.572659   431 raft_consensus.cc:2243] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.573424   431 raft_consensus.cc:2272] T ef635d06ca2448f098dadbba833fa52c P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.575366   431 tablet_replica.cc:333] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.576169   431 raft_consensus.cc:2243] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.576818   431 raft_consensus.cc:2272] T fa904b1a1a63492ca9d5820c1984c7e8 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.579795   431 tablet_replica.cc:333] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.580605   431 raft_consensus.cc:2243] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.581195   431 raft_consensus.cc:2272] T 2169bc2b2ef940d0a49aeb2d93d1db5a P 451c871fd36f4d95a76b62d041aa7b60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.583621   431 tablet_replica.cc:333] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.584192   431 raft_consensus.cc:2243] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.584712   431 raft_consensus.cc:2272] T f4213d5ed7d5428aa77410084c68a98b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.587116   431 tablet_replica.cc:333] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.587704   431 raft_consensus.cc:2243] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.588150   431 raft_consensus.cc:2272] T 55fdf0e57b3341a1a01a23f13df81770 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.590315   431 tablet_replica.cc:333] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.590904   431 raft_consensus.cc:2243] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.591349   431 raft_consensus.cc:2272] T 00d0bc42f3174047b43f78e52fcfbd04 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.593358   431 tablet_replica.cc:333] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.593948   431 raft_consensus.cc:2243] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.594748   431 raft_consensus.cc:2272] T 8e878af3a78b443b8f7eb3a54f069a57 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.596752   431 tablet_replica.cc:333] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.597400   431 raft_consensus.cc:2243] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.597929   431 raft_consensus.cc:2272] T 752cedead4aa452ba24e59e59abfccfc P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.600692   431 tablet_replica.cc:333] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.601442   431 raft_consensus.cc:2243] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.601899   431 raft_consensus.cc:2272] T e4079962b0054d1c828d8ab946214dfa P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.604416   431 tablet_replica.cc:333] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
W20260709 13:03:35.605067  9879 consensus_peers.cc:597] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Couldn't send request to peer 451c871fd36f4d95a76b62d041aa7b60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.605157   431 raft_consensus.cc:2243] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:35.605777  9879 consensus_peers.cc:597] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Couldn't send request to peer 451c871fd36f4d95a76b62d041aa7b60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.606328   431 raft_consensus.cc:2272] T bcb34d3df6d146e7b2406dafa071fd52 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.609373   431 tablet_replica.cc:333] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.610203   431 raft_consensus.cc:2243] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.611229   431 raft_consensus.cc:2272] T dd42823bee8f4722a5f2b15fc1a3dac5 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.614346   431 tablet_replica.cc:333] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.614931   431 raft_consensus.cc:2243] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.615782   431 raft_consensus.cc:2272] T 5b91b2a3a4a24086b9e05f782ee36615 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.618042   431 tablet_replica.cc:333] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.618654   431 raft_consensus.cc:2243] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.619433   431 raft_consensus.cc:2272] T 12b5370a6691486895274f9b937bbb1e P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.621595   431 tablet_replica.cc:333] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.622247   431 raft_consensus.cc:2243] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.622696   431 raft_consensus.cc:2272] T 0e2b7abebcdc4cbbac180a3762ad607b P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.624869   431 tablet_replica.cc:333] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.625479   431 raft_consensus.cc:2243] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.625912   431 raft_consensus.cc:2272] T f36b261dca1448a8976c337d0adca949 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.628101   431 tablet_replica.cc:333] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.628695   431 raft_consensus.cc:2243] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.629480   431 raft_consensus.cc:2272] T a0f0ca4181d94a888b1dd8f39485828c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.631520   431 tablet_replica.cc:333] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.632076   431 raft_consensus.cc:2243] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.632961   431 raft_consensus.cc:2272] T 165514a80df44205b5aee88c4509ba6e P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.639014   431 tablet_replica.cc:333] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.639834   431 raft_consensus.cc:2243] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.641062   431 raft_consensus.cc:2272] T 048c260ea0264cacbc43596c71ecb9d4 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.644316   431 tablet_replica.cc:333] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.645273   431 raft_consensus.cc:2243] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.646236   431 raft_consensus.cc:2272] T 2e1663fd19784f6db7ea0fddb0fefb4c P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.648977   431 tablet_replica.cc:333] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.649598   431 raft_consensus.cc:2243] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.650105   431 raft_consensus.cc:2272] T 6dfed6059cc642b290ce15a921704fc4 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.652730   431 tablet_replica.cc:333] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.653306   431 raft_consensus.cc:2243] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.654129   431 raft_consensus.cc:2272] T b64e505f3a594381a9e50a8030c33783 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.656410   431 tablet_replica.cc:333] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.657028   431 raft_consensus.cc:2243] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.657560   431 raft_consensus.cc:2272] T d7fb824343684771b7c7042727a90e40 P 451c871fd36f4d95a76b62d041aa7b60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.659433   431 tablet_replica.cc:333] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.659933   431 raft_consensus.cc:2243] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.660316   431 raft_consensus.cc:2272] T 36e6a4d52c8045909369ffe63bfc03dc P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.662533   431 tablet_replica.cc:333] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.663038   431 raft_consensus.cc:2243] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.663394   431 raft_consensus.cc:2272] T 60ee1293277e45038d5f7e4289589ded P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.665465   431 tablet_replica.cc:333] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.666008   431 raft_consensus.cc:2243] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.666424   431 raft_consensus.cc:2272] T 12ec003b8fb0423eae15b72ac88ce69f P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.668429   431 tablet_replica.cc:333] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.669085   431 raft_consensus.cc:2243] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.669554   431 raft_consensus.cc:2272] T 44eaceee580a4f8c8edd343f46ce1b32 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.671707   431 tablet_replica.cc:333] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.672410   431 raft_consensus.cc:2243] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.673218   431 raft_consensus.cc:2272] T 95ddf7a725a64a6e9c3c1ede3c67402d P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.676386   431 tablet_replica.cc:333] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.677021   431 raft_consensus.cc:2243] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.677500   431 raft_consensus.cc:2272] T df66a70431354160b6aa78186f21c43b P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.679603   431 tablet_replica.cc:333] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.681985   431 raft_consensus.cc:2243] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.682499   431 raft_consensus.cc:2272] T ffeb40161a4049b8a9b37f9cadfdc50f P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.686240   431 tablet_replica.cc:333] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.686821   431 raft_consensus.cc:2243] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.687270   431 raft_consensus.cc:2272] T 4d42567f00fd44cabc99c217e4df31d8 P 451c871fd36f4d95a76b62d041aa7b60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.689126   431 tablet_replica.cc:333] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.689621   431 raft_consensus.cc:2243] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.690007   431 raft_consensus.cc:2272] T e3b14229f08e4078b2e335de63179868 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.691816   431 tablet_replica.cc:333] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.692328   431 raft_consensus.cc:2243] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.692802   431 raft_consensus.cc:2272] T 9d0495f84dcd455a878471b702e53cdd P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.694936   431 tablet_replica.cc:333] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.695657   431 raft_consensus.cc:2243] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.696189   431 raft_consensus.cc:2272] T 0396d5b67f85469b9963a11345ace667 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.699187   431 tablet_replica.cc:333] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.699754   431 raft_consensus.cc:2243] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.700279   431 raft_consensus.cc:2272] T 47136b305fde43d8b8b8af12cecd9750 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.702419   431 tablet_replica.cc:333] T 52ab365fb7404f4d88cf7333834d27c5 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.703150   431 raft_consensus.cc:2243] T 52ab365fb7404f4d88cf7333834d27c5 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.703593   431 raft_consensus.cc:2272] T 52ab365fb7404f4d88cf7333834d27c5 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:35.706058  9879 consensus_peers.cc:597] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Couldn't send request to peer 451c871fd36f4d95a76b62d041aa7b60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.706188   431 tablet_replica.cc:333] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.706889   431 raft_consensus.cc:2243] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.707320   431 raft_consensus.cc:2272] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:35.708271  9879 consensus_peers.cc:597] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Couldn't send request to peer 451c871fd36f4d95a76b62d041aa7b60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.709448   431 tablet_replica.cc:333] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.710016   431 raft_consensus.cc:2243] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.710438   431 raft_consensus.cc:2272] T 492d90625d5e4006b85a116618e1ebdd P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.712482   431 tablet_replica.cc:333] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.713056   431 raft_consensus.cc:2243] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.713822   431 raft_consensus.cc:2272] T 26c146a1db6843fc81be490f926d3137 P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.716866   431 tablet_replica.cc:333] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.717459   431 raft_consensus.cc:2243] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.718006   431 raft_consensus.cc:2272] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.721098   431 tablet_replica.cc:333] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.723802   431 raft_consensus.cc:2243] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.724412   431 raft_consensus.cc:2272] T ceffadfaf404425f90705c5a6e0e60bc P 451c871fd36f4d95a76b62d041aa7b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.727371   431 tablet_replica.cc:333] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.728037   431 raft_consensus.cc:2243] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.728117 10880 raft_consensus.cc:493] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:35.728767 10880 raft_consensus.cc:515] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:35.732702   431 raft_consensus.cc:2272] T 1359e0d2d58948c199c04b275867bffd P 451c871fd36f4d95a76b62d041aa7b60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.733704 10880 leader_election.cc:290] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:35.735571 10880 raft_consensus.cc:493] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:35.736362 10880 raft_consensus.cc:515] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:35.739001   431 tablet_replica.cc:333] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.739231 10880 leader_election.cc:290] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:35.740285   431 raft_consensus.cc:2243] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.740999   431 raft_consensus.cc:2272] T b7422f3d4e364cb68af3b39f23fd94bf P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:35.741786  9879 leader_election.cc:336] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:35.742874  9877 leader_election.cc:336] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Network error: Client connection negotiation failed: client connection to 127.0.107.194:44623: connect: Connection refused (error 111)
I20260709 13:03:35.743310  9877 leader_election.cc:304] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:35.744513   431 tablet_replica.cc:333] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60: stopping tablet replica
I20260709 13:03:35.745050 10830 raft_consensus.cc:2749] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:35.745373   431 raft_consensus.cc:2243] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.746153   431 raft_consensus.cc:2272] T dd27b85a4d824953b7b73f36aff6acc9 P 451c871fd36f4d95a76b62d041aa7b60 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:35.746290  9879 leader_election.cc:336] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:35.748529  9877 leader_election.cc:336] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Network error: Client connection negotiation failed: client connection to 127.0.107.194:44623: connect: Connection refused (error 111)
I20260709 13:03:35.749028  9877 leader_election.cc:304] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:35.750180 10830 raft_consensus.cc:2749] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:35.753141  9879 consensus_peers.cc:597] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Couldn't send request to peer 451c871fd36f4d95a76b62d041aa7b60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.764240  9879 consensus_peers.cc:597] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Couldn't send request to peer 451c871fd36f4d95a76b62d041aa7b60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.785298  9879 consensus_peers.cc:597] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Couldn't send request to peer 451c871fd36f4d95a76b62d041aa7b60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.802801  9879 consensus_peers.cc:597] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Couldn't send request to peer 451c871fd36f4d95a76b62d041aa7b60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.828979  9879 consensus_peers.cc:597] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Couldn't send request to peer 451c871fd36f4d95a76b62d041aa7b60. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:35769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.836966   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:35.860440 10880 raft_consensus.cc:493] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:35.861258 10880 raft_consensus.cc:515] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:35.870163 10880 leader_election.cc:290] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
W20260709 13:03:35.872550  9877 leader_election.cc:336] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Network error: Client connection negotiation failed: client connection to 127.0.107.194:44623: connect: Connection refused (error 111)
W20260709 13:03:35.876407  9879 leader_election.cc:336] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
I20260709 13:03:35.877010  9879 leader_election.cc:304] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:35.877802 10880 raft_consensus.cc:2749] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:35.924692   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:03:35.965783   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:03:35.966336  9879 consensus_peers.cc:597] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 -> Peer 451c871fd36f4d95a76b62d041aa7b60 (127.0.107.195:35769): Couldn't send request to peer 451c871fd36f4d95a76b62d041aa7b60. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:35769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.966805   431 tablet_replica.cc:333] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:35.967921   431 raft_consensus.cc:2243] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.968658   431 raft_consensus.cc:2272] T d1d0271039c54d29bb678ff19e90a76a P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.970734   431 tablet_replica.cc:333] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:35.971289   431 raft_consensus.cc:2243] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.971704   431 raft_consensus.cc:2272] T 38dadd5ead404b82a843d64283e7f2a1 P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.973999   431 tablet_replica.cc:333] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:35.974575   431 raft_consensus.cc:2243] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.974969   431 raft_consensus.cc:2272] T 839d06ab83a14f179212ace3780771f2 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.977499   431 tablet_replica.cc:333] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:35.978250   431 raft_consensus.cc:2243] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.978714   431 raft_consensus.cc:2272] T e17ab55de9cb48ea8add7a3b93294673 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.980981   431 tablet_replica.cc:333] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:35.981612   431 raft_consensus.cc:2243] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.982424   431 raft_consensus.cc:2272] T e8d49a0a0c7c4fc4bd734945246961cc P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.984529   431 tablet_replica.cc:333] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:35.985109   431 raft_consensus.cc:2243] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:35.986016   431 raft_consensus.cc:2272] T f4213d5ed7d5428aa77410084c68a98b P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.987979   431 tablet_replica.cc:333] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:35.988833   431 raft_consensus.cc:2243] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.989348   431 raft_consensus.cc:2272] T 76a88ee2ae1f4e17826b23090e31bf02 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.991336   431 tablet_replica.cc:333] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:35.991927   431 raft_consensus.cc:2243] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.992408   431 raft_consensus.cc:2272] T bcb34d3df6d146e7b2406dafa071fd52 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.994571   431 tablet_replica.cc:333] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:35.995164   431 raft_consensus.cc:2243] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.995618   431 raft_consensus.cc:2272] T 5b91b2a3a4a24086b9e05f782ee36615 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:35.997677   431 tablet_replica.cc:333] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:35.998224   431 raft_consensus.cc:2243] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:35.998605   431 raft_consensus.cc:2272] T dd42823bee8f4722a5f2b15fc1a3dac5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.000435   431 tablet_replica.cc:333] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.001070   431 raft_consensus.cc:2243] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.001545   431 raft_consensus.cc:2272] T 12b5370a6691486895274f9b937bbb1e P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.003480   431 tablet_replica.cc:333] T 752cedead4aa452ba24e59e59abfccfc P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.004251   431 raft_consensus.cc:2243] T 752cedead4aa452ba24e59e59abfccfc P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.004796   431 raft_consensus.cc:2272] T 752cedead4aa452ba24e59e59abfccfc P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.005033 10880 raft_consensus.cc:493] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2bb23251eccc42b1ba4e8c3f8d97ea83)
I20260709 13:03:36.005733 10880 raft_consensus.cc:515] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8557220d7e6a4ccbbef222e80a5584a5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 36227 } } peers { permanent_uuid: "2bb23251eccc42b1ba4e8c3f8d97ea83" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 32917 } } peers { permanent_uuid: "837fad20523b4348b68f0a1e1af12404" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44623 } }
I20260709 13:03:36.007261   431 tablet_replica.cc:333] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.007982   431 raft_consensus.cc:2243] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:36.008137 10880 leader_election.cc:290] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917), 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623)
I20260709 13:03:36.009665   431 raft_consensus.cc:2272] T 00d0bc42f3174047b43f78e52fcfbd04 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.012705   431 tablet_replica.cc:333] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
W20260709 13:03:36.012562  9879 leader_election.cc:336] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2bb23251eccc42b1ba4e8c3f8d97ea83 (127.0.107.193:32917): Network error: Client connection negotiation failed: client connection to 127.0.107.193:32917: connect: Connection refused (error 111)
W20260709 13:03:36.013515  9877 leader_election.cc:336] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 837fad20523b4348b68f0a1e1af12404 (127.0.107.194:44623): Network error: Client connection negotiation failed: client connection to 127.0.107.194:44623: connect: Connection refused (error 111)
I20260709 13:03:36.013820   431 raft_consensus.cc:2243] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.013947  9877 leader_election.cc:304] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8557220d7e6a4ccbbef222e80a5584a5; no voters: 2bb23251eccc42b1ba4e8c3f8d97ea83, 837fad20523b4348b68f0a1e1af12404
I20260709 13:03:36.014544   431 raft_consensus.cc:2272] T 8e878af3a78b443b8f7eb3a54f069a57 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.014964 10880 raft_consensus.cc:2749] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:36.016920   431 tablet_replica.cc:333] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.017618   431 raft_consensus.cc:2243] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.018075   431 raft_consensus.cc:2272] T 3f858210936a4559a877f1628213432c P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.020138   431 tablet_replica.cc:333] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.020813   431 raft_consensus.cc:2243] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:36.021725   431 raft_consensus.cc:2272] T 3fbf0dc7bcfe41e58f7c298165f4d2b5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.023965   431 tablet_replica.cc:333] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.024691   431 raft_consensus.cc:2243] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.025175   431 raft_consensus.cc:2272] T 4df3f52d3b03462987204a034f95a927 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.027199   431 tablet_replica.cc:333] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.027837   431 raft_consensus.cc:2243] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.028306   431 raft_consensus.cc:2272] T 15a2118bc9914ddda2630ddb688ebaa9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.030216   431 tablet_replica.cc:333] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.030781   431 raft_consensus.cc:2243] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.031215   431 raft_consensus.cc:2272] T 165514a80df44205b5aee88c4509ba6e P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.033079   431 tablet_replica.cc:333] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.033674   431 raft_consensus.cc:2243] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.034107   431 raft_consensus.cc:2272] T 11c560f6bb9c4ebfa538d60759ae2739 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.037637   431 tablet_replica.cc:333] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.038225   431 raft_consensus.cc:2243] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:36.039038   431 raft_consensus.cc:2272] T f36b261dca1448a8976c337d0adca949 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.041096   431 tablet_replica.cc:333] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.041635   431 raft_consensus.cc:2243] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.042007   431 raft_consensus.cc:2272] T 4d42567f00fd44cabc99c217e4df31d8 P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.043767   431 tablet_replica.cc:333] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.044286   431 raft_consensus.cc:2243] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.044735   431 raft_consensus.cc:2272] T e53ce2e48bf64a4cac0e42aed1e3ac61 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.047175   431 tablet_replica.cc:333] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.047978   431 raft_consensus.cc:2243] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:36.048913   431 raft_consensus.cc:2272] T 73b95221ddfd49cca2e58073915a692a P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.051728   431 tablet_replica.cc:333] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.052351   431 raft_consensus.cc:2243] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.052853   431 raft_consensus.cc:2272] T 36e6a4d52c8045909369ffe63bfc03dc P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.055570   431 tablet_replica.cc:333] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.056125   431 raft_consensus.cc:2243] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:36.057022   431 raft_consensus.cc:2272] T 60ee1293277e45038d5f7e4289589ded P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.059423   431 tablet_replica.cc:333] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.060025   431 raft_consensus.cc:2243] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.060444   431 raft_consensus.cc:2272] T 048c260ea0264cacbc43596c71ecb9d4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.062309   431 tablet_replica.cc:333] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.062985   431 raft_consensus.cc:2243] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.063462   431 raft_consensus.cc:2272] T ef635d06ca2448f098dadbba833fa52c P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.066018   431 tablet_replica.cc:333] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.066605   431 raft_consensus.cc:2243] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:36.067656   431 raft_consensus.cc:2272] T 03e983261153492e83602412c376fa6f P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.069693   431 tablet_replica.cc:333] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.070230   431 raft_consensus.cc:2243] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:36.071018   431 raft_consensus.cc:2272] T e3b14229f08e4078b2e335de63179868 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.073323   431 tablet_replica.cc:333] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.073904   431 raft_consensus.cc:2243] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.074352   431 raft_consensus.cc:2272] T b64e505f3a594381a9e50a8030c33783 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.076191   431 tablet_replica.cc:333] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.076795   431 raft_consensus.cc:2243] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:36.077615   431 raft_consensus.cc:2272] T 12ec003b8fb0423eae15b72ac88ce69f P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.079537   431 tablet_replica.cc:333] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.080065   431 raft_consensus.cc:2243] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:36.080909   431 raft_consensus.cc:2272] T de10962da0124f0eb699ad981d76d6f4 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.083003   431 tablet_replica.cc:333] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.083549   431 raft_consensus.cc:2243] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.083968   431 raft_consensus.cc:2272] T 95ddf7a725a64a6e9c3c1ede3c67402d P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.085992   431 tablet_replica.cc:333] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.086513   431 raft_consensus.cc:2243] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.086931   431 raft_consensus.cc:2272] T 9d0495f84dcd455a878471b702e53cdd P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.088768   431 tablet_replica.cc:333] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.089284   431 raft_consensus.cc:2243] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.089689   431 raft_consensus.cc:2272] T 0396d5b67f85469b9963a11345ace667 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.091571   431 tablet_replica.cc:333] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.092073   431 raft_consensus.cc:2243] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.092487   431 raft_consensus.cc:2272] T 52ab365fb7404f4d88cf7333834d27c5 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.094359   431 tablet_replica.cc:333] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.094880   431 raft_consensus.cc:2243] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.095407   431 raft_consensus.cc:2272] T 26c146a1db6843fc81be490f926d3137 P 8557220d7e6a4ccbbef222e80a5584a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.097361   431 tablet_replica.cc:333] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.097898   431 raft_consensus.cc:2243] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:36.098958   431 raft_consensus.cc:2272] T 62f57279c5dc4c9a8a1d2c4a65a1c167 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.101410   431 tablet_replica.cc:333] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.102056   431 raft_consensus.cc:2243] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.102471   431 raft_consensus.cc:2272] T dfad36487cbe42f3adf25a44fa2b1b62 P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.104897   431 tablet_replica.cc:333] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.105387   431 raft_consensus.cc:2243] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:36.106526   431 raft_consensus.cc:2272] T df66a70431354160b6aa78186f21c43b P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.108525   431 tablet_replica.cc:333] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.109112   431 raft_consensus.cc:2243] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:36.109877   431 raft_consensus.cc:2272] T b7422f3d4e364cb68af3b39f23fd94bf P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.111850   431 tablet_replica.cc:333] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.112346   431 raft_consensus.cc:2243] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:36.112869   431 raft_consensus.cc:2272] T 3e792dd7473944b79554c8d6ad554fab P 8557220d7e6a4ccbbef222e80a5584a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.114795   431 tablet_replica.cc:333] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5: stopping tablet replica
I20260709 13:03:36.115265   431 raft_consensus.cc:2243] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:36.116003   431 raft_consensus.cc:2272] T dd27b85a4d824953b7b73f36aff6acc9 P 8557220d7e6a4ccbbef222e80a5584a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.194031   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:03:36.282706   431 master.cc:562] Master@127.0.107.254:33941 shutting down...
I20260709 13:03:36.311965   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:36.312490   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:36.312863   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 47b2f201f08043c7937fe627602622bd: stopping tablet replica
I20260709 13:03:36.334879   431 master.cc:584] Master@127.0.107.254:33941 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32339 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:03:36.433561   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:46721
I20260709 13:03:36.434676   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:36.441720 10890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:36.442061 10891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:36.443699 10893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:36.445600   431 server_base.cc:1061] running on GCE node
I20260709 13:03:36.446815   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:36.447043   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:36.447172   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602216447150 us; error 0 us; skew 500 ppm
I20260709 13:03:36.447685   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:36.450806   431 webserver.cc:533] Webserver started at http://127.0.107.254:33291/ using document root <none> and password file <none>
I20260709 13:03:36.451349   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:36.451519   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:36.451745   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:36.452929   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/master-0-root/instance:
uuid: "9d3cd824f61a43a0ab6d7acaf4c45853"
format_stamp: "Formatted at 2026-07-09 13:03:36 on dist-test-slave-c08m"
I20260709 13:03:36.457857   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:36.461850 10898 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:36.462754   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:03:36.463063   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/master-0-root
uuid: "9d3cd824f61a43a0ab6d7acaf4c45853"
format_stamp: "Formatted at 2026-07-09 13:03:36 on dist-test-slave-c08m"
I20260709 13:03:36.463361   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:36.481824   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:36.483078   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:36.531036   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:46721
I20260709 13:03:36.531147 10949 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:46721 every 8 connection(s)
I20260709 13:03:36.535812 10950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:36.549170 10950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853: Bootstrap starting.
I20260709 13:03:36.554327 10950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:36.558949 10950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853: No bootstrap required, opened a new log
I20260709 13:03:36.561223 10950 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d3cd824f61a43a0ab6d7acaf4c45853" member_type: VOTER }
I20260709 13:03:36.561631 10950 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:36.561861 10950 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d3cd824f61a43a0ab6d7acaf4c45853, State: Initialized, Role: FOLLOWER
I20260709 13:03:36.562544 10950 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d3cd824f61a43a0ab6d7acaf4c45853" member_type: VOTER }
I20260709 13:03:36.562999 10950 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:36.563227 10950 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:36.563501 10950 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:36.568501 10950 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d3cd824f61a43a0ab6d7acaf4c45853" member_type: VOTER }
I20260709 13:03:36.569028 10950 leader_election.cc:304] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d3cd824f61a43a0ab6d7acaf4c45853; no voters: 
I20260709 13:03:36.570165 10950 leader_election.cc:290] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:36.570642 10953 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:36.572154 10953 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [term 1 LEADER]: Becoming Leader. State: Replica: 9d3cd824f61a43a0ab6d7acaf4c45853, State: Running, Role: LEADER
I20260709 13:03:36.572882 10953 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d3cd824f61a43a0ab6d7acaf4c45853" member_type: VOTER }
I20260709 13:03:36.573148 10950 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:36.578176 10955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d3cd824f61a43a0ab6d7acaf4c45853. Latest consensus state: current_term: 1 leader_uuid: "9d3cd824f61a43a0ab6d7acaf4c45853" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d3cd824f61a43a0ab6d7acaf4c45853" member_type: VOTER } }
I20260709 13:03:36.578301 10954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d3cd824f61a43a0ab6d7acaf4c45853" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d3cd824f61a43a0ab6d7acaf4c45853" member_type: VOTER } }
I20260709 13:03:36.579455 10955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:36.579483 10954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:36.587334 10961 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:36.592942 10961 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:36.594087   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:36.601688 10961 catalog_manager.cc:1383] Generated new cluster ID: 3fc15c8d317745c2a9f2e7a99793c9e7
I20260709 13:03:36.602005 10961 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:36.628096 10961 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:36.629434 10961 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:36.644953 10961 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853: Generated new TSK 0
I20260709 13:03:36.645593 10961 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:36.660961   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:36.667695 10971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:36.668946 10972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:36.670953 10974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:36.671784   431 server_base.cc:1061] running on GCE node
I20260709 13:03:36.672897   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:36.673079   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:36.673393   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602216673324 us; error 0 us; skew 500 ppm
I20260709 13:03:36.674117   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:36.676822   431 webserver.cc:533] Webserver started at http://127.0.107.193:34963/ using document root <none> and password file <none>
I20260709 13:03:36.677330   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:36.677554   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:36.678285   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:36.679559   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-0-root/instance:
uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
format_stamp: "Formatted at 2026-07-09 13:03:36 on dist-test-slave-c08m"
I20260709 13:03:36.685133   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:03:36.689711 10979 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:36.691182   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.003s
I20260709 13:03:36.691567   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-0-root
uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
format_stamp: "Formatted at 2026-07-09 13:03:36 on dist-test-slave-c08m"
I20260709 13:03:36.691975   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:36.709571   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:36.711149   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:36.712867   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:36.716154   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:36.716468   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:36.716745   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:36.716887   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:36.771020   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:36415
I20260709 13:03:36.771091 11041 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:36415 every 8 connection(s)
I20260709 13:03:36.778523   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:36.787712 11046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:36.789716 11047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:36.792843 11049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:36.793047   431 server_base.cc:1061] running on GCE node
I20260709 13:03:36.794993   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:36.795279   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:36.795701   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602216795468 us; error 0 us; skew 500 ppm
I20260709 13:03:36.796310   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:36.799607   431 webserver.cc:533] Webserver started at http://127.0.107.194:37407/ using document root <none> and password file <none>
I20260709 13:03:36.800071 11042 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46721
I20260709 13:03:36.800132   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:36.800552   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:36.800652 11042 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:36.800940   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:36.801556 11042 heartbeater.cc:507] Master 127.0.107.254:46721 requested a full tablet report, sending...
I20260709 13:03:36.802232   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-1-root/instance:
uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
format_stamp: "Formatted at 2026-07-09 13:03:36 on dist-test-slave-c08m"
I20260709 13:03:36.804086 10915 ts_manager.cc:194] Registered new tserver with Master: 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415)
I20260709 13:03:36.806931 10915 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42498
I20260709 13:03:36.809096   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:03:36.813025 11054 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:36.813944   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:03:36.814277   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-1-root
uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
format_stamp: "Formatted at 2026-07-09 13:03:36 on dist-test-slave-c08m"
I20260709 13:03:36.814571   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:36.836750   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:36.838032   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:36.839584   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:36.842039   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:36.842280   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:36.842536   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:36.842718   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:36.885293   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39931
I20260709 13:03:36.885553 11116 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39931 every 8 connection(s)
I20260709 13:03:36.890681   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:36.899736 11120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:36.901057 11121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:36.904089 11123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:36.904939 11117 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46721
I20260709 13:03:36.905092   431 server_base.cc:1061] running on GCE node
I20260709 13:03:36.905527 11117 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:36.906322   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:03:36.906484 11117 heartbeater.cc:507] Master 127.0.107.254:46721 requested a full tablet report, sending...
W20260709 13:03:36.906663   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:36.907083   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602216907056 us; error 0 us; skew 500 ppm
I20260709 13:03:36.907688   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:36.908910 10915 ts_manager.cc:194] Registered new tserver with Master: ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:36.910492 10915 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42510
I20260709 13:03:36.911080   431 webserver.cc:533] Webserver started at http://127.0.107.195:36701/ using document root <none> and password file <none>
I20260709 13:03:36.911681   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:36.911937   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:36.912235   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:36.913887   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-2-root/instance:
uuid: "c915415c45b84f77af0116dd589ca3eb"
format_stamp: "Formatted at 2026-07-09 13:03:36 on dist-test-slave-c08m"
I20260709 13:03:36.918955   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:03:36.923411 11128 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:36.925089   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:03:36.925696   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-2-root
uuid: "c915415c45b84f77af0116dd589ca3eb"
format_stamp: "Formatted at 2026-07-09 13:03:36 on dist-test-slave-c08m"
I20260709 13:03:36.926043   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:36.945640   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:36.947057   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:36.948640   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:36.951152   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:36.951422   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:36.951674   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:36.951857   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:37.002996   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:36571
I20260709 13:03:37.003111 11190 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:36571 every 8 connection(s)
I20260709 13:03:37.018778 11191 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46721
I20260709 13:03:37.019279 11191 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:37.020071 11191 heartbeater.cc:507] Master 127.0.107.254:46721 requested a full tablet report, sending...
I20260709 13:03:37.022435 10915 ts_manager.cc:194] Registered new tserver with Master: c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:37.022964   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016272881s
I20260709 13:03:37.024173 10915 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42524
I20260709 13:03:37.050849 10915 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42540:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:37.053951 10915 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:37.134796 11156 tablet_service.cc:1511] Processing CreateTablet for tablet 8854e9ac34a342109991a82cf9fccea2 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:37.136433 11156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8854e9ac34a342109991a82cf9fccea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.140444 11155 tablet_service.cc:1511] Processing CreateTablet for tablet e3b8940dfe37411ebfe5bc8561f99043 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:37.142239 11155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b8940dfe37411ebfe5bc8561f99043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.149797 11082 tablet_service.cc:1511] Processing CreateTablet for tablet 8854e9ac34a342109991a82cf9fccea2 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:37.150326 11081 tablet_service.cc:1511] Processing CreateTablet for tablet e3b8940dfe37411ebfe5bc8561f99043 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:37.151333 11082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8854e9ac34a342109991a82cf9fccea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.152082 11081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b8940dfe37411ebfe5bc8561f99043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.159438 11007 tablet_service.cc:1511] Processing CreateTablet for tablet 8854e9ac34a342109991a82cf9fccea2 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:37.161464 11007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8854e9ac34a342109991a82cf9fccea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.161923 11005 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef5d307c2824d0f9701fd04d02d9f25 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:37.164255 11005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef5d307c2824d0f9701fd04d02d9f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.166692 11006 tablet_service.cc:1511] Processing CreateTablet for tablet e3b8940dfe37411ebfe5bc8561f99043 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:37.168805 11006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b8940dfe37411ebfe5bc8561f99043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.171341 11080 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef5d307c2824d0f9701fd04d02d9f25 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:37.172946 11080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef5d307c2824d0f9701fd04d02d9f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.178385 11154 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef5d307c2824d0f9701fd04d02d9f25 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:37.182631 11004 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebcedc4294d44909dab672ad2f13cda (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:37.184804 11154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef5d307c2824d0f9701fd04d02d9f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.186827 11079 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebcedc4294d44909dab672ad2f13cda (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:37.198853 11079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebcedc4294d44909dab672ad2f13cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.199010 11003 tablet_service.cc:1511] Processing CreateTablet for tablet 74f85914203c419293a1652cda6c1ca0 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:37.193486 11155 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebcedc4294d44909dab672ad2f13cda (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:37.202941 11155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebcedc4294d44909dab672ad2f13cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.202479 11078 tablet_service.cc:1511] Processing CreateTablet for tablet 74f85914203c419293a1652cda6c1ca0 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:37.207468 11153 tablet_service.cc:1511] Processing CreateTablet for tablet 74f85914203c419293a1652cda6c1ca0 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:37.209419 11153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f85914203c419293a1652cda6c1ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.210058 11078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f85914203c419293a1652cda6c1ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.216005 11002 tablet_service.cc:1511] Processing CreateTablet for tablet 3e92fa6252ad448dac0dc99b21309964 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:37.217893 11003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f85914203c419293a1652cda6c1ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.221299 11002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e92fa6252ad448dac0dc99b21309964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.225183 11004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebcedc4294d44909dab672ad2f13cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.229419 11077 tablet_service.cc:1511] Processing CreateTablet for tablet 3e92fa6252ad448dac0dc99b21309964 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:37.230937 11077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e92fa6252ad448dac0dc99b21309964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.231377 11152 tablet_service.cc:1511] Processing CreateTablet for tablet 3e92fa6252ad448dac0dc99b21309964 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:37.233027 11152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e92fa6252ad448dac0dc99b21309964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.239761 11001 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4031e6b89346bda4c8aa52342e7028 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:37.241942 11001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4031e6b89346bda4c8aa52342e7028. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.284701 11077 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4031e6b89346bda4c8aa52342e7028 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:37.286322 11077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4031e6b89346bda4c8aa52342e7028. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.305667 11156 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4031e6b89346bda4c8aa52342e7028 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:37.307502 11156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4031e6b89346bda4c8aa52342e7028. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.319660 11206 tablet_bootstrap.cc:492] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb: Bootstrap starting.
I20260709 13:03:37.327310 11000 tablet_service.cc:1511] Processing CreateTablet for tablet ca7814861a6547799f3685cb896d4ea6 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:37.328979 11000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca7814861a6547799f3685cb896d4ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.337950 11207 tablet_bootstrap.cc:492] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87: Bootstrap starting.
I20260709 13:03:37.338358 11081 tablet_service.cc:1511] Processing CreateTablet for tablet ca7814861a6547799f3685cb896d4ea6 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:37.340050 11081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca7814861a6547799f3685cb896d4ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.339886 11152 tablet_service.cc:1511] Processing CreateTablet for tablet ca7814861a6547799f3685cb896d4ea6 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:37.341410 11152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca7814861a6547799f3685cb896d4ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.347420 11206 tablet_bootstrap.cc:654] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.349376 11080 tablet_service.cc:1511] Processing CreateTablet for tablet 98cb40c0103f4be4b3c70690b6c73403 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:37.350803 11080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cb40c0103f4be4b3c70690b6c73403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.348062 11005 tablet_service.cc:1511] Processing CreateTablet for tablet 98cb40c0103f4be4b3c70690b6c73403 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:37.356528 11005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cb40c0103f4be4b3c70690b6c73403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.356812 11208 tablet_bootstrap.cc:492] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:37.357028 11153 tablet_service.cc:1511] Processing CreateTablet for tablet 98cb40c0103f4be4b3c70690b6c73403 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:37.358664 11153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cb40c0103f4be4b3c70690b6c73403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.368822 11207 tablet_bootstrap.cc:654] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.369937 11007 tablet_service.cc:1511] Processing CreateTablet for tablet 5040dbf98d7646a48eaa60571252ab45 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:37.371563 11007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5040dbf98d7646a48eaa60571252ab45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.388002 11078 tablet_service.cc:1511] Processing CreateTablet for tablet 5040dbf98d7646a48eaa60571252ab45 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:37.389473 11078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5040dbf98d7646a48eaa60571252ab45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.389382 11155 tablet_service.cc:1511] Processing CreateTablet for tablet 5040dbf98d7646a48eaa60571252ab45 (DEFAULT_TABLE table=test-workload [id=c4528b30bb184fd2ad3eb8832dfff159]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:37.398214 11155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5040dbf98d7646a48eaa60571252ab45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.401547 11206 tablet_bootstrap.cc:492] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb: No bootstrap required, opened a new log
I20260709 13:03:37.402416 11206 ts_tablet_manager.cc:1403] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.007s
I20260709 13:03:37.398269 11208 tablet_bootstrap.cc:654] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.430168 11207 tablet_bootstrap.cc:492] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87: No bootstrap required, opened a new log
I20260709 13:03:37.430833 11207 ts_tablet_manager.cc:1403] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.009s
I20260709 13:03:37.433432 11207 raft_consensus.cc:359] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.433993 11207 raft_consensus.cc:385] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.434289 11207 raft_consensus.cc:740] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.435228 11207 consensus_queue.cc:260] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.422080 11206 raft_consensus.cc:359] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } } peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } }
I20260709 13:03:37.436627 11206 raft_consensus.cc:385] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.437088 11206 raft_consensus.cc:740] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.438103 11206 consensus_queue.cc:260] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } } peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } }
I20260709 13:03:37.443235 11191 heartbeater.cc:499] Master 127.0.107.254:46721 was elected leader, sending a full tablet report...
I20260709 13:03:37.443475 11208 tablet_bootstrap.cc:492] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414: No bootstrap required, opened a new log
I20260709 13:03:37.444525 11207 ts_tablet_manager.cc:1434] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.001s
I20260709 13:03:37.445515 11117 heartbeater.cc:499] Master 127.0.107.254:46721 was elected leader, sending a full tablet report...
I20260709 13:03:37.449913 11208 ts_tablet_manager.cc:1403] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.094s	user 0.010s	sys 0.006s
I20260709 13:03:37.450093 11207 tablet_bootstrap.cc:492] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87: Bootstrap starting.
I20260709 13:03:37.453603 11208 raft_consensus.cc:359] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.454640 11208 raft_consensus.cc:385] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.454995 11208 raft_consensus.cc:740] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.454126 11206 ts_tablet_manager.cc:1434] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.004s
I20260709 13:03:37.458074 11206 tablet_bootstrap.cc:492] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb: Bootstrap starting.
I20260709 13:03:37.458443 11207 tablet_bootstrap.cc:654] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.455948 11208 consensus_queue.cc:260] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.465675 11206 tablet_bootstrap.cc:654] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.470642 11208 ts_tablet_manager.cc:1434] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.009s
I20260709 13:03:37.472322 11042 heartbeater.cc:499] Master 127.0.107.254:46721 was elected leader, sending a full tablet report...
I20260709 13:03:37.475459 11206 tablet_bootstrap.cc:492] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb: No bootstrap required, opened a new log
I20260709 13:03:37.476063 11206 ts_tablet_manager.cc:1403] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:03:37.476408 11207 tablet_bootstrap.cc:492] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87: No bootstrap required, opened a new log
I20260709 13:03:37.477145 11207 ts_tablet_manager.cc:1403] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260709 13:03:37.478034 11208 tablet_bootstrap.cc:492] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:37.479493 11206 raft_consensus.cc:359] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.480374 11206 raft_consensus.cc:385] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.480901 11206 raft_consensus.cc:740] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.480341 11207 raft_consensus.cc:359] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.481626 11207 raft_consensus.cc:385] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.482048 11207 raft_consensus.cc:740] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.481913 11206 consensus_queue.cc:260] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.483223 11207 consensus_queue.cc:260] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.485555 11206 ts_tablet_manager.cc:1434] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:03:37.485766 11207 ts_tablet_manager.cc:1434] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:37.486117 11208 tablet_bootstrap.cc:654] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.486727 11206 tablet_bootstrap.cc:492] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb: Bootstrap starting.
I20260709 13:03:37.487118 11207 tablet_bootstrap.cc:492] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87: Bootstrap starting.
I20260709 13:03:37.494403 11206 tablet_bootstrap.cc:654] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.498333 11207 tablet_bootstrap.cc:654] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.501206 11208 tablet_bootstrap.cc:492] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414: No bootstrap required, opened a new log
I20260709 13:03:37.501398 11206 tablet_bootstrap.cc:492] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb: No bootstrap required, opened a new log
I20260709 13:03:37.501842 11208 ts_tablet_manager.cc:1403] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:03:37.502112 11206 ts_tablet_manager.cc:1403] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.008s
I20260709 13:03:37.505602 11208 raft_consensus.cc:359] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.506417 11208 raft_consensus.cc:385] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.506743 11208 raft_consensus.cc:740] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.506525 11206 raft_consensus.cc:359] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
W20260709 13:03:37.507905 11192 tablet.cc:2406] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:37.507905 11206 raft_consensus.cc:385] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.509297 11206 raft_consensus.cc:740] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.510066 11208 consensus_queue.cc:260] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.510174 11206 consensus_queue.cc:260] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.512645 11206 ts_tablet_manager.cc:1434] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:03:37.513046 11208 ts_tablet_manager.cc:1434] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:03:37.514173 11206 tablet_bootstrap.cc:492] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb: Bootstrap starting.
I20260709 13:03:37.514222 11208 tablet_bootstrap.cc:492] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:37.517961 11207 tablet_bootstrap.cc:492] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87: No bootstrap required, opened a new log
I20260709 13:03:37.518587 11207 ts_tablet_manager.cc:1403] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.010s
I20260709 13:03:37.521828 11207 raft_consensus.cc:359] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.522449 11206 tablet_bootstrap.cc:654] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.522637 11207 raft_consensus.cc:385] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.523023 11207 raft_consensus.cc:740] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.523415 11208 tablet_bootstrap.cc:654] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.524001 11207 consensus_queue.cc:260] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.531194 11207 ts_tablet_manager.cc:1434] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:03:37.532779 11207 tablet_bootstrap.cc:492] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87: Bootstrap starting.
I20260709 13:03:37.542742 11207 tablet_bootstrap.cc:654] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.544332 11206 tablet_bootstrap.cc:492] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb: No bootstrap required, opened a new log
I20260709 13:03:37.544975 11206 ts_tablet_manager.cc:1403] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.011s
I20260709 13:03:37.548995 11206 raft_consensus.cc:359] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.550086 11206 raft_consensus.cc:385] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.550486 11206 raft_consensus.cc:740] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.551743 11206 consensus_queue.cc:260] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.559322 11206 ts_tablet_manager.cc:1434] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:03:37.561053 11206 tablet_bootstrap.cc:492] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb: Bootstrap starting.
I20260709 13:03:37.571707 11206 tablet_bootstrap.cc:654] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:37.586213 10963 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:37.590797 11208 tablet_bootstrap.cc:492] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414: No bootstrap required, opened a new log
I20260709 13:03:37.590982 11207 tablet_bootstrap.cc:492] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87: No bootstrap required, opened a new log
I20260709 13:03:37.591578 11208 ts_tablet_manager.cc:1403] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.078s	user 0.024s	sys 0.047s
I20260709 13:03:37.591671 11207 ts_tablet_manager.cc:1403] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.034s
I20260709 13:03:37.593098 11206 tablet_bootstrap.cc:492] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb: No bootstrap required, opened a new log
I20260709 13:03:37.593708 11206 ts_tablet_manager.cc:1403] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.007s
I20260709 13:03:37.594684 11207 raft_consensus.cc:359] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } } peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } }
I20260709 13:03:37.595356 11207 raft_consensus.cc:385] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.595125 11208 raft_consensus.cc:359] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.595688 11207 raft_consensus.cc:740] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.596021 11208 raft_consensus.cc:385] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.596499 11208 raft_consensus.cc:740] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.596477 11207 consensus_queue.cc:260] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } } peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } }
I20260709 13:03:37.597231 11206 raft_consensus.cc:359] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.597718 11208 consensus_queue.cc:260] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.598497 11206 raft_consensus.cc:385] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.598834 11206 raft_consensus.cc:740] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.600147 11207 ts_tablet_manager.cc:1434] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:37.600432 11208 ts_tablet_manager.cc:1434] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:03:37.601236 11207 tablet_bootstrap.cc:492] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87: Bootstrap starting.
I20260709 13:03:37.601509 11208 tablet_bootstrap.cc:492] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:37.599740 11206 consensus_queue.cc:260] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.608348 11206 ts_tablet_manager.cc:1434] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:03:37.609133 11208 tablet_bootstrap.cc:654] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.609745 11206 tablet_bootstrap.cc:492] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb: Bootstrap starting.
I20260709 13:03:37.609225 11207 tablet_bootstrap.cc:654] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.620846 11206 tablet_bootstrap.cc:654] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.626420 11208 tablet_bootstrap.cc:492] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414: No bootstrap required, opened a new log
I20260709 13:03:37.627012 11208 ts_tablet_manager.cc:1403] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.000s
I20260709 13:03:37.628132 11206 tablet_bootstrap.cc:492] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb: No bootstrap required, opened a new log
I20260709 13:03:37.628621 11207 tablet_bootstrap.cc:492] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87: No bootstrap required, opened a new log
I20260709 13:03:37.628750 11206 ts_tablet_manager.cc:1403] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:03:37.629217 11207 ts_tablet_manager.cc:1403] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.004s
I20260709 13:03:37.629516 11208 raft_consensus.cc:359] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.630123 11208 raft_consensus.cc:385] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.630309 11208 raft_consensus.cc:740] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.631191 11208 consensus_queue.cc:260] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.632544 11206 raft_consensus.cc:359] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.632845 11207 raft_consensus.cc:359] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.633499 11206 raft_consensus.cc:385] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.633630 11207 raft_consensus.cc:385] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.633672 11208 ts_tablet_manager.cc:1434] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:37.633922 11206 raft_consensus.cc:740] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.634223 11207 raft_consensus.cc:740] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.635275 11208 tablet_bootstrap.cc:492] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:37.635062 11206 consensus_queue.cc:260] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.635128 11207 consensus_queue.cc:260] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.637923 11206 ts_tablet_manager.cc:1434] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:03:37.638851 11207 ts_tablet_manager.cc:1434] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:03:37.639281 11206 tablet_bootstrap.cc:492] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb: Bootstrap starting.
I20260709 13:03:37.640270 11207 tablet_bootstrap.cc:492] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87: Bootstrap starting.
I20260709 13:03:37.643663 11208 tablet_bootstrap.cc:654] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.646013 11212 raft_consensus.cc:493] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.646898 11212 raft_consensus.cc:515] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } } peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } }
I20260709 13:03:37.647419 11206 tablet_bootstrap.cc:654] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.652786 11212 leader_election.cc:290] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571), 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415)
I20260709 13:03:37.656670 11213 raft_consensus.cc:493] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.657289 11213 raft_consensus.cc:515] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.661375 11207 tablet_bootstrap.cc:654] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.680670 11206 tablet_bootstrap.cc:492] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb: No bootstrap required, opened a new log
I20260709 13:03:37.681324 11206 ts_tablet_manager.cc:1403] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb: Time spent bootstrapping tablet: real 0.042s	user 0.029s	sys 0.012s
I20260709 13:03:37.683182 11213 leader_election.cc:290] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:37.689417 11208 tablet_bootstrap.cc:492] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414: No bootstrap required, opened a new log
I20260709 13:03:37.690115 11208 ts_tablet_manager.cc:1403] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.000s
I20260709 13:03:37.695210 11206 raft_consensus.cc:359] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.696128 11206 raft_consensus.cc:385] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.696481 11206 raft_consensus.cc:740] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.697374 11206 consensus_queue.cc:260] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.699997 11206 ts_tablet_manager.cc:1434] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 13:03:37.701104 11206 tablet_bootstrap.cc:492] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb: Bootstrap starting.
I20260709 13:03:37.705991 11212 raft_consensus.cc:493] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.695672 11208 raft_consensus.cc:359] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } } peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } }
I20260709 13:03:37.706741 11208 raft_consensus.cc:385] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.706616 11212 raft_consensus.cc:515] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.707353 11208 raft_consensus.cc:740] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.707839 11206 tablet_bootstrap.cc:654] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.709084 11212 leader_election.cc:290] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:37.712574 11208 consensus_queue.cc:260] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } } peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } }
I20260709 13:03:37.716871 11017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" is_pre_election: true
I20260709 13:03:37.717669 11017 raft_consensus.cc:2468] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 0.
I20260709 13:03:37.719288 11131 leader_election.cc:304] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb; no voters: 
I20260709 13:03:37.720346 11213 raft_consensus.cc:2804] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:37.720863 11213 raft_consensus.cc:493] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.721239 11213 raft_consensus.cc:3060] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.723631 11166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8854e9ac34a342109991a82cf9fccea2" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
I20260709 13:03:37.724473 11166 raft_consensus.cc:2468] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 0.
I20260709 13:03:37.725885 11207 tablet_bootstrap.cc:492] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87: No bootstrap required, opened a new log
I20260709 13:03:37.726511 11207 ts_tablet_manager.cc:1403] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.003s
I20260709 13:03:37.726950 11214 raft_consensus.cc:493] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.727476 11214 raft_consensus.cc:515] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.727838 11166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
I20260709 13:03:37.729310 11056 leader_election.cc:304] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:37.729689 11206 tablet_bootstrap.cc:492] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb: No bootstrap required, opened a new log
I20260709 13:03:37.730253 11206 ts_tablet_manager.cc:1403] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.005s
I20260709 13:03:37.730427 11212 raft_consensus.cc:2804] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:37.730881 11212 raft_consensus.cc:493] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.731411 11212 raft_consensus.cc:3060] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.731709 11207 raft_consensus.cc:359] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.732558 11207 raft_consensus.cc:385] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.732877 11207 raft_consensus.cc:740] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.733515 11206 raft_consensus.cc:359] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.734256 11206 raft_consensus.cc:385] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.734532 11206 raft_consensus.cc:740] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.735435 11206 consensus_queue.cc:260] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.720853 11208 ts_tablet_manager.cc:1434] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.003s
I20260709 13:03:37.740967 11208 tablet_bootstrap.cc:492] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:37.741163 11017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8854e9ac34a342109991a82cf9fccea2" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" is_pre_election: true
I20260709 13:03:37.741888 11017 raft_consensus.cc:2468] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 0.
I20260709 13:03:37.743273 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" is_pre_election: true
I20260709 13:03:37.744144 11016 raft_consensus.cc:2468] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 0.
I20260709 13:03:37.747350 11057 leader_election.cc:304] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:37.735283 11214 leader_election.cc:290] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:37.762468 11206 ts_tablet_manager.cc:1434] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.011s
I20260709 13:03:37.763686 11206 tablet_bootstrap.cc:492] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb: Bootstrap starting.
I20260709 13:03:37.769505 11206 tablet_bootstrap.cc:654] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.778728 11239 raft_consensus.cc:493] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.779626 11239 raft_consensus.cc:515] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.783517 11206 tablet_bootstrap.cc:492] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb: No bootstrap required, opened a new log
I20260709 13:03:37.784293 11206 ts_tablet_manager.cc:1403] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.008s
I20260709 13:03:37.784127 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" is_pre_election: true
W20260709 13:03:37.786466 11131 leader_election.cc:343] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.787931 11206 raft_consensus.cc:359] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.788807 11206 raft_consensus.cc:385] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.739248 11207 consensus_queue.cc:260] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.789347 11206 raft_consensus.cc:740] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Initialized, Role: FOLLOWER
W20260709 13:03:37.793592 11057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:36415, user_credentials={real_user=slave}} blocked reactor thread for 46493.9us
I20260709 13:03:37.794008 11244 raft_consensus.cc:493] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.794332 11240 raft_consensus.cc:2804] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:37.794852 11240 raft_consensus.cc:493] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.795356 11240 raft_consensus.cc:3060] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.794749 11244 raft_consensus.cc:515] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.788360 11239 leader_election.cc:290] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:37.801040 11206 consensus_queue.cc:260] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.803081 11206 ts_tablet_manager.cc:1434] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:03:37.804765 11206 tablet_bootstrap.cc:492] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb: Bootstrap starting.
I20260709 13:03:37.806092 11212 raft_consensus.cc:515] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } } peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } }
I20260709 13:03:37.803753 11213 raft_consensus.cc:515] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.809062 11239 raft_consensus.cc:493] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.809605 11239 raft_consensus.cc:515] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.810859 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8854e9ac34a342109991a82cf9fccea2" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:37.811817 11165 raft_consensus.cc:3060] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.809849 11166 raft_consensus.cc:2393] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9ea67ff4ae4261b3829d00316d8e87 in current term 1: Already voted for candidate c915415c45b84f77af0116dd589ca3eb in this term.
I20260709 13:03:37.813724 11208 tablet_bootstrap.cc:654] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.813733 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" is_pre_election: true
W20260709 13:03:37.815829 11131 leader_election.cc:343] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.811859 11239 leader_election.cc:290] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:37.808403 11212 leader_election.cc:290] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 election: Requested vote from peers c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571), 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415)
I20260709 13:03:37.821095 11207 ts_tablet_manager.cc:1434] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87: Time spent starting tablet: real 0.094s	user 0.014s	sys 0.016s
I20260709 13:03:37.822435 11212 raft_consensus.cc:493] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.823097 11212 raft_consensus.cc:515] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.823589 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:37.824416 11016 raft_consensus.cc:3060] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.827188 11213 leader_election.cc:290] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:37.839453 11207 tablet_bootstrap.cc:492] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87: Bootstrap starting.
I20260709 13:03:37.845439 11166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
I20260709 13:03:37.846423 11166 raft_consensus.cc:2468] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 0.
I20260709 13:03:37.847383 11206 tablet_bootstrap.cc:654] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.847921 11207 tablet_bootstrap.cc:654] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.847733 11164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5d307c2824d0f9701fd04d02d9f25" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
I20260709 13:03:37.848608 11164 raft_consensus.cc:2468] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34c6ca470f7b408ca1fb7b7f3ad65414 in term 0.
I20260709 13:03:37.849800 11017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8854e9ac34a342109991a82cf9fccea2" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:37.850450 11017 raft_consensus.cc:3060] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.851285 11244 leader_election.cc:290] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:37.852034 11244 raft_consensus.cc:493] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.853140 11015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" is_pre_election: true
I20260709 13:03:37.855273 11165 raft_consensus.cc:2468] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 1.
I20260709 13:03:37.854892 11092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
I20260709 13:03:37.856431 11212 leader_election.cc:290] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:37.857362 11091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
I20260709 13:03:37.858513 11091 raft_consensus.cc:2468] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 0.
I20260709 13:03:37.858970 11016 raft_consensus.cc:2468] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 1.
I20260709 13:03:37.860247 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
I20260709 13:03:37.860769 11131 leader_election.cc:304] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb; no voters: 
I20260709 13:03:37.861665 11089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
I20260709 13:03:37.852632 11244 raft_consensus.cc:515] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
W20260709 13:03:37.863862 11057 leader_election.cc:343] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.864125 11014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b8940dfe37411ebfe5bc8561f99043" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" is_pre_election: true
I20260709 13:03:37.865046 11014 raft_consensus.cc:2468] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 0.
I20260709 13:03:37.865521 11244 leader_election.cc:290] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:37.866715 11057 leader_election.cc:304] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:37.867785 11014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebcedc4294d44909dab672ad2f13cda" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" is_pre_election: true
I20260709 13:03:37.867749 11056 leader_election.cc:304] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414
I20260709 13:03:37.869733 11244 raft_consensus.cc:2804] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:37.869496 11014 raft_consensus.cc:2468] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 0.
I20260709 13:03:37.870302 11056 leader_election.cc:304] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:37.870240 11244 raft_consensus.cc:493] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.871505 11244 raft_consensus.cc:3060] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.871593 11245 raft_consensus.cc:2804] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:37.860288 11129 leader_election.cc:304] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414
I20260709 13:03:37.872337 11245 raft_consensus.cc:493] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.872991 11245 raft_consensus.cc:3060] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.874396 11239 raft_consensus.cc:2804] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:37.874197 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b8940dfe37411ebfe5bc8561f99043" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
I20260709 13:03:37.871554 11212 raft_consensus.cc:2804] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:37.875303 11165 raft_consensus.cc:2468] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 0.
I20260709 13:03:37.875509 11212 raft_consensus.cc:697] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 LEADER]: Becoming Leader. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:37.876782 11212 consensus_queue.cc:237] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } } peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } }
I20260709 13:03:37.878616 11057 leader_election.cc:304] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:37.879920 11246 raft_consensus.cc:2804] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:37.880338 11246 raft_consensus.cc:493] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.880720 11246 raft_consensus.cc:3060] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.861966 11213 raft_consensus.cc:2804] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:37.874955 11239 raft_consensus.cc:493] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.886309 11239 raft_consensus.cc:3060] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.892023 11244 raft_consensus.cc:515] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.892798 11206 tablet_bootstrap.cc:492] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb: No bootstrap required, opened a new log
I20260709 13:03:37.893558 11206 ts_tablet_manager.cc:1403] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.000s
I20260709 13:03:37.894404 10981 leader_election.cc:304] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb; no voters: 
I20260709 13:03:37.909435 11014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b8940dfe37411ebfe5bc8561f99043" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:37.910349 11014 raft_consensus.cc:3060] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.896965 11214 raft_consensus.cc:2804] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:37.904448 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebcedc4294d44909dab672ad2f13cda" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
I20260709 13:03:37.919313 11244 leader_election.cc:290] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
W20260709 13:03:37.919548 11129 leader_election.cc:343] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.920662 11129 leader_election.cc:304] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87
I20260709 13:03:37.912855 11213 raft_consensus.cc:697] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 1 LEADER]: Becoming Leader. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:37.914143 11214 raft_consensus.cc:493] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.927471 11214 raft_consensus.cc:3060] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.928084 11213 consensus_queue.cc:237] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.925439 11165 raft_consensus.cc:2468] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 0.
I20260709 13:03:37.903791 11245 raft_consensus.cc:515] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.926262 11206 raft_consensus.cc:359] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.934147 11206 raft_consensus.cc:385] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.934418 11206 raft_consensus.cc:740] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.936246 11206 consensus_queue.cc:260] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.938925 11239 raft_consensus.cc:515] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.942689 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:37.943094 10911 catalog_manager.cc:5697] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:37.944409 11131 leader_election.cc:343] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.943161 11250 raft_consensus.cc:2749] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:37.950263 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5d307c2824d0f9701fd04d02d9f25" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
I20260709 13:03:37.950376 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:37.950814 11250 raft_consensus.cc:493] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.945268 11245 leader_election.cc:290] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:37.951184 11090 raft_consensus.cc:2468] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34c6ca470f7b408ca1fb7b7f3ad65414 in term 0.
I20260709 13:03:37.951376 11250 raft_consensus.cc:515] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
W20260709 13:03:37.952127 11057 leader_election.cc:343] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.951152 11208 tablet_bootstrap.cc:492] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414: No bootstrap required, opened a new log
I20260709 13:03:37.953964 11208 ts_tablet_manager.cc:1403] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.213s	user 0.039s	sys 0.019s
I20260709 13:03:37.953817 11246 raft_consensus.cc:515] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.956945 11206 ts_tablet_manager.cc:1434] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 13:03:37.955354 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cb40c0103f4be4b3c70690b6c73403" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" is_pre_election: true
W20260709 13:03:37.963938 11131 leader_election.cc:343] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.964409 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebcedc4294d44909dab672ad2f13cda" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:37.965497 11016 raft_consensus.cc:3060] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.945577 11239 leader_election.cc:290] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:37.945286 11017 raft_consensus.cc:2468] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 1.
I20260709 13:03:37.966248 11240 raft_consensus.cc:515] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.976491 11092 raft_consensus.cc:2393] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c915415c45b84f77af0116dd589ca3eb in current term 1: Already voted for candidate ca9ea67ff4ae4261b3829d00316d8e87 in this term.
I20260709 13:03:37.976854 11208 raft_consensus.cc:359] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.978029 11208 raft_consensus.cc:385] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.978425 11208 raft_consensus.cc:740] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.979605 11208 consensus_queue.cc:260] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.981662 11207 tablet_bootstrap.cc:492] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87: No bootstrap required, opened a new log
I20260709 13:03:37.982304 11207 ts_tablet_manager.cc:1403] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent bootstrapping tablet: real 0.143s	user 0.036s	sys 0.028s
I20260709 13:03:37.982191 11246 leader_election.cc:290] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:37.987119 11207 raft_consensus.cc:359] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.988161 11207 raft_consensus.cc:385] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.991750 11017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:37.984208 11250 leader_election.cc:290] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:37.992955 11017 raft_consensus.cc:2393] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9ea67ff4ae4261b3829d00316d8e87 in current term 1: Already voted for candidate c915415c45b84f77af0116dd589ca3eb in this term.
I20260709 13:03:37.988513 11207 raft_consensus.cc:740] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.993088 11014 raft_consensus.cc:2468] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 1.
I20260709 13:03:37.991439 11240 leader_election.cc:290] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:37.949163 11251 raft_consensus.cc:493] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.981667 11016 raft_consensus.cc:2468] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 1.
W20260709 13:03:37.998811 11129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39931, user_credentials={real_user=slave}} blocked reactor thread for 79352.5us
I20260709 13:03:38.000734 11057 leader_election.cc:304] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:38.004197 11057 leader_election.cc:304] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:38.004652 11240 raft_consensus.cc:2804] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.005007 11246 raft_consensus.cc:2804] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.005439 11240 raft_consensus.cc:697] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 LEADER]: Becoming Leader. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:38.005627 11246 raft_consensus.cc:697] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 LEADER]: Becoming Leader. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:38.006402 11240 consensus_queue.cc:237] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.006600 11246 consensus_queue.cc:237] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:37.996996 11251 raft_consensus.cc:515] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.010092 10913 catalog_manager.cc:5697] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb reported cstate change: term changed from 0 to 1, leader changed from <none> to c915415c45b84f77af0116dd589ca3eb (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c915415c45b84f77af0116dd589ca3eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:38.011276 11251 leader_election.cc:290] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:38.011129 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b8940dfe37411ebfe5bc8561f99043" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:38.012537 11164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:37.997582 11207 consensus_queue.cc:260] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.012705 11165 raft_consensus.cc:3060] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.999050 11214 raft_consensus.cc:515] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.020838 11164 raft_consensus.cc:2393] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9ea67ff4ae4261b3829d00316d8e87 in current term 1: Already voted for candidate c915415c45b84f77af0116dd589ca3eb in this term.
I20260709 13:03:38.021409 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca7814861a6547799f3685cb896d4ea6" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" is_pre_election: true
I20260709 13:03:38.022038 11207 ts_tablet_manager.cc:1434] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.001s
I20260709 13:03:38.021962 11166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebcedc4294d44909dab672ad2f13cda" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:38.027163 11166 raft_consensus.cc:3060] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.029316 11089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cb40c0103f4be4b3c70690b6c73403" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
I20260709 13:03:38.030395 11089 raft_consensus.cc:2468] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 0.
I20260709 13:03:38.033178 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
I20260709 13:03:38.034607 11090 raft_consensus.cc:2393] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c915415c45b84f77af0116dd589ca3eb in current term 1: Already voted for candidate ca9ea67ff4ae4261b3829d00316d8e87 in this term.
I20260709 13:03:38.034730 11129 leader_election.cc:304] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414
I20260709 13:03:38.025307 11092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5d307c2824d0f9701fd04d02d9f25" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
I20260709 13:03:38.035992 11092 raft_consensus.cc:3060] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.015036 11251 raft_consensus.cc:493] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.041750 11251 raft_consensus.cc:515] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.049477 11254 raft_consensus.cc:2804] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.050205 11254 raft_consensus.cc:493] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.050614 11254 raft_consensus.cc:3060] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.033219 11164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:38.052790 11014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5040dbf98d7646a48eaa60571252ab45" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" is_pre_election: true
W20260709 13:03:38.055001 11131 leader_election.cc:343] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.056413 11251 leader_election.cc:290] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:38.057843 11056 leader_election.cc:304] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9ea67ff4ae4261b3829d00316d8e87; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb
I20260709 13:03:38.058863 11245 raft_consensus.cc:2749] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.059396 11208 ts_tablet_manager.cc:1434] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.105s	user 0.012s	sys 0.005s
I20260709 13:03:38.060109 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca7814861a6547799f3685cb896d4ea6" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
I20260709 13:03:38.066956 11129 leader_election.cc:304] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87
I20260709 13:03:38.067883 11251 raft_consensus.cc:2749] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:03:38.068349 11129 leader_election.cc:343] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.068928 11208 tablet_bootstrap.cc:492] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:38.070679 11056 leader_election.cc:304] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9ea67ff4ae4261b3829d00316d8e87; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb
I20260709 13:03:38.071550 11245 raft_consensus.cc:2749] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.067549 11165 raft_consensus.cc:2468] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 1.
I20260709 13:03:38.075466 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5040dbf98d7646a48eaa60571252ab45" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
W20260709 13:03:38.079882 11129 leader_election.cc:343] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:38.080017 11131 leader_election.cc:343] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.080685 11131 leader_election.cc:304] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87
I20260709 13:03:38.079411 11208 tablet_bootstrap.cc:654] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.081041 11129 leader_election.cc:304] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87
I20260709 13:03:38.081976 11251 raft_consensus.cc:2749] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.082470 11213 raft_consensus.cc:2749] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.082966 11207 tablet_bootstrap.cc:492] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87: Bootstrap starting.
I20260709 13:03:38.083402 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5d307c2824d0f9701fd04d02d9f25" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:38.081018 11214 leader_election.cc:290] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 election: Requested vote from peers ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:38.084285 11165 raft_consensus.cc:3060] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.086022 11254 raft_consensus.cc:515] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.087353 11092 raft_consensus.cc:2468] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c6ca470f7b408ca1fb7b7f3ad65414 in term 1.
I20260709 13:03:38.088953 10980 leader_election.cc:304] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:38.091296 11214 raft_consensus.cc:2804] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.091877 11256 raft_consensus.cc:493] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.092609 11256 raft_consensus.cc:515] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.097151 11164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
I20260709 13:03:38.097769 11164 raft_consensus.cc:2468] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34c6ca470f7b408ca1fb7b7f3ad65414 in term 0.
I20260709 13:03:38.098879 10981 leader_election.cc:304] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb; no voters: 
I20260709 13:03:38.099656 11254 leader_election.cc:290] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:38.099859 11256 leader_election.cc:290] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:38.105726 11165 raft_consensus.cc:2468] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c6ca470f7b408ca1fb7b7f3ad65414 in term 1.
I20260709 13:03:38.106433 11256 raft_consensus.cc:2804] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.108466 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cb40c0103f4be4b3c70690b6c73403" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:38.109287 11256 raft_consensus.cc:493] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.109787 11256 raft_consensus.cc:3060] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:38.110522 11131 leader_election.cc:343] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.112692 11207 tablet_bootstrap.cc:654] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.116326 11166 raft_consensus.cc:2468] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 1.
I20260709 13:03:38.117790 11214 raft_consensus.cc:697] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 LEADER]: Becoming Leader. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Running, Role: LEADER
I20260709 13:03:38.122541 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cb40c0103f4be4b3c70690b6c73403" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
I20260709 13:03:38.123220 11090 raft_consensus.cc:3060] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.118304 11092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
W20260709 13:03:38.129410 10980 leader_election.cc:343] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.132465 11256 raft_consensus.cc:515] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.133719 11208 tablet_bootstrap.cc:492] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414: No bootstrap required, opened a new log
I20260709 13:03:38.134831 11207 tablet_bootstrap.cc:492] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87: No bootstrap required, opened a new log
I20260709 13:03:38.135771 11207 ts_tablet_manager.cc:1403] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.008s
I20260709 13:03:38.136258 11092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
W20260709 13:03:38.140324 10980 leader_election.cc:343] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.140074 11207 raft_consensus.cc:359] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.141366 11207 raft_consensus.cc:385] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.134295 11208 ts_tablet_manager.cc:1403] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.004s
I20260709 13:03:38.141849 11207 raft_consensus.cc:740] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.142293 11166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:38.127404 11214 consensus_queue.cc:237] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.143051 11166 raft_consensus.cc:3060] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.142997 11207 consensus_queue.cc:260] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.145957 11208 raft_consensus.cc:359] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.146733 11208 raft_consensus.cc:385] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.141762 11256 leader_election.cc:290] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 election: Requested vote from peers ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:38.147346 11090 raft_consensus.cc:2468] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 1.
I20260709 13:03:38.147078 11208 raft_consensus.cc:740] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.149108 11207 ts_tablet_manager.cc:1434] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:03:38.151398 11207 tablet_bootstrap.cc:492] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87: Bootstrap starting.
I20260709 13:03:38.151194 11129 leader_election.cc:304] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414
I20260709 13:03:38.152478 11254 raft_consensus.cc:2804] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.153074 11254 raft_consensus.cc:697] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 1 LEADER]: Becoming Leader. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:38.151222 11208 consensus_queue.cc:260] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.153972 11254 consensus_queue.cc:237] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.155951 11208 ts_tablet_manager.cc:1434] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:03:38.160722 11166 raft_consensus.cc:2468] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c6ca470f7b408ca1fb7b7f3ad65414 in term 1.
I20260709 13:03:38.162664 10981 leader_election.cc:304] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb; no voters: ca9ea67ff4ae4261b3829d00316d8e87
I20260709 13:03:38.162868 11207 tablet_bootstrap.cc:654] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.162868 10915 catalog_manager.cc:5697] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.164323 11214 raft_consensus.cc:2804] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.165041 11214 raft_consensus.cc:697] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 LEADER]: Becoming Leader. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Running, Role: LEADER
I20260709 13:03:38.166796 11214 consensus_queue.cc:237] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.170117 11208 tablet_bootstrap.cc:492] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:38.175889 11207 tablet_bootstrap.cc:492] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87: No bootstrap required, opened a new log
I20260709 13:03:38.176652 11207 ts_tablet_manager.cc:1403] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
I20260709 13:03:38.182075 11207 raft_consensus.cc:359] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.182915 11207 raft_consensus.cc:385] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.183254 11207 raft_consensus.cc:740] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.192193 11207 consensus_queue.cc:260] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.194152 11207 ts_tablet_manager.cc:1434] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:03:38.195361 11207 tablet_bootstrap.cc:492] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87: Bootstrap starting.
I20260709 13:03:38.196555 11208 tablet_bootstrap.cc:654] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.202188 11207 tablet_bootstrap.cc:654] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.204352 10915 catalog_manager.cc:5697] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb reported cstate change: term changed from 0 to 1, leader changed from <none> to c915415c45b84f77af0116dd589ca3eb (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c915415c45b84f77af0116dd589ca3eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:38.204573 10911 catalog_manager.cc:5697] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.210311 11208 tablet_bootstrap.cc:492] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414: No bootstrap required, opened a new log
I20260709 13:03:38.210886 11208 ts_tablet_manager.cc:1403] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.004s
I20260709 13:03:38.211053 11207 tablet_bootstrap.cc:492] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87: No bootstrap required, opened a new log
I20260709 13:03:38.211549 11207 ts_tablet_manager.cc:1403] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:03:38.214588 11208 raft_consensus.cc:359] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.215906 11208 raft_consensus.cc:385] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.216825 11208 raft_consensus.cc:740] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.218283 11208 consensus_queue.cc:260] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.221848 11207 raft_consensus.cc:359] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.222862 11207 raft_consensus.cc:385] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.223227 11207 raft_consensus.cc:740] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.224104 11207 consensus_queue.cc:260] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.227504 11207 ts_tablet_manager.cc:1434] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:03:38.228010 10913 catalog_manager.cc:5697] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.229332 11208 ts_tablet_manager.cc:1434] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 13:03:38.230319 11208 tablet_bootstrap.cc:492] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:38.230331 10913 catalog_manager.cc:5697] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.237136 11208 tablet_bootstrap.cc:654] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.242203 11208 tablet_bootstrap.cc:492] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414: No bootstrap required, opened a new log
I20260709 13:03:38.242729 11208 ts_tablet_manager.cc:1403] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:03:38.245101 11208 raft_consensus.cc:359] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.245666 11208 raft_consensus.cc:385] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.245891 11208 raft_consensus.cc:740] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.246608 11208 consensus_queue.cc:260] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.249512 11208 ts_tablet_manager.cc:1434] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:38.250524 11208 tablet_bootstrap.cc:492] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:38.256515 11208 tablet_bootstrap.cc:654] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.261289 11208 tablet_bootstrap.cc:492] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414: No bootstrap required, opened a new log
I20260709 13:03:38.261720 11208 ts_tablet_manager.cc:1403] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:03:38.263607 11208 raft_consensus.cc:359] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.264143 11208 raft_consensus.cc:385] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.264364 11208 raft_consensus.cc:740] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.265013 11208 consensus_queue.cc:260] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.266804 11208 ts_tablet_manager.cc:1434] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:38.343890 11246 raft_consensus.cc:493] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.344461 11246 raft_consensus.cc:515] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.346400 11246 leader_election.cc:290] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:38.347231 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" is_pre_election: true
I20260709 13:03:38.347414 11166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
I20260709 13:03:38.348315 11166 raft_consensus.cc:2393] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9ea67ff4ae4261b3829d00316d8e87 in current term 1: Already voted for candidate 34c6ca470f7b408ca1fb7b7f3ad65414 in this term.
I20260709 13:03:38.349283 11056 leader_election.cc:304] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9ea67ff4ae4261b3829d00316d8e87; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb
I20260709 13:03:38.349977 11246 raft_consensus.cc:3060] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.355490 11246 raft_consensus.cc:2749] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.427376 11254 consensus_queue.cc:1048] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.442565 11251 consensus_queue.cc:1048] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.454651 11214 raft_consensus.cc:493] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.455225 11214 raft_consensus.cc:515] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.457466 11214 leader_election.cc:290] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:38.458793 11240 consensus_queue.cc:1048] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.458995 11166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5040dbf98d7646a48eaa60571252ab45" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
I20260709 13:03:38.459762 11166 raft_consensus.cc:2468] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34c6ca470f7b408ca1fb7b7f3ad65414 in term 0.
I20260709 13:03:38.461318 10981 leader_election.cc:304] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb; no voters: 
I20260709 13:03:38.462173 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5040dbf98d7646a48eaa60571252ab45" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
I20260709 13:03:38.462409 11246 consensus_queue.cc:1048] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.463047 11090 raft_consensus.cc:2468] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34c6ca470f7b408ca1fb7b7f3ad65414 in term 0.
I20260709 13:03:38.463848 11246 consensus_queue.cc:1048] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.462195 11256 raft_consensus.cc:493] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.465147 11256 raft_consensus.cc:515] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.466620 11262 raft_consensus.cc:2804] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.466967 11262 raft_consensus.cc:493] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.467209 11262 raft_consensus.cc:3060] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.468787 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
I20260709 13:03:38.469645 11165 raft_consensus.cc:2393] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34c6ca470f7b408ca1fb7b7f3ad65414 in current term 1: Already voted for candidate c915415c45b84f77af0116dd589ca3eb in this term.
I20260709 13:03:38.467229 11256 leader_election.cc:290] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:38.470041 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
I20260709 13:03:38.470985 11090 raft_consensus.cc:2393] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34c6ca470f7b408ca1fb7b7f3ad65414 in current term 1: Already voted for candidate ca9ea67ff4ae4261b3829d00316d8e87 in this term.
I20260709 13:03:38.472081 10980 leader_election.cc:304] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414; no voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87
I20260709 13:03:38.472987 11214 raft_consensus.cc:3060] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.475050 11262 raft_consensus.cc:515] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.488731 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5040dbf98d7646a48eaa60571252ab45" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
I20260709 13:03:38.489390 11090 raft_consensus.cc:3060] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.497488 11090 raft_consensus.cc:2468] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c6ca470f7b408ca1fb7b7f3ad65414 in term 1.
I20260709 13:03:38.497853 11214 raft_consensus.cc:2749] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.498811 10980 leader_election.cc:304] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:38.499900 11256 raft_consensus.cc:2804] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.497267 11246 consensus_queue.cc:1048] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:38.500429 11256 raft_consensus.cc:697] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 LEADER]: Becoming Leader. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Running, Role: LEADER
I20260709 13:03:38.501369 11256 consensus_queue.cc:237] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.512020 11262 leader_election.cc:290] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 election: Requested vote from peers ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:38.513306 11166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5040dbf98d7646a48eaa60571252ab45" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:38.514092 11166 raft_consensus.cc:3060] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.523324 11245 consensus_queue.cc:1048] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.530120 11240 consensus_queue.cc:1048] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:38.538813 11166 raft_consensus.cc:2468] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34c6ca470f7b408ca1fb7b7f3ad65414 in term 1.
I20260709 13:03:38.541553 11262 consensus_queue.cc:1048] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.541875 11288 raft_consensus.cc:493] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.543135 11288 raft_consensus.cc:515] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.550631 11288 leader_election.cc:290] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:38.551352 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca7814861a6547799f3685cb896d4ea6" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" is_pre_election: true
I20260709 13:03:38.552124 11016 raft_consensus.cc:2468] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 0.
I20260709 13:03:38.552217 11164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca7814861a6547799f3685cb896d4ea6" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
I20260709 13:03:38.552940 11164 raft_consensus.cc:2468] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 0.
I20260709 13:03:38.553874 11057 leader_election.cc:304] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:38.554899 11288 raft_consensus.cc:2804] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.552332 10915 catalog_manager.cc:5697] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.555390 11288 raft_consensus.cc:493] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.560083 11262 consensus_queue.cc:1048] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:38.555817 11288 raft_consensus.cc:3060] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.569607 11288 raft_consensus.cc:515] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.571942 11288 leader_election.cc:290] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:38.573757 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca7814861a6547799f3685cb896d4ea6" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:38.574254 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca7814861a6547799f3685cb896d4ea6" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:38.574522 11165 raft_consensus.cc:3060] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.575160 11016 raft_consensus.cc:3060] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.583501 11165 raft_consensus.cc:2468] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 1.
I20260709 13:03:38.586524 11056 leader_election.cc:304] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:38.587167 11016 raft_consensus.cc:2468] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 1.
I20260709 13:03:38.587576 11288 raft_consensus.cc:2804] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.588268 11288 raft_consensus.cc:697] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 LEADER]: Becoming Leader. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:38.589262 11288 consensus_queue.cc:237] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
W20260709 13:03:38.595831 10963 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:38.600535 10911 catalog_manager.cc:5697] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.641820 11262 raft_consensus.cc:493] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.642422 11262 raft_consensus.cc:515] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:38.644217 11262 leader_election.cc:290] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:38.645187 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cb40c0103f4be4b3c70690b6c73403" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
I20260709 13:03:38.645285 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cb40c0103f4be4b3c70690b6c73403" candidate_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
I20260709 13:03:38.645952 11090 raft_consensus.cc:2393] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34c6ca470f7b408ca1fb7b7f3ad65414 in current term 1: Already voted for candidate c915415c45b84f77af0116dd589ca3eb in this term.
I20260709 13:03:38.646919 10980 leader_election.cc:304] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414; no voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87
I20260709 13:03:38.647610 11262 raft_consensus.cc:3060] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.653353 11262 raft_consensus.cc:2749] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.653468 11260 consensus_queue.cc:1048] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:38.666543 11262 consensus_queue.cc:1048] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.713389 11251 consensus_queue.cc:1048] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.725644 11251 consensus_queue.cc:1048] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.898768 11262 consensus_queue.cc:1048] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.911312 11260 consensus_queue.cc:1048] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:39.045694 11240 consensus_queue.cc:1048] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:39.061517 11288 consensus_queue.cc:1048] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:39.600876 10963 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:39.811870 11251 raft_consensus.cc:493] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.812433 11251 raft_consensus.cc:515] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:39.814263 11251 leader_election.cc:290] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:39.815546 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
I20260709 13:03:39.815397 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" is_pre_election: true
I20260709 13:03:39.816398 11090 raft_consensus.cc:2468] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 1.
I20260709 13:03:39.816447 11016 raft_consensus.cc:2468] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 1.
I20260709 13:03:39.818140 11131 leader_election.cc:304] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb; no voters: 
I20260709 13:03:39.818975 11251 raft_consensus.cc:2804] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:39.819331 11251 raft_consensus.cc:493] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.819614 11251 raft_consensus.cc:3060] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.826357 11251 raft_consensus.cc:515] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:39.828267 11251 leader_election.cc:290] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:39.829269 11016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:39.829344 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
I20260709 13:03:39.829941 11016 raft_consensus.cc:3060] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.829999 11090 raft_consensus.cc:3060] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.835518 11016 raft_consensus.cc:2468] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 2.
I20260709 13:03:39.835518 11090 raft_consensus.cc:2468] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 2.
I20260709 13:03:39.836781 11131 leader_election.cc:304] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb; no voters: 
I20260709 13:03:39.837591 11251 raft_consensus.cc:2804] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:39.838501 11251 raft_consensus.cc:697] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Becoming Leader. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:39.839349 11251 consensus_queue.cc:237] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:39.847559 10913 catalog_manager.cc:5697] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb reported cstate change: term changed from 0 to 2, leader changed from <none> to c915415c45b84f77af0116dd589ca3eb (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c915415c45b84f77af0116dd589ca3eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.340901 11090 raft_consensus.cc:1275] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Refusing update from remote peer c915415c45b84f77af0116dd589ca3eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:40.342320 11251 consensus_queue.cc:1048] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:40.356717 11016 raft_consensus.cc:1275] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Refusing update from remote peer c915415c45b84f77af0116dd589ca3eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:40.358698 11251 consensus_queue.cc:1048] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:40.507745   431 ts_manager.cc:295] Set tserver state for 34c6ca470f7b408ca1fb7b7f3ad65414 to MAINTENANCE_MODE
I20260709 13:03:40.508562   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:03:40.514454 11057 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 115 similar messages]
W20260709 13:03:40.520061 11057 consensus_peers.cc:597] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.540794   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:40.541764   431 tablet_replica.cc:333] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414: stopping tablet replica
I20260709 13:03:40.542382   431 raft_consensus.cc:2243] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.542809   431 raft_consensus.cc:2272] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.544831   431 tablet_replica.cc:333] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414: stopping tablet replica
I20260709 13:03:40.545378   431 raft_consensus.cc:2243] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.546255   431 raft_consensus.cc:2272] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.549149   431 tablet_replica.cc:333] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414: stopping tablet replica
I20260709 13:03:40.549731   431 raft_consensus.cc:2243] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.550474   431 raft_consensus.cc:2272] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.552379   431 tablet_replica.cc:333] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414: stopping tablet replica
I20260709 13:03:40.553028   431 raft_consensus.cc:2243] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.553694   431 raft_consensus.cc:2272] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.555873   431 tablet_replica.cc:333] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414: stopping tablet replica
I20260709 13:03:40.556444   431 raft_consensus.cc:2243] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.557000   431 raft_consensus.cc:2272] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.559115   431 tablet_replica.cc:333] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414: stopping tablet replica
I20260709 13:03:40.559659   431 raft_consensus.cc:2243] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.560056   431 raft_consensus.cc:2272] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.563023   431 tablet_replica.cc:333] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414: stopping tablet replica
I20260709 13:03:40.563649   431 raft_consensus.cc:2243] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.564060   431 raft_consensus.cc:2272] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.566198   431 tablet_replica.cc:333] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414: stopping tablet replica
I20260709 13:03:40.566687   431 raft_consensus.cc:2243] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.567063   431 raft_consensus.cc:2272] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.569067   431 tablet_replica.cc:333] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414: stopping tablet replica
I20260709 13:03:40.569552   431 raft_consensus.cc:2243] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.569923   431 raft_consensus.cc:2272] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.571718   431 tablet_replica.cc:333] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414: stopping tablet replica
I20260709 13:03:40.572145   431 raft_consensus.cc:2243] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.572943   431 raft_consensus.cc:2272] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:40.601851 10963 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:40.604703   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:40.609428 11057 consensus_peers.cc:597] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.736445 11131 consensus_peers.cc:597] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.814106 11131 consensus_peers.cc:597] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.902390 11131 consensus_peers.cc:597] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.902484 11057 consensus_peers.cc:597] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.929113 11057 consensus_peers.cc:597] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:41.503665 11315 raft_consensus.cc:493] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34c6ca470f7b408ca1fb7b7f3ad65414)
I20260709 13:03:41.504249 11315 raft_consensus.cc:515] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:41.506274 11315 leader_election.cc:290] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:41.507404 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5d307c2824d0f9701fd04d02d9f25" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
W20260709 13:03:41.509912 11057 leader_election.cc:336] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111)
I20260709 13:03:41.510283 11057 leader_election.cc:304] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9ea67ff4ae4261b3829d00316d8e87; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb
I20260709 13:03:41.510875 11315 raft_consensus.cc:2749] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:41.603364 10963 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:41.691201 11324 raft_consensus.cc:493] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34c6ca470f7b408ca1fb7b7f3ad65414)
I20260709 13:03:41.691815 11324 raft_consensus.cc:515] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:41.693575 11324 leader_election.cc:290] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:41.694670 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
W20260709 13:03:41.697695 11131 leader_election.cc:336] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111)
I20260709 13:03:41.698145 11131 leader_election.cc:304] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87
I20260709 13:03:41.698897 11324 raft_consensus.cc:2749] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:41.752377 11315 raft_consensus.cc:493] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34c6ca470f7b408ca1fb7b7f3ad65414)
I20260709 13:03:41.753016 11315 raft_consensus.cc:515] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:41.754966 11315 leader_election.cc:290] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:41.755959 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
I20260709 13:03:41.756676 11165 raft_consensus.cc:2468] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 1.
I20260709 13:03:41.757887 11056 leader_election.cc:304] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:41.758744 11315 raft_consensus.cc:2804] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:41.759119 11315 raft_consensus.cc:493] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34c6ca470f7b408ca1fb7b7f3ad65414)
I20260709 13:03:41.759485 11315 raft_consensus.cc:3060] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:41.759604 11057 leader_election.cc:336] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111)
I20260709 13:03:41.764647 11315 raft_consensus.cc:515] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:41.766569 11315 leader_election.cc:290] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:41.767715 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:41.768409 11165 raft_consensus.cc:3060] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:41.770375 11057 leader_election.cc:336] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111)
I20260709 13:03:41.774749 11165 raft_consensus.cc:2468] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 2.
I20260709 13:03:41.776266 11056 leader_election.cc:304] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414
I20260709 13:03:41.777133 11315 raft_consensus.cc:2804] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:41.777685 11315 raft_consensus.cc:697] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 LEADER]: Becoming Leader. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:41.778564 11315 consensus_queue.cc:237] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:41.786499 10913 catalog_manager.cc:5697] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 reported cstate change: term changed from 1 to 2, leader changed from 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193) to ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:41.805130 11315 raft_consensus.cc:493] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34c6ca470f7b408ca1fb7b7f3ad65414)
I20260709 13:03:41.805792 11315 raft_consensus.cc:515] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:41.807870 11315 leader_election.cc:290] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:41.809163 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5040dbf98d7646a48eaa60571252ab45" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c915415c45b84f77af0116dd589ca3eb" is_pre_election: true
W20260709 13:03:41.810678 11057 leader_election.cc:336] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111)
I20260709 13:03:41.811074 11057 leader_election.cc:304] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9ea67ff4ae4261b3829d00316d8e87; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb
I20260709 13:03:41.811785 11315 raft_consensus.cc:2749] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:41.865263 11324 raft_consensus.cc:493] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34c6ca470f7b408ca1fb7b7f3ad65414)
I20260709 13:03:41.865945 11324 raft_consensus.cc:515] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:41.867640 11324 leader_election.cc:290] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:41.868830 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5d307c2824d0f9701fd04d02d9f25" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
I20260709 13:03:41.869670 11090 raft_consensus.cc:2468] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 1.
I20260709 13:03:41.870702 11129 leader_election.cc:304] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:41.871526 11309 raft_consensus.cc:2804] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:41.871905 11309 raft_consensus.cc:493] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34c6ca470f7b408ca1fb7b7f3ad65414)
W20260709 13:03:41.871984 11131 leader_election.cc:336] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111)
I20260709 13:03:41.872334 11309 raft_consensus.cc:3060] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.878088 11309 raft_consensus.cc:515] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:41.879827 11309 leader_election.cc:290] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:41.880997 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5d307c2824d0f9701fd04d02d9f25" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
I20260709 13:03:41.881606 11090 raft_consensus.cc:3060] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:41.884095 11131 leader_election.cc:336] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111)
I20260709 13:03:41.887578 11090 raft_consensus.cc:2468] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 2.
I20260709 13:03:41.888890 11129 leader_election.cc:304] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414
I20260709 13:03:41.889784 11309 raft_consensus.cc:2804] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:41.890379 11309 raft_consensus.cc:697] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Becoming Leader. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:41.891372 11309 consensus_queue.cc:237] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:41.899859 10913 catalog_manager.cc:5697] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb reported cstate change: term changed from 1 to 2, leader changed from 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193) to c915415c45b84f77af0116dd589ca3eb (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c915415c45b84f77af0116dd589ca3eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.947351 11309 raft_consensus.cc:493] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34c6ca470f7b408ca1fb7b7f3ad65414)
I20260709 13:03:41.947923 11309 raft_consensus.cc:515] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:41.949787 11309 leader_election.cc:290] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:41.950978 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5040dbf98d7646a48eaa60571252ab45" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" is_pre_election: true
I20260709 13:03:41.951711 11090 raft_consensus.cc:2468] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 1.
I20260709 13:03:41.952798 11129 leader_election.cc:304] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:41.953588 11309 raft_consensus.cc:2804] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:41.953928 11309 raft_consensus.cc:493] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34c6ca470f7b408ca1fb7b7f3ad65414)
W20260709 13:03:41.954118 11131 leader_election.cc:336] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111)
I20260709 13:03:41.954329 11309 raft_consensus.cc:3060] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.959715 11309 raft_consensus.cc:515] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:41.961558 11309 leader_election.cc:290] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:41.962795 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5040dbf98d7646a48eaa60571252ab45" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
I20260709 13:03:41.963371 11090 raft_consensus.cc:3060] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:41.965296 11131 leader_election.cc:336] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111)
I20260709 13:03:41.969231 11090 raft_consensus.cc:2468] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 2.
I20260709 13:03:41.970588 11129 leader_election.cc:304] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c915415c45b84f77af0116dd589ca3eb, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 34c6ca470f7b408ca1fb7b7f3ad65414
I20260709 13:03:41.971339 11309 raft_consensus.cc:2804] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:41.971906 11309 raft_consensus.cc:697] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Becoming Leader. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:41.972769 11309 consensus_queue.cc:237] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:41.979732 10913 catalog_manager.cc:5697] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb reported cstate change: term changed from 1 to 2, leader changed from 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193) to c915415c45b84f77af0116dd589ca3eb (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c915415c45b84f77af0116dd589ca3eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:42.200255 11165 raft_consensus.cc:1275] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Refusing update from remote peer ca9ea67ff4ae4261b3829d00316d8e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.201997 11315 consensus_queue.cc:1048] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:42.217020 11057 consensus_peers.cc:597] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:42.453454 11131 consensus_peers.cc:597] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:42.463394 11090 raft_consensus.cc:1275] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Refusing update from remote peer c915415c45b84f77af0116dd589ca3eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.464804 11309 consensus_queue.cc:1048] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:42.514138 11090 raft_consensus.cc:1275] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Refusing update from remote peer c915415c45b84f77af0116dd589ca3eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.515584 11309 consensus_queue.cc:1048] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:42.529759 11131 consensus_peers.cc:597] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:42.639353 10963 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:43.071513 11057 consensus_peers.cc:597] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.151518 11057 consensus_peers.cc:597] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.152840 11131 consensus_peers.cc:597] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.266814 11057 consensus_peers.cc:597] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.266953 11131 consensus_peers.cc:597] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.298477 11131 consensus_peers.cc:597] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.522234 11057 consensus_peers.cc:597] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.641101 10963 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:44.642163 10963 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:44.819818 11057 consensus_peers.cc:597] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:45.073936 11131 consensus_peers.cc:597] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:45.076417 11131 consensus_peers.cc:597] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:45.516502 11057 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111) [suppressed 98 similar messages]
W20260709 13:03:45.519169 11057 consensus_peers.cc:597] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:45.590241 11131 consensus_peers.cc:597] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:45.620726 11131 consensus_peers.cc:597] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:45.626586   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:45.635556 11344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:45.635627 11345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:45.638772 11347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:45.641574   431 server_base.cc:1061] running on GCE node
I20260709 13:03:45.643229   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:45.643229 10963 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:45.643549   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:45.643864   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602225643839 us; error 0 us; skew 500 ppm
I20260709 13:03:45.644630   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:45.647843   431 webserver.cc:533] Webserver started at http://127.0.107.193:34963/ using document root <none> and password file <none>
I20260709 13:03:45.648573   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:45.648948   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:03:45.654480   431 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:03:45.659427 11352 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.660449   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:03:45.660907   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-0-root
uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
format_stamp: "Formatted at 2026-07-09 13:03:36 on dist-test-slave-c08m"
I20260709 13:03:45.661330   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601889622018-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:45.686980   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:45.688354   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:45.690086   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:45.694504 11359 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:03:45.703444 11057 consensus_peers.cc:597] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:45.731205 11057 consensus_peers.cc:597] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:45.760802   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:03:45.761282   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.068s	user 0.003s	sys 0.000s
I20260709 13:03:45.761641   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:03:45.768822 11359 tablet_bootstrap.cc:492] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:45.786074 11359 tablet_bootstrap.cc:492] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:45.787029 11359 tablet_bootstrap.cc:492] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap complete.
I20260709 13:03:45.787647 11359 ts_tablet_manager.cc:1403] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:03:45.790309 11359 raft_consensus.cc:359] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:45.791523 11359 raft_consensus.cc:740] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.792346 11359 consensus_queue.cc:260] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:45.795222 11359 ts_tablet_manager.cc:1434] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:03:45.795969 11359 tablet_bootstrap.cc:492] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:45.809481 11359 tablet_bootstrap.cc:492] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:45.810307 11359 tablet_bootstrap.cc:492] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap complete.
I20260709 13:03:45.810963 11359 ts_tablet_manager.cc:1403] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:03:45.813836 11359 raft_consensus.cc:359] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:45.814594 11359 raft_consensus.cc:740] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
W20260709 13:03:45.816119 11057 consensus_peers.cc:597] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:45.816663 11359 consensus_queue.cc:260] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:45.817961   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:03:45.818280   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.057s	user 0.054s	sys 0.000s
I20260709 13:03:45.818503 11359 ts_tablet_manager.cc:1434] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:45.819286 11359 tablet_bootstrap.cc:492] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:45.834599 11359 tablet_bootstrap.cc:492] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:45.835425 11359 tablet_bootstrap.cc:492] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap complete.
I20260709 13:03:45.836134 11359 ts_tablet_manager.cc:1403] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:03:45.838639 11359 raft_consensus.cc:359] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:45.839282 11359 raft_consensus.cc:740] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.839984 11359 consensus_queue.cc:260] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:45.841836 11359 ts_tablet_manager.cc:1434] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:03:45.842562 11359 tablet_bootstrap.cc:492] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:45.857674 11359 tablet_bootstrap.cc:492] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:45.858860 11359 tablet_bootstrap.cc:492] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap complete.
I20260709 13:03:45.859480 11359 ts_tablet_manager.cc:1403] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 13:03:45.864466 11359 raft_consensus.cc:359] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } } peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } }
I20260709 13:03:45.865509 11359 raft_consensus.cc:740] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.866413 11359 consensus_queue.cc:260] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } } peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } }
I20260709 13:03:45.868793 11359 ts_tablet_manager.cc:1434] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:45.869719 11359 tablet_bootstrap.cc:492] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:45.882843   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:36415
I20260709 13:03:45.883051 11420 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:36415 every 8 connection(s)
I20260709 13:03:45.889395 11359 tablet_bootstrap.cc:492] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:45.890290   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:45.890713 11359 tablet_bootstrap.cc:492] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap complete.
I20260709 13:03:45.891602 11359 ts_tablet_manager.cc:1403] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 13:03:45.895285 11359 raft_consensus.cc:359] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:45.896548 11359 raft_consensus.cc:740] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.897680 11359 consensus_queue.cc:260] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:45.900689 11359 ts_tablet_manager.cc:1434] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:03:45.901706 11359 tablet_bootstrap.cc:492] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:45.915122 11422 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46721
I20260709 13:03:45.915673 11422 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:45.916867 11422 heartbeater.cc:507] Master 127.0.107.254:46721 requested a full tablet report, sending...
I20260709 13:03:45.921217 11359 tablet_bootstrap.cc:492] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:45.922370 11359 tablet_bootstrap.cc:492] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap complete.
I20260709 13:03:45.923106 11359 ts_tablet_manager.cc:1403] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:03:45.924510 10915 ts_manager.cc:194] Re-registered known tserver with Master: 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415)
I20260709 13:03:45.925503 11359 raft_consensus.cc:359] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:45.926136 11359 raft_consensus.cc:740] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.926198 11165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964"
dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
mode: GRACEFUL
new_leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
 from {username='slave'} at 127.0.0.1:48676
I20260709 13:03:45.926968 11359 consensus_queue.cc:260] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:45.927320 11165 raft_consensus.cc:606] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Received request to transfer leadership to TS ca9ea67ff4ae4261b3829d00316d8e87
I20260709 13:03:45.929425 11359 ts_tablet_manager.cc:1434] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:45.930287 11359 tablet_bootstrap.cc:492] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:45.937592 10915 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52562
I20260709 13:03:45.941720 11422 heartbeater.cc:499] Master 127.0.107.254:46721 was elected leader, sending a full tablet report...
I20260709 13:03:45.944576 11090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028"
dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
mode: GRACEFUL
new_leader_uuid: "c915415c45b84f77af0116dd589ca3eb"
 from {username='slave'} at 127.0.0.1:52458
I20260709 13:03:45.945305 11090 raft_consensus.cc:606] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 LEADER]: Received request to transfer leadership to TS c915415c45b84f77af0116dd589ca3eb
I20260709 13:03:45.946784   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:45.946880 11359 tablet_bootstrap.cc:492] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:45.947640   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:45.947976 11359 tablet_bootstrap.cc:492] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap complete.
I20260709 13:03:45.948542   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:45.948787 11359 ts_tablet_manager.cc:1403] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:03:45.951532 11359 raft_consensus.cc:359] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:45.952246 11359 raft_consensus.cc:740] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.953024 11359 consensus_queue.cc:260] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:45.955294 11359 ts_tablet_manager.cc:1434] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:45.956176 11359 tablet_bootstrap.cc:492] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:45.974956 11359 tablet_bootstrap.cc:492] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:45.976234 11359 tablet_bootstrap.cc:492] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap complete.
I20260709 13:03:45.976497 11396 raft_consensus.cc:3060] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.977032 11359 ts_tablet_manager.cc:1403] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:03:45.980731 11359 raft_consensus.cc:359] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:45.981797 11359 raft_consensus.cc:740] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.982755 11359 consensus_queue.cc:260] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:45.985083 11359 ts_tablet_manager.cc:1434] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:45.986131 11359 tablet_bootstrap.cc:492] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:46.003362 11359 tablet_bootstrap.cc:492] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:46.004317 11359 tablet_bootstrap.cc:492] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap complete.
I20260709 13:03:46.005016 11359 ts_tablet_manager.cc:1403] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:03:46.008765 11359 raft_consensus.cc:359] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:46.009490 11359 raft_consensus.cc:740] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:46.010277 11359 consensus_queue.cc:260] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:46.012413 11359 ts_tablet_manager.cc:1434] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:46.013307 11359 tablet_bootstrap.cc:492] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap starting.
I20260709 13:03:46.026084 11395 raft_consensus.cc:3060] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.030431 11359 tablet_bootstrap.cc:492] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:46.031708 11359 tablet_bootstrap.cc:492] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414: Bootstrap complete.
I20260709 13:03:46.032477 11359 ts_tablet_manager.cc:1403] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 13:03:46.035794 11359 raft_consensus.cc:359] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:46.036548 11359 raft_consensus.cc:740] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c6ca470f7b408ca1fb7b7f3ad65414, State: Initialized, Role: FOLLOWER
I20260709 13:03:46.037400 11359 consensus_queue.cc:260] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:46.039573 11359 ts_tablet_manager.cc:1434] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:03:46.131721 11340 raft_consensus.cc:993] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb: : Instructing follower ca9ea67ff4ae4261b3829d00316d8e87 to start an election
I20260709 13:03:46.132313 11439 raft_consensus.cc:1081] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Signalling peer ca9ea67ff4ae4261b3829d00316d8e87 to start an election
I20260709 13:03:46.134225 11090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964"
dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
 from {username='slave'} at 127.0.0.1:51150
I20260709 13:03:46.134706 11090 raft_consensus.cc:493] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:46.134979 11090 raft_consensus.cc:3060] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.140806 11090 raft_consensus.cc:515] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:46.142452 11090 leader_election.cc:290] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 3 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:46.143563 11395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:46.143607 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:46.144462 11395 raft_consensus.cc:3060] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.144523 11165 raft_consensus.cc:3055] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:46.145026 11165 raft_consensus.cc:740] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:46.146003 11165 consensus_queue.cc:260] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:46.147488 11165 raft_consensus.cc:3060] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.151469 11395 raft_consensus.cc:2468] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 3.
I20260709 13:03:46.152750 11057 leader_election.cc:304] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:46.153681 11335 raft_consensus.cc:2804] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:46.154191 11165 raft_consensus.cc:2468] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 3.
I20260709 13:03:46.155171 11335 raft_consensus.cc:697] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 LEADER]: Becoming Leader. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:46.156240 11335 consensus_queue.cc:237] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:46.164034 10915 catalog_manager.cc:5697] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 reported cstate change: term changed from 2 to 3, leader changed from c915415c45b84f77af0116dd589ca3eb (127.0.107.195) to ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.216077 11440 raft_consensus.cc:993] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87: : Instructing follower c915415c45b84f77af0116dd589ca3eb to start an election
I20260709 13:03:46.216696 11335 raft_consensus.cc:1081] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 LEADER]: Signalling peer c915415c45b84f77af0116dd589ca3eb to start an election
I20260709 13:03:46.218611 11165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028"
dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
 from {username='slave'} at 127.0.0.1:57172
I20260709 13:03:46.219282 11165 raft_consensus.cc:493] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:46.219592 11165 raft_consensus.cc:3060] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.226106 11165 raft_consensus.cc:515] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:46.228304 11165 leader_election.cc:290] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 3 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:46.229173 11395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:46.229415 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4031e6b89346bda4c8aa52342e7028" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
I20260709 13:03:46.229895 11090 raft_consensus.cc:3055] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:46.229898 11395 raft_consensus.cc:3060] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.230340 11090 raft_consensus.cc:740] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:46.231406 11090 consensus_queue.cc:260] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:46.232913 11090 raft_consensus.cc:3060] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.238822 11395 raft_consensus.cc:2468] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 3.
I20260709 13:03:46.241029 11131 leader_election.cc:304] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb; no voters: 
I20260709 13:03:46.241776 11090 raft_consensus.cc:2468] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 3.
I20260709 13:03:46.242040 11439 raft_consensus.cc:2804] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:46.242707 11439 raft_consensus.cc:697] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 3 LEADER]: Becoming Leader. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:46.243661 11439 consensus_queue.cc:237] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:46.253899 10915 catalog_manager.cc:5697] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb reported cstate change: term changed from 2 to 3, leader changed from ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194) to c915415c45b84f77af0116dd589ca3eb (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c915415c45b84f77af0116dd589ca3eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:46.589854 11395 raft_consensus.cc:3060] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.595741 11396 raft_consensus.cc:1275] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Refusing update from remote peer ca9ea67ff4ae4261b3829d00316d8e87: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:46.597424 11335 consensus_queue.cc:1048] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:46.610509 11165 raft_consensus.cc:1275] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Refusing update from remote peer ca9ea67ff4ae4261b3829d00316d8e87: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:46.614209 11440 consensus_queue.cc:1048] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:03:46.644642 10963 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:46.721207 11090 raft_consensus.cc:1275] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Refusing update from remote peer c915415c45b84f77af0116dd589ca3eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:46.722689 11448 consensus_queue.cc:1048] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:46.733052 11396 raft_consensus.cc:1275] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Refusing update from remote peer c915415c45b84f77af0116dd589ca3eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:46.734644 11439 consensus_queue.cc:1048] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:46.959937   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:46.968235 11090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ebcedc4294d44909dab672ad2f13cda"
dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
mode: GRACEFUL
new_leader_uuid: "c915415c45b84f77af0116dd589ca3eb"
 from {username='slave'} at 127.0.0.1:52458
I20260709 13:03:46.968755 11090 raft_consensus.cc:606] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 LEADER]: Received request to transfer leadership to TS c915415c45b84f77af0116dd589ca3eb
I20260709 13:03:46.972311 11165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ef5d307c2824d0f9701fd04d02d9f25"
dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
mode: GRACEFUL
new_leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
 from {username='slave'} at 127.0.0.1:48676
I20260709 13:03:46.973028 11165 raft_consensus.cc:606] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Received request to transfer leadership to TS ca9ea67ff4ae4261b3829d00316d8e87
I20260709 13:03:46.974594   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:46.975174   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:46.975785   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:47.108889 11335 raft_consensus.cc:993] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87: : Instructing follower c915415c45b84f77af0116dd589ca3eb to start an election
I20260709 13:03:47.109479 11457 raft_consensus.cc:1081] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 LEADER]: Signalling peer c915415c45b84f77af0116dd589ca3eb to start an election
I20260709 13:03:47.111039 11165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ebcedc4294d44909dab672ad2f13cda"
dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
 from {username='slave'} at 127.0.0.1:57172
I20260709 13:03:47.111541 11165 raft_consensus.cc:493] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:47.111784 11165 raft_consensus.cc:3060] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:47.117101 11165 raft_consensus.cc:515] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:47.118705 11165 leader_election.cc:290] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:47.119660 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebcedc4294d44909dab672ad2f13cda" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:47.119721 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebcedc4294d44909dab672ad2f13cda" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
I20260709 13:03:47.120334 11396 raft_consensus.cc:3060] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:47.120442 11090 raft_consensus.cc:3055] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:47.120935 11090 raft_consensus.cc:740] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:47.121667 11090 consensus_queue.cc:260] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:47.122627 11090 raft_consensus.cc:3060] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:47.126163 11396 raft_consensus.cc:2468] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 2.
I20260709 13:03:47.127372 11131 leader_election.cc:304] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb; no voters: 
I20260709 13:03:47.127614 11090 raft_consensus.cc:2468] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 2.
I20260709 13:03:47.128191 11439 raft_consensus.cc:2804] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:47.128849 11439 raft_consensus.cc:697] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Becoming Leader. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:47.129877 11439 consensus_queue.cc:237] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:47.137262 10915 catalog_manager.cc:5697] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb reported cstate change: term changed from 1 to 2, leader changed from ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194) to c915415c45b84f77af0116dd589ca3eb (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c915415c45b84f77af0116dd589ca3eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:47.455847 11439 raft_consensus.cc:993] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb: : Instructing follower ca9ea67ff4ae4261b3829d00316d8e87 to start an election
I20260709 13:03:47.456339 11448 raft_consensus.cc:1081] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Signalling peer ca9ea67ff4ae4261b3829d00316d8e87 to start an election
I20260709 13:03:47.458052 11090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ef5d307c2824d0f9701fd04d02d9f25"
dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
 from {username='slave'} at 127.0.0.1:51150
I20260709 13:03:47.459039 11090 raft_consensus.cc:493] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:47.459493 11090 raft_consensus.cc:3060] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:47.465821 11090 raft_consensus.cc:515] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:47.467429 11090 leader_election.cc:290] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 3 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:47.468382 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5d307c2824d0f9701fd04d02d9f25" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:47.468670 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5d307c2824d0f9701fd04d02d9f25" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:47.469115 11396 raft_consensus.cc:3060] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:47.469167 11165 raft_consensus.cc:3055] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:47.469664 11165 raft_consensus.cc:740] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:47.470534 11165 consensus_queue.cc:260] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:47.471820 11165 raft_consensus.cc:3060] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:47.477419 11396 raft_consensus.cc:2468] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 3.
I20260709 13:03:47.479143 11057 leader_election.cc:304] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:47.480002 11457 raft_consensus.cc:2804] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:47.480041 11165 raft_consensus.cc:2468] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 3.
I20260709 13:03:47.480767 11457 raft_consensus.cc:697] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 LEADER]: Becoming Leader. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:47.482033 11457 consensus_queue.cc:237] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:47.493886 10915 catalog_manager.cc:5697] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 reported cstate change: term changed from 2 to 3, leader changed from c915415c45b84f77af0116dd589ca3eb (127.0.107.195) to ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:47.590787 11090 raft_consensus.cc:1275] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Refusing update from remote peer c915415c45b84f77af0116dd589ca3eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.592576 11448 consensus_queue.cc:1048] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.603302 11396 raft_consensus.cc:1275] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Refusing update from remote peer c915415c45b84f77af0116dd589ca3eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.605141 11340 consensus_queue.cc:1048] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:47.645799 10963 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:47.966070 11165 raft_consensus.cc:1275] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Refusing update from remote peer ca9ea67ff4ae4261b3829d00316d8e87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:47.967886 11457 consensus_queue.cc:1048] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:47.981056 11396 raft_consensus.cc:1275] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Refusing update from remote peer ca9ea67ff4ae4261b3829d00316d8e87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:47.982450   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:47.982869 11335 consensus_queue.cc:1048] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:48.000800 11090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964"
dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
mode: GRACEFUL
new_leader_uuid: "c915415c45b84f77af0116dd589ca3eb"
 from {username='slave'} at 127.0.0.1:52458
I20260709 13:03:48.001411 11090 raft_consensus.cc:606] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 LEADER]: Received request to transfer leadership to TS c915415c45b84f77af0116dd589ca3eb
I20260709 13:03:48.004680 11165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98cb40c0103f4be4b3c70690b6c73403"
dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
mode: GRACEFUL
new_leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
 from {username='slave'} at 127.0.0.1:48676
I20260709 13:03:48.005182 11165 raft_consensus.cc:606] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 1 LEADER]: Received request to transfer leadership to TS ca9ea67ff4ae4261b3829d00316d8e87
I20260709 13:03:48.006374   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:48.007102   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:48.007779   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:48.055106 11470 raft_consensus.cc:993] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87: : Instructing follower c915415c45b84f77af0116dd589ca3eb to start an election
I20260709 13:03:48.055676 11470 raft_consensus.cc:1081] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 LEADER]: Signalling peer c915415c45b84f77af0116dd589ca3eb to start an election
I20260709 13:03:48.057209 11165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964"
dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
 from {username='slave'} at 127.0.0.1:57172
I20260709 13:03:48.057828 11165 raft_consensus.cc:493] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.058105 11165 raft_consensus.cc:3060] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.062835 11165 raft_consensus.cc:515] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:48.064921 11165 leader_election.cc:290] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 4 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:48.065369 11395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:48.065960 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e92fa6252ad448dac0dc99b21309964" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
I20260709 13:03:48.066286 11395 raft_consensus.cc:3060] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.066614 11090 raft_consensus.cc:3055] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:48.067549 11090 raft_consensus.cc:740] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:48.068384 11090 consensus_queue.cc:260] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:48.069597 11090 raft_consensus.cc:3060] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.074352 11395 raft_consensus.cc:2468] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 4.
I20260709 13:03:48.075730 11131 leader_election.cc:304] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb; no voters: 
I20260709 13:03:48.076162 11090 raft_consensus.cc:2468] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 4.
I20260709 13:03:48.076577 11340 raft_consensus.cc:2804] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:48.077188 11340 raft_consensus.cc:697] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 4 LEADER]: Becoming Leader. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:48.077993 11340 consensus_queue.cc:237] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:48.085587 10915 catalog_manager.cc:5697] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb reported cstate change: term changed from 3 to 4, leader changed from ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194) to c915415c45b84f77af0116dd589ca3eb (127.0.107.195). New cstate: current_term: 4 leader_uuid: "c915415c45b84f77af0116dd589ca3eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.422197 11476 raft_consensus.cc:993] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb: : Instructing follower ca9ea67ff4ae4261b3829d00316d8e87 to start an election
I20260709 13:03:48.422674 11476 raft_consensus.cc:1081] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 1 LEADER]: Signalling peer ca9ea67ff4ae4261b3829d00316d8e87 to start an election
I20260709 13:03:48.424492 11090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98cb40c0103f4be4b3c70690b6c73403"
dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
 from {username='slave'} at 127.0.0.1:51150
I20260709 13:03:48.425298 11090 raft_consensus.cc:493] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:48.425668 11090 raft_consensus.cc:3060] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.431152 11090 raft_consensus.cc:515] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:48.432763 11090 leader_election.cc:290] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:48.433605 11395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cb40c0103f4be4b3c70690b6c73403" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:48.434120 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cb40c0103f4be4b3c70690b6c73403" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:48.434329 11395 raft_consensus.cc:3060] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.434727 11165 raft_consensus.cc:3055] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:48.435070 11165 raft_consensus.cc:740] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:48.435940 11165 consensus_queue.cc:260] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:48.437033 11165 raft_consensus.cc:3060] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.440442 11395 raft_consensus.cc:2468] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 2.
I20260709 13:03:48.441735 11057 leader_election.cc:304] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:48.441926 11165 raft_consensus.cc:2468] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 2.
I20260709 13:03:48.442549 11470 raft_consensus.cc:2804] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:48.443076 11470 raft_consensus.cc:697] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 LEADER]: Becoming Leader. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:48.443951 11470 consensus_queue.cc:237] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:48.452361 10915 catalog_manager.cc:5697] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 reported cstate change: term changed from 1 to 2, leader changed from c915415c45b84f77af0116dd589ca3eb (127.0.107.195) to ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.625962 11395 raft_consensus.cc:1275] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 4 FOLLOWER]: Refusing update from remote peer c915415c45b84f77af0116dd589ca3eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:48.627202 11090 raft_consensus.cc:1275] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 4 FOLLOWER]: Refusing update from remote peer c915415c45b84f77af0116dd589ca3eb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:48.627554 11476 consensus_queue.cc:1048] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:48.628710 11439 consensus_queue.cc:1048] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:48.646785 10963 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:48.832793 11395 raft_consensus.cc:1275] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Refusing update from remote peer ca9ea67ff4ae4261b3829d00316d8e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:48.834322 11470 consensus_queue.cc:1048] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:48.844107 11165 raft_consensus.cc:1275] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Refusing update from remote peer ca9ea67ff4ae4261b3829d00316d8e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:48.846712 11457 consensus_queue.cc:1048] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:49.014312   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:49.021979 11165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0"
dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
mode: GRACEFUL
new_leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
 from {username='slave'} at 127.0.0.1:48676
I20260709 13:03:49.022467 11165 raft_consensus.cc:606] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 1 LEADER]: Received request to transfer leadership to TS ca9ea67ff4ae4261b3829d00316d8e87
I20260709 13:03:49.025028 11090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca7814861a6547799f3685cb896d4ea6"
dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
mode: GRACEFUL
new_leader_uuid: "c915415c45b84f77af0116dd589ca3eb"
 from {username='slave'} at 127.0.0.1:52458
I20260709 13:03:49.025480 11090 raft_consensus.cc:606] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 LEADER]: Received request to transfer leadership to TS c915415c45b84f77af0116dd589ca3eb
I20260709 13:03:49.026628   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:49.027266   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:49.027956   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:49.268667 11470 raft_consensus.cc:993] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87: : Instructing follower c915415c45b84f77af0116dd589ca3eb to start an election
I20260709 13:03:49.269289 11457 raft_consensus.cc:1081] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 LEADER]: Signalling peer c915415c45b84f77af0116dd589ca3eb to start an election
I20260709 13:03:49.270774 11165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca7814861a6547799f3685cb896d4ea6"
dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
 from {username='slave'} at 127.0.0.1:57172
I20260709 13:03:49.271266 11165 raft_consensus.cc:493] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:49.271541 11165 raft_consensus.cc:3060] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.276547 11165 raft_consensus.cc:515] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:49.278154 11165 leader_election.cc:290] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:49.279160 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca7814861a6547799f3685cb896d4ea6" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
I20260709 13:03:49.279023 11395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca7814861a6547799f3685cb896d4ea6" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:49.279980 11090 raft_consensus.cc:3055] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:49.280054 11395 raft_consensus.cc:3060] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.280378 11090 raft_consensus.cc:740] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:49.281302 11090 consensus_queue.cc:260] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:49.282648 11090 raft_consensus.cc:3060] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.286787 11395 raft_consensus.cc:2468] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 2.
I20260709 13:03:49.287818 11090 raft_consensus.cc:2468] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 2.
I20260709 13:03:49.287987 11131 leader_election.cc:304] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb; no voters: 
I20260709 13:03:49.288964 11439 raft_consensus.cc:2804] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:49.289937 11439 raft_consensus.cc:697] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Becoming Leader. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:49.290725 11439 consensus_queue.cc:237] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:49.297940 10913 catalog_manager.cc:5697] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb reported cstate change: term changed from 1 to 2, leader changed from ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194) to c915415c45b84f77af0116dd589ca3eb (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c915415c45b84f77af0116dd589ca3eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:49.588624 11486 raft_consensus.cc:993] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb: : Instructing follower ca9ea67ff4ae4261b3829d00316d8e87 to start an election
I20260709 13:03:49.589155 11439 raft_consensus.cc:1081] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 1 LEADER]: Signalling peer ca9ea67ff4ae4261b3829d00316d8e87 to start an election
I20260709 13:03:49.590819 11090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0"
dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
 from {username='slave'} at 127.0.0.1:51150
I20260709 13:03:49.591260 11090 raft_consensus.cc:493] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:49.591485 11090 raft_consensus.cc:3060] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.596149 11090 raft_consensus.cc:515] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:49.597605 11090 leader_election.cc:290] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:49.598754 11166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:49.599228 11395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:49.599450 11166 raft_consensus.cc:3055] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:49.599830 11166 raft_consensus.cc:740] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:49.599845 11395 raft_consensus.cc:3060] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.601027 11166 consensus_queue.cc:260] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:49.602490 11166 raft_consensus.cc:3060] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.608099 11395 raft_consensus.cc:2468] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 2.
I20260709 13:03:49.609602 11057 leader_election.cc:304] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:49.610484 11491 raft_consensus.cc:2804] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:49.610783 11166 raft_consensus.cc:2468] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 2.
I20260709 13:03:49.611187 11491 raft_consensus.cc:697] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 LEADER]: Becoming Leader. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:49.612196 11491 consensus_queue.cc:237] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:49.619295 10913 catalog_manager.cc:5697] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 reported cstate change: term changed from 1 to 2, leader changed from c915415c45b84f77af0116dd589ca3eb (127.0.107.195) to ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:49.647847 10963 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:49.683660 11090 raft_consensus.cc:1275] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Refusing update from remote peer c915415c45b84f77af0116dd589ca3eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.685206 11439 consensus_queue.cc:1048] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.696182 11395 raft_consensus.cc:1275] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Refusing update from remote peer c915415c45b84f77af0116dd589ca3eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.698256 11439 consensus_queue.cc:1048] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:50.035375   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:50.044548 11166 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ebcedc4294d44909dab672ad2f13cda"
dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
mode: GRACEFUL
new_leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
 from {username='slave'} at 127.0.0.1:48676
I20260709 13:03:50.045236 11166 raft_consensus.cc:606] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Received request to transfer leadership to TS ca9ea67ff4ae4261b3829d00316d8e87
I20260709 13:03:50.048638 11090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0"
dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
mode: GRACEFUL
new_leader_uuid: "c915415c45b84f77af0116dd589ca3eb"
 from {username='slave'} at 127.0.0.1:52458
I20260709 13:03:50.049207 11090 raft_consensus.cc:606] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 LEADER]: Received request to transfer leadership to TS c915415c45b84f77af0116dd589ca3eb
I20260709 13:03:50.050755   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:50.051281   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:50.051889   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:50.069514 11166 raft_consensus.cc:1275] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Refusing update from remote peer ca9ea67ff4ae4261b3829d00316d8e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:50.071265 11470 consensus_queue.cc:1048] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:50.078640 11491 raft_consensus.cc:993] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87: : Instructing follower c915415c45b84f77af0116dd589ca3eb to start an election
I20260709 13:03:50.079151 11491 raft_consensus.cc:1081] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 LEADER]: Signalling peer c915415c45b84f77af0116dd589ca3eb to start an election
I20260709 13:03:50.081502 11165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0"
dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
 from {username='slave'} at 127.0.0.1:57172
I20260709 13:03:50.083840 11165 raft_consensus.cc:493] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:50.084250 11165 raft_consensus.cc:3060] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.087411 11396 raft_consensus.cc:1275] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Refusing update from remote peer ca9ea67ff4ae4261b3829d00316d8e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:50.089213 11470 consensus_queue.cc:1048] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:50.093129 11165 raft_consensus.cc:515] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:50.099372 11090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
I20260709 13:03:50.100008 11090 raft_consensus.cc:3055] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:50.100353 11090 raft_consensus.cc:740] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:50.101058 11090 consensus_queue.cc:260] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:50.101975 11165 leader_election.cc:290] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 3 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194:39931)
I20260709 13:03:50.103994 11395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f85914203c419293a1652cda6c1ca0" candidate_uuid: "c915415c45b84f77af0116dd589ca3eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:50.104259 11090 raft_consensus.cc:3060] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.104733 11395 raft_consensus.cc:3060] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.111092 11395 raft_consensus.cc:2468] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 3.
I20260709 13:03:50.111876 11090 raft_consensus.cc:2468] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c915415c45b84f77af0116dd589ca3eb in term 3.
I20260709 13:03:50.112664 11131 leader_election.cc:304] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, c915415c45b84f77af0116dd589ca3eb; no voters: 
I20260709 13:03:50.113533 11439 raft_consensus.cc:2804] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:50.114101 11439 raft_consensus.cc:697] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 3 LEADER]: Becoming Leader. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:50.114880 11439 consensus_queue.cc:237] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:50.121304 10913 catalog_manager.cc:5697] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb reported cstate change: term changed from 2 to 3, leader changed from ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194) to c915415c45b84f77af0116dd589ca3eb (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c915415c45b84f77af0116dd589ca3eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.235409 11439 raft_consensus.cc:993] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb: : Instructing follower ca9ea67ff4ae4261b3829d00316d8e87 to start an election
I20260709 13:03:50.235891 11439 raft_consensus.cc:1081] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Signalling peer ca9ea67ff4ae4261b3829d00316d8e87 to start an election
I20260709 13:03:50.237421 11090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ebcedc4294d44909dab672ad2f13cda"
dest_uuid: "ca9ea67ff4ae4261b3829d00316d8e87"
 from {username='slave'} at 127.0.0.1:51150
I20260709 13:03:50.237914 11090 raft_consensus.cc:493] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:50.238166 11090 raft_consensus.cc:3060] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.242815 11090 raft_consensus.cc:515] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:50.244903 11090 leader_election.cc:290] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 3 election: Requested vote from peers 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415), c915415c45b84f77af0116dd589ca3eb (127.0.107.195:36571)
I20260709 13:03:50.245820 11165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebcedc4294d44909dab672ad2f13cda" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c915415c45b84f77af0116dd589ca3eb"
I20260709 13:03:50.245733 11395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebcedc4294d44909dab672ad2f13cda" candidate_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414"
I20260709 13:03:50.246589 11165 raft_consensus.cc:3055] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:50.246637 11395 raft_consensus.cc:3060] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.247005 11165 raft_consensus.cc:740] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c915415c45b84f77af0116dd589ca3eb, State: Running, Role: LEADER
I20260709 13:03:50.247802 11165 consensus_queue.cc:260] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:50.249001 11165 raft_consensus.cc:3060] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.254143 11395 raft_consensus.cc:2468] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 3.
I20260709 13:03:50.255581 11057 leader_election.cc:304] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c6ca470f7b408ca1fb7b7f3ad65414, ca9ea67ff4ae4261b3829d00316d8e87; no voters: 
I20260709 13:03:50.255864 11165 raft_consensus.cc:2468] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9ea67ff4ae4261b3829d00316d8e87 in term 3.
I20260709 13:03:50.256294 11470 raft_consensus.cc:2804] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:50.256937 11470 raft_consensus.cc:697] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 LEADER]: Becoming Leader. State: Replica: ca9ea67ff4ae4261b3829d00316d8e87, State: Running, Role: LEADER
I20260709 13:03:50.257822 11470 consensus_queue.cc:237] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } }
I20260709 13:03:50.265159 10913 catalog_manager.cc:5697] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 reported cstate change: term changed from 2 to 3, leader changed from c915415c45b84f77af0116dd589ca3eb (127.0.107.195) to ca9ea67ff4ae4261b3829d00316d8e87 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.522928 11395 raft_consensus.cc:1275] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Refusing update from remote peer c915415c45b84f77af0116dd589ca3eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:50.524262 11505 consensus_queue.cc:1048] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:50.533959 11090 raft_consensus.cc:1275] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Refusing update from remote peer c915415c45b84f77af0116dd589ca3eb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:50.535772 11439 consensus_queue.cc:1048] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9ea67ff4ae4261b3829d00316d8e87" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:50.648931 10963 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:50.650338 11165 raft_consensus.cc:1275] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Refusing update from remote peer ca9ea67ff4ae4261b3829d00316d8e87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:50.651801 11470 consensus_queue.cc:1048] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c915415c45b84f77af0116dd589ca3eb" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:50.661432 11395 raft_consensus.cc:1275] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Refusing update from remote peer ca9ea67ff4ae4261b3829d00316d8e87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:50.663542 11470 consensus_queue.cc:1048] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c6ca470f7b408ca1fb7b7f3ad65414" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:51.059369   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:51.090327   431 tablet_server.cc:179] TabletServer@127.0.107.193:36415 shutting down...
W20260709 13:03:51.107324 11057 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:03:51.114882 11057 consensus_peers.cc:597] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.117571   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:51.118461   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:51.119354   431 raft_consensus.cc:2243] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.119930   431 raft_consensus.cc:2272] T 98cb40c0103f4be4b3c70690b6c73403 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.122504   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:51.123334   431 raft_consensus.cc:2243] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.123883   431 raft_consensus.cc:2272] T 5ef5d307c2824d0f9701fd04d02d9f25 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.126092   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:51.126849   431 raft_consensus.cc:2243] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.127470   431 raft_consensus.cc:2272] T 2ebcedc4294d44909dab672ad2f13cda P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.127492 11131 consensus_peers.cc:597] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.132858   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:51.133567   431 raft_consensus.cc:2243] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.134006   431 raft_consensus.cc:2272] T 5040dbf98d7646a48eaa60571252ab45 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.135958   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:51.136462   431 raft_consensus.cc:2243] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.136948   431 raft_consensus.cc:2272] T 9b4031e6b89346bda4c8aa52342e7028 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.138808   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:51.139312   431 raft_consensus.cc:2243] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.139678   431 raft_consensus.cc:2272] T 3e92fa6252ad448dac0dc99b21309964 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.141574   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:51.142069   431 raft_consensus.cc:2243] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.142393   431 raft_consensus.cc:2272] T 8854e9ac34a342109991a82cf9fccea2 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.144169   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:51.144740   431 raft_consensus.cc:2243] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.145118   431 raft_consensus.cc:2272] T 74f85914203c419293a1652cda6c1ca0 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.147353   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:51.147828   431 raft_consensus.cc:2243] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.148152   431 raft_consensus.cc:2272] T e3b8940dfe37411ebfe5bc8561f99043 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.149966   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:51.150367   431 raft_consensus.cc:2243] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.150719   431 raft_consensus.cc:2272] T ca7814861a6547799f3685cb896d4ea6 P 34c6ca470f7b408ca1fb7b7f3ad65414 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.182243   431 tablet_server.cc:196] TabletServer@127.0.107.193:36415 shutdown complete.
I20260709 13:03:51.202955   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:51.229816 11131 consensus_peers.cc:597] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.247020   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:51.247968   431 tablet_replica.cc:333] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87: stopping tablet replica
I20260709 13:03:51.249104   431 raft_consensus.cc:2243] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.249871   431 raft_consensus.cc:2272] T 5040dbf98d7646a48eaa60571252ab45 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.252465   431 tablet_replica.cc:333] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87: stopping tablet replica
I20260709 13:03:51.253153   431 raft_consensus.cc:2243] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.253571   431 raft_consensus.cc:2272] T 9b4031e6b89346bda4c8aa52342e7028 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.255890   431 tablet_replica.cc:333] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87: stopping tablet replica
I20260709 13:03:51.256402   431 raft_consensus.cc:2243] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.257201   431 raft_consensus.cc:2272] T 98cb40c0103f4be4b3c70690b6c73403 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.259292   431 tablet_replica.cc:333] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87: stopping tablet replica
I20260709 13:03:51.259997   431 raft_consensus.cc:2243] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.260869   431 raft_consensus.cc:2272] T 2ebcedc4294d44909dab672ad2f13cda P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.264796   431 tablet_replica.cc:333] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87: stopping tablet replica
W20260709 13:03:51.265314 11057 consensus_peers.cc:597] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 -> Peer 34c6ca470f7b408ca1fb7b7f3ad65414 (127.0.107.193:36415): Couldn't send request to peer 34c6ca470f7b408ca1fb7b7f3ad65414. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.265529   431 raft_consensus.cc:2243] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.266777   431 raft_consensus.cc:2272] T 5ef5d307c2824d0f9701fd04d02d9f25 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.269249   431 tablet_replica.cc:333] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87: stopping tablet replica
I20260709 13:03:51.269869   431 raft_consensus.cc:2243] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.270284   431 raft_consensus.cc:2272] T 3e92fa6252ad448dac0dc99b21309964 P ca9ea67ff4ae4261b3829d00316d8e87 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.272782   431 tablet_replica.cc:333] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87: stopping tablet replica
I20260709 13:03:51.273433   431 raft_consensus.cc:2243] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.274374   431 raft_consensus.cc:2272] T 8854e9ac34a342109991a82cf9fccea2 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.277825   431 tablet_replica.cc:333] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87: stopping tablet replica
I20260709 13:03:51.278641   431 raft_consensus.cc:2243] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.279233   431 raft_consensus.cc:2272] T 74f85914203c419293a1652cda6c1ca0 P ca9ea67ff4ae4261b3829d00316d8e87 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.282021   431 tablet_replica.cc:333] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87: stopping tablet replica
I20260709 13:03:51.282622   431 raft_consensus.cc:2243] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.283047   431 raft_consensus.cc:2272] T ca7814861a6547799f3685cb896d4ea6 P ca9ea67ff4ae4261b3829d00316d8e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.285593   431 tablet_replica.cc:333] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87: stopping tablet replica
I20260709 13:03:51.286167   431 raft_consensus.cc:2243] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.287161   431 raft_consensus.cc:2272] T e3b8940dfe37411ebfe5bc8561f99043 P ca9ea67ff4ae4261b3829d00316d8e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.321856   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:51.347285   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:51.378885   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:51.379745   431 tablet_replica.cc:333] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb: stopping tablet replica
I20260709 13:03:51.380494   431 raft_consensus.cc:2243] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.381482   431 raft_consensus.cc:2272] T 5040dbf98d7646a48eaa60571252ab45 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.383762   431 tablet_replica.cc:333] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb: stopping tablet replica
I20260709 13:03:51.384454   431 raft_consensus.cc:2243] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.385458   431 raft_consensus.cc:2272] T 9b4031e6b89346bda4c8aa52342e7028 P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.387645   431 tablet_replica.cc:333] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb: stopping tablet replica
I20260709 13:03:51.388145   431 raft_consensus.cc:2243] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.388535   431 raft_consensus.cc:2272] T 98cb40c0103f4be4b3c70690b6c73403 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.390690   431 tablet_replica.cc:333] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb: stopping tablet replica
I20260709 13:03:51.391225   431 raft_consensus.cc:2243] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.391626   431 raft_consensus.cc:2272] T 5ef5d307c2824d0f9701fd04d02d9f25 P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.393813   431 tablet_replica.cc:333] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb: stopping tablet replica
I20260709 13:03:51.394375   431 raft_consensus.cc:2243] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.394793   431 raft_consensus.cc:2272] T 2ebcedc4294d44909dab672ad2f13cda P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.397863   431 tablet_replica.cc:333] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb: stopping tablet replica
I20260709 13:03:51.398733   431 raft_consensus.cc:2243] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.399736   431 raft_consensus.cc:2272] T ca7814861a6547799f3685cb896d4ea6 P c915415c45b84f77af0116dd589ca3eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.401863   431 tablet_replica.cc:333] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb: stopping tablet replica
I20260709 13:03:51.402416   431 raft_consensus.cc:2243] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.402904   431 raft_consensus.cc:2272] T e3b8940dfe37411ebfe5bc8561f99043 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.405687   431 tablet_replica.cc:333] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb: stopping tablet replica
I20260709 13:03:51.406369   431 raft_consensus.cc:2243] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.406853   431 raft_consensus.cc:2272] T 8854e9ac34a342109991a82cf9fccea2 P c915415c45b84f77af0116dd589ca3eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.409188   431 tablet_replica.cc:333] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb: stopping tablet replica
I20260709 13:03:51.409718   431 raft_consensus.cc:2243] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.410519   431 raft_consensus.cc:2272] T 3e92fa6252ad448dac0dc99b21309964 P c915415c45b84f77af0116dd589ca3eb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.412824   431 tablet_replica.cc:333] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb: stopping tablet replica
I20260709 13:03:51.413365   431 raft_consensus.cc:2243] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.414227   431 raft_consensus.cc:2272] T 74f85914203c419293a1652cda6c1ca0 P c915415c45b84f77af0116dd589ca3eb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.458281   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:51.486050   431 master.cc:562] Master@127.0.107.254:46721 shutting down...
I20260709 13:03:51.513008   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.513563   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.513868   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9d3cd824f61a43a0ab6d7acaf4c45853: stopping tablet replica
I20260709 13:03:51.537058   431 master.cc:584] Master@127.0.107.254:46721 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (15157 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:03:51.591321   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:36373
I20260709 13:03:51.592782   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:51.598744 11518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:51.598786 11517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:51.600965 11520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:51.602003   431 server_base.cc:1061] running on GCE node
I20260709 13:03:51.603120   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:51.603367   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:51.603531   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602231603513 us; error 0 us; skew 500 ppm
I20260709 13:03:51.604518   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:51.607754   431 webserver.cc:533] Webserver started at http://127.0.107.254:34185/ using document root <none> and password file <none>
I20260709 13:03:51.608340   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:51.608557   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:51.609019   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:51.610173   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/master-0-root/instance:
uuid: "8ebfa774f4d84508b389619d856ec284"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-c08m"
I20260709 13:03:51.615183   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:03:51.619557 11525 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.620473   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:03:51.620867   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/master-0-root
uuid: "8ebfa774f4d84508b389619d856ec284"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-c08m"
I20260709 13:03:51.621239   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:51.639184   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:51.640502   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:51.683334   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:36373
I20260709 13:03:51.683455 11576 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:36373 every 8 connection(s)
I20260709 13:03:51.687306 11577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:51.699436 11577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284: Bootstrap starting.
I20260709 13:03:51.704883 11577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.709481 11577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284: No bootstrap required, opened a new log
I20260709 13:03:51.712049 11577 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ebfa774f4d84508b389619d856ec284" member_type: VOTER }
I20260709 13:03:51.712456 11577 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.712814 11577 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ebfa774f4d84508b389619d856ec284, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.713459 11577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ebfa774f4d84508b389619d856ec284" member_type: VOTER }
I20260709 13:03:51.713919 11577 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:51.714169 11577 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:51.714470 11577 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.720212 11577 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ebfa774f4d84508b389619d856ec284" member_type: VOTER }
I20260709 13:03:51.721004 11577 leader_election.cc:304] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ebfa774f4d84508b389619d856ec284; no voters: 
I20260709 13:03:51.722314 11577 leader_election.cc:290] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:51.722892 11580 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.724494 11580 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [term 1 LEADER]: Becoming Leader. State: Replica: 8ebfa774f4d84508b389619d856ec284, State: Running, Role: LEADER
I20260709 13:03:51.725267 11580 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ebfa774f4d84508b389619d856ec284" member_type: VOTER }
I20260709 13:03:51.725486 11577 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:51.730973 11582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ebfa774f4d84508b389619d856ec284. Latest consensus state: current_term: 1 leader_uuid: "8ebfa774f4d84508b389619d856ec284" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ebfa774f4d84508b389619d856ec284" member_type: VOTER } }
I20260709 13:03:51.731150 11581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ebfa774f4d84508b389619d856ec284" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ebfa774f4d84508b389619d856ec284" member_type: VOTER } }
I20260709 13:03:51.731755 11582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:51.731995 11581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:51.734675 11589 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:51.739847 11589 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:51.743283   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:51.749678 11589 catalog_manager.cc:1383] Generated new cluster ID: 0abbb756a1624b76bdca34bca251fb56
I20260709 13:03:51.750006 11589 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:51.774252 11589 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:51.775645 11589 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:51.798928 11589 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284: Generated new TSK 0
I20260709 13:03:51.799594 11589 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:51.810784   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:51.818094 11598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:51.819214 11599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:51.820061 11601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:51.821262   431 server_base.cc:1061] running on GCE node
I20260709 13:03:51.822321   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:51.822521   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:51.822652   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602231822641 us; error 0 us; skew 500 ppm
I20260709 13:03:51.823320   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:51.825930   431 webserver.cc:533] Webserver started at http://127.0.107.193:36181/ using document root <none> and password file <none>
I20260709 13:03:51.826467   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:51.826683   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:51.827041   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:51.828356   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-0-root/instance:
uuid: "6dde46af447142a38edbae78f8ca719d"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-c08m"
I20260709 13:03:51.833151   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:03:51.836952 11606 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.838081   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:03:51.838404   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-0-root
uuid: "6dde46af447142a38edbae78f8ca719d"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-c08m"
I20260709 13:03:51.838670   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:51.863193   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:51.864435   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:51.866070   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:51.868844   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:51.869046   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.869331   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:51.869483   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.920279   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:37307
I20260709 13:03:51.920360 11668 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:37307 every 8 connection(s)
I20260709 13:03:51.926869   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:51.935858 11673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:51.937337 11674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:51.940894 11676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:51.940939   431 server_base.cc:1061] running on GCE node
I20260709 13:03:51.942732   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:51.943038   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:51.943246   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602231943228 us; error 0 us; skew 500 ppm
I20260709 13:03:51.944186   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:51.944782 11669 heartbeater.cc:344] Connected to a master server at 127.0.107.254:36373
I20260709 13:03:51.945281 11669 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:51.946467 11669 heartbeater.cc:507] Master 127.0.107.254:36373 requested a full tablet report, sending...
I20260709 13:03:51.948504   431 webserver.cc:533] Webserver started at http://127.0.107.194:42199/ using document root <none> and password file <none>
I20260709 13:03:51.949323   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:51.949594   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:51.949590 11542 ts_manager.cc:194] Registered new tserver with Master: 6dde46af447142a38edbae78f8ca719d (127.0.107.193:37307)
I20260709 13:03:51.950206   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:51.952088   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-1-root/instance:
uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-c08m"
I20260709 13:03:51.952673 11542 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44782
I20260709 13:03:51.958807   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:51.963546 11681 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:51.965180   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:03:51.965494   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-1-root
uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8"
format_stamp: "Formatted at 2026-07-09 13:03:51 on dist-test-slave-c08m"
I20260709 13:03:51.965765   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:51.986963   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:51.988193   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:51.990031   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:51.992527   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:51.992825   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:03:51.993106   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:51.993302   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:52.045696   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39185
I20260709 13:03:52.045846 11743 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39185 every 8 connection(s)
I20260709 13:03:52.051218   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:52.060058 11748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:52.060058 11747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:52.064898 11744 heartbeater.cc:344] Connected to a master server at 127.0.107.254:36373
W20260709 13:03:52.065059 11750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:52.065840 11744 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:52.066816 11744 heartbeater.cc:507] Master 127.0.107.254:36373 requested a full tablet report, sending...
I20260709 13:03:52.067606   431 server_base.cc:1061] running on GCE node
I20260709 13:03:52.068872   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:52.069125   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:52.069324   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602232069300 us; error 0 us; skew 500 ppm
I20260709 13:03:52.069337 11542 ts_manager.cc:194] Registered new tserver with Master: 0fbf5f688bb34ce6ad0cb6ae977abee8 (127.0.107.194:39185)
I20260709 13:03:52.069972   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:52.071403 11542 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44792
I20260709 13:03:52.073207   431 webserver.cc:533] Webserver started at http://127.0.107.195:37189/ using document root <none> and password file <none>
I20260709 13:03:52.073846   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:52.074111   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:52.074381   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:52.075618   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-2-root/instance:
uuid: "c84757ae63834b71b34ff9140172b557"
format_stamp: "Formatted at 2026-07-09 13:03:52 on dist-test-slave-c08m"
I20260709 13:03:52.081090   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:03:52.084852 11755 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:52.085790   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:03:52.086119   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-2-root
uuid: "c84757ae63834b71b34ff9140172b557"
format_stamp: "Formatted at 2026-07-09 13:03:52 on dist-test-slave-c08m"
I20260709 13:03:52.086433   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601889622018-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:52.115223   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:52.116570   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:52.118270   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:52.120466   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:52.120723   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:03:52.120910   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:52.121035   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:52.169313   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:35939
I20260709 13:03:52.169411 11817 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:35939 every 8 connection(s)
I20260709 13:03:52.185113 11818 heartbeater.cc:344] Connected to a master server at 127.0.107.254:36373
I20260709 13:03:52.185621 11818 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:52.186805 11818 heartbeater.cc:507] Master 127.0.107.254:36373 requested a full tablet report, sending...
I20260709 13:03:52.189087 11542 ts_manager.cc:194] Registered new tserver with Master: c84757ae63834b71b34ff9140172b557 (127.0.107.195:35939)
I20260709 13:03:52.189826   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016519929s
I20260709 13:03:52.190587 11542 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44808
I20260709 13:03:52.223073 11542 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44820:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:52.226068 11542 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:52.276691 11634 tablet_service.cc:1511] Processing CreateTablet for tablet acfca01d52104fc5980fae814eb752c3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=9b40dc73698a4c7684d6a602b55512dc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:52.278167 11634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acfca01d52104fc5980fae814eb752c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.279968 11633 tablet_service.cc:1511] Processing CreateTablet for tablet 966d56df2a3d4d4e8cd9bf3e1495695f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=9b40dc73698a4c7684d6a602b55512dc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:52.281574 11633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966d56df2a3d4d4e8cd9bf3e1495695f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.286214 11783 tablet_service.cc:1511] Processing CreateTablet for tablet acfca01d52104fc5980fae814eb752c3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=9b40dc73698a4c7684d6a602b55512dc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:52.287796 11783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acfca01d52104fc5980fae814eb752c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.287933 11782 tablet_service.cc:1511] Processing CreateTablet for tablet 966d56df2a3d4d4e8cd9bf3e1495695f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=9b40dc73698a4c7684d6a602b55512dc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:52.293624 11782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966d56df2a3d4d4e8cd9bf3e1495695f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.289862 11709 tablet_service.cc:1511] Processing CreateTablet for tablet acfca01d52104fc5980fae814eb752c3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=9b40dc73698a4c7684d6a602b55512dc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:52.292104 11708 tablet_service.cc:1511] Processing CreateTablet for tablet 966d56df2a3d4d4e8cd9bf3e1495695f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=9b40dc73698a4c7684d6a602b55512dc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:52.299314 11709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acfca01d52104fc5980fae814eb752c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.304693 11708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966d56df2a3d4d4e8cd9bf3e1495695f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.310905 11833 tablet_bootstrap.cc:492] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d: Bootstrap starting.
I20260709 13:03:52.321138 11833 tablet_bootstrap.cc:654] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.312963 11834 tablet_bootstrap.cc:492] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557: Bootstrap starting.
I20260709 13:03:52.327946 11835 tablet_bootstrap.cc:492] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8: Bootstrap starting.
I20260709 13:03:52.328279 11834 tablet_bootstrap.cc:654] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.333264 11833 tablet_bootstrap.cc:492] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d: No bootstrap required, opened a new log
I20260709 13:03:52.333777 11833 ts_tablet_manager.cc:1403] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:03:52.335021 11834 tablet_bootstrap.cc:492] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557: No bootstrap required, opened a new log
I20260709 13:03:52.335570 11834 ts_tablet_manager.cc:1403] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 13:03:52.335733 11835 tablet_bootstrap.cc:654] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.337366 11833 raft_consensus.cc:359] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } } peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } }
I20260709 13:03:52.338232 11833 raft_consensus.cc:385] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.338562 11833 raft_consensus.cc:740] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dde46af447142a38edbae78f8ca719d, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.339100 11834 raft_consensus.cc:359] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } } peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } }
I20260709 13:03:52.339381 11833 consensus_queue.cc:260] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } } peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } }
I20260709 13:03:52.339916 11834 raft_consensus.cc:385] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.340248 11834 raft_consensus.cc:740] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84757ae63834b71b34ff9140172b557, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.341194 11834 consensus_queue.cc:260] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } } peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } }
I20260709 13:03:52.342160 11669 heartbeater.cc:499] Master 127.0.107.254:36373 was elected leader, sending a full tablet report...
I20260709 13:03:52.342562 11833 ts_tablet_manager.cc:1434] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:03:52.343979 11833 tablet_bootstrap.cc:492] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d: Bootstrap starting.
I20260709 13:03:52.347963 11835 tablet_bootstrap.cc:492] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8: No bootstrap required, opened a new log
I20260709 13:03:52.348660 11835 ts_tablet_manager.cc:1403] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:03:52.352100 11835 raft_consensus.cc:359] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.352914 11835 raft_consensus.cc:385] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.353226 11835 raft_consensus.cc:740] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fbf5f688bb34ce6ad0cb6ae977abee8, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.353996 11833 tablet_bootstrap.cc:654] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.354197 11835 consensus_queue.cc:260] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.364043 11835 ts_tablet_manager.cc:1434] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 13:03:52.364320 11744 heartbeater.cc:499] Master 127.0.107.254:36373 was elected leader, sending a full tablet report...
I20260709 13:03:52.365223 11835 tablet_bootstrap.cc:492] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8: Bootstrap starting.
I20260709 13:03:52.372864 11835 tablet_bootstrap.cc:654] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.375401 11833 tablet_bootstrap.cc:492] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d: No bootstrap required, opened a new log
I20260709 13:03:52.376025 11833 ts_tablet_manager.cc:1403] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.008s
I20260709 13:03:52.379588 11833 raft_consensus.cc:359] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.380435 11833 raft_consensus.cc:385] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.380829 11833 raft_consensus.cc:740] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dde46af447142a38edbae78f8ca719d, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.381739 11833 consensus_queue.cc:260] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.383878 11833 ts_tablet_manager.cc:1434] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 13:03:52.385596 11818 heartbeater.cc:499] Master 127.0.107.254:36373 was elected leader, sending a full tablet report...
I20260709 13:03:52.386310 11834 ts_tablet_manager.cc:1434] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557: Time spent starting tablet: real 0.050s	user 0.016s	sys 0.032s
I20260709 13:03:52.387523 11834 tablet_bootstrap.cc:492] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557: Bootstrap starting.
I20260709 13:03:52.388960 11835 tablet_bootstrap.cc:492] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8: No bootstrap required, opened a new log
I20260709 13:03:52.389565 11835 ts_tablet_manager.cc:1403] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.011s
I20260709 13:03:52.392781 11835 raft_consensus.cc:359] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } } peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } }
I20260709 13:03:52.393612 11835 raft_consensus.cc:385] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.393896 11835 raft_consensus.cc:740] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fbf5f688bb34ce6ad0cb6ae977abee8, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.394474 11834 tablet_bootstrap.cc:654] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.394809 11835 consensus_queue.cc:260] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } } peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } }
I20260709 13:03:52.397610 11835 ts_tablet_manager.cc:1434] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:03:52.401432 11834 tablet_bootstrap.cc:492] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557: No bootstrap required, opened a new log
I20260709 13:03:52.401978 11834 ts_tablet_manager.cc:1403] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.008s
I20260709 13:03:52.404484 11834 raft_consensus.cc:359] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.405149 11834 raft_consensus.cc:385] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.405392 11834 raft_consensus.cc:740] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84757ae63834b71b34ff9140172b557, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.406096 11834 consensus_queue.cc:260] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.407652 11834 ts_tablet_manager.cc:1434] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:52.444414 11839 raft_consensus.cc:493] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.445130 11839 raft_consensus.cc:515] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } } peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } }
I20260709 13:03:52.447290 11839 leader_election.cc:290] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84757ae63834b71b34ff9140172b557 (127.0.107.195:35939), 0fbf5f688bb34ce6ad0cb6ae977abee8 (127.0.107.194:39185)
I20260709 13:03:52.457185 11793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acfca01d52104fc5980fae814eb752c3" candidate_uuid: "6dde46af447142a38edbae78f8ca719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84757ae63834b71b34ff9140172b557" is_pre_election: true
I20260709 13:03:52.457921 11793 raft_consensus.cc:2468] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dde46af447142a38edbae78f8ca719d in term 0.
I20260709 13:03:52.459044 11608 leader_election.cc:304] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dde46af447142a38edbae78f8ca719d, c84757ae63834b71b34ff9140172b557; no voters: 
I20260709 13:03:52.460129 11839 raft_consensus.cc:2804] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.460515 11839 raft_consensus.cc:493] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.460888 11839 raft_consensus.cc:3060] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.462546 11719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acfca01d52104fc5980fae814eb752c3" candidate_uuid: "6dde46af447142a38edbae78f8ca719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" is_pre_election: true
I20260709 13:03:52.463359 11719 raft_consensus.cc:2468] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dde46af447142a38edbae78f8ca719d in term 0.
I20260709 13:03:52.467540 11839 raft_consensus.cc:515] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } } peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } }
I20260709 13:03:52.469522 11839 leader_election.cc:290] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [CANDIDATE]: Term 1 election: Requested vote from peers c84757ae63834b71b34ff9140172b557 (127.0.107.195:35939), 0fbf5f688bb34ce6ad0cb6ae977abee8 (127.0.107.194:39185)
I20260709 13:03:52.470434 11793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acfca01d52104fc5980fae814eb752c3" candidate_uuid: "6dde46af447142a38edbae78f8ca719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84757ae63834b71b34ff9140172b557"
I20260709 13:03:52.470676 11719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acfca01d52104fc5980fae814eb752c3" candidate_uuid: "6dde46af447142a38edbae78f8ca719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8"
I20260709 13:03:52.471073 11793 raft_consensus.cc:3060] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.471297 11719 raft_consensus.cc:3060] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.478282 11793 raft_consensus.cc:2468] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dde46af447142a38edbae78f8ca719d in term 1.
I20260709 13:03:52.478547 11719 raft_consensus.cc:2468] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dde46af447142a38edbae78f8ca719d in term 1.
I20260709 13:03:52.479454 11608 leader_election.cc:304] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dde46af447142a38edbae78f8ca719d, c84757ae63834b71b34ff9140172b557; no voters: 
I20260709 13:03:52.480444 11839 raft_consensus.cc:2804] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.481559 11839 raft_consensus.cc:697] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [term 1 LEADER]: Becoming Leader. State: Replica: 6dde46af447142a38edbae78f8ca719d, State: Running, Role: LEADER
I20260709 13:03:52.482509 11839 consensus_queue.cc:237] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } } peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } }
I20260709 13:03:52.489997 11540 catalog_manager.cc:5697] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dde46af447142a38edbae78f8ca719d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6dde46af447142a38edbae78f8ca719d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.495317 11839 raft_consensus.cc:493] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.495915 11839 raft_consensus.cc:515] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.498050 11839 leader_election.cc:290] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fbf5f688bb34ce6ad0cb6ae977abee8 (127.0.107.194:39185), c84757ae63834b71b34ff9140172b557 (127.0.107.195:35939)
I20260709 13:03:52.498867 11719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966d56df2a3d4d4e8cd9bf3e1495695f" candidate_uuid: "6dde46af447142a38edbae78f8ca719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" is_pre_election: true
I20260709 13:03:52.499580 11793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966d56df2a3d4d4e8cd9bf3e1495695f" candidate_uuid: "6dde46af447142a38edbae78f8ca719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84757ae63834b71b34ff9140172b557" is_pre_election: true
I20260709 13:03:52.499632 11719 raft_consensus.cc:2468] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dde46af447142a38edbae78f8ca719d in term 0.
I20260709 13:03:52.500524 11793 raft_consensus.cc:2468] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dde46af447142a38edbae78f8ca719d in term 0.
I20260709 13:03:52.501282 11610 leader_election.cc:304] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fbf5f688bb34ce6ad0cb6ae977abee8, 6dde46af447142a38edbae78f8ca719d; no voters: 
I20260709 13:03:52.502210 11839 raft_consensus.cc:2804] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.502522 11839 raft_consensus.cc:493] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.502743 11839 raft_consensus.cc:3060] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.508034 11839 raft_consensus.cc:515] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.509882 11839 leader_election.cc:290] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [CANDIDATE]: Term 1 election: Requested vote from peers 0fbf5f688bb34ce6ad0cb6ae977abee8 (127.0.107.194:39185), c84757ae63834b71b34ff9140172b557 (127.0.107.195:35939)
I20260709 13:03:52.510917 11719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966d56df2a3d4d4e8cd9bf3e1495695f" candidate_uuid: "6dde46af447142a38edbae78f8ca719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8"
I20260709 13:03:52.510980 11793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966d56df2a3d4d4e8cd9bf3e1495695f" candidate_uuid: "6dde46af447142a38edbae78f8ca719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84757ae63834b71b34ff9140172b557"
I20260709 13:03:52.511600 11719 raft_consensus.cc:3060] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.511721 11793 raft_consensus.cc:3060] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.517148 11793 raft_consensus.cc:2468] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dde46af447142a38edbae78f8ca719d in term 1.
I20260709 13:03:52.517148 11719 raft_consensus.cc:2468] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dde46af447142a38edbae78f8ca719d in term 1.
I20260709 13:03:52.518436 11608 leader_election.cc:304] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dde46af447142a38edbae78f8ca719d, c84757ae63834b71b34ff9140172b557; no voters: 
I20260709 13:03:52.519217 11839 raft_consensus.cc:2804] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.519649 11839 raft_consensus.cc:697] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 1 LEADER]: Becoming Leader. State: Replica: 6dde46af447142a38edbae78f8ca719d, State: Running, Role: LEADER
I20260709 13:03:52.520311 11839 consensus_queue.cc:237] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.528556 11540 catalog_manager.cc:5697] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dde46af447142a38edbae78f8ca719d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6dde46af447142a38edbae78f8ca719d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.609575 11540 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44836:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:52.612020 11540 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:52.638110 11634 tablet_service.cc:1511] Processing CreateTablet for tablet 5389c19cd1454f03b79705b90551cfbc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1feb691758a945f7966a740ebe60751b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:52.639470 11634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5389c19cd1454f03b79705b90551cfbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.639690 11708 tablet_service.cc:1511] Processing CreateTablet for tablet 5389c19cd1454f03b79705b90551cfbc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1feb691758a945f7966a740ebe60751b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:52.640656 11782 tablet_service.cc:1511] Processing CreateTablet for tablet 5389c19cd1454f03b79705b90551cfbc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1feb691758a945f7966a740ebe60751b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:52.641119 11708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5389c19cd1454f03b79705b90551cfbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.641983 11782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5389c19cd1454f03b79705b90551cfbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.645983 11783 tablet_service.cc:1511] Processing CreateTablet for tablet a24fc545c1d6448cb49836804316e9e9 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1feb691758a945f7966a740ebe60751b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:52.647028 11709 tablet_service.cc:1511] Processing CreateTablet for tablet a24fc545c1d6448cb49836804316e9e9 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1feb691758a945f7966a740ebe60751b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:52.647413 11783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24fc545c1d6448cb49836804316e9e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.648483 11709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24fc545c1d6448cb49836804316e9e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.653755 11633 tablet_service.cc:1511] Processing CreateTablet for tablet a24fc545c1d6448cb49836804316e9e9 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1feb691758a945f7966a740ebe60751b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:52.655234 11633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24fc545c1d6448cb49836804316e9e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:52.660141 11835 tablet_bootstrap.cc:492] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8: Bootstrap starting.
I20260709 13:03:52.661158 11834 tablet_bootstrap.cc:492] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557: Bootstrap starting.
I20260709 13:03:52.667870 11834 tablet_bootstrap.cc:654] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.670171 11835 tablet_bootstrap.cc:654] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.678719 11833 tablet_bootstrap.cc:492] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d: Bootstrap starting.
I20260709 13:03:52.682845 11835 tablet_bootstrap.cc:492] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8: No bootstrap required, opened a new log
I20260709 13:03:52.685843 11835 ts_tablet_manager.cc:1403] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 13:03:52.687371 11833 tablet_bootstrap.cc:654] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.692484 11835 raft_consensus.cc:359] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.693495 11835 raft_consensus.cc:385] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.693859 11835 raft_consensus.cc:740] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fbf5f688bb34ce6ad0cb6ae977abee8, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.694839 11835 consensus_queue.cc:260] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.695791 11834 tablet_bootstrap.cc:492] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557: No bootstrap required, opened a new log
I20260709 13:03:52.696367 11834 ts_tablet_manager.cc:1403] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.016s
I20260709 13:03:52.697631 11835 ts_tablet_manager.cc:1434] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:52.698860 11835 tablet_bootstrap.cc:492] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8: Bootstrap starting.
I20260709 13:03:52.699947 11833 tablet_bootstrap.cc:492] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d: No bootstrap required, opened a new log
I20260709 13:03:52.699756 11834 raft_consensus.cc:359] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.700671 11834 raft_consensus.cc:385] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.700789 11833 ts_tablet_manager.cc:1403] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.001s
I20260709 13:03:52.701064 11834 raft_consensus.cc:740] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84757ae63834b71b34ff9140172b557, State: Initialized, Role: FOLLOWER
W20260709 13:03:52.739264 11590 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:52.702077 11834 consensus_queue.cc:260] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.740859 11833 raft_consensus.cc:359] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.742321 11833 raft_consensus.cc:385] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.742693 11833 raft_consensus.cc:740] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dde46af447142a38edbae78f8ca719d, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.743884 11833 consensus_queue.cc:260] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.747997 11833 ts_tablet_manager.cc:1434] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.008s
I20260709 13:03:52.751016 11833 tablet_bootstrap.cc:492] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d: Bootstrap starting.
I20260709 13:03:52.752187 11834 ts_tablet_manager.cc:1434] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557: Time spent starting tablet: real 0.055s	user 0.003s	sys 0.005s
I20260709 13:03:52.753361 11835 tablet_bootstrap.cc:654] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.754673 11834 tablet_bootstrap.cc:492] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557: Bootstrap starting.
I20260709 13:03:52.761049 11833 tablet_bootstrap.cc:654] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.770303 11834 tablet_bootstrap.cc:654] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.776367 11833 tablet_bootstrap.cc:492] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d: No bootstrap required, opened a new log
I20260709 13:03:52.777004 11833 ts_tablet_manager.cc:1403] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.017s
I20260709 13:03:52.778227 11839 raft_consensus.cc:493] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.779071 11835 tablet_bootstrap.cc:492] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8: No bootstrap required, opened a new log
I20260709 13:03:52.779067 11839 raft_consensus.cc:515] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.780314 11835 ts_tablet_manager.cc:1403] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8: Time spent bootstrapping tablet: real 0.082s	user 0.020s	sys 0.015s
I20260709 13:03:52.781397 11833 raft_consensus.cc:359] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.782281 11833 raft_consensus.cc:385] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.782593 11833 raft_consensus.cc:740] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dde46af447142a38edbae78f8ca719d, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.784031 11833 consensus_queue.cc:260] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.785033 11793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5389c19cd1454f03b79705b90551cfbc" candidate_uuid: "6dde46af447142a38edbae78f8ca719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84757ae63834b71b34ff9140172b557" is_pre_election: true
I20260709 13:03:52.786083 11793 raft_consensus.cc:2468] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dde46af447142a38edbae78f8ca719d in term 0.
I20260709 13:03:52.785804 11835 raft_consensus.cc:359] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.786772 11835 raft_consensus.cc:385] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.787144 11835 raft_consensus.cc:740] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fbf5f688bb34ce6ad0cb6ae977abee8, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.787389 11833 ts_tablet_manager.cc:1434] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:03:52.788432 11835 consensus_queue.cc:260] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.789332 11608 leader_election.cc:304] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dde46af447142a38edbae78f8ca719d, c84757ae63834b71b34ff9140172b557; no voters: 
I20260709 13:03:52.790743 11839 leader_election.cc:290] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fbf5f688bb34ce6ad0cb6ae977abee8 (127.0.107.194:39185), c84757ae63834b71b34ff9140172b557 (127.0.107.195:35939)
I20260709 13:03:52.791458 11839 raft_consensus.cc:2804] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.791857 11839 raft_consensus.cc:493] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.792065 11835 ts_tablet_manager.cc:1434] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:03:52.792321 11839 raft_consensus.cc:3060] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.791931 11719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5389c19cd1454f03b79705b90551cfbc" candidate_uuid: "6dde46af447142a38edbae78f8ca719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" is_pre_election: true
I20260709 13:03:52.793962 11719 raft_consensus.cc:2468] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dde46af447142a38edbae78f8ca719d in term 0.
I20260709 13:03:52.797286 11834 tablet_bootstrap.cc:492] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557: No bootstrap required, opened a new log
I20260709 13:03:52.797931 11834 ts_tablet_manager.cc:1403] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.008s
I20260709 13:03:52.801637 11834 raft_consensus.cc:359] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.802493 11834 raft_consensus.cc:385] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.802809 11834 raft_consensus.cc:740] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84757ae63834b71b34ff9140172b557, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.803745 11834 consensus_queue.cc:260] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.804744 11839 raft_consensus.cc:515] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.806325 11834 ts_tablet_manager.cc:1434] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:52.807042 11839 leader_election.cc:290] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [CANDIDATE]: Term 1 election: Requested vote from peers 0fbf5f688bb34ce6ad0cb6ae977abee8 (127.0.107.194:39185), c84757ae63834b71b34ff9140172b557 (127.0.107.195:35939)
I20260709 13:03:52.807906 11719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5389c19cd1454f03b79705b90551cfbc" candidate_uuid: "6dde46af447142a38edbae78f8ca719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8"
I20260709 13:03:52.808188 11793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5389c19cd1454f03b79705b90551cfbc" candidate_uuid: "6dde46af447142a38edbae78f8ca719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84757ae63834b71b34ff9140172b557"
I20260709 13:03:52.808570 11719 raft_consensus.cc:3060] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.808835 11793 raft_consensus.cc:3060] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.819392 11793 raft_consensus.cc:2468] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dde46af447142a38edbae78f8ca719d in term 1.
I20260709 13:03:52.820847 11608 leader_election.cc:304] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dde46af447142a38edbae78f8ca719d, c84757ae63834b71b34ff9140172b557; no voters: 
I20260709 13:03:52.821801 11839 raft_consensus.cc:2804] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.822252 11839 raft_consensus.cc:697] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 1 LEADER]: Becoming Leader. State: Replica: 6dde46af447142a38edbae78f8ca719d, State: Running, Role: LEADER
I20260709 13:03:52.823271 11839 consensus_queue.cc:237] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:52.824536 11719 raft_consensus.cc:2468] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dde46af447142a38edbae78f8ca719d in term 1.
I20260709 13:03:52.834632 11542 catalog_manager.cc:5697] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dde46af447142a38edbae78f8ca719d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "6dde46af447142a38edbae78f8ca719d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.877513 11839 consensus_queue.cc:1048] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.895116 11839 consensus_queue.cc:1048] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.945179 11847 consensus_queue.cc:1048] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.961335 11839 consensus_queue.cc:1048] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.041325 11840 raft_consensus.cc:493] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.041947 11840 raft_consensus.cc:515] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:53.044305 11840 leader_election.cc:290] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dde46af447142a38edbae78f8ca719d (127.0.107.193:37307), 0fbf5f688bb34ce6ad0cb6ae977abee8 (127.0.107.194:39185)
I20260709 13:03:53.057878 11644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24fc545c1d6448cb49836804316e9e9" candidate_uuid: "c84757ae63834b71b34ff9140172b557" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dde46af447142a38edbae78f8ca719d" is_pre_election: true
I20260709 13:03:53.058743 11644 raft_consensus.cc:2468] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c84757ae63834b71b34ff9140172b557 in term 0.
I20260709 13:03:53.059466 11719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24fc545c1d6448cb49836804316e9e9" candidate_uuid: "c84757ae63834b71b34ff9140172b557" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" is_pre_election: true
I20260709 13:03:53.060204 11719 raft_consensus.cc:2468] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c84757ae63834b71b34ff9140172b557 in term 0.
I20260709 13:03:53.060277 11759 leader_election.cc:304] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dde46af447142a38edbae78f8ca719d, c84757ae63834b71b34ff9140172b557; no voters: 
I20260709 13:03:53.061314 11840 raft_consensus.cc:2804] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.061682 11840 raft_consensus.cc:493] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.061968 11840 raft_consensus.cc:3060] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.069648 11840 raft_consensus.cc:515] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:53.071381 11840 leader_election.cc:290] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [CANDIDATE]: Term 1 election: Requested vote from peers 6dde46af447142a38edbae78f8ca719d (127.0.107.193:37307), 0fbf5f688bb34ce6ad0cb6ae977abee8 (127.0.107.194:39185)
I20260709 13:03:53.072407 11644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24fc545c1d6448cb49836804316e9e9" candidate_uuid: "c84757ae63834b71b34ff9140172b557" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dde46af447142a38edbae78f8ca719d"
I20260709 13:03:53.072826 11719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24fc545c1d6448cb49836804316e9e9" candidate_uuid: "c84757ae63834b71b34ff9140172b557" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8"
I20260709 13:03:53.073091 11644 raft_consensus.cc:3060] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.073493 11719 raft_consensus.cc:3060] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.079931 11719 raft_consensus.cc:2468] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84757ae63834b71b34ff9140172b557 in term 1.
I20260709 13:03:53.080324 11644 raft_consensus.cc:2468] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84757ae63834b71b34ff9140172b557 in term 1.
I20260709 13:03:53.081252 11759 leader_election.cc:304] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fbf5f688bb34ce6ad0cb6ae977abee8, c84757ae63834b71b34ff9140172b557; no voters: 
I20260709 13:03:53.082015 11840 raft_consensus.cc:2804] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.083109 11840 raft_consensus.cc:697] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 1 LEADER]: Becoming Leader. State: Replica: c84757ae63834b71b34ff9140172b557, State: Running, Role: LEADER
I20260709 13:03:53.083801 11840 consensus_queue.cc:237] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:53.091925 11540 catalog_manager.cc:5697] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 reported cstate change: term changed from 0 to 1, leader changed from <none> to c84757ae63834b71b34ff9140172b557 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c84757ae63834b71b34ff9140172b557" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.154754 11644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "966d56df2a3d4d4e8cd9bf3e1495695f"
dest_uuid: "6dde46af447142a38edbae78f8ca719d"
mode: GRACEFUL
new_leader_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8"
 from {username='slave'} at 127.0.0.1:46496
I20260709 13:03:53.155493 11644 raft_consensus.cc:606] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 1 LEADER]: Received request to transfer leadership to TS 0fbf5f688bb34ce6ad0cb6ae977abee8
I20260709 13:03:53.176419 11793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a24fc545c1d6448cb49836804316e9e9"
dest_uuid: "c84757ae63834b71b34ff9140172b557"
mode: GRACEFUL
new_leader_uuid: "6dde46af447142a38edbae78f8ca719d"
 from {username='slave'} at 127.0.0.1:36700
I20260709 13:03:53.177084 11793 raft_consensus.cc:606] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 1 LEADER]: Received request to transfer leadership to TS 6dde46af447142a38edbae78f8ca719d
I20260709 13:03:53.306281 11839 consensus_queue.cc:1048] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.320292 11847 consensus_queue.cc:1048] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:53.503144 11839 raft_consensus.cc:993] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d: : Instructing follower 0fbf5f688bb34ce6ad0cb6ae977abee8 to start an election
I20260709 13:03:53.503733 11880 raft_consensus.cc:1081] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 1 LEADER]: Signalling peer 0fbf5f688bb34ce6ad0cb6ae977abee8 to start an election
I20260709 13:03:53.505774 11719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "966d56df2a3d4d4e8cd9bf3e1495695f"
dest_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8"
 from {username='slave'} at 127.0.0.1:59974
I20260709 13:03:53.506769 11719 raft_consensus.cc:493] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:53.507166 11719 raft_consensus.cc:3060] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.512805 11719 raft_consensus.cc:515] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:53.514930 11719 leader_election.cc:290] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [CANDIDATE]: Term 2 election: Requested vote from peers 6dde46af447142a38edbae78f8ca719d (127.0.107.193:37307), c84757ae63834b71b34ff9140172b557 (127.0.107.195:35939)
I20260709 13:03:53.526616 11644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966d56df2a3d4d4e8cd9bf3e1495695f" candidate_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6dde46af447142a38edbae78f8ca719d"
I20260709 13:03:53.526904 11793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966d56df2a3d4d4e8cd9bf3e1495695f" candidate_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c84757ae63834b71b34ff9140172b557"
I20260709 13:03:53.527333 11644 raft_consensus.cc:3055] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:53.527539 11793 raft_consensus.cc:3060] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.527717 11644 raft_consensus.cc:740] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6dde46af447142a38edbae78f8ca719d, State: Running, Role: LEADER
I20260709 13:03:53.528748 11644 consensus_queue.cc:260] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:53.530123 11644 raft_consensus.cc:3060] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.535389 11793 raft_consensus.cc:2468] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fbf5f688bb34ce6ad0cb6ae977abee8 in term 2.
I20260709 13:03:53.537250 11683 leader_election.cc:304] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fbf5f688bb34ce6ad0cb6ae977abee8, c84757ae63834b71b34ff9140172b557; no voters: 
I20260709 13:03:53.537593 11644 raft_consensus.cc:2468] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fbf5f688bb34ce6ad0cb6ae977abee8 in term 2.
I20260709 13:03:53.538244 11841 raft_consensus.cc:2804] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:53.539685 11841 raft_consensus.cc:697] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 2 LEADER]: Becoming Leader. State: Replica: 0fbf5f688bb34ce6ad0cb6ae977abee8, State: Running, Role: LEADER
I20260709 13:03:53.540779 11841 consensus_queue.cc:237] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:53.547608 11542 catalog_manager.cc:5697] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 reported cstate change: term changed from 1 to 2, leader changed from 6dde46af447142a38edbae78f8ca719d (127.0.107.193) to 0fbf5f688bb34ce6ad0cb6ae977abee8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.625381 11840 consensus_queue.cc:1048] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.634274 11886 raft_consensus.cc:993] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557: : Instructing follower 6dde46af447142a38edbae78f8ca719d to start an election
I20260709 13:03:53.634975 11886 raft_consensus.cc:1081] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 1 LEADER]: Signalling peer 6dde46af447142a38edbae78f8ca719d to start an election
I20260709 13:03:53.637276 11643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a24fc545c1d6448cb49836804316e9e9"
dest_uuid: "6dde46af447142a38edbae78f8ca719d"
 from {username='slave'} at 127.0.0.1:46486
I20260709 13:03:53.637894 11643 raft_consensus.cc:493] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:53.638264 11643 raft_consensus.cc:3060] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.640661 11886 consensus_queue.cc:1048] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.647440 11643 raft_consensus.cc:515] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:53.648653 11644 raft_consensus.cc:1240] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [term 2 FOLLOWER]: Rejecting Update request from peer c84757ae63834b71b34ff9140172b557 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:53.651665 11643 leader_election.cc:290] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [CANDIDATE]: Term 2 election: Requested vote from peers 0fbf5f688bb34ce6ad0cb6ae977abee8 (127.0.107.194:39185), c84757ae63834b71b34ff9140172b557 (127.0.107.195:35939)
I20260709 13:03:53.652315 11719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24fc545c1d6448cb49836804316e9e9" candidate_uuid: "6dde46af447142a38edbae78f8ca719d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8"
I20260709 13:03:53.653517 11719 raft_consensus.cc:3060] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.653749 11793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24fc545c1d6448cb49836804316e9e9" candidate_uuid: "6dde46af447142a38edbae78f8ca719d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c84757ae63834b71b34ff9140172b557"
I20260709 13:03:53.653631 11886 consensus_queue.cc:1059] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:53.654912 11793 raft_consensus.cc:3055] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:53.655269 11793 raft_consensus.cc:740] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c84757ae63834b71b34ff9140172b557, State: Running, Role: LEADER
I20260709 13:03:53.656086 11793 consensus_queue.cc:260] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:53.657415 11793 raft_consensus.cc:3060] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.660537 11719 raft_consensus.cc:2468] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dde46af447142a38edbae78f8ca719d in term 2.
I20260709 13:03:53.661965 11610 leader_election.cc:304] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fbf5f688bb34ce6ad0cb6ae977abee8, 6dde46af447142a38edbae78f8ca719d; no voters: 
I20260709 13:03:53.663326 11880 raft_consensus.cc:2804] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:53.663766 11880 raft_consensus.cc:697] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [term 2 LEADER]: Becoming Leader. State: Replica: 6dde46af447142a38edbae78f8ca719d, State: Running, Role: LEADER
I20260709 13:03:53.663833 11793 raft_consensus.cc:2468] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dde46af447142a38edbae78f8ca719d in term 2.
W20260709 13:03:53.665095 11886 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:03:53.664703 11880 consensus_queue.cc:237] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:53.672027 11540 catalog_manager.cc:5697] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d reported cstate change: term changed from 1 to 2, leader changed from c84757ae63834b71b34ff9140172b557 (127.0.107.195) to 6dde46af447142a38edbae78f8ca719d (127.0.107.193). New cstate: current_term: 2 leader_uuid: "6dde46af447142a38edbae78f8ca719d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.938026   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:03:53.940135   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:03:53.940521   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:03:53.954265 11643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5389c19cd1454f03b79705b90551cfbc"
dest_uuid: "6dde46af447142a38edbae78f8ca719d"
mode: GRACEFUL
new_leader_uuid: "c84757ae63834b71b34ff9140172b557"
 from {username='slave'} at 127.0.0.1:46514
I20260709 13:03:53.955022 11643 raft_consensus.cc:606] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 1 LEADER]: Received request to transfer leadership to TS c84757ae63834b71b34ff9140172b557
I20260709 13:03:53.956525   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:03:53.987210 11643 raft_consensus.cc:1275] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 2 FOLLOWER]: Refusing update from remote peer 0fbf5f688bb34ce6ad0cb6ae977abee8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.988874 11841 consensus_queue.cc:1048] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:54.000550 11793 raft_consensus.cc:1275] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557 [term 2 FOLLOWER]: Refusing update from remote peer 0fbf5f688bb34ce6ad0cb6ae977abee8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:54.002702 11841 consensus_queue.cc:1048] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:54.058233 11719 raft_consensus.cc:1275] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 2 FOLLOWER]: Refusing update from remote peer 6dde46af447142a38edbae78f8ca719d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:54.059693 11880 consensus_queue.cc:1048] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:54.069183 11793 raft_consensus.cc:1275] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 2 FOLLOWER]: Refusing update from remote peer 6dde46af447142a38edbae78f8ca719d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:54.071118 11880 consensus_queue.cc:1048] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:54.233845 11880 raft_consensus.cc:993] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d: : Instructing follower c84757ae63834b71b34ff9140172b557 to start an election
I20260709 13:03:54.234368 11839 raft_consensus.cc:1081] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 1 LEADER]: Signalling peer c84757ae63834b71b34ff9140172b557 to start an election
I20260709 13:03:54.236454 11793 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5389c19cd1454f03b79705b90551cfbc"
dest_uuid: "c84757ae63834b71b34ff9140172b557"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:03:54.237131 11793 raft_consensus.cc:493] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:54.237497 11793 raft_consensus.cc:3060] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.243716 11793 raft_consensus.cc:515] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:54.245460 11793 leader_election.cc:290] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [CANDIDATE]: Term 2 election: Requested vote from peers 6dde46af447142a38edbae78f8ca719d (127.0.107.193:37307), 0fbf5f688bb34ce6ad0cb6ae977abee8 (127.0.107.194:39185)
I20260709 13:03:54.246564 11643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5389c19cd1454f03b79705b90551cfbc" candidate_uuid: "c84757ae63834b71b34ff9140172b557" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6dde46af447142a38edbae78f8ca719d"
I20260709 13:03:54.246872 11719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5389c19cd1454f03b79705b90551cfbc" candidate_uuid: "c84757ae63834b71b34ff9140172b557" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8"
I20260709 13:03:54.247196 11643 raft_consensus.cc:3055] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:54.247552 11719 raft_consensus.cc:3060] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.247562 11643 raft_consensus.cc:740] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6dde46af447142a38edbae78f8ca719d, State: Running, Role: LEADER
I20260709 13:03:54.248514 11643 consensus_queue.cc:260] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:54.249569 11643 raft_consensus.cc:3060] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.253748 11719 raft_consensus.cc:2468] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84757ae63834b71b34ff9140172b557 in term 2.
I20260709 13:03:54.254882 11643 raft_consensus.cc:2468] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84757ae63834b71b34ff9140172b557 in term 2.
I20260709 13:03:54.255090 11759 leader_election.cc:304] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fbf5f688bb34ce6ad0cb6ae977abee8, c84757ae63834b71b34ff9140172b557; no voters: 
I20260709 13:03:54.256045 11886 raft_consensus.cc:2804] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:54.257436 11886 raft_consensus.cc:697] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [term 2 LEADER]: Becoming Leader. State: Replica: c84757ae63834b71b34ff9140172b557, State: Running, Role: LEADER
I20260709 13:03:54.258517 11886 consensus_queue.cc:237] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } }
I20260709 13:03:54.265477 11542 catalog_manager.cc:5697] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 reported cstate change: term changed from 1 to 2, leader changed from 6dde46af447142a38edbae78f8ca719d (127.0.107.193) to c84757ae63834b71b34ff9140172b557 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c84757ae63834b71b34ff9140172b557" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dde46af447142a38edbae78f8ca719d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fbf5f688bb34ce6ad0cb6ae977abee8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c84757ae63834b71b34ff9140172b557" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35939 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.330998   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:03:54.361382   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:54.362174   431 tablet_replica.cc:333] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d: stopping tablet replica
I20260709 13:03:54.362776   431 raft_consensus.cc:2243] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.363173   431 raft_consensus.cc:2272] T 5389c19cd1454f03b79705b90551cfbc P 6dde46af447142a38edbae78f8ca719d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.365860   431 tablet_replica.cc:333] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d: stopping tablet replica
I20260709 13:03:54.366430   431 raft_consensus.cc:2243] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:54.367368   431 raft_consensus.cc:2272] T a24fc545c1d6448cb49836804316e9e9 P 6dde46af447142a38edbae78f8ca719d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.370334   431 tablet_replica.cc:333] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d: stopping tablet replica
I20260709 13:03:54.370952   431 raft_consensus.cc:2243] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.371405   431 raft_consensus.cc:2272] T 966d56df2a3d4d4e8cd9bf3e1495695f P 6dde46af447142a38edbae78f8ca719d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.374691   431 tablet_replica.cc:333] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d: stopping tablet replica
I20260709 13:03:54.375265   431 raft_consensus.cc:2243] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:54.376124   431 raft_consensus.cc:2272] T acfca01d52104fc5980fae814eb752c3 P 6dde46af447142a38edbae78f8ca719d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.393654   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:03:54.411298   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:03:54.437453   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:54.438268   431 tablet_replica.cc:333] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8: stopping tablet replica
I20260709 13:03:54.438959   431 raft_consensus.cc:2243] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.439474   431 raft_consensus.cc:2272] T 5389c19cd1454f03b79705b90551cfbc P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.442262   431 tablet_replica.cc:333] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8: stopping tablet replica
I20260709 13:03:54.442782   431 raft_consensus.cc:2243] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.443188   431 raft_consensus.cc:2272] T acfca01d52104fc5980fae814eb752c3 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.445374   431 tablet_replica.cc:333] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8: stopping tablet replica
I20260709 13:03:54.446040   431 raft_consensus.cc:2243] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.446588   431 raft_consensus.cc:2272] T a24fc545c1d6448cb49836804316e9e9 P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.449246   431 tablet_replica.cc:333] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8: stopping tablet replica
I20260709 13:03:54.449993   431 raft_consensus.cc:2243] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:54.450912   431 raft_consensus.cc:2272] T 966d56df2a3d4d4e8cd9bf3e1495695f P 0fbf5f688bb34ce6ad0cb6ae977abee8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.477607   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:54.495390   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:54.517508   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:54.518266   431 tablet_replica.cc:333] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557: stopping tablet replica
I20260709 13:03:54.518831   431 raft_consensus.cc:2243] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:54.519493   431 pending_rounds.cc:70] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557: Trying to abort 1 pending ops.
I20260709 13:03:54.519672   431 pending_rounds.cc:77] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634751531241472 op_type: NO_OP noop_request { }
I20260709 13:03:54.519937   431 raft_consensus.cc:2889] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:54.520241   431 raft_consensus.cc:2272] T 5389c19cd1454f03b79705b90551cfbc P c84757ae63834b71b34ff9140172b557 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.523252   431 tablet_replica.cc:333] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557: stopping tablet replica
I20260709 13:03:54.523865   431 raft_consensus.cc:2243] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.524334   431 raft_consensus.cc:2272] T a24fc545c1d6448cb49836804316e9e9 P c84757ae63834b71b34ff9140172b557 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.526973   431 tablet_replica.cc:333] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557: stopping tablet replica
I20260709 13:03:54.527640   431 raft_consensus.cc:2243] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.528090   431 raft_consensus.cc:2272] T 966d56df2a3d4d4e8cd9bf3e1495695f P c84757ae63834b71b34ff9140172b557 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.530870   431 tablet_replica.cc:333] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557: stopping tablet replica
I20260709 13:03:54.531462   431 raft_consensus.cc:2243] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:54.531904   431 raft_consensus.cc:2272] T acfca01d52104fc5980fae814eb752c3 P c84757ae63834b71b34ff9140172b557 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.556362   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:54.573045   431 master.cc:562] Master@127.0.107.254:36373 shutting down...
I20260709 13:03:54.594062   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:54.594666   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:54.595036   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8ebfa774f4d84508b389619d856ec284: stopping tablet replica
I20260709 13:03:54.615094   431 master.cc:584] Master@127.0.107.254:36373 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3065 ms)
[----------] 6 tests from LeaderRebalancerTest (344855 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:03:54.656757   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:38137
I20260709 13:03:54.658025   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:54.664076 11897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:54.664288 11898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:54.666145   431 server_base.cc:1061] running on GCE node
W20260709 13:03:54.666111 11900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:54.667490   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:54.667686   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:54.667805   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602234667795 us; error 0 us; skew 500 ppm
I20260709 13:03:54.668278   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:54.671020   431 webserver.cc:533] Webserver started at http://127.0.107.254:45737/ using document root <none> and password file <none>
I20260709 13:03:54.671482   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:54.671645   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:54.671864   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:54.673341   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/master-0-root/instance:
uuid: "88480e052ad14f86ad88829cb5cd25c9"
format_stamp: "Formatted at 2026-07-09 13:03:54 on dist-test-slave-c08m"
I20260709 13:03:54.678160   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:03:54.681844 11905 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:54.682749   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:03:54.683084   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/master-0-root
uuid: "88480e052ad14f86ad88829cb5cd25c9"
format_stamp: "Formatted at 2026-07-09 13:03:54 on dist-test-slave-c08m"
I20260709 13:03:54.683354   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:54.693591   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:54.694876   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:54.736750   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:38137
I20260709 13:03:54.736833 11956 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:38137 every 8 connection(s)
I20260709 13:03:54.740957 11957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.754631 11957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9: Bootstrap starting.
I20260709 13:03:54.760269 11957 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.764951 11957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9: No bootstrap required, opened a new log
I20260709 13:03:54.767253 11957 raft_consensus.cc:359] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88480e052ad14f86ad88829cb5cd25c9" member_type: VOTER }
I20260709 13:03:54.767648 11957 raft_consensus.cc:385] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.767910 11957 raft_consensus.cc:740] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88480e052ad14f86ad88829cb5cd25c9, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.768532 11957 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88480e052ad14f86ad88829cb5cd25c9" member_type: VOTER }
I20260709 13:03:54.769084 11957 raft_consensus.cc:399] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:54.769322 11957 raft_consensus.cc:493] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:54.769606 11957 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.775236 11957 raft_consensus.cc:515] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88480e052ad14f86ad88829cb5cd25c9" member_type: VOTER }
I20260709 13:03:54.775851 11957 leader_election.cc:304] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88480e052ad14f86ad88829cb5cd25c9; no voters: 
I20260709 13:03:54.777155 11957 leader_election.cc:290] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:54.777593 11960 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.779100 11960 raft_consensus.cc:697] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [term 1 LEADER]: Becoming Leader. State: Replica: 88480e052ad14f86ad88829cb5cd25c9, State: Running, Role: LEADER
I20260709 13:03:54.779917 11960 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88480e052ad14f86ad88829cb5cd25c9" member_type: VOTER }
I20260709 13:03:54.780158 11957 sys_catalog.cc:565] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:54.783164 11961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88480e052ad14f86ad88829cb5cd25c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88480e052ad14f86ad88829cb5cd25c9" member_type: VOTER } }
I20260709 13:03:54.783113 11962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88480e052ad14f86ad88829cb5cd25c9. Latest consensus state: current_term: 1 leader_uuid: "88480e052ad14f86ad88829cb5cd25c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88480e052ad14f86ad88829cb5cd25c9" member_type: VOTER } }
I20260709 13:03:54.783850 11961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:54.783982 11962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:54.788324 11965 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:54.793537 11965 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:54.797552   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:54.803201 11965 catalog_manager.cc:1383] Generated new cluster ID: 0e2aed38f88840a5b4b52d6d2f556356
I20260709 13:03:54.803469 11965 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:54.818068 11965 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:54.819413 11965 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:54.834874 11965 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9: Generated new TSK 0
I20260709 13:03:54.835506 11965 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:54.864305   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:54.871416 11978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:54.872833 11979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:54.875638 11981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:54.875880   431 server_base.cc:1061] running on GCE node
I20260709 13:03:54.876996   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:54.877247   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:54.877420   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602234877397 us; error 0 us; skew 500 ppm
I20260709 13:03:54.877938   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:54.880532   431 webserver.cc:533] Webserver started at http://127.0.107.193:38085/ using document root <none> and password file <none>
I20260709 13:03:54.881135   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:54.881352   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:54.881834   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:54.883076   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-0-root/instance:
uuid: "1affb97882084b8783e590354f97be84"
format_stamp: "Formatted at 2026-07-09 13:03:54 on dist-test-slave-c08m"
I20260709 13:03:54.887753   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:03:54.891579 11986 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:54.892784   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:54.893085   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-0-root
uuid: "1affb97882084b8783e590354f97be84"
format_stamp: "Formatted at 2026-07-09 13:03:54 on dist-test-slave-c08m"
I20260709 13:03:54.893363   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:54.923859   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:54.925364   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:54.927085   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:54.929481   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:54.929682   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:54.929870   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:54.930011   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:54.977449   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43521
I20260709 13:03:54.977605 12048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43521 every 8 connection(s)
I20260709 13:03:54.983071   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:54.992508 12053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:54.995493 12054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:54.997349   431 server_base.cc:1061] running on GCE node
W20260709 13:03:54.998454 12056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:54.998687 12049 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38137
I20260709 13:03:54.999308 12049 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:54.999934   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:55.000331   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:55.000206 12049 heartbeater.cc:507] Master 127.0.107.254:38137 requested a full tablet report, sending...
I20260709 13:03:55.001012   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602235000984 us; error 0 us; skew 500 ppm
I20260709 13:03:55.001748   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:55.003448 11922 ts_manager.cc:194] Registered new tserver with Master: 1affb97882084b8783e590354f97be84 (127.0.107.193:43521)
I20260709 13:03:55.005865 11922 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43964
I20260709 13:03:55.006040   431 webserver.cc:533] Webserver started at http://127.0.107.194:37017/ using document root <none> and password file <none>
I20260709 13:03:55.006814   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:55.007063   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:55.007380   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:55.008760   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-1-root/instance:
uuid: "ec4cb6593e3d45458f39de98c49431ba"
format_stamp: "Formatted at 2026-07-09 13:03:55 on dist-test-slave-c08m"
I20260709 13:03:55.014320   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:03:55.018698 12061 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:55.019996   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:55.020386   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-1-root
uuid: "ec4cb6593e3d45458f39de98c49431ba"
format_stamp: "Formatted at 2026-07-09 13:03:55 on dist-test-slave-c08m"
I20260709 13:03:55.020812   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:55.069932   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:55.071228   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:55.073156   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:55.075567   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:55.075876   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:55.076177   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:55.076354   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:55.125526   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33219
I20260709 13:03:55.125696 12123 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33219 every 8 connection(s)
I20260709 13:03:55.130754   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:55.140576 12128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:55.141896 12127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:55.144381   431 server_base.cc:1061] running on GCE node
W20260709 13:03:55.144917 12130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:55.146337   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:55.146637   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:55.146838   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602235146821 us; error 0 us; skew 500 ppm
I20260709 13:03:55.147727 12124 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38137
I20260709 13:03:55.147990   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:55.148294 12124 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:55.149299 12124 heartbeater.cc:507] Master 127.0.107.254:38137 requested a full tablet report, sending...
I20260709 13:03:55.151120   431 webserver.cc:533] Webserver started at http://127.0.107.195:44031/ using document root <none> and password file <none>
I20260709 13:03:55.151770   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:55.151835 11922 ts_manager.cc:194] Registered new tserver with Master: ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:03:55.152428   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:55.153044   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:55.153501 11922 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43976
I20260709 13:03:55.155591   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-2-root/instance:
uuid: "a67b474ab9354f4d937a2d0cd422e5df"
format_stamp: "Formatted at 2026-07-09 13:03:55 on dist-test-slave-c08m"
I20260709 13:03:55.161690   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:03:55.166000 12135 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:55.166970   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:03:55.167416   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-2-root
uuid: "a67b474ab9354f4d937a2d0cd422e5df"
format_stamp: "Formatted at 2026-07-09 13:03:55 on dist-test-slave-c08m"
I20260709 13:03:55.167753   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601889622018-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:55.208339   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:55.209676   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:55.211308   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:55.214365   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:55.214723   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:55.215019   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:55.215214   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:55.272871   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:46013
I20260709 13:03:55.273033 12197 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:46013 every 8 connection(s)
I20260709 13:03:55.290185 12198 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38137
I20260709 13:03:55.290634 12198 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:55.291870 12198 heartbeater.cc:507] Master 127.0.107.254:38137 requested a full tablet report, sending...
I20260709 13:03:55.294158 11922 ts_manager.cc:194] Registered new tserver with Master: a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:55.294932   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018311517s
I20260709 13:03:55.296236 11922 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43990
I20260709 13:03:55.325280 11922 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43994:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:55.328424 11922 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:55.422372 12089 tablet_service.cc:1511] Processing CreateTablet for tablet 83202045303b4403b8a8ba2f723bad5b (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:55.424288 12089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83202045303b4403b8a8ba2f723bad5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.424129 12086 tablet_service.cc:1511] Processing CreateTablet for tablet 703c68323a7e41fc87b8c48189a6c563 (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:55.425951 12086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703c68323a7e41fc87b8c48189a6c563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.425835 12011 tablet_service.cc:1511] Processing CreateTablet for tablet 703c68323a7e41fc87b8c48189a6c563 (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:55.427129 12088 tablet_service.cc:1511] Processing CreateTablet for tablet 4154b1f61d0147ebb9b941ed1bd8058a (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:55.428141 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703c68323a7e41fc87b8c48189a6c563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.428614 12088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4154b1f61d0147ebb9b941ed1bd8058a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.429723 12012 tablet_service.cc:1511] Processing CreateTablet for tablet 6bfe096a4bdd4aac9bfc641d24d667d5 (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:55.432116 12013 tablet_service.cc:1511] Processing CreateTablet for tablet 4154b1f61d0147ebb9b941ed1bd8058a (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:55.432144 12087 tablet_service.cc:1511] Processing CreateTablet for tablet 6bfe096a4bdd4aac9bfc641d24d667d5 (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:55.434180 12014 tablet_service.cc:1511] Processing CreateTablet for tablet 83202045303b4403b8a8ba2f723bad5b (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:55.434506 12087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfe096a4bdd4aac9bfc641d24d667d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.442026 12014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83202045303b4403b8a8ba2f723bad5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.444393 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfe096a4bdd4aac9bfc641d24d667d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.446240 12013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4154b1f61d0147ebb9b941ed1bd8058a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.470791 12010 tablet_service.cc:1511] Processing CreateTablet for tablet a3b7d4c4a66b4fbf9963fddef0ec2cdf (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:55.472117 12216 tablet_bootstrap.cc:492] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:03:55.472540 12010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b7d4c4a66b4fbf9963fddef0ec2cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.484934 12163 tablet_service.cc:1511] Processing CreateTablet for tablet 83202045303b4403b8a8ba2f723bad5b (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:55.487190 12163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83202045303b4403b8a8ba2f723bad5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.487504 12216 tablet_bootstrap.cc:654] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.503919 12162 tablet_service.cc:1511] Processing CreateTablet for tablet 4154b1f61d0147ebb9b941ed1bd8058a (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:55.509634 12162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4154b1f61d0147ebb9b941ed1bd8058a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.513891 12217 tablet_bootstrap.cc:492] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:03:55.519586 12161 tablet_service.cc:1511] Processing CreateTablet for tablet 6bfe096a4bdd4aac9bfc641d24d667d5 (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:55.521325 12217 tablet_bootstrap.cc:654] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.521863 12161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfe096a4bdd4aac9bfc641d24d667d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.538743 12160 tablet_service.cc:1511] Processing CreateTablet for tablet 703c68323a7e41fc87b8c48189a6c563 (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:55.539415 12217 tablet_bootstrap.cc:492] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:03:55.540052 12217 ts_tablet_manager.cc:1403] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.000s
I20260709 13:03:55.539621 12086 tablet_service.cc:1511] Processing CreateTablet for tablet a3b7d4c4a66b4fbf9963fddef0ec2cdf (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:55.540409 12160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703c68323a7e41fc87b8c48189a6c563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.540717 12014 tablet_service.cc:1511] Processing CreateTablet for tablet a8470d1f74104ccc9695026f52865eca (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:55.541211 12086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b7d4c4a66b4fbf9963fddef0ec2cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.542003 12014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8470d1f74104ccc9695026f52865eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.543517 12217 raft_consensus.cc:359] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.544375 12217 raft_consensus.cc:385] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.544700 12217 raft_consensus.cc:740] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.545742 12217 consensus_queue.cc:260] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.546037 12159 tablet_service.cc:1511] Processing CreateTablet for tablet a3b7d4c4a66b4fbf9963fddef0ec2cdf (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:55.547487 12159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b7d4c4a66b4fbf9963fddef0ec2cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.558540 12049 heartbeater.cc:499] Master 127.0.107.254:38137 was elected leader, sending a full tablet report...
I20260709 13:03:55.558880 12085 tablet_service.cc:1511] Processing CreateTablet for tablet a8470d1f74104ccc9695026f52865eca (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:55.559656 12217 ts_tablet_manager.cc:1434] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.002s
I20260709 13:03:55.560478 12085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8470d1f74104ccc9695026f52865eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.564015 12158 tablet_service.cc:1511] Processing CreateTablet for tablet a8470d1f74104ccc9695026f52865eca (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:55.565796 12158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8470d1f74104ccc9695026f52865eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.569444 12217 tablet_bootstrap.cc:492] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:03:55.576475 12217 tablet_bootstrap.cc:654] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.599301 12221 tablet_bootstrap.cc:492] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:03:55.610348 12011 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3a2f5b782946a6a17501fa72f56043 (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:55.611778 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3a2f5b782946a6a17501fa72f56043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.612650 12013 tablet_service.cc:1511] Processing CreateTablet for tablet 2c2974b9251e4403b9b7b2169042e6ee (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:55.612788 12156 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3a2f5b782946a6a17501fa72f56043 (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:55.614127 12013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c2974b9251e4403b9b7b2169042e6ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.614429 12156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3a2f5b782946a6a17501fa72f56043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.617728 12086 tablet_service.cc:1511] Processing CreateTablet for tablet cbc5703b8ed84a96838349220e891c0b (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:55.619432 12086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc5703b8ed84a96838349220e891c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.614496 12221 tablet_bootstrap.cc:654] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.617815 12089 tablet_service.cc:1511] Processing CreateTablet for tablet 2c2974b9251e4403b9b7b2169042e6ee (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:55.621870 12084 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3a2f5b782946a6a17501fa72f56043 (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:55.623994 12160 tablet_service.cc:1511] Processing CreateTablet for tablet cbc5703b8ed84a96838349220e891c0b (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:55.624501 12216 tablet_bootstrap.cc:492] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:03:55.625231 12216 ts_tablet_manager.cc:1403] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.153s	user 0.040s	sys 0.032s
I20260709 13:03:55.625489 12160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc5703b8ed84a96838349220e891c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.628512 12216 raft_consensus.cc:359] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.629465 12216 raft_consensus.cc:385] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.629963 12216 raft_consensus.cc:740] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.630225 12157 tablet_service.cc:1511] Processing CreateTablet for tablet 2c2974b9251e4403b9b7b2169042e6ee (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:55.630877 12216 consensus_queue.cc:260] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.631835 12157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c2974b9251e4403b9b7b2169042e6ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.633289 12084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3a2f5b782946a6a17501fa72f56043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.633692 12012 tablet_service.cc:1511] Processing CreateTablet for tablet cbc5703b8ed84a96838349220e891c0b (DEFAULT_TABLE table=test-workload [id=28e96440e4c84ee7ae855d674a26dd8e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:55.635166 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc5703b8ed84a96838349220e891c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.640782 12089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c2974b9251e4403b9b7b2169042e6ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:55.649148 12124 heartbeater.cc:499] Master 127.0.107.254:38137 was elected leader, sending a full tablet report...
I20260709 13:03:55.649658 12216 ts_tablet_manager.cc:1434] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.004s
I20260709 13:03:55.656373 12216 tablet_bootstrap.cc:492] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:03:55.682914 12216 tablet_bootstrap.cc:654] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.722363 12221 tablet_bootstrap.cc:492] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:03:55.722950 12216 tablet_bootstrap.cc:492] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:03:55.724277 12221 ts_tablet_manager.cc:1403] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.125s	user 0.032s	sys 0.040s
I20260709 13:03:55.724377 12216 ts_tablet_manager.cc:1403] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.068s	user 0.025s	sys 0.020s
I20260709 13:03:55.727931 12221 raft_consensus.cc:359] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.728768 12221 raft_consensus.cc:385] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.728209 12216 raft_consensus.cc:359] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } }
I20260709 13:03:55.729305 12216 raft_consensus.cc:385] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.729773 12216 raft_consensus.cc:740] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.730765 12216 consensus_queue.cc:260] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } }
I20260709 13:03:55.733248 12216 ts_tablet_manager.cc:1434] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:03:55.733610 12217 tablet_bootstrap.cc:492] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:03:55.729108 12221 raft_consensus.cc:740] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.734287 12217 ts_tablet_manager.cc:1403] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.165s	user 0.013s	sys 0.011s
I20260709 13:03:55.734575 12221 consensus_queue.cc:260] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.736450 12216 tablet_bootstrap.cc:492] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:03:55.744729 12216 tablet_bootstrap.cc:654] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.744908 12198 heartbeater.cc:499] Master 127.0.107.254:38137 was elected leader, sending a full tablet report...
I20260709 13:03:55.747639 12217 raft_consensus.cc:359] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.750629 12217 raft_consensus.cc:385] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.751199 12217 raft_consensus.cc:740] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.752492 12217 consensus_queue.cc:260] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.753648 12221 ts_tablet_manager.cc:1434] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.003s
I20260709 13:03:55.754951 12221 tablet_bootstrap.cc:492] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:03:55.758409 12217 ts_tablet_manager.cc:1434] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:03:55.758556 12216 tablet_bootstrap.cc:492] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:03:55.759254 12216 ts_tablet_manager.cc:1403] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.003s
I20260709 13:03:55.759657 12217 tablet_bootstrap.cc:492] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:03:55.762498 12221 tablet_bootstrap.cc:654] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.762384 12216 raft_consensus.cc:359] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.763489 12216 raft_consensus.cc:385] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.763917 12216 raft_consensus.cc:740] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.764971 12216 consensus_queue.cc:260] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.767314 12216 ts_tablet_manager.cc:1434] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:03:55.768497 12216 tablet_bootstrap.cc:492] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:03:55.769879 12217 tablet_bootstrap.cc:654] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.776248 12216 tablet_bootstrap.cc:654] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.778365 12221 tablet_bootstrap.cc:492] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:03:55.779023 12221 ts_tablet_manager.cc:1403] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.002s
I20260709 13:03:55.781023 12217 tablet_bootstrap.cc:492] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:03:55.782246 12217 ts_tablet_manager.cc:1403] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:03:55.782610 12221 raft_consensus.cc:359] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.783622 12221 raft_consensus.cc:385] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.784142 12221 raft_consensus.cc:740] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.784942 12221 consensus_queue.cc:260] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.787740 12221 ts_tablet_manager.cc:1434] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:03:55.787532 12217 raft_consensus.cc:359] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } }
I20260709 13:03:55.789055 12221 tablet_bootstrap.cc:492] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:03:55.788525 12217 raft_consensus.cc:385] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.789959 12217 raft_consensus.cc:740] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
W20260709 13:03:55.792378 11970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:55.793314 12217 consensus_queue.cc:260] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } }
I20260709 13:03:55.794173 12216 tablet_bootstrap.cc:492] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:03:55.794760 12216 ts_tablet_manager.cc:1403] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260709 13:03:55.795614 12217 ts_tablet_manager.cc:1434] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:03:55.796238 12226 raft_consensus.cc:493] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.797001 12221 tablet_bootstrap.cc:654] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.796892 12226 raft_consensus.cc:515] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.799381 12216 raft_consensus.cc:359] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.800068 12223 raft_consensus.cc:493] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.800839 12216 raft_consensus.cc:385] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.801005 12223 raft_consensus.cc:515] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } }
I20260709 13:03:55.796852 12217 tablet_bootstrap.cc:492] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:03:55.812845 12226 leader_election.cc:290] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:03:55.801175 12216 raft_consensus.cc:740] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.814436 12216 consensus_queue.cc:260] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.812086 12221 tablet_bootstrap.cc:492] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:03:55.817878 12223 leader_election.cc:290] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013), 1affb97882084b8783e590354f97be84 (127.0.107.193:43521)
I20260709 13:03:55.822238 12221 ts_tablet_manager.cc:1403] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.003s
I20260709 13:03:55.825964 12221 raft_consensus.cc:359] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.831296 12221 raft_consensus.cc:385] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.832330 12220 raft_consensus.cc:493] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.832449 12221 raft_consensus.cc:740] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.833173 12220 raft_consensus.cc:515] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.833926 12221 consensus_queue.cc:260] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.837157 12221 ts_tablet_manager.cc:1434] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:03:55.838479 12221 tablet_bootstrap.cc:492] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:03:55.846562 12217 tablet_bootstrap.cc:654] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.848042 12220 leader_election.cc:290] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:55.860971 12221 tablet_bootstrap.cc:654] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.898044 12216 ts_tablet_manager.cc:1434] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.103s	user 0.012s	sys 0.013s
I20260709 13:03:55.901557 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfe096a4bdd4aac9bfc641d24d667d5" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:03:55.901993 12216 tablet_bootstrap.cc:492] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:03:55.904002 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83202045303b4403b8a8ba2f723bad5b" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
W20260709 13:03:55.906109 12062 leader_election.cc:343] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:55.910612 12136 leader_election.cc:343] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1affb97882084b8783e590354f97be84 (127.0.107.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.909816 12217 tablet_bootstrap.cc:492] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:03:55.911854 12217 ts_tablet_manager.cc:1403] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.115s	user 0.009s	sys 0.011s
I20260709 13:03:55.910394 12216 tablet_bootstrap.cc:654] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.914472 12099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4154b1f61d0147ebb9b941ed1bd8058a" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:03:55.917039 12220 raft_consensus.cc:493] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:55.917574 11987 leader_election.cc:343] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.917881 12220 raft_consensus.cc:515] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } }
I20260709 13:03:55.917120 12217 raft_consensus.cc:359] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.919358 12217 raft_consensus.cc:385] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.919690 12217 raft_consensus.cc:740] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.927268 12217 consensus_queue.cc:260] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.930044 12099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83202045303b4403b8a8ba2f723bad5b" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:03:55.930193 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83202045303b4403b8a8ba2f723bad5b" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:03:55.930954 12099 raft_consensus.cc:2468] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 0.
I20260709 13:03:55.931097 12024 raft_consensus.cc:2468] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 0.
I20260709 13:03:55.932309 12221 tablet_bootstrap.cc:492] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:03:55.932494 11987 leader_election.cc:304] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:55.932931 12221 ts_tablet_manager.cc:1403] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.095s	user 0.021s	sys 0.011s
I20260709 13:03:55.932737 12062 leader_election.cc:304] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: a67b474ab9354f4d937a2d0cd422e5df
I20260709 13:03:55.934273 12237 raft_consensus.cc:2804] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.934679 12237 raft_consensus.cc:493] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.934473 12099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfe096a4bdd4aac9bfc641d24d667d5" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:03:55.935122 12237 raft_consensus.cc:3060] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.935397 12220 leader_election.cc:290] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:03:55.935930 12220 raft_consensus.cc:493] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:55.936215 12136 leader_election.cc:343] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.936012 12221 raft_consensus.cc:359] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.936897 12221 raft_consensus.cc:385] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.936820 12136 leader_election.cc:304] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df; no voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba
I20260709 13:03:55.937366 12221 raft_consensus.cc:740] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.938246 12221 consensus_queue.cc:260] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.938467 12226 raft_consensus.cc:2749] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.936401 12220 raft_consensus.cc:515] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.946063 12244 raft_consensus.cc:2804] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.946574 12244 raft_consensus.cc:493] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.946923 12244 raft_consensus.cc:3060] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.952041 12220 leader_election.cc:290] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:55.955842 12216 tablet_bootstrap.cc:492] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:03:55.956502 12216 ts_tablet_manager.cc:1403] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.007s
I20260709 13:03:55.957641 12099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703c68323a7e41fc87b8c48189a6c563" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:03:55.958400 12099 raft_consensus.cc:2468] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 0.
I20260709 13:03:55.959754 12216 raft_consensus.cc:359] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.961316 12237 raft_consensus.cc:515] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } }
I20260709 13:03:55.962230 12216 raft_consensus.cc:385] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.962661 12216 raft_consensus.cc:740] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.962994 11987 leader_election.cc:304] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:55.960923 12217 ts_tablet_manager.cc:1434] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.020s
I20260709 13:03:55.963450 12216 consensus_queue.cc:260] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.963950 12237 leader_election.cc:290] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Requested vote from peers a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013), 1affb97882084b8783e590354f97be84 (127.0.107.193:43521)
I20260709 13:03:55.965592 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83202045303b4403b8a8ba2f723bad5b" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:03:55.965919 12221 ts_tablet_manager.cc:1434] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:03:55.966326 12216 ts_tablet_manager.cc:1434] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:55.966866 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83202045303b4403b8a8ba2f723bad5b" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:03:55.967473 12216 tablet_bootstrap.cc:492] T 6bfe096a4bdd4aac9bfc641d24d667d5 P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:03:55.967027 12221 tablet_bootstrap.cc:492] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:03:55.969933 12217 tablet_bootstrap.cc:492] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:03:55.970721 12171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703c68323a7e41fc87b8c48189a6c563" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:03:55.971493 12171 raft_consensus.cc:2468] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 0.
W20260709 13:03:55.972846 12062 leader_election.cc:343] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.969727 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83202045303b4403b8a8ba2f723bad5b" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:03:55.974766 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4154b1f61d0147ebb9b941ed1bd8058a" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:03:55.975795 12216 tablet_bootstrap.cc:654] T 6bfe096a4bdd4aac9bfc641d24d667d5 P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:55.976995 11987 leader_election.cc:343] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:55.978129 11987 leader_election.cc:343] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.978554 11987 leader_election.cc:304] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1affb97882084b8783e590354f97be84; no voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba
I20260709 13:03:55.980521 12244 raft_consensus.cc:515] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } }
I20260709 13:03:55.981866 12024 raft_consensus.cc:2393] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ec4cb6593e3d45458f39de98c49431ba in current term 1: Already voted for candidate 1affb97882084b8783e590354f97be84 in this term.
I20260709 13:03:55.982926 12217 tablet_bootstrap.cc:654] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.987285 12221 tablet_bootstrap.cc:654] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.987463 12062 leader_election.cc:304] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4cb6593e3d45458f39de98c49431ba; no voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df
I20260709 13:03:55.988606 12220 raft_consensus.cc:2749] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.990005 12220 raft_consensus.cc:493] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.990803 12220 raft_consensus.cc:515] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:55.993016 12244 leader_election.cc:290] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Requested vote from peers a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:03:55.993723 12099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83202045303b4403b8a8ba2f723bad5b" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:03:55.995383 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83202045303b4403b8a8ba2f723bad5b" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:03:55.996951 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfe096a4bdd4aac9bfc641d24d667d5" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:03:55.999049 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfe096a4bdd4aac9bfc641d24d667d5" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:03:55.988744 12223 raft_consensus.cc:2749] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.000095 12172 raft_consensus.cc:2468] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 0.
I20260709 13:03:56.001257 12099 raft_consensus.cc:2393] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1affb97882084b8783e590354f97be84 in current term 1: Already voted for candidate ec4cb6593e3d45458f39de98c49431ba in this term.
W20260709 13:03:56.004356 11987 leader_election.cc:343] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.966965 12245 raft_consensus.cc:2804] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.005790 12245 raft_consensus.cc:493] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:56.006089 11987 leader_election.cc:343] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.006330 12245 raft_consensus.cc:3060] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.006872 11987 leader_election.cc:304] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1affb97882084b8783e590354f97be84; no voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba
I20260709 13:03:56.008279 12244 raft_consensus.cc:2749] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.993870 12220 leader_election.cc:290] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:56.010161 11987 leader_election.cc:304] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: ec4cb6593e3d45458f39de98c49431ba
I20260709 13:03:56.017041 12246 raft_consensus.cc:2804] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.018123 12246 raft_consensus.cc:493] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.018668 12246 raft_consensus.cc:3060] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.024124 12217 tablet_bootstrap.cc:492] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:03:56.025100 12217 ts_tablet_manager.cc:1403] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.061s	user 0.006s	sys 0.018s
I20260709 13:03:56.032516 12217 raft_consensus.cc:359] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.033712 12217 raft_consensus.cc:385] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.034149 12217 raft_consensus.cc:740] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.035332 12217 consensus_queue.cc:260] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.039110 12217 ts_tablet_manager.cc:1434] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.007s
I20260709 13:03:56.040720 12217 tablet_bootstrap.cc:492] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:03:56.050457 12217 tablet_bootstrap.cc:654] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.063381 12245 raft_consensus.cc:515] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.064404 12217 tablet_bootstrap.cc:492] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:03:56.068702 12216 tablet_bootstrap.cc:492] T 6bfe096a4bdd4aac9bfc641d24d667d5 P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:03:56.069190 12217 ts_tablet_manager.cc:1403] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.019s
I20260709 13:03:56.069236 12216 ts_tablet_manager.cc:1403] T 6bfe096a4bdd4aac9bfc641d24d667d5 P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.102s	user 0.037s	sys 0.059s
I20260709 13:03:56.068063 12221 tablet_bootstrap.cc:492] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:03:56.070086 12221 ts_tablet_manager.cc:1403] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.103s	user 0.023s	sys 0.061s
I20260709 13:03:56.070194 12246 raft_consensus.cc:515] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.072516 12216 raft_consensus.cc:359] T 6bfe096a4bdd4aac9bfc641d24d667d5 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.073377 12216 raft_consensus.cc:385] T 6bfe096a4bdd4aac9bfc641d24d667d5 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.073709 12099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703c68323a7e41fc87b8c48189a6c563" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:03:56.073316 12221 raft_consensus.cc:359] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.073977 12216 raft_consensus.cc:740] T 6bfe096a4bdd4aac9bfc641d24d667d5 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.074422 12221 raft_consensus.cc:385] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.074910 12221 raft_consensus.cc:740] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.075498 12245 leader_election.cc:290] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Requested vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:56.075241 12216 consensus_queue.cc:260] T 6bfe096a4bdd4aac9bfc641d24d667d5 P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.075785 12221 consensus_queue.cc:260] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.073978 12217 raft_consensus.cc:359] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.076496 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "703c68323a7e41fc87b8c48189a6c563" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:03:56.076817 12217 raft_consensus.cc:385] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.077165 12172 raft_consensus.cc:3060] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.077325 12217 raft_consensus.cc:740] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.078455 12216 ts_tablet_manager.cc:1434] T 6bfe096a4bdd4aac9bfc641d24d667d5 P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:03:56.078544 12221 ts_tablet_manager.cc:1434] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:56.078338 12217 consensus_queue.cc:260] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.079663 12216 tablet_bootstrap.cc:492] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:03:56.079730 12221 tablet_bootstrap.cc:492] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:03:56.080740 12217 ts_tablet_manager.cc:1434] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:03:56.081841 12217 tablet_bootstrap.cc:492] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:03:56.087373 12221 tablet_bootstrap.cc:654] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.088121 12216 tablet_bootstrap.cc:654] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.089776 12217 tablet_bootstrap.cc:654] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.074461 12099 raft_consensus.cc:3060] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.075335 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfe096a4bdd4aac9bfc641d24d667d5" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:03:56.098176 12098 raft_consensus.cc:3060] T 6bfe096a4bdd4aac9bfc641d24d667d5 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.109370 12216 tablet_bootstrap.cc:492] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:03:56.110467 12216 ts_tablet_manager.cc:1403] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.007s
I20260709 13:03:56.115083 12216 raft_consensus.cc:359] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.116205 12216 raft_consensus.cc:385] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.117954 12226 raft_consensus.cc:493] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.118563 12226 raft_consensus.cc:515] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.120110 12099 raft_consensus.cc:2468] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 1.
I20260709 13:03:56.120819 12226 leader_election.cc:290] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:03:56.122104 11987 leader_election.cc:304] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:56.123342 12245 raft_consensus.cc:2804] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.124029 12245 raft_consensus.cc:697] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Becoming Leader. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:03:56.126322 12245 consensus_queue.cc:237] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.127050 12246 leader_election.cc:290] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Requested vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:56.128204 12172 raft_consensus.cc:2468] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 1.
I20260709 13:03:56.130915 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfe096a4bdd4aac9bfc641d24d667d5" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:03:56.131237 12098 raft_consensus.cc:2468] T 6bfe096a4bdd4aac9bfc641d24d667d5 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 1.
I20260709 13:03:56.131976 12172 raft_consensus.cc:3060] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.132434 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4154b1f61d0147ebb9b941ed1bd8058a" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:03:56.132794 12246 raft_consensus.cc:493] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.132987 11987 leader_election.cc:304] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:56.133262 12024 raft_consensus.cc:2468] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 0.
I20260709 13:03:56.133356 12246 raft_consensus.cc:515] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.134071 12220 raft_consensus.cc:2804] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.134639 12220 raft_consensus.cc:697] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Becoming Leader. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:03:56.135550 12220 consensus_queue.cc:237] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.135895 12246 leader_election.cc:290] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:56.123147 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4154b1f61d0147ebb9b941ed1bd8058a" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:03:56.137960 12097 raft_consensus.cc:2468] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 0.
I20260709 13:03:56.138311 12136 leader_election.cc:304] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:03:56.138743 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b7d4c4a66b4fbf9963fddef0ec2cdf" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:03:56.139330 12226 raft_consensus.cc:2804] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.139753 12173 raft_consensus.cc:2468] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 0.
I20260709 13:03:56.139819 12226 raft_consensus.cc:493] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.140314 12226 raft_consensus.cc:3060] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.141476 11987 leader_election.cc:304] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:03:56.142530 12244 raft_consensus.cc:2804] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.141568 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b7d4c4a66b4fbf9963fddef0ec2cdf" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:03:56.142926 12244 raft_consensus.cc:493] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.144011 12244 raft_consensus.cc:3060] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.124951 12216 raft_consensus.cc:740] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.152046 12217 tablet_bootstrap.cc:492] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:03:56.152735 12217 ts_tablet_manager.cc:1403] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.071s	user 0.036s	sys 0.007s
I20260709 13:03:56.156075 12226 raft_consensus.cc:515] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.157099 12221 tablet_bootstrap.cc:492] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:03:56.157650 12221 ts_tablet_manager.cc:1403] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.078s	user 0.024s	sys 0.023s
I20260709 13:03:56.158325 12244 raft_consensus.cc:515] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.159368 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4154b1f61d0147ebb9b941ed1bd8058a" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:03:56.160010 12024 raft_consensus.cc:3060] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.148723 12098 raft_consensus.cc:2468] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 0.
I20260709 13:03:56.154911 12216 consensus_queue.cc:260] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.163445 12216 ts_tablet_manager.cc:1434] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.052s	user 0.011s	sys 0.000s
I20260709 13:03:56.165692 12216 tablet_bootstrap.cc:492] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:03:56.164040 12221 raft_consensus.cc:359] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.169179 12221 raft_consensus.cc:385] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.169654 12221 raft_consensus.cc:740] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.170615 12221 consensus_queue.cc:260] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.173462 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b7d4c4a66b4fbf9963fddef0ec2cdf" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:03:56.173777 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b7d4c4a66b4fbf9963fddef0ec2cdf" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:03:56.168915 12172 raft_consensus.cc:2468] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 1.
I20260709 13:03:56.180774 12173 raft_consensus.cc:3060] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.174353 12244 leader_election.cc:290] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Requested vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:56.158414 12217 raft_consensus.cc:359] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.182216 12217 raft_consensus.cc:385] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.182554 12217 raft_consensus.cc:740] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.183169 12216 tablet_bootstrap.cc:654] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.183550 12217 consensus_queue.cc:260] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.184999 12098 raft_consensus.cc:3060] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.186286 12217 ts_tablet_manager.cc:1434] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.003s
I20260709 13:03:56.187821 12217 tablet_bootstrap.cc:492] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:03:56.179630 11922 catalog_manager.cc:5697] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1affb97882084b8783e590354f97be84 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "1affb97882084b8783e590354f97be84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.189849 11922 catalog_manager.cc:5697] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1affb97882084b8783e590354f97be84 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "1affb97882084b8783e590354f97be84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.196017 12216 tablet_bootstrap.cc:492] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:03:56.196849 12216 ts_tablet_manager.cc:1403] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.007s
I20260709 13:03:56.197016 12217 tablet_bootstrap.cc:654] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.200307 12216 raft_consensus.cc:359] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.201545 12216 raft_consensus.cc:385] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.202118 12216 raft_consensus.cc:740] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.203410 12216 consensus_queue.cc:260] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.204538 12223 raft_consensus.cc:493] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.204278 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4154b1f61d0147ebb9b941ed1bd8058a" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:03:56.205714 12223 raft_consensus.cc:515] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.205789 12097 raft_consensus.cc:3060] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.210911 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8470d1f74104ccc9695026f52865eca" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:03:56.211908 12172 raft_consensus.cc:2468] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 0.
I20260709 13:03:56.213527 12062 leader_election.cc:304] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:56.214473 12237 raft_consensus.cc:2804] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.214885 12237 raft_consensus.cc:493] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.215229 12237 raft_consensus.cc:3060] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.217363 12216 ts_tablet_manager.cc:1434] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:03:56.211000 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8470d1f74104ccc9695026f52865eca" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:03:56.222541 12023 raft_consensus.cc:2468] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 0.
I20260709 13:03:56.222095 12024 raft_consensus.cc:2468] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 1.
I20260709 13:03:56.224304 12223 leader_election.cc:290] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:56.224365 12136 leader_election.cc:304] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:03:56.227078 12216 tablet_bootstrap.cc:492] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:03:56.228926 12226 leader_election.cc:290] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:03:56.230017 12226 raft_consensus.cc:2804] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.230870 12226 raft_consensus.cc:697] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Becoming Leader. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:03:56.234264 12216 tablet_bootstrap.cc:654] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.228971 12237 raft_consensus.cc:515] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.244132 12237 leader_election.cc:290] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:56.200086 12173 raft_consensus.cc:2468] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 1.
I20260709 13:03:56.256340 12216 tablet_bootstrap.cc:492] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:03:56.246455 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8470d1f74104ccc9695026f52865eca" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:03:56.257197 12216 ts_tablet_manager.cc:1403] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.009s
I20260709 13:03:56.257344 12172 raft_consensus.cc:3060] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.258643 12221 ts_tablet_manager.cc:1434] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.101s	user 0.033s	sys 0.051s
I20260709 13:03:56.259814 12216 raft_consensus.cc:359] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.250270 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8470d1f74104ccc9695026f52865eca" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:03:56.252743 12226 consensus_queue.cc:237] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.260478 12216 raft_consensus.cc:385] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.260715 12024 raft_consensus.cc:3060] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.260848 12216 raft_consensus.cc:740] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.261794 12216 consensus_queue.cc:260] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.249269 12217 tablet_bootstrap.cc:492] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:03:56.265836 12217 ts_tablet_manager.cc:1403] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.078s	user 0.007s	sys 0.015s
I20260709 13:03:56.267988 12216 ts_tablet_manager.cc:1434] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:03:56.269081 11987 leader_election.cc:304] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:03:56.255436 12098 raft_consensus.cc:2468] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 1.
I20260709 13:03:56.254343 12097 raft_consensus.cc:2468] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 1.
I20260709 13:03:56.270632 12024 raft_consensus.cc:2468] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 1.
I20260709 13:03:56.270539 12244 raft_consensus.cc:2804] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.273093 12062 leader_election.cc:304] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:56.273294 12244 raft_consensus.cc:697] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Becoming Leader. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:03:56.273895 12237 raft_consensus.cc:2804] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.274345 12237 raft_consensus.cc:697] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Becoming Leader. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Running, Role: LEADER
I20260709 13:03:56.274993 12237 consensus_queue.cc:237] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.274607 12244 consensus_queue.cc:237] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.277123 12217 raft_consensus.cc:359] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.278261 12217 raft_consensus.cc:385] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.278836 12217 raft_consensus.cc:740] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.259832 12221 tablet_bootstrap.cc:492] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:03:56.280103 12217 consensus_queue.cc:260] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.291672 12217 ts_tablet_manager.cc:1434] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:03:56.299295 12172 raft_consensus.cc:2468] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 1.
I20260709 13:03:56.304744 12217 tablet_bootstrap.cc:492] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:03:56.309441 12221 tablet_bootstrap.cc:654] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.315431 12217 tablet_bootstrap.cc:654] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.317943 11921 catalog_manager.cc:5697] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df reported cstate change: term changed from 0 to 1, leader changed from <none> to a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.333864 11919 catalog_manager.cc:5697] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1affb97882084b8783e590354f97be84 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "1affb97882084b8783e590354f97be84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.338466 12244 raft_consensus.cc:493] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.339279 12244 raft_consensus.cc:515] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.343775 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc5703b8ed84a96838349220e891c0b" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:03:56.344540 12097 raft_consensus.cc:2468] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 0.
I20260709 13:03:56.345920 11987 leader_election.cc:304] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:56.344761 12244 leader_election.cc:290] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:56.346733 12221 tablet_bootstrap.cc:492] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:03:56.346845 12245 raft_consensus.cc:2804] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.347209 12245 raft_consensus.cc:493] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.346261 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc5703b8ed84a96838349220e891c0b" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:03:56.347312 12221 ts_tablet_manager.cc:1403] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.088s	user 0.025s	sys 0.018s
I20260709 13:03:56.347394 12217 tablet_bootstrap.cc:492] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:03:56.348186 12217 ts_tablet_manager.cc:1403] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.019s
I20260709 13:03:56.347441 12245 raft_consensus.cc:3060] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:56.348760 11987 leader_election.cc:343] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.351457 12221 raft_consensus.cc:359] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } }
I20260709 13:03:56.352442 12221 raft_consensus.cc:385] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.351923 12217 raft_consensus.cc:359] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.353056 12217 raft_consensus.cc:385] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.353480 12217 raft_consensus.cc:740] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.354115 12217 consensus_queue.cc:260] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.352965 12221 raft_consensus.cc:740] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.356267 12217 ts_tablet_manager.cc:1434] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:56.355890 12245 raft_consensus.cc:515] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.357107 12221 consensus_queue.cc:260] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } }
I20260709 13:03:56.360303 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc5703b8ed84a96838349220e891c0b" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:03:56.360509 12221 ts_tablet_manager.cc:1434] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:03:56.360985 12097 raft_consensus.cc:3060] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.361356 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc5703b8ed84a96838349220e891c0b" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:03:56.362010 12221 tablet_bootstrap.cc:492] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
W20260709 13:03:56.363183 11987 leader_election.cc:343] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.363881 12245 leader_election.cc:290] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Requested vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:56.367363 11922 catalog_manager.cc:5697] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4cb6593e3d45458f39de98c49431ba (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ec4cb6593e3d45458f39de98c49431ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.369445 12097 raft_consensus.cc:2468] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 1.
I20260709 13:03:56.370091 12221 tablet_bootstrap.cc:654] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.370668 11987 leader_election.cc:304] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: a67b474ab9354f4d937a2d0cd422e5df
I20260709 13:03:56.371625 12245 raft_consensus.cc:2804] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.372391 12245 raft_consensus.cc:697] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Becoming Leader. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:03:56.373458 12245 consensus_queue.cc:237] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.378542 12221 tablet_bootstrap.cc:492] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:03:56.379271 12221 ts_tablet_manager.cc:1403] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:03:56.382306 12221 raft_consensus.cc:359] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.383002 12221 raft_consensus.cc:385] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.383292 12221 raft_consensus.cc:740] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.383973 12221 consensus_queue.cc:260] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.385850 12221 ts_tablet_manager.cc:1434] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:56.386828 12221 tablet_bootstrap.cc:492] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:03:56.387426 11922 catalog_manager.cc:5697] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1affb97882084b8783e590354f97be84 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "1affb97882084b8783e590354f97be84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.392676 12221 tablet_bootstrap.cc:654] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.399382 12221 tablet_bootstrap.cc:492] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:03:56.399930 12221 ts_tablet_manager.cc:1403] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:03:56.401983 12237 raft_consensus.cc:493] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.402559 12237 raft_consensus.cc:515] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.403147 12221 raft_consensus.cc:359] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.404304 12221 raft_consensus.cc:385] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.404608 12221 raft_consensus.cc:740] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.405133 12237 leader_election.cc:290] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:56.405484 12221 consensus_queue.cc:260] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.407130 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a2f5b782946a6a17501fa72f56043" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:03:56.407707 12221 ts_tablet_manager.cc:1434] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:03:56.407860 12024 raft_consensus.cc:2468] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 0.
I20260709 13:03:56.408792 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a2f5b782946a6a17501fa72f56043" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:03:56.409088 12062 leader_election.cc:304] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:56.409461 12172 raft_consensus.cc:2468] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 0.
I20260709 13:03:56.410030 12237 raft_consensus.cc:2804] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.410403 12237 raft_consensus.cc:493] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.410758 12237 raft_consensus.cc:3060] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.416496 12237 raft_consensus.cc:515] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.418501 12237 leader_election.cc:290] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:56.419425 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a2f5b782946a6a17501fa72f56043" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:03:56.419628 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a2f5b782946a6a17501fa72f56043" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:03:56.420258 12172 raft_consensus.cc:3060] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.420289 12024 raft_consensus.cc:3060] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.428000 12172 raft_consensus.cc:2468] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 1.
I20260709 13:03:56.428000 12024 raft_consensus.cc:2468] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 1.
I20260709 13:03:56.429502 12062 leader_election.cc:304] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:56.430354 12237 raft_consensus.cc:2804] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.431434 12237 raft_consensus.cc:697] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Becoming Leader. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Running, Role: LEADER
I20260709 13:03:56.432647 12237 consensus_queue.cc:237] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.442135 11919 catalog_manager.cc:5697] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4cb6593e3d45458f39de98c49431ba (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ec4cb6593e3d45458f39de98c49431ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.462344 12237 raft_consensus.cc:493] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.463004 12237 raft_consensus.cc:515] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.464856 12237 leader_election.cc:290] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:56.465756 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2974b9251e4403b9b7b2169042e6ee" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:03:56.466104 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2974b9251e4403b9b7b2169042e6ee" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:03:56.466406 12024 raft_consensus.cc:2468] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 0.
I20260709 13:03:56.466907 12172 raft_consensus.cc:2468] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 0.
I20260709 13:03:56.467468 12062 leader_election.cc:304] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:56.468132 12237 raft_consensus.cc:2804] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.468456 12237 raft_consensus.cc:493] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.468818 12237 raft_consensus.cc:3060] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.474623 12237 raft_consensus.cc:515] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.476985 12237 leader_election.cc:290] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:56.477809 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2974b9251e4403b9b7b2169042e6ee" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:03:56.478062 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2974b9251e4403b9b7b2169042e6ee" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:03:56.478466 12024 raft_consensus.cc:3060] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.478614 12172 raft_consensus.cc:3060] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.484025 12024 raft_consensus.cc:2468] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 1.
I20260709 13:03:56.484017 12172 raft_consensus.cc:2468] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 1.
I20260709 13:03:56.485360 12062 leader_election.cc:304] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:56.486153 12237 raft_consensus.cc:2804] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.486685 12237 raft_consensus.cc:697] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Becoming Leader. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Running, Role: LEADER
I20260709 13:03:56.487483 12237 consensus_queue.cc:237] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.497498 11919 catalog_manager.cc:5697] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4cb6593e3d45458f39de98c49431ba (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ec4cb6593e3d45458f39de98c49431ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.659675 12245 consensus_queue.cc:1048] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.662621 12226 raft_consensus.cc:493] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.663295 12226 raft_consensus.cc:515] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } }
I20260709 13:03:56.665767 12226 leader_election.cc:290] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), 1affb97882084b8783e590354f97be84 (127.0.107.193:43521)
I20260709 13:03:56.666694 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83202045303b4403b8a8ba2f723bad5b" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:03:56.667574 12097 raft_consensus.cc:2393] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a67b474ab9354f4d937a2d0cd422e5df in current term 1: Already voted for candidate ec4cb6593e3d45458f39de98c49431ba in this term.
I20260709 13:03:56.669006 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83202045303b4403b8a8ba2f723bad5b" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:03:56.669835 12024 raft_consensus.cc:2393] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a67b474ab9354f4d937a2d0cd422e5df in current term 1: Already voted for candidate 1affb97882084b8783e590354f97be84 in this term.
I20260709 13:03:56.672852 12136 leader_election.cc:304] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df; no voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba
I20260709 13:03:56.672979 12245 consensus_queue.cc:1048] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.674075 12226 raft_consensus.cc:3060] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.685262 12256 consensus_queue.cc:1048] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:56.686344 12226 raft_consensus.cc:2749] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.694283 12260 raft_consensus.cc:493] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.694864 12260 raft_consensus.cc:515] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:56.697037 12260 leader_election.cc:290] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:03:56.699163 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc5703b8ed84a96838349220e891c0b" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:03:56.700515 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc5703b8ed84a96838349220e891c0b" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:03:56.701416 12098 raft_consensus.cc:2393] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a67b474ab9354f4d937a2d0cd422e5df in current term 1: Already voted for candidate 1affb97882084b8783e590354f97be84 in this term.
I20260709 13:03:56.703048 12245 consensus_queue.cc:1048] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.703572 12136 leader_election.cc:304] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df; no voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba
I20260709 13:03:56.704934 12260 raft_consensus.cc:3060] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.705287 12256 consensus_queue.cc:1048] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.710516 12244 consensus_queue.cc:1048] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.716908 12260 raft_consensus.cc:2749] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.741439 12244 consensus_queue.cc:1048] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:56.757797 12285 consensus_queue.cc:1048] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:56.769227 12237 consensus_queue.cc:1048] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:56.783447 12290 consensus_queue.cc:1048] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:56.794379 11970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:56.884081 12290 consensus_queue.cc:1048] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.899631 12223 consensus_queue.cc:1048] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.899940 12289 consensus_queue.cc:1048] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:56.915079 12237 consensus_queue.cc:1048] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.988015 12285 consensus_queue.cc:1048] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.999951 12284 consensus_queue.cc:1048] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:57.796414 11970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:58.072309 12283 raft_consensus.cc:493] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.073009 12283 raft_consensus.cc:515] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } }
I20260709 13:03:58.075266 12283 leader_election.cc:290] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:03:58.075683 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83202045303b4403b8a8ba2f723bad5b" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:03:58.076321 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83202045303b4403b8a8ba2f723bad5b" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:03:58.076442 12172 raft_consensus.cc:2468] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 1.
I20260709 13:03:58.076982 12097 raft_consensus.cc:2468] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 1.
I20260709 13:03:58.077875 11987 leader_election.cc:304] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:03:58.078788 12283 raft_consensus.cc:2804] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:58.079100 12283 raft_consensus.cc:493] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.079380 12283 raft_consensus.cc:3060] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.085685 12283 raft_consensus.cc:515] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } }
I20260709 13:03:58.087291 12283 leader_election.cc:290] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 2 election: Requested vote from peers a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:03:58.088408 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83202045303b4403b8a8ba2f723bad5b" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:03:58.088768 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83202045303b4403b8a8ba2f723bad5b" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:03:58.089097 12172 raft_consensus.cc:3060] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.089354 12097 raft_consensus.cc:3060] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.094669 12097 raft_consensus.cc:2468] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 2.
I20260709 13:03:58.095037 12172 raft_consensus.cc:2468] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 2.
I20260709 13:03:58.095889 11987 leader_election.cc:304] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:58.096829 12283 raft_consensus.cc:2804] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:58.097301 12283 raft_consensus.cc:697] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 2 LEADER]: Becoming Leader. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:03:58.098050 12283 consensus_queue.cc:237] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } }
I20260709 13:03:58.106238 11920 catalog_manager.cc:5697] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 reported cstate change: term changed from 0 to 2, leader changed from <none> to 1affb97882084b8783e590354f97be84 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1affb97882084b8783e590354f97be84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:58.517282 12097 raft_consensus.cc:1275] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Refusing update from remote peer 1affb97882084b8783e590354f97be84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:58.518779 12283 consensus_queue.cc:1048] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.530565 12173 raft_consensus.cc:1275] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Refusing update from remote peer 1affb97882084b8783e590354f97be84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:58.535961 12305 consensus_queue.cc:1048] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.746760 12173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4154b1f61d0147ebb9b941ed1bd8058a"
dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
mode: GRACEFUL
new_leader_uuid: "1affb97882084b8783e590354f97be84"
 from {username='slave'} at 127.0.0.1:52764
I20260709 13:03:58.747413 12173 raft_consensus.cc:606] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Received request to transfer leadership to TS 1affb97882084b8783e590354f97be84
I20260709 13:03:58.767311 12024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3b7d4c4a66b4fbf9963fddef0ec2cdf"
dest_uuid: "1affb97882084b8783e590354f97be84"
mode: GRACEFUL
new_leader_uuid: "ec4cb6593e3d45458f39de98c49431ba"
 from {username='slave'} at 127.0.0.1:44786
I20260709 13:03:58.767874 12024 raft_consensus.cc:606] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Received request to transfer leadership to TS ec4cb6593e3d45458f39de98c49431ba
I20260709 13:03:58.776489 12024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbc5703b8ed84a96838349220e891c0b"
dest_uuid: "1affb97882084b8783e590354f97be84"
mode: GRACEFUL
new_leader_uuid: "ec4cb6593e3d45458f39de98c49431ba"
 from {username='slave'} at 127.0.0.1:44786
I20260709 13:03:58.777158 12024 raft_consensus.cc:606] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Received request to transfer leadership to TS ec4cb6593e3d45458f39de98c49431ba
I20260709 13:03:58.794540 12097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d3a2f5b782946a6a17501fa72f56043"
dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
mode: GRACEFUL
new_leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
 from {username='slave'} at 127.0.0.1:51500
I20260709 13:03:58.795245 12097 raft_consensus.cc:606] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Received request to transfer leadership to TS a67b474ab9354f4d937a2d0cd422e5df
I20260709 13:03:58.917303 12284 raft_consensus.cc:993] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84: : Instructing follower ec4cb6593e3d45458f39de98c49431ba to start an election
I20260709 13:03:58.917809 12305 raft_consensus.cc:1081] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Signalling peer ec4cb6593e3d45458f39de98c49431ba to start an election
I20260709 13:03:58.919416 12097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3b7d4c4a66b4fbf9963fddef0ec2cdf"
dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
 from {username='slave'} at 127.0.0.1:54806
I20260709 13:03:58.919893 12097 raft_consensus.cc:493] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:58.920145 12097 raft_consensus.cc:3060] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.925711 12097 raft_consensus.cc:515] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:58.927832 12097 leader_election.cc:290] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 2 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:58.928686 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b7d4c4a66b4fbf9963fddef0ec2cdf" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:03:58.928997 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b7d4c4a66b4fbf9963fddef0ec2cdf" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:03:58.929436 12024 raft_consensus.cc:3055] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:58.929544 12173 raft_consensus.cc:3060] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.929852 12024 raft_consensus.cc:740] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:03:58.930728 12024 consensus_queue.cc:260] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:58.932085 12024 raft_consensus.cc:3060] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.938230 12173 raft_consensus.cc:2468] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 2.
I20260709 13:03:58.939858 12062 leader_election.cc:304] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:58.940433 12024 raft_consensus.cc:2468] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 2.
I20260709 13:03:58.940896 12290 raft_consensus.cc:2804] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:58.942539 12290 raft_consensus.cc:697] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Becoming Leader. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Running, Role: LEADER
I20260709 13:03:58.943574 12290 consensus_queue.cc:237] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:58.951257 12290 raft_consensus.cc:993] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba: : Instructing follower a67b474ab9354f4d937a2d0cd422e5df to start an election
I20260709 13:03:58.951822 12313 raft_consensus.cc:1081] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Signalling peer a67b474ab9354f4d937a2d0cd422e5df to start an election
I20260709 13:03:58.952834 11922 catalog_manager.cc:5697] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba reported cstate change: term changed from 1 to 2, leader changed from 1affb97882084b8783e590354f97be84 (127.0.107.193) to ec4cb6593e3d45458f39de98c49431ba (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ec4cb6593e3d45458f39de98c49431ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:58.953853 12173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d3a2f5b782946a6a17501fa72f56043"
dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
 from {username='slave'} at 127.0.0.1:47870
I20260709 13:03:58.954521 12173 raft_consensus.cc:493] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:58.954872 12173 raft_consensus.cc:3060] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.963568 12173 raft_consensus.cc:515] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:58.966540 12173 leader_election.cc:290] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 2 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:03:58.968256 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a2f5b782946a6a17501fa72f56043" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:03:58.968763 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a2f5b782946a6a17501fa72f56043" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:03:58.969115 12097 raft_consensus.cc:3055] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:58.969455 12024 raft_consensus.cc:3060] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.969558 12097 raft_consensus.cc:740] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Running, Role: LEADER
I20260709 13:03:58.970804 12097 consensus_queue.cc:260] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:58.972301 12097 raft_consensus.cc:3060] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.973733 12305 raft_consensus.cc:993] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84: : Instructing follower ec4cb6593e3d45458f39de98c49431ba to start an election
I20260709 13:03:58.974262 12305 raft_consensus.cc:1081] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Signalling peer ec4cb6593e3d45458f39de98c49431ba to start an election
I20260709 13:03:58.979494 12024 raft_consensus.cc:2468] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 2.
I20260709 13:03:58.979633 12098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbc5703b8ed84a96838349220e891c0b"
dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
 from {username='slave'} at 127.0.0.1:54806
I20260709 13:03:58.980511 12098 raft_consensus.cc:493] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:58.980952 12098 raft_consensus.cc:3060] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.981034 12318 raft_consensus.cc:993] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df: : Instructing follower 1affb97882084b8783e590354f97be84 to start an election
I20260709 13:03:58.981741 12260 raft_consensus.cc:1081] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Signalling peer 1affb97882084b8783e590354f97be84 to start an election
I20260709 13:03:58.982103 12097 raft_consensus.cc:2468] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 2.
I20260709 13:03:58.983603 12136 leader_election.cc:304] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:58.984038 12023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4154b1f61d0147ebb9b941ed1bd8058a"
dest_uuid: "1affb97882084b8783e590354f97be84"
 from {username='slave'} at 127.0.0.1:33536
I20260709 13:03:58.984508 12260 raft_consensus.cc:2804] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:58.984915 12023 raft_consensus.cc:493] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:58.985420 12023 raft_consensus.cc:3060] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.985431 12260 raft_consensus.cc:697] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [term 2 LEADER]: Becoming Leader. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:03:58.988824 12098 raft_consensus.cc:515] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:58.990021 12260 consensus_queue.cc:237] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:58.993479 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc5703b8ed84a96838349220e891c0b" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:03:58.994076 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc5703b8ed84a96838349220e891c0b" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:03:58.994346 12023 raft_consensus.cc:515] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:58.994879 12173 raft_consensus.cc:3060] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:58.994838 12024 raft_consensus.cc:3055] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:58.995585 12024 raft_consensus.cc:740] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:03:58.997648 12024 consensus_queue.cc:260] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:58.998915 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4154b1f61d0147ebb9b941ed1bd8058a" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:03:58.999639 12097 raft_consensus.cc:3060] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:59.000720 12098 leader_election.cc:290] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 2 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:59.001447 12024 raft_consensus.cc:3060] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:59.004777 12023 leader_election.cc:290] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 2 election: Requested vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:03:59.006191 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4154b1f61d0147ebb9b941ed1bd8058a" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:03:59.007335 12172 raft_consensus.cc:3055] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:59.007678 12172 raft_consensus.cc:740] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:03:59.008555 12172 consensus_queue.cc:260] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:59.010056 12172 raft_consensus.cc:3060] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:59.011350 12024 raft_consensus.cc:2468] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 2.
I20260709 13:03:59.013144 12062 leader_election.cc:304] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:59.014134 12313 raft_consensus.cc:2804] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:59.016068 12173 raft_consensus.cc:2468] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 2.
I20260709 13:03:59.016458 12313 raft_consensus.cc:697] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Becoming Leader. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Running, Role: LEADER
I20260709 13:03:59.017253 12097 raft_consensus.cc:2468] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 2.
I20260709 13:03:59.017468 12313 consensus_queue.cc:237] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:59.018476 12172 raft_consensus.cc:2468] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 2.
I20260709 13:03:59.018801 11987 leader_election.cc:304] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:03:59.019775 12284 raft_consensus.cc:2804] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:59.020511 12284 raft_consensus.cc:697] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 2 LEADER]: Becoming Leader. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:03:59.021363 12284 consensus_queue.cc:237] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:03:59.024024 11922 catalog_manager.cc:5697] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df reported cstate change: term changed from 1 to 2, leader changed from ec4cb6593e3d45458f39de98c49431ba (127.0.107.194) to a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195). New cstate: current_term: 2 leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:59.031704 11920 catalog_manager.cc:5697] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba reported cstate change: term changed from 1 to 2, leader changed from 1affb97882084b8783e590354f97be84 (127.0.107.193) to ec4cb6593e3d45458f39de98c49431ba (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ec4cb6593e3d45458f39de98c49431ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:59.038461 11922 catalog_manager.cc:5697] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 reported cstate change: term changed from 1 to 2, leader changed from a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195) to 1affb97882084b8783e590354f97be84 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1affb97882084b8783e590354f97be84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:59.398681 12172 raft_consensus.cc:1275] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Refusing update from remote peer ec4cb6593e3d45458f39de98c49431ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:59.400014 12313 consensus_queue.cc:1048] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:59.410277 12024 raft_consensus.cc:1275] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Refusing update from remote peer ec4cb6593e3d45458f39de98c49431ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:59.412151 12313 consensus_queue.cc:1048] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:59.413282 12097 raft_consensus.cc:1275] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Refusing update from remote peer a67b474ab9354f4d937a2d0cd422e5df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:59.415033 12260 consensus_queue.cc:1048] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:59.432072 12172 raft_consensus.cc:1275] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Refusing update from remote peer 1affb97882084b8783e590354f97be84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:59.434755 12283 consensus_queue.cc:1048] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:59.436473 12024 raft_consensus.cc:1275] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Refusing update from remote peer a67b474ab9354f4d937a2d0cd422e5df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:59.436992 12097 raft_consensus.cc:1275] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Refusing update from remote peer 1affb97882084b8783e590354f97be84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:59.438478 12283 consensus_queue.cc:1048] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:59.440253 12328 consensus_queue.cc:1048] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:59.465327 12172 raft_consensus.cc:1275] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Refusing update from remote peer ec4cb6593e3d45458f39de98c49431ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:59.466850 12024 raft_consensus.cc:1275] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Refusing update from remote peer ec4cb6593e3d45458f39de98c49431ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:59.468720 12313 consensus_queue.cc:1048] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:59.469504 12290 consensus_queue.cc:1048] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:01.829305 11920 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33204:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:01.831965 11920 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:01.886437 12013 tablet_service.cc:1511] Processing CreateTablet for tablet 4508e3e099fa4c3ba2701a2ed5456073 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:01.887765 12013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4508e3e099fa4c3ba2701a2ed5456073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.887527 12086 tablet_service.cc:1511] Processing CreateTablet for tablet 4508e3e099fa4c3ba2701a2ed5456073 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:01.888911 12086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4508e3e099fa4c3ba2701a2ed5456073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.889952 12160 tablet_service.cc:1511] Processing CreateTablet for tablet 4508e3e099fa4c3ba2701a2ed5456073 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:01.891316 12160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4508e3e099fa4c3ba2701a2ed5456073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.891986 12012 tablet_service.cc:1511] Processing CreateTablet for tablet 84e8240166164d33af54f986dfc46774 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:01.893352 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84e8240166164d33af54f986dfc46774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.909309 12084 tablet_service.cc:1511] Processing CreateTablet for tablet 84e8240166164d33af54f986dfc46774 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:01.911989 12084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84e8240166164d33af54f986dfc46774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.912760 12157 tablet_service.cc:1511] Processing CreateTablet for tablet 84e8240166164d33af54f986dfc46774 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:01.914170 12157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84e8240166164d33af54f986dfc46774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.914578 12350 tablet_bootstrap.cc:492] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:04:01.916515 12014 tablet_service.cc:1511] Processing CreateTablet for tablet 29c39c37d9904d2d90d7781489f0297d (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:01.918004 12014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c39c37d9904d2d90d7781489f0297d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.928256 12350 tablet_bootstrap.cc:654] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.935271 12086 tablet_service.cc:1511] Processing CreateTablet for tablet 29c39c37d9904d2d90d7781489f0297d (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:01.936784 12086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c39c37d9904d2d90d7781489f0297d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.940450 12011 tablet_service.cc:1511] Processing CreateTablet for tablet a5423d1b6aa74ce7bfebc649bac20c9c (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:01.942199 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5423d1b6aa74ce7bfebc649bac20c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.942793 12351 tablet_bootstrap.cc:492] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:04:01.946130 12157 tablet_service.cc:1511] Processing CreateTablet for tablet 29c39c37d9904d2d90d7781489f0297d (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:01.947597 12157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c39c37d9904d2d90d7781489f0297d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.962940 12353 tablet_bootstrap.cc:492] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:04:01.968147 12089 tablet_service.cc:1511] Processing CreateTablet for tablet a5423d1b6aa74ce7bfebc649bac20c9c (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:01.969832 12089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5423d1b6aa74ce7bfebc649bac20c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.971751 12351 tablet_bootstrap.cc:654] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.979657 12160 tablet_service.cc:1511] Processing CreateTablet for tablet a5423d1b6aa74ce7bfebc649bac20c9c (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:01.981252 12160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5423d1b6aa74ce7bfebc649bac20c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.982838 12012 tablet_service.cc:1511] Processing CreateTablet for tablet 3995b16a40174d659fc83a6b4c085c06 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:01.992224 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3995b16a40174d659fc83a6b4c085c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.993117 12084 tablet_service.cc:1511] Processing CreateTablet for tablet 3995b16a40174d659fc83a6b4c085c06 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:01.987653 12353 tablet_bootstrap.cc:654] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.993635 12157 tablet_service.cc:1511] Processing CreateTablet for tablet 3995b16a40174d659fc83a6b4c085c06 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:01.994530 12084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3995b16a40174d659fc83a6b4c085c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.995111 12157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3995b16a40174d659fc83a6b4c085c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.999634 12350 tablet_bootstrap.cc:492] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:04:02.000514 12350 ts_tablet_manager.cc:1403] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.086s	user 0.015s	sys 0.020s
I20260709 13:04:02.003763 12013 tablet_service.cc:1511] Processing CreateTablet for tablet 40b2c6a620484f0fbba197f2f1395c96 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:02.005471 12013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b2c6a620484f0fbba197f2f1395c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.004314 12350 raft_consensus.cc:359] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.008422 12350 raft_consensus.cc:385] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.008767 12350 raft_consensus.cc:740] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.009527 12350 consensus_queue.cc:260] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.012720 12087 tablet_service.cc:1511] Processing CreateTablet for tablet 40b2c6a620484f0fbba197f2f1395c96 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:02.019533 12350 ts_tablet_manager.cc:1434] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:04:02.020747 12350 tablet_bootstrap.cc:492] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:04:02.026366 12087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b2c6a620484f0fbba197f2f1395c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.022425 12014 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3df09f5b7a4b379cf42e01a9f3a90a (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:02.029104 12014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3df09f5b7a4b379cf42e01a9f3a90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.033624 12351 tablet_bootstrap.cc:492] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:04:02.034268 12351 ts_tablet_manager.cc:1403] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.009s
I20260709 13:04:02.034088 12086 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3df09f5b7a4b379cf42e01a9f3a90a (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:02.035743 12086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3df09f5b7a4b379cf42e01a9f3a90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.036386 12156 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3df09f5b7a4b379cf42e01a9f3a90a (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:02.037814 12156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3df09f5b7a4b379cf42e01a9f3a90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.039623 12351 raft_consensus.cc:359] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.048866 12351 raft_consensus.cc:385] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.049472 12351 raft_consensus.cc:740] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.042443 12353 tablet_bootstrap.cc:492] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:04:02.050235 12353 ts_tablet_manager.cc:1403] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.088s	user 0.007s	sys 0.010s
I20260709 13:04:02.050484 12350 tablet_bootstrap.cc:654] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.058521 12353 raft_consensus.cc:359] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.059458 12353 raft_consensus.cc:385] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.061154 12353 raft_consensus.cc:740] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.062315 12353 consensus_queue.cc:260] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.060900 12160 tablet_service.cc:1511] Processing CreateTablet for tablet 40b2c6a620484f0fbba197f2f1395c96 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:02.059474 12351 consensus_queue.cc:260] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.073240 12351 ts_tablet_manager.cc:1434] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.004s
I20260709 13:04:02.074515 12351 tablet_bootstrap.cc:492] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:04:02.080940 12160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40b2c6a620484f0fbba197f2f1395c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.090126 12353 ts_tablet_manager.cc:1434] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.039s	user 0.001s	sys 0.007s
I20260709 13:04:02.093989 12084 tablet_service.cc:1511] Processing CreateTablet for tablet 8b31a412cfa34a58bd8f9c3778505443 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:02.096161 12084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b31a412cfa34a58bd8f9c3778505443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.097927 12014 tablet_service.cc:1511] Processing CreateTablet for tablet 8b31a412cfa34a58bd8f9c3778505443 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:02.099373 12014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b31a412cfa34a58bd8f9c3778505443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.109786 12163 tablet_service.cc:1511] Processing CreateTablet for tablet 8b31a412cfa34a58bd8f9c3778505443 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:02.111879 12163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b31a412cfa34a58bd8f9c3778505443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.117982 12011 tablet_service.cc:1511] Processing CreateTablet for tablet 4dad3ed304874728bb2fb1af7cb51866 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:02.119283 12353 tablet_bootstrap.cc:492] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:04:02.119024 12086 tablet_service.cc:1511] Processing CreateTablet for tablet 4dad3ed304874728bb2fb1af7cb51866 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:02.120434 12086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dad3ed304874728bb2fb1af7cb51866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.124053 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dad3ed304874728bb2fb1af7cb51866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.119099 12158 tablet_service.cc:1511] Processing CreateTablet for tablet 4dad3ed304874728bb2fb1af7cb51866 (DEFAULT_TABLE table=soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:02.130348 12158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dad3ed304874728bb2fb1af7cb51866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.137380 12353 tablet_bootstrap.cc:654] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.146602 12350 tablet_bootstrap.cc:492] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:04:02.147159 12350 ts_tablet_manager.cc:1403] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.127s	user 0.022s	sys 0.008s
I20260709 13:04:02.150399 12351 tablet_bootstrap.cc:654] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.150879 12350 raft_consensus.cc:359] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.151690 12350 raft_consensus.cc:385] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.152006 12350 raft_consensus.cc:740] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.157601 12350 consensus_queue.cc:260] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.163825 12350 ts_tablet_manager.cc:1434] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:04:02.165123 12343 raft_consensus.cc:493] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.165724 12343 raft_consensus.cc:515] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.167945 12343 leader_election.cc:290] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:02.169221 12350 tablet_bootstrap.cc:492] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:04:02.169989 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4508e3e099fa4c3ba2701a2ed5456073" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:04:02.170670 12172 raft_consensus.cc:2468] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 0.
I20260709 13:04:02.172260 11987 leader_election.cc:304] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:04:02.173938 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4508e3e099fa4c3ba2701a2ed5456073" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:04:02.174708 12098 raft_consensus.cc:2468] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 0.
I20260709 13:04:02.176749 12343 raft_consensus.cc:2804] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.177309 12343 raft_consensus.cc:493] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.177740 12343 raft_consensus.cc:3060] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.178164 12350 tablet_bootstrap.cc:654] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.183367 12353 tablet_bootstrap.cc:492] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:04:02.183913 12353 ts_tablet_manager.cc:1403] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.037s
I20260709 13:04:02.187800 12353 raft_consensus.cc:359] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.188194 12343 raft_consensus.cc:515] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.188697 12353 raft_consensus.cc:385] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.189363 12353 raft_consensus.cc:740] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.190658 12343 leader_election.cc:290] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Requested vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:02.191471 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4508e3e099fa4c3ba2701a2ed5456073" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:02.191938 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4508e3e099fa4c3ba2701a2ed5456073" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:04:02.192101 12098 raft_consensus.cc:3060] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.192498 12172 raft_consensus.cc:3060] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.193671 12353 consensus_queue.cc:260] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.196375 12353 ts_tablet_manager.cc:1434] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:02.197667 12353 tablet_bootstrap.cc:492] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:04:02.200425 12172 raft_consensus.cc:2468] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 1.
I20260709 13:04:02.204980 12098 raft_consensus.cc:2468] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 1.
I20260709 13:04:02.210435 11987 leader_election.cc:304] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:04:02.213729 12343 raft_consensus.cc:2804] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.214226 12343 raft_consensus.cc:697] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Becoming Leader. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:04:02.202996 12351 tablet_bootstrap.cc:492] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:04:02.216693 12351 ts_tablet_manager.cc:1403] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.142s	user 0.010s	sys 0.009s
I20260709 13:04:02.215046 12343 consensus_queue.cc:237] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.221603 12350 tablet_bootstrap.cc:492] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:04:02.222229 12350 ts_tablet_manager.cc:1403] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.007s
I20260709 13:04:02.225011 12350 raft_consensus.cc:359] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.225564 12353 tablet_bootstrap.cc:654] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.225907 12350 raft_consensus.cc:385] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.226254 12350 raft_consensus.cc:740] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.227129 12350 consensus_queue.cc:260] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.227437 12351 raft_consensus.cc:359] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.228690 12351 raft_consensus.cc:385] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.229159 12351 raft_consensus.cc:740] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.229622 12350 ts_tablet_manager.cc:1434] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:02.230821 12350 tablet_bootstrap.cc:492] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:04:02.230260 12351 consensus_queue.cc:260] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.233325 12351 ts_tablet_manager.cc:1434] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:04:02.234455 12351 tablet_bootstrap.cc:492] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:04:02.239455 11920 catalog_manager.cc:5697] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1affb97882084b8783e590354f97be84 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "1affb97882084b8783e590354f97be84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.241923 12351 tablet_bootstrap.cc:654] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.253141 12350 tablet_bootstrap.cc:654] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.253747 12351 tablet_bootstrap.cc:492] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:04:02.254258 12351 ts_tablet_manager.cc:1403] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.001s
I20260709 13:04:02.256713 12351 raft_consensus.cc:359] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.257346 12351 raft_consensus.cc:385] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.257645 12351 raft_consensus.cc:740] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.258635 12351 consensus_queue.cc:260] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.260542 12350 tablet_bootstrap.cc:492] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:04:02.260711 12353 tablet_bootstrap.cc:492] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:04:02.261029 12351 ts_tablet_manager.cc:1434] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.006s
I20260709 13:04:02.261730 12350 ts_tablet_manager.cc:1403] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.004s
I20260709 13:04:02.261749 12353 ts_tablet_manager.cc:1403] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.064s	user 0.006s	sys 0.012s
I20260709 13:04:02.262713 12351 tablet_bootstrap.cc:492] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:04:02.265372 12350 raft_consensus.cc:359] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.266139 12350 raft_consensus.cc:385] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.265901 12353 raft_consensus.cc:359] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.266528 12350 raft_consensus.cc:740] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.266907 12353 raft_consensus.cc:385] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.267323 12353 raft_consensus.cc:740] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.267901 12350 consensus_queue.cc:260] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.268227 12353 consensus_queue.cc:260] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.270540 12351 tablet_bootstrap.cc:654] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.273893 12353 ts_tablet_manager.cc:1434] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:04:02.275458 12353 tablet_bootstrap.cc:492] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:04:02.276371 12350 ts_tablet_manager.cc:1434] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:04:02.279238 12351 tablet_bootstrap.cc:492] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:04:02.279876 12351 ts_tablet_manager.cc:1403] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 13:04:02.282608 12353 tablet_bootstrap.cc:654] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.283106 12350 tablet_bootstrap.cc:492] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:04:02.283146 12351 raft_consensus.cc:359] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.284247 12351 raft_consensus.cc:385] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.284574 12351 raft_consensus.cc:740] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.285600 12351 consensus_queue.cc:260] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.289484 12351 ts_tablet_manager.cc:1434] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:04:02.291251 12351 tablet_bootstrap.cc:492] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:04:02.299330 12336 raft_consensus.cc:493] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.300384 12350 tablet_bootstrap.cc:654] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.303479 12351 tablet_bootstrap.cc:654] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.299964 12336 raft_consensus.cc:515] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.305330 12353 tablet_bootstrap.cc:492] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:04:02.306059 12353 ts_tablet_manager.cc:1403] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.010s
I20260709 13:04:02.308984 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e8240166164d33af54f986dfc46774" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:04:02.310022 12023 raft_consensus.cc:2468] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 0.
I20260709 13:04:02.310485 12353 raft_consensus.cc:359] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.311597 12353 raft_consensus.cc:385] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.311998 12353 raft_consensus.cc:740] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.311859 12136 leader_election.cc:304] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:04:02.313179 12353 consensus_queue.cc:260] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.315625 12351 tablet_bootstrap.cc:492] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:04:02.316696 12336 leader_election.cc:290] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:02.317389 12336 raft_consensus.cc:2804] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.317800 12336 raft_consensus.cc:493] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.317924 12351 ts_tablet_manager.cc:1403] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.004s
I20260709 13:04:02.319072 12350 tablet_bootstrap.cc:492] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:04:02.319609 12350 ts_tablet_manager.cc:1403] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.016s
I20260709 13:04:02.322057 12353 ts_tablet_manager.cc:1434] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:04:02.323562 12353 tablet_bootstrap.cc:492] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:04:02.326663 12351 raft_consensus.cc:359] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.318271 12336 raft_consensus.cc:3060] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.327572 12351 raft_consensus.cc:385] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.328019 12351 raft_consensus.cc:740] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.328902 12351 consensus_queue.cc:260] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.330685 12353 tablet_bootstrap.cc:654] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.331368 12351 ts_tablet_manager.cc:1434] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:04:02.332726 12351 tablet_bootstrap.cc:492] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:04:02.335381 12350 raft_consensus.cc:359] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.336189 12350 raft_consensus.cc:385] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.336534 12350 raft_consensus.cc:740] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.337375 12350 consensus_queue.cc:260] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.339926 12350 ts_tablet_manager.cc:1434] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:04:02.340821 12351 tablet_bootstrap.cc:654] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.341197 12350 tablet_bootstrap.cc:492] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:04:02.348455 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e8240166164d33af54f986dfc46774" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:04:02.349262 12098 raft_consensus.cc:2468] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 0.
I20260709 13:04:02.350696 12350 tablet_bootstrap.cc:654] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.353543 12351 tablet_bootstrap.cc:492] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:04:02.354408 12351 ts_tablet_manager.cc:1403] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.014s
I20260709 13:04:02.364421 12336 raft_consensus.cc:515] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.367077 12369 raft_consensus.cc:493] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.367779 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e8240166164d33af54f986dfc46774" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:02.368036 12369 raft_consensus.cc:515] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.371305 12369 leader_election.cc:290] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:02.368727 12023 raft_consensus.cc:3060] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.373497 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5423d1b6aa74ce7bfebc649bac20c9c" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:04:02.377141 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5423d1b6aa74ce7bfebc649bac20c9c" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:04:02.378223 12098 raft_consensus.cc:2468] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 0.
I20260709 13:04:02.383930 12136 leader_election.cc:304] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:04:02.385192 12369 raft_consensus.cc:2804] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:02.385408 12136 leader_election.cc:343] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1affb97882084b8783e590354f97be84 (127.0.107.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.385591 12369 raft_consensus.cc:493] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.389657 12369 raft_consensus.cc:3060] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.389804 12351 raft_consensus.cc:359] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.390980 12351 raft_consensus.cc:385] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.391381 12351 raft_consensus.cc:740] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.392875 12336 leader_election.cc:290] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:02.392429 12351 consensus_queue.cc:260] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.393481 12023 raft_consensus.cc:2468] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 1.
I20260709 13:04:02.394443 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e8240166164d33af54f986dfc46774" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:02.395645 12098 raft_consensus.cc:3060] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.397737 12369 raft_consensus.cc:515] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.398126 12350 tablet_bootstrap.cc:492] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:04:02.399081 12350 ts_tablet_manager.cc:1403] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.058s	user 0.033s	sys 0.021s
I20260709 13:04:02.399972 12369 leader_election.cc:290] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:02.403355 12350 raft_consensus.cc:359] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.404613 12350 raft_consensus.cc:385] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.405009 12350 raft_consensus.cc:740] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.406049 12350 consensus_queue.cc:260] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.409654 12350 ts_tablet_manager.cc:1434] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.006s
I20260709 13:04:02.411432 12350 tablet_bootstrap.cc:492] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:04:02.412422 12351 ts_tablet_manager.cc:1434] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.015s
I20260709 13:04:02.413733 12351 tablet_bootstrap.cc:492] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:04:02.421403 12351 tablet_bootstrap.cc:654] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.421403 12350 tablet_bootstrap.cc:654] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.436172 12350 tablet_bootstrap.cc:492] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:04:02.436336 12351 tablet_bootstrap.cc:492] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:04:02.436784 12350 ts_tablet_manager.cc:1403] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.008s
I20260709 13:04:02.436872 12351 ts_tablet_manager.cc:1403] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:04:02.440289 12351 raft_consensus.cc:359] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.441103 12351 raft_consensus.cc:385] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.441416 12351 raft_consensus.cc:740] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.441452 12350 raft_consensus.cc:359] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.442261 12350 raft_consensus.cc:385] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.442639 12350 raft_consensus.cc:740] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.442274 12351 consensus_queue.cc:260] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.443545 12350 consensus_queue.cc:260] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.444283 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5423d1b6aa74ce7bfebc649bac20c9c" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:02.445526 12351 ts_tablet_manager.cc:1434] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:04:02.446537 12350 ts_tablet_manager.cc:1434] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:04:02.446601 12351 tablet_bootstrap.cc:492] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:04:02.447857 12350 tablet_bootstrap.cc:492] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:04:02.454730 12351 tablet_bootstrap.cc:654] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.454218 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5423d1b6aa74ce7bfebc649bac20c9c" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:02.455403 12350 tablet_bootstrap.cc:654] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.455523 12097 raft_consensus.cc:3060] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.465626 12136 leader_election.cc:304] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:04:02.467406 12351 tablet_bootstrap.cc:492] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:04:02.469914 12351 ts_tablet_manager.cc:1403] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.009s
W20260709 13:04:02.470045 12136 leader_election.cc:343] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1affb97882084b8783e590354f97be84 (127.0.107.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.470332 12336 raft_consensus.cc:2804] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.467638 12350 tablet_bootstrap.cc:492] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:04:02.472150 12350 ts_tablet_manager.cc:1403] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.012s
I20260709 13:04:02.474679 12097 raft_consensus.cc:2468] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 1.
I20260709 13:04:02.476205 12337 raft_consensus.cc:493] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.481135 12337 raft_consensus.cc:515] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.480357 12350 raft_consensus.cc:359] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.481910 12350 raft_consensus.cc:385] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.482270 12350 raft_consensus.cc:740] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.480379 12353 tablet_bootstrap.cc:492] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:04:02.483438 12353 ts_tablet_manager.cc:1403] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.160s	user 0.049s	sys 0.062s
I20260709 13:04:02.483711 12351 raft_consensus.cc:359] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.483191 12350 consensus_queue.cc:260] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.484479 12351 raft_consensus.cc:385] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.484835 12351 raft_consensus.cc:740] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.484499 12098 raft_consensus.cc:2468] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 1.
I20260709 13:04:02.485785 12373 raft_consensus.cc:493] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.486006 12338 raft_consensus.cc:493] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.485924 12351 consensus_queue.cc:260] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.486351 12373 raft_consensus.cc:515] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.486627 12338 raft_consensus.cc:515] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.487106 12350 ts_tablet_manager.cc:1434] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:02.488093 12350 tablet_bootstrap.cc:492] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba: Bootstrap starting.
I20260709 13:04:02.488204 12351 ts_tablet_manager.cc:1434] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:04:02.488564 12373 leader_election.cc:290] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:02.489410 12351 tablet_bootstrap.cc:492] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df: Bootstrap starting.
I20260709 13:04:02.490674 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b2c6a620484f0fbba197f2f1395c96" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:04:02.491361 12172 raft_consensus.cc:2468] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 0.
I20260709 13:04:02.491663 12353 raft_consensus.cc:359] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.492355 12353 raft_consensus.cc:385] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.492643 12353 raft_consensus.cc:740] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.493417 12353 consensus_queue.cc:260] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.495895 12353 ts_tablet_manager.cc:1434] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:04:02.497072 12351 tablet_bootstrap.cc:654] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.498863 12350 tablet_bootstrap.cc:654] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.499529 11987 leader_election.cc:304] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:04:02.497116 12353 tablet_bootstrap.cc:492] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:04:02.500625 12343 raft_consensus.cc:2804] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.501060 12343 raft_consensus.cc:493] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.501420 12343 raft_consensus.cc:3060] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.505896 12136 leader_election.cc:304] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 1affb97882084b8783e590354f97be84
I20260709 13:04:02.506928 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3995b16a40174d659fc83a6b4c085c06" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:04:02.507829 12373 raft_consensus.cc:2804] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.508107 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b2c6a620484f0fbba197f2f1395c96" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:04:02.508376 12373 raft_consensus.cc:697] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Becoming Leader. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:02.509042 12097 raft_consensus.cc:2468] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 0.
I20260709 13:04:02.509328 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3995b16a40174d659fc83a6b4c085c06" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:04:02.509743 12353 tablet_bootstrap.cc:654] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.509565 12373 consensus_queue.cc:237] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.510078 12172 raft_consensus.cc:2468] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 0.
I20260709 13:04:02.511452 12062 leader_election.cc:304] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:04:02.508239 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b2c6a620484f0fbba197f2f1395c96" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
W20260709 13:04:02.512398 12062 leader_election.cc:343] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1affb97882084b8783e590354f97be84 (127.0.107.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.514036 12356 raft_consensus.cc:2804] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.514475 12356 raft_consensus.cc:493] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.514804 12356 raft_consensus.cc:3060] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.516978 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b2c6a620484f0fbba197f2f1395c96" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:04:02.517684 12098 raft_consensus.cc:2468] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 0.
I20260709 13:04:02.488564 12338 leader_election.cc:290] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:02.483841 12337 leader_election.cc:290] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:02.476667 12336 raft_consensus.cc:697] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Becoming Leader. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:02.530956 12336 consensus_queue.cc:237] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.529786 12136 leader_election.cc:304] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:04:02.533502 12369 raft_consensus.cc:2804] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.533880 12369 raft_consensus.cc:493] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.534183 12369 raft_consensus.cc:3060] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.534897 12356 raft_consensus.cc:515] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.527448 12343 raft_consensus.cc:515] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.556941 12024 raft_consensus.cc:2393] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a67b474ab9354f4d937a2d0cd422e5df in current term 1: Already voted for candidate 1affb97882084b8783e590354f97be84 in this term.
I20260709 13:04:02.558683 12343 leader_election.cc:290] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Requested vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:02.559619 12350 tablet_bootstrap.cc:492] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba: No bootstrap required, opened a new log
I20260709 13:04:02.560101 12350 ts_tablet_manager.cc:1403] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba: Time spent bootstrapping tablet: real 0.072s	user 0.024s	sys 0.034s
I20260709 13:04:02.560320 12353 tablet_bootstrap.cc:492] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:04:02.559365 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b2c6a620484f0fbba197f2f1395c96" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:04:02.562608 12369 raft_consensus.cc:515] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.563457 12353 ts_tablet_manager.cc:1403] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.067s	user 0.026s	sys 0.002s
I20260709 13:04:02.563580 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b2c6a620484f0fbba197f2f1395c96" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:02.564133 12172 raft_consensus.cc:2393] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1affb97882084b8783e590354f97be84 in current term 1: Already voted for candidate a67b474ab9354f4d937a2d0cd422e5df in this term.
I20260709 13:04:02.564314 12098 raft_consensus.cc:3060] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.565169 12369 leader_election.cc:290] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:02.567005 12353 raft_consensus.cc:359] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.568013 12356 leader_election.cc:290] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:02.568259 12353 raft_consensus.cc:385] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.568610 12353 raft_consensus.cc:740] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.569495 12353 consensus_queue.cc:260] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.572026 12353 ts_tablet_manager.cc:1434] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:02.573097 12353 tablet_bootstrap.cc:492] T 3995b16a40174d659fc83a6b4c085c06 P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:04:02.575440 12369 raft_consensus.cc:493] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.576166 12098 raft_consensus.cc:2468] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 1.
I20260709 13:04:02.577333 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b2c6a620484f0fbba197f2f1395c96" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:02.577486 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b2c6a620484f0fbba197f2f1395c96" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:02.578078 12097 raft_consensus.cc:2393] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a67b474ab9354f4d937a2d0cd422e5df in current term 1: Already voted for candidate 1affb97882084b8783e590354f97be84 in this term.
I20260709 13:04:02.578395 12024 raft_consensus.cc:2393] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a67b474ab9354f4d937a2d0cd422e5df in current term 1: Already voted for candidate 1affb97882084b8783e590354f97be84 in this term.
I20260709 13:04:02.579396 11987 leader_election.cc:304] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: a67b474ab9354f4d937a2d0cd422e5df
I20260709 13:04:02.580054 12136 leader_election.cc:304] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df; no voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba
I20260709 13:04:02.580348 12353 tablet_bootstrap.cc:654] T 3995b16a40174d659fc83a6b4c085c06 P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.576013 12369 raft_consensus.cc:515] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.584404 12351 tablet_bootstrap.cc:492] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df: No bootstrap required, opened a new log
I20260709 13:04:02.584959 12351 ts_tablet_manager.cc:1403] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.023s
I20260709 13:04:02.586412 12369 leader_election.cc:290] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:02.586269 12350 raft_consensus.cc:359] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.587175 12350 raft_consensus.cc:385] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.587255 12369 raft_consensus.cc:2749] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.587491 12350 raft_consensus.cc:740] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.587657 12351 raft_consensus.cc:359] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.588443 12350 consensus_queue.cc:260] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.588419 12351 raft_consensus.cc:385] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.591223 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3995b16a40174d659fc83a6b4c085c06" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:02.591418 12373 raft_consensus.cc:493] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.591560 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3995b16a40174d659fc83a6b4c085c06" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:04:02.591899 12373 raft_consensus.cc:515] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.592245 12173 raft_consensus.cc:3060] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:02.593101 12062 leader_election.cc:343] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1affb97882084b8783e590354f97be84 (127.0.107.193:43521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.594002 12373 leader_election.cc:290] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:02.591109 12351 raft_consensus.cc:740] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.595454 12350 ts_tablet_manager.cc:1434] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:04:02.583686 12343 raft_consensus.cc:2804] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.598310 12343 raft_consensus.cc:697] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Becoming Leader. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:04:02.599248 12343 consensus_queue.cc:237] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.599682 12351 consensus_queue.cc:260] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.601884 12351 ts_tablet_manager.cc:1434] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:04:02.602798 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3df09f5b7a4b379cf42e01a9f3a90a" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:04:02.603492 12024 raft_consensus.cc:2468] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 0.
I20260709 13:04:02.604610 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c39c37d9904d2d90d7781489f0297d" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:04:02.605319 12023 raft_consensus.cc:2468] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 0.
I20260709 13:04:02.606746 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3df09f5b7a4b379cf42e01a9f3a90a" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:04:02.607424 12097 raft_consensus.cc:2468] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 0.
I20260709 13:04:02.609328 12381 raft_consensus.cc:493] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.609871 12381 raft_consensus.cc:515] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.614895 12381 leader_election.cc:290] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:02.615435 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c39c37d9904d2d90d7781489f0297d" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:04:02.616164 12023 raft_consensus.cc:2468] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 0.
I20260709 13:04:02.615628 11921 catalog_manager.cc:5697] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df reported cstate change: term changed from 0 to 1, leader changed from <none> to a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.617471 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c39c37d9904d2d90d7781489f0297d" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:04:02.618108 12172 raft_consensus.cc:2468] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 0.
I20260709 13:04:02.618884 12062 leader_election.cc:304] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:04:02.619741 12381 raft_consensus.cc:2804] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.620148 12381 raft_consensus.cc:493] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.620512 12381 raft_consensus.cc:3060] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.618813 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c39c37d9904d2d90d7781489f0297d" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:04:02.608032 12173 raft_consensus.cc:2468] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 1.
I20260709 13:04:02.634244 12136 leader_election.cc:304] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:04:02.635934 12385 raft_consensus.cc:2804] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.636473 12385 raft_consensus.cc:493] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.636862 12385 raft_consensus.cc:3060] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.635756 12136 leader_election.cc:304] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:04:02.639416 12336 raft_consensus.cc:2804] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.639883 12336 raft_consensus.cc:493] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.640318 12336 raft_consensus.cc:3060] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.636485 12062 leader_election.cc:304] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 1affb97882084b8783e590354f97be84
I20260709 13:04:02.642105 12356 raft_consensus.cc:2804] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.643697 12356 raft_consensus.cc:697] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Becoming Leader. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Running, Role: LEADER
I20260709 13:04:02.648272 12381 raft_consensus.cc:515] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.652828 12098 raft_consensus.cc:2393] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a67b474ab9354f4d937a2d0cd422e5df in current term 1: Already voted for candidate ec4cb6593e3d45458f39de98c49431ba in this term.
I20260709 13:04:02.652412 12336 raft_consensus.cc:515] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.651598 12385 raft_consensus.cc:515] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.648329 12356 consensus_queue.cc:237] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.657243 12381 leader_election.cc:290] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:02.657269 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c39c37d9904d2d90d7781489f0297d" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:02.659578 12024 raft_consensus.cc:3060] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.662766 12385 leader_election.cc:290] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:02.664350 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3df09f5b7a4b379cf42e01a9f3a90a" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:02.665096 12023 raft_consensus.cc:3060] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.665519 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3df09f5b7a4b379cf42e01a9f3a90a" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:02.666162 12098 raft_consensus.cc:3060] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.667776 11921 catalog_manager.cc:5697] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1affb97882084b8783e590354f97be84 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "1affb97882084b8783e590354f97be84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.668953 12336 leader_election.cc:290] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:02.671087 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c39c37d9904d2d90d7781489f0297d" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:02.671932 12097 raft_consensus.cc:2393] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a67b474ab9354f4d937a2d0cd422e5df in current term 1: Already voted for candidate ec4cb6593e3d45458f39de98c49431ba in this term.
I20260709 13:04:02.671927 12023 raft_consensus.cc:2468] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 1.
I20260709 13:04:02.671614 11922 catalog_manager.cc:5697] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4cb6593e3d45458f39de98c49431ba (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ec4cb6593e3d45458f39de98c49431ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.674342 12136 leader_election.cc:304] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:04:02.676573 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c39c37d9904d2d90d7781489f0297d" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:02.676750 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c39c37d9904d2d90d7781489f0297d" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:04:02.677544 12172 raft_consensus.cc:2393] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ec4cb6593e3d45458f39de98c49431ba in current term 1: Already voted for candidate a67b474ab9354f4d937a2d0cd422e5df in this term.
I20260709 13:04:02.680847 12336 raft_consensus.cc:2804] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.681447 12336 raft_consensus.cc:697] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Becoming Leader. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:02.684937 12353 tablet_bootstrap.cc:492] T 3995b16a40174d659fc83a6b4c085c06 P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:04:02.685714 12353 ts_tablet_manager.cc:1403] T 3995b16a40174d659fc83a6b4c085c06 P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.006s
I20260709 13:04:02.685638 12336 consensus_queue.cc:237] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.686335 12098 raft_consensus.cc:2468] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 1.
I20260709 13:04:02.690217 12062 leader_election.cc:304] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4cb6593e3d45458f39de98c49431ba; no voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df
I20260709 13:04:02.689623 12353 raft_consensus.cc:359] T 3995b16a40174d659fc83a6b4c085c06 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.689999 11919 catalog_manager.cc:5697] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df reported cstate change: term changed from 0 to 1, leader changed from <none> to a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.691519 12388 raft_consensus.cc:2749] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.693707 12353 raft_consensus.cc:385] T 3995b16a40174d659fc83a6b4c085c06 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.694195 12353 raft_consensus.cc:740] T 3995b16a40174d659fc83a6b4c085c06 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.694378 12024 raft_consensus.cc:2468] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 1.
I20260709 13:04:02.694984 12353 consensus_queue.cc:260] T 3995b16a40174d659fc83a6b4c085c06 P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.696039 12136 leader_election.cc:304] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: ec4cb6593e3d45458f39de98c49431ba
I20260709 13:04:02.697367 12385 raft_consensus.cc:2804] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.697562 12353 ts_tablet_manager.cc:1434] T 3995b16a40174d659fc83a6b4c085c06 P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:04:02.697975 12385 raft_consensus.cc:697] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Becoming Leader. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:02.698768 12353 tablet_bootstrap.cc:492] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:04:02.698871 12385 consensus_queue.cc:237] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.705541 12353 tablet_bootstrap.cc:654] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.711625 12343 consensus_queue.cc:1048] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:02.719024 11921 catalog_manager.cc:5697] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df reported cstate change: term changed from 0 to 1, leader changed from <none> to a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.720485 11921 catalog_manager.cc:5697] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df reported cstate change: term changed from 0 to 1, leader changed from <none> to a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.729550 12353 tablet_bootstrap.cc:492] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:04:02.730329 12353 ts_tablet_manager.cc:1403] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.018s
I20260709 13:04:02.739223 12353 raft_consensus.cc:359] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.739984 12353 raft_consensus.cc:385] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.740270 12353 raft_consensus.cc:740] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.742628 12353 consensus_queue.cc:260] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.745106 12353 ts_tablet_manager.cc:1434] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:04:02.746217 12353 tablet_bootstrap.cc:492] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84: Bootstrap starting.
I20260709 13:04:02.746999 12343 consensus_queue.cc:1048] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:02.761051 12353 tablet_bootstrap.cc:654] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.768229 12353 tablet_bootstrap.cc:492] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84: No bootstrap required, opened a new log
I20260709 13:04:02.768846 12353 ts_tablet_manager.cc:1403] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.002s
I20260709 13:04:02.771768 12353 raft_consensus.cc:359] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.772621 12353 raft_consensus.cc:385] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.772938 12353 raft_consensus.cc:740] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.773655 12353 consensus_queue.cc:260] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.775759 12353 ts_tablet_manager.cc:1434] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:02.821069 12388 raft_consensus.cc:493] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.823756 12396 raft_consensus.cc:493] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.823428 12388 raft_consensus.cc:515] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.824810 12396 raft_consensus.cc:515] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.828565 12396 leader_election.cc:290] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:02.829303 12388 leader_election.cc:290] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:02.830404 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dad3ed304874728bb2fb1af7cb51866" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:04:02.831300 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dad3ed304874728bb2fb1af7cb51866" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:04:02.832031 12024 raft_consensus.cc:2468] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 0.
I20260709 13:04:02.833827 12172 raft_consensus.cc:2468] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 0.
I20260709 13:04:02.834533 12062 leader_election.cc:304] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:04:02.834939 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5423d1b6aa74ce7bfebc649bac20c9c" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df" is_pre_election: true
I20260709 13:04:02.834975 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5423d1b6aa74ce7bfebc649bac20c9c" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:04:02.836643 12388 raft_consensus.cc:2804] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.837440 12388 raft_consensus.cc:493] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.837993 12388 raft_consensus.cc:3060] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.837931 12098 raft_consensus.cc:2393] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1affb97882084b8783e590354f97be84 in current term 1: Already voted for candidate a67b474ab9354f4d937a2d0cd422e5df in this term.
I20260709 13:04:02.842029 11987 leader_election.cc:304] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1affb97882084b8783e590354f97be84; no voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba
I20260709 13:04:02.844194 12396 raft_consensus.cc:3060] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.853292 12388 raft_consensus.cc:515] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.856906 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dad3ed304874728bb2fb1af7cb51866" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:02.857301 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dad3ed304874728bb2fb1af7cb51866" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:04:02.857815 12024 raft_consensus.cc:3060] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.858042 12396 raft_consensus.cc:2749] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.858140 12173 raft_consensus.cc:3060] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.859428 12388 leader_election.cc:290] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
W20260709 13:04:02.865245 11970 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:02.867626 12336 raft_consensus.cc:493] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.868417 12336 raft_consensus.cc:515] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.871238 12336 leader_election.cc:290] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:02.872044 12173 raft_consensus.cc:2468] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 1.
I20260709 13:04:02.872144 12024 raft_consensus.cc:2468] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 1.
I20260709 13:04:02.873147 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b31a412cfa34a58bd8f9c3778505443" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84" is_pre_election: true
I20260709 13:04:02.872884 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b31a412cfa34a58bd8f9c3778505443" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba" is_pre_election: true
I20260709 13:04:02.878232 12098 raft_consensus.cc:2468] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 0.
I20260709 13:04:02.878363 12062 leader_election.cc:304] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:04:02.879647 12136 leader_election.cc:304] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:04:02.879786 12388 raft_consensus.cc:2804] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.878356 12023 raft_consensus.cc:2468] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 0.
I20260709 13:04:02.880903 12388 raft_consensus.cc:697] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Becoming Leader. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Running, Role: LEADER
I20260709 13:04:02.880653 12336 raft_consensus.cc:2804] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.883025 12336 raft_consensus.cc:493] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.883411 12336 raft_consensus.cc:3060] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.883272 12388 consensus_queue.cc:237] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.897135 12336 raft_consensus.cc:515] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.900347 12336 leader_election.cc:290] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:02.901572 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b31a412cfa34a58bd8f9c3778505443" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:02.902663 12023 raft_consensus.cc:3060] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.906111 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b31a412cfa34a58bd8f9c3778505443" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:02.907156 12098 raft_consensus.cc:3060] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.912665 11921 catalog_manager.cc:5697] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4cb6593e3d45458f39de98c49431ba (127.0.107.194). New cstate: current_term: 1 leader_uuid: "ec4cb6593e3d45458f39de98c49431ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.916062 12023 raft_consensus.cc:2468] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 1.
I20260709 13:04:02.918625 12136 leader_election.cc:304] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:04:02.919788 12336 raft_consensus.cc:2804] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.920801 12336 raft_consensus.cc:697] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Becoming Leader. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:02.921553 12098 raft_consensus.cc:2468] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 1.
I20260709 13:04:02.922364 12336 consensus_queue.cc:237] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:02.938272 12336 consensus_queue.cc:1048] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:02.950920 11919 catalog_manager.cc:5697] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df reported cstate change: term changed from 0 to 1, leader changed from <none> to a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.962728 12336 consensus_queue.cc:1048] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:02.997759 12336 consensus_queue.cc:1048] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.013549 12373 consensus_queue.cc:1048] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.055100 12023 raft_consensus.cc:3060] T 3995b16a40174d659fc83a6b4c085c06 P 1affb97882084b8783e590354f97be84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.058346 12173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84e8240166164d33af54f986dfc46774"
dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
mode: GRACEFUL
new_leader_uuid: "1affb97882084b8783e590354f97be84"
 from {username='slave'} at 127.0.0.1:52764
I20260709 13:04:03.059367 12173 raft_consensus.cc:606] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Received request to transfer leadership to TS 1affb97882084b8783e590354f97be84
I20260709 13:04:03.064453 12388 consensus_queue.cc:1048] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.065762 12173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29c39c37d9904d2d90d7781489f0297d"
dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
mode: GRACEFUL
new_leader_uuid: "1affb97882084b8783e590354f97be84"
 from {username='slave'} at 127.0.0.1:52764
I20260709 13:04:03.066406 12173 raft_consensus.cc:606] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Received request to transfer leadership to TS 1affb97882084b8783e590354f97be84
I20260709 13:04:03.073299 12173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5423d1b6aa74ce7bfebc649bac20c9c"
dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
mode: GRACEFUL
new_leader_uuid: "1affb97882084b8783e590354f97be84"
 from {username='slave'} at 127.0.0.1:52764
I20260709 13:04:03.073992 12173 raft_consensus.cc:606] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Received request to transfer leadership to TS 1affb97882084b8783e590354f97be84
I20260709 13:04:03.080251 12356 consensus_queue.cc:1048] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.091856 12024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40b2c6a620484f0fbba197f2f1395c96"
dest_uuid: "1affb97882084b8783e590354f97be84"
mode: GRACEFUL
new_leader_uuid: "ec4cb6593e3d45458f39de98c49431ba"
 from {username='slave'} at 127.0.0.1:44786
I20260709 13:04:03.092515 12024 raft_consensus.cc:606] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Received request to transfer leadership to TS ec4cb6593e3d45458f39de98c49431ba
I20260709 13:04:03.099759 12173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d3df09f5b7a4b379cf42e01a9f3a90a"
dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
mode: GRACEFUL
new_leader_uuid: "ec4cb6593e3d45458f39de98c49431ba"
 from {username='slave'} at 127.0.0.1:52764
I20260709 13:04:03.100414 12173 raft_consensus.cc:606] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Received request to transfer leadership to TS ec4cb6593e3d45458f39de98c49431ba
I20260709 13:04:03.106251 12173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b31a412cfa34a58bd8f9c3778505443"
dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
mode: GRACEFUL
new_leader_uuid: "ec4cb6593e3d45458f39de98c49431ba"
 from {username='slave'} at 127.0.0.1:52764
I20260709 13:04:03.106845 12173 raft_consensus.cc:606] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Received request to transfer leadership to TS ec4cb6593e3d45458f39de98c49431ba
I20260709 13:04:03.113140 12097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dad3ed304874728bb2fb1af7cb51866"
dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
mode: GRACEFUL
new_leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
 from {username='slave'} at 127.0.0.1:51500
I20260709 13:04:03.113830 12097 raft_consensus.cc:606] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Received request to transfer leadership to TS a67b474ab9354f4d937a2d0cd422e5df
I20260709 13:04:03.114029 12343 consensus_queue.cc:1048] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.120872 12343 consensus_queue.cc:1048] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.128247 12373 consensus_queue.cc:1048] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:03.131709 12337 raft_consensus.cc:993] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84: : Instructing follower ec4cb6593e3d45458f39de98c49431ba to start an election
I20260709 13:04:03.132332 12337 raft_consensus.cc:1081] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Signalling peer ec4cb6593e3d45458f39de98c49431ba to start an election
I20260709 13:04:03.137416 12099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40b2c6a620484f0fbba197f2f1395c96"
dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
 from {username='slave'} at 127.0.0.1:54806
I20260709 13:04:03.138129 12099 raft_consensus.cc:493] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.138478 12099 raft_consensus.cc:3060] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.153290 12099 raft_consensus.cc:515] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.155633 12099 leader_election.cc:290] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 2 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:03.156909 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b2c6a620484f0fbba197f2f1395c96" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:03.157902 12023 raft_consensus.cc:3055] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:03.158020 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40b2c6a620484f0fbba197f2f1395c96" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:04:03.158470 12023 raft_consensus.cc:740] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:04:03.158798 12172 raft_consensus.cc:3060] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.159397 12023 consensus_queue.cc:260] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.160705 12023 raft_consensus.cc:3060] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.171350 12385 consensus_queue.cc:1048] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.174865 12385 consensus_queue.cc:1048] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:03.178848 12172 raft_consensus.cc:2468] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 2.
I20260709 13:04:03.180727 12023 raft_consensus.cc:2468] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 2.
I20260709 13:04:03.180068 12062 leader_election.cc:304] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:04:03.182154 12388 raft_consensus.cc:2804] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.182760 12388 raft_consensus.cc:697] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Becoming Leader. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Running, Role: LEADER
I20260709 13:04:03.184064 12388 consensus_queue.cc:237] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.193226 12385 raft_consensus.cc:993] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df: : Instructing follower ec4cb6593e3d45458f39de98c49431ba to start an election
I20260709 13:04:03.193737 12385 raft_consensus.cc:1081] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Signalling peer ec4cb6593e3d45458f39de98c49431ba to start an election
I20260709 13:04:03.194653 12385 raft_consensus.cc:993] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df: : Instructing follower 1affb97882084b8783e590354f97be84 to start an election
I20260709 13:04:03.195128 12385 raft_consensus.cc:1081] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Signalling peer 1affb97882084b8783e590354f97be84 to start an election
I20260709 13:04:03.198890 12023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29c39c37d9904d2d90d7781489f0297d"
dest_uuid: "1affb97882084b8783e590354f97be84"
 from {username='slave'} at 127.0.0.1:33536
I20260709 13:04:03.198630 12099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d3df09f5b7a4b379cf42e01a9f3a90a"
dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:04:03.199373 11921 catalog_manager.cc:5697] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba reported cstate change: term changed from 1 to 2, leader changed from 1affb97882084b8783e590354f97be84 (127.0.107.193) to ec4cb6593e3d45458f39de98c49431ba (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ec4cb6593e3d45458f39de98c49431ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.201092 12023 raft_consensus.cc:493] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.200989 12336 consensus_queue.cc:1048] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.202056 12023 raft_consensus.cc:3060] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.200489 12099 raft_consensus.cc:493] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.202867 12099 raft_consensus.cc:3060] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.211274 12023 raft_consensus.cc:515] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.215915 12099 raft_consensus.cc:515] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.218791 12099 leader_election.cc:290] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 2 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:03.220512 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3df09f5b7a4b379cf42e01a9f3a90a" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:03.221259 12024 raft_consensus.cc:3060] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.221972 12023 leader_election.cc:290] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 2 election: Requested vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:03.223894 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c39c37d9904d2d90d7781489f0297d" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:04:03.224606 12173 raft_consensus.cc:3055] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:03.226341 12173 raft_consensus.cc:740] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:03.227370 12173 consensus_queue.cc:260] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.225449 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3df09f5b7a4b379cf42e01a9f3a90a" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:04:03.224890 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c39c37d9904d2d90d7781489f0297d" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:03.231073 12172 raft_consensus.cc:3055] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:03.231695 12172 raft_consensus.cc:740] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:03.229135 12173 raft_consensus.cc:3060] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.233191 12172 consensus_queue.cc:260] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.231202 12024 raft_consensus.cc:2468] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 2.
I20260709 13:04:03.235090 12172 raft_consensus.cc:3060] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.236364 12062 leader_election.cc:304] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:04:03.244711 12356 raft_consensus.cc:2804] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.245704 12356 raft_consensus.cc:697] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Becoming Leader. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Running, Role: LEADER
I20260709 13:04:03.246768 12356 consensus_queue.cc:237] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.245633 12172 raft_consensus.cc:2468] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 2.
I20260709 13:04:03.255725 12173 raft_consensus.cc:2468] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 2.
I20260709 13:04:03.256927 11987 leader_election.cc:304] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: ec4cb6593e3d45458f39de98c49431ba
I20260709 13:04:03.257818 12396 raft_consensus.cc:2804] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.258297 12396 raft_consensus.cc:697] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [term 2 LEADER]: Becoming Leader. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:04:03.259263 12396 consensus_queue.cc:237] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.267236 11922 catalog_manager.cc:5697] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba reported cstate change: term changed from 1 to 2, leader changed from a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195) to ec4cb6593e3d45458f39de98c49431ba (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ec4cb6593e3d45458f39de98c49431ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.271467 12356 consensus_queue.cc:1048] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.280000 12388 raft_consensus.cc:993] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba: : Instructing follower a67b474ab9354f4d937a2d0cd422e5df to start an election
I20260709 13:04:03.279788 11919 catalog_manager.cc:5697] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 reported cstate change: term changed from 1 to 2, leader changed from a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195) to 1affb97882084b8783e590354f97be84 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1affb97882084b8783e590354f97be84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.280712 12381 raft_consensus.cc:1081] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Signalling peer a67b474ab9354f4d937a2d0cd422e5df to start an election
I20260709 13:04:03.284484 12173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dad3ed304874728bb2fb1af7cb51866"
dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
 from {username='slave'} at 127.0.0.1:47870
I20260709 13:04:03.285111 12173 raft_consensus.cc:493] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.285521 12173 raft_consensus.cc:3060] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.285813 12381 consensus_queue.cc:1048] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:03.293529 12173 raft_consensus.cc:515] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.294973 12172 raft_consensus.cc:1240] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Rejecting Update request from peer ec4cb6593e3d45458f39de98c49431ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:03.296995 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dad3ed304874728bb2fb1af7cb51866" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:03.298851 12338 consensus_queue.cc:1059] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.299827 12173 leader_election.cc:290] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 2 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:03.300227 12338 raft_consensus.cc:3055] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:03.300674 12338 raft_consensus.cc:740] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Running, Role: LEADER
I20260709 13:04:03.301338 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dad3ed304874728bb2fb1af7cb51866" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:03.301471 12338 consensus_queue.cc:260] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.302464 12338 raft_consensus.cc:3060] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.315465 12098 raft_consensus.cc:2468] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 2.
I20260709 13:04:03.317888 12136 leader_election.cc:304] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 1affb97882084b8783e590354f97be84
I20260709 13:04:03.318675 12336 raft_consensus.cc:2804] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.319128 12336 raft_consensus.cc:697] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [term 2 LEADER]: Becoming Leader. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:03.319903 12336 consensus_queue.cc:237] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.326759 11922 catalog_manager.cc:5697] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df reported cstate change: term changed from 1 to 2, leader changed from ec4cb6593e3d45458f39de98c49431ba (127.0.107.194) to a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195). New cstate: current_term: 2 leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:03.390419 12336 consensus_queue.cc:1048] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:03.402567 12385 consensus_queue.cc:1048] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:03.408860 12385 raft_consensus.cc:993] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df: : Instructing follower 1affb97882084b8783e590354f97be84 to start an election
I20260709 13:04:03.409422 12373 raft_consensus.cc:1081] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Signalling peer 1affb97882084b8783e590354f97be84 to start an election
I20260709 13:04:03.412621 12024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5423d1b6aa74ce7bfebc649bac20c9c"
dest_uuid: "1affb97882084b8783e590354f97be84"
 from {username='slave'} at 127.0.0.1:33536
I20260709 13:04:03.413343 12024 raft_consensus.cc:493] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.413661 12373 raft_consensus.cc:993] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df: : Instructing follower ec4cb6593e3d45458f39de98c49431ba to start an election
I20260709 13:04:03.413836 12024 raft_consensus.cc:3060] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.414310 12373 raft_consensus.cc:1081] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Signalling peer ec4cb6593e3d45458f39de98c49431ba to start an election
I20260709 13:04:03.416560 12097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b31a412cfa34a58bd8f9c3778505443"
dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:04:03.417336 12097 raft_consensus.cc:493] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.417701 12097 raft_consensus.cc:3060] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.420831 12024 raft_consensus.cc:515] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.422573 12024 leader_election.cc:290] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 2 election: Requested vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:03.423830 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5423d1b6aa74ce7bfebc649bac20c9c" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:04:03.424541 12173 raft_consensus.cc:3055] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:03.424783 12098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5423d1b6aa74ce7bfebc649bac20c9c" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:03.424882 12173 raft_consensus.cc:740] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:03.425552 12098 raft_consensus.cc:3060] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.425570 12097 raft_consensus.cc:515] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.426322 12173 consensus_queue.cc:260] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.427862 12173 raft_consensus.cc:3060] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.435480 12098 raft_consensus.cc:2468] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 2.
I20260709 13:04:03.436435 12173 raft_consensus.cc:2468] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 2.
I20260709 13:04:03.436510 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b31a412cfa34a58bd8f9c3778505443" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:03.437071 11987 leader_election.cc:304] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:04:03.437352 12024 raft_consensus.cc:3060] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.438017 12343 raft_consensus.cc:2804] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.438503 12343 raft_consensus.cc:697] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [term 2 LEADER]: Becoming Leader. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:04:03.438937 12097 leader_election.cc:290] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 2 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:03.439459 12343 consensus_queue.cc:237] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.440352 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b31a412cfa34a58bd8f9c3778505443" candidate_uuid: "ec4cb6593e3d45458f39de98c49431ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:04:03.441490 12173 raft_consensus.cc:3055] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:03.442029 12173 raft_consensus.cc:740] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:03.443833 12173 consensus_queue.cc:260] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.445048 12173 raft_consensus.cc:3060] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.445858 12024 raft_consensus.cc:2468] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 2.
I20260709 13:04:03.447302 12062 leader_election.cc:304] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:04:03.448205 12338 raft_consensus.cc:2804] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.448909 12338 raft_consensus.cc:697] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Becoming Leader. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Running, Role: LEADER
I20260709 13:04:03.449838 12338 consensus_queue.cc:237] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.452128 12173 raft_consensus.cc:2468] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4cb6593e3d45458f39de98c49431ba in term 2.
I20260709 13:04:03.457331 11919 catalog_manager.cc:5697] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 reported cstate change: term changed from 1 to 2, leader changed from a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195) to 1affb97882084b8783e590354f97be84 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1affb97882084b8783e590354f97be84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.458385 11922 catalog_manager.cc:5697] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba reported cstate change: term changed from 1 to 2, leader changed from a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195) to ec4cb6593e3d45458f39de98c49431ba (127.0.107.194). New cstate: current_term: 2 leader_uuid: "ec4cb6593e3d45458f39de98c49431ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.516373 12385 raft_consensus.cc:993] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df: : Instructing follower 1affb97882084b8783e590354f97be84 to start an election
I20260709 13:04:03.516932 12373 raft_consensus.cc:1081] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Signalling peer 1affb97882084b8783e590354f97be84 to start an election
I20260709 13:04:03.518697 12024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84e8240166164d33af54f986dfc46774"
dest_uuid: "1affb97882084b8783e590354f97be84"
 from {username='slave'} at 127.0.0.1:33536
I20260709 13:04:03.519239 12024 raft_consensus.cc:493] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.519538 12024 raft_consensus.cc:3060] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.524389 12024 raft_consensus.cc:515] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.526459 12024 leader_election.cc:290] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 2 election: Requested vote from peers ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219), a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195:46013)
I20260709 13:04:03.527112 12097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e8240166164d33af54f986dfc46774" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:03.527524 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84e8240166164d33af54f986dfc46774" candidate_uuid: "1affb97882084b8783e590354f97be84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
I20260709 13:04:03.527750 12097 raft_consensus.cc:3060] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.528087 12173 raft_consensus.cc:3055] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:03.528362 12173 raft_consensus.cc:740] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:03.529274 12173 consensus_queue.cc:260] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.530265 12173 raft_consensus.cc:3060] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.533285 12097 raft_consensus.cc:2468] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 2.
I20260709 13:04:03.534597 11987 leader_election.cc:304] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:04:03.535472 12343 raft_consensus.cc:2804] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.535764 12173 raft_consensus.cc:2468] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1affb97882084b8783e590354f97be84 in term 2.
I20260709 13:04:03.536089 12343 raft_consensus.cc:697] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [term 2 LEADER]: Becoming Leader. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:04:03.537163 12343 consensus_queue.cc:237] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:03.544348 11922 catalog_manager.cc:5697] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 reported cstate change: term changed from 1 to 2, leader changed from a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195) to 1affb97882084b8783e590354f97be84 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1affb97882084b8783e590354f97be84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.625738 12173 raft_consensus.cc:1275] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Refusing update from remote peer ec4cb6593e3d45458f39de98c49431ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.627099 12338 consensus_queue.cc:1048] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.635456 12024 raft_consensus.cc:1275] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Refusing update from remote peer ec4cb6593e3d45458f39de98c49431ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.637430 12381 consensus_queue.cc:1048] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.640332 12173 raft_consensus.cc:1275] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Refusing update from remote peer ec4cb6593e3d45458f39de98c49431ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.644364 12388 consensus_queue.cc:1048] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:03.649901 12170 raft_consensus.cc:1275] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Refusing update from remote peer 1affb97882084b8783e590354f97be84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.651819 12343 consensus_queue.cc:1048] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.658326 12024 raft_consensus.cc:1275] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Refusing update from remote peer ec4cb6593e3d45458f39de98c49431ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.661417 12356 consensus_queue.cc:1048] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.664031 12097 raft_consensus.cc:3060] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.674237 12097 raft_consensus.cc:1275] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Refusing update from remote peer 1affb97882084b8783e590354f97be84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.675803 12343 consensus_queue.cc:1048] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.832201 12172 raft_consensus.cc:1275] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Refusing update from remote peer 1affb97882084b8783e590354f97be84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.833750 12343 consensus_queue.cc:1048] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.842356 12097 raft_consensus.cc:1275] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Refusing update from remote peer 1affb97882084b8783e590354f97be84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.843905 12337 consensus_queue.cc:1048] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.892074 12024 raft_consensus.cc:3060] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.892552 12023 raft_consensus.cc:1275] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Refusing update from remote peer ec4cb6593e3d45458f39de98c49431ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.894168 12381 consensus_queue.cc:1048] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.898304 12024 raft_consensus.cc:1275] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Refusing update from remote peer a67b474ab9354f4d937a2d0cd422e5df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.900099 12373 consensus_queue.cc:1048] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.903489 12172 raft_consensus.cc:1275] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Refusing update from remote peer ec4cb6593e3d45458f39de98c49431ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.905668 12338 consensus_queue.cc:1048] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.915441 12097 raft_consensus.cc:1275] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Refusing update from remote peer a67b474ab9354f4d937a2d0cd422e5df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.918921 12384 consensus_queue.cc:1048] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:03.948500 12172 raft_consensus.cc:1275] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Refusing update from remote peer 1affb97882084b8783e590354f97be84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.949882 12337 consensus_queue.cc:1048] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.960124 12097 raft_consensus.cc:1275] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Refusing update from remote peer 1affb97882084b8783e590354f97be84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.962649 12343 consensus_queue.cc:1048] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:06.118224 11919 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33204:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:04:06.139339 11919 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33204:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:04:06.170544   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:04:06.250945 12437 log.cc:927] Time spent T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84: Append to log took a long time: real 0.052s	user 0.000s	sys 0.005s
W20260709 13:04:06.390156 12450 log.cc:927] Time spent T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:04:06.400204 12062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 101920us
W20260709 13:04:06.477100 12445 log.cc:927] Time spent T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:04:06.510249 12474 tablet.cc:1724] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:06.546674 12459 log.cc:927] Time spent T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:04:06.548810 12473 log.cc:927] Time spent T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
W20260709 13:04:06.600728 12062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43521, user_credentials={real_user=slave}} blocked reactor thread for 105722us
I20260709 13:04:06.603999 12479 tablet.cc:1724] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.614508 12022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4508e3e099fa4c3ba2701a2ed5456073"
dest_uuid: "1affb97882084b8783e590354f97be84"
mode: GRACEFUL
new_leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
 from {username='slave'} at 127.0.0.1:44796
I20260709 13:04:06.615018 12481 tablet.cc:1724] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.623409 12478 tablet.cc:1724] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.627693 12483 tablet.cc:1724] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.640014 12487 tablet.cc:1724] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.632192 12486 tablet.cc:1724] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:06.682946 11987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 78920.2us
I20260709 13:04:06.681970 12022 raft_consensus.cc:606] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Received request to transfer leadership to TS a67b474ab9354f4d937a2d0cd422e5df
I20260709 13:04:06.641804 12480 tablet.cc:1724] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.685480 12494 tablet.cc:1724] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.633360 12489 tablet.cc:1724] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.707527 11919 catalog_manager.cc:5789] TS ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219) does not have the latest schema for tablet 40b2c6a620484f0fbba197f2f1395c96 (table soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]). Expected version 1 got 0
I20260709 13:04:06.709889 12492 tablet.cc:1724] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.724052 12474 tablet.cc:1724] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.714617 11919 catalog_manager.cc:5789] TS ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219) does not have the latest schema for tablet 3995b16a40174d659fc83a6b4c085c06 (table soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]). Expected version 1 got 0
I20260709 13:04:06.631984 12488 tablet.cc:1724] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.728461 11919 catalog_manager.cc:5789] TS ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219) does not have the latest schema for tablet 8d3df09f5b7a4b379cf42e01a9f3a90a (table soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad]). Expected version 1 got 0
I20260709 13:04:06.737601 12493 raft_consensus.cc:993] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84: : Instructing follower a67b474ab9354f4d937a2d0cd422e5df to start an election
I20260709 13:04:06.738306 12493 raft_consensus.cc:1081] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Signalling peer a67b474ab9354f4d937a2d0cd422e5df to start an election
I20260709 13:04:06.715425 12478 tablet.cc:1724] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.745004 12486 tablet.cc:1724] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.744992 12170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4508e3e099fa4c3ba2701a2ed5456073"
dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
 from {username='slave'} at 127.0.0.1:47874
I20260709 13:04:06.747519 12170 raft_consensus.cc:493] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:06.747957 12170 raft_consensus.cc:3060] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.757272 12483 tablet.cc:1724] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.748725 12487 tablet.cc:1724] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.759559 12479 tablet.cc:1724] T 3995b16a40174d659fc83a6b4c085c06 P 1affb97882084b8783e590354f97be84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.774366 12494 tablet.cc:1724] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.778102 12481 tablet.cc:1724] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.782588 12488 tablet.cc:1724] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.785615 12492 tablet.cc:1724] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.791157 12480 tablet.cc:1724] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.793370 12487 tablet.cc:1724] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.819025 12483 tablet.cc:1724] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.821843 12492 tablet.cc:1724] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.827122 12489 tablet.cc:1724] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:06.846815 12170 raft_consensus.cc:515] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:06.849243 12170 leader_election.cc:290] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 2 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:06.851223 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4508e3e099fa4c3ba2701a2ed5456073" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:06.852001 12022 raft_consensus.cc:3055] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:06.852718 12095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4508e3e099fa4c3ba2701a2ed5456073" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:06.853421 12095 raft_consensus.cc:3060] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.855985 12096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d3df09f5b7a4b379cf42e01a9f3a90a"
dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
mode: GRACEFUL
new_leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
 from {username='slave'} at 127.0.0.1:51502
I20260709 13:04:06.852342 12022 raft_consensus.cc:740] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:04:06.856707 12096 raft_consensus.cc:606] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Received request to transfer leadership to TS a67b474ab9354f4d937a2d0cd422e5df
I20260709 13:04:06.857530 12022 consensus_queue.cc:260] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:06.858203   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:04:06.858960   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:06.859011 12022 raft_consensus.cc:3060] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.864820 12095 raft_consensus.cc:2468] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 2.
I20260709 13:04:06.866451 12136 leader_election.cc:304] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a67b474ab9354f4d937a2d0cd422e5df, ec4cb6593e3d45458f39de98c49431ba; no voters: 
I20260709 13:04:06.867604 12467 raft_consensus.cc:2804] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:06.868055 12467 raft_consensus.cc:697] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [term 2 LEADER]: Becoming Leader. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:06.869801 12021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4154b1f61d0147ebb9b941ed1bd8058a"
dest_uuid: "1affb97882084b8783e590354f97be84"
mode: GRACEFUL
new_leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
 from {username='slave'} at 127.0.0.1:44796
I20260709 13:04:06.870548 12021 raft_consensus.cc:606] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 2 LEADER]: Received request to transfer leadership to TS a67b474ab9354f4d937a2d0cd422e5df
I20260709 13:04:06.870057 12467 consensus_queue.cc:237] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:06.876430 12022 raft_consensus.cc:2468] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 2.
I20260709 13:04:06.876535 12095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbc5703b8ed84a96838349220e891c0b"
dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
mode: GRACEFUL
new_leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
 from {username='slave'} at 127.0.0.1:51502
I20260709 13:04:06.877444 12095 raft_consensus.cc:606] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Received request to transfer leadership to TS a67b474ab9354f4d937a2d0cd422e5df
I20260709 13:04:06.878983   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:06.879608   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:06.881029 11922 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9: soft_deleted_table [id=2f21ae2de27d44bebd582450577342ad] alter complete (version 1)
I20260709 13:04:06.891239 11921 catalog_manager.cc:5697] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df reported cstate change: term changed from 1 to 2, leader changed from 1affb97882084b8783e590354f97be84 (127.0.107.193) to a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195). New cstate: current_term: 2 leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.966536 12491 raft_consensus.cc:993] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84: : Instructing follower a67b474ab9354f4d937a2d0cd422e5df to start an election
I20260709 13:04:06.967079 12468 raft_consensus.cc:1081] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 2 LEADER]: Signalling peer a67b474ab9354f4d937a2d0cd422e5df to start an election
I20260709 13:04:06.968477 12170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4154b1f61d0147ebb9b941ed1bd8058a"
dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
 from {username='slave'} at 127.0.0.1:47874
I20260709 13:04:06.969112 12170 raft_consensus.cc:493] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:06.969373 12170 raft_consensus.cc:3060] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:06.974903 12170 raft_consensus.cc:515] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:06.976702 12170 leader_election.cc:290] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 3 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:06.977758 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4154b1f61d0147ebb9b941ed1bd8058a" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:06.978557 12022 raft_consensus.cc:3055] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:06.978976 12022 raft_consensus.cc:740] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1affb97882084b8783e590354f97be84, State: Running, Role: LEADER
I20260709 13:04:06.979843 12022 consensus_queue.cc:260] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:06.981283 12022 raft_consensus.cc:3060] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:06.977921 12095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4154b1f61d0147ebb9b941ed1bd8058a" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:06.982920 12095 raft_consensus.cc:3060] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:06.983263 12461 raft_consensus.cc:993] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba: : Instructing follower a67b474ab9354f4d937a2d0cd422e5df to start an election
I20260709 13:04:06.983980 12485 raft_consensus.cc:1081] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Signalling peer a67b474ab9354f4d937a2d0cd422e5df to start an election
I20260709 13:04:06.986271 12170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbc5703b8ed84a96838349220e891c0b"
dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
 from {username='slave'} at 127.0.0.1:47870
I20260709 13:04:06.988653 12022 raft_consensus.cc:2468] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 3.
I20260709 13:04:06.988827 12170 raft_consensus.cc:493] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:06.989583 12170 raft_consensus.cc:3060] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:06.989962 12136 leader_election.cc:304] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:04:06.990993 12467 raft_consensus.cc:2804] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:06.991492 12467 raft_consensus.cc:697] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 3 LEADER]: Becoming Leader. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:06.992178 12095 raft_consensus.cc:2468] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 3.
I20260709 13:04:06.992359 12467 consensus_queue.cc:237] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:06.997514 12170 raft_consensus.cc:515] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:07.000026 12170 leader_election.cc:290] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 3 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:07.000278 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc5703b8ed84a96838349220e891c0b" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:07.000981 12022 raft_consensus.cc:3060] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:07.001343 12095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc5703b8ed84a96838349220e891c0b" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:07.001901 12095 raft_consensus.cc:3055] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:07.002194 12095 raft_consensus.cc:740] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Running, Role: LEADER
I20260709 13:04:07.002951 12095 consensus_queue.cc:260] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:07.002547 11921 catalog_manager.cc:5697] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df reported cstate change: term changed from 2 to 3, leader changed from 1affb97882084b8783e590354f97be84 (127.0.107.193) to a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195). New cstate: current_term: 3 leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.004112 12095 raft_consensus.cc:3060] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:07.008523 12022 raft_consensus.cc:2468] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 3.
I20260709 13:04:07.010246 12136 leader_election.cc:304] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:04:07.011241 12467 raft_consensus.cc:2804] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:07.011934 12467 raft_consensus.cc:697] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 3 LEADER]: Becoming Leader. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:07.014837 12467 consensus_queue.cc:237] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:07.018112 12095 raft_consensus.cc:2468] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 3.
I20260709 13:04:07.025913 11921 catalog_manager.cc:5697] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df reported cstate change: term changed from 2 to 3, leader changed from ec4cb6593e3d45458f39de98c49431ba (127.0.107.194) to a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195). New cstate: current_term: 3 leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.231781 12485 raft_consensus.cc:993] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba: : Instructing follower a67b474ab9354f4d937a2d0cd422e5df to start an election
I20260709 13:04:07.232251 12461 raft_consensus.cc:1081] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Signalling peer a67b474ab9354f4d937a2d0cd422e5df to start an election
I20260709 13:04:07.234356 12170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d3df09f5b7a4b379cf42e01a9f3a90a"
dest_uuid: "a67b474ab9354f4d937a2d0cd422e5df"
 from {username='slave'} at 127.0.0.1:47870
I20260709 13:04:07.234961 12170 raft_consensus.cc:493] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:07.235445 12170 raft_consensus.cc:3060] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:07.241618 12170 raft_consensus.cc:515] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:07.243294 12170 leader_election.cc:290] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 3 election: Requested vote from peers 1affb97882084b8783e590354f97be84 (127.0.107.193:43521), ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219)
I20260709 13:04:07.244632 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3df09f5b7a4b379cf42e01a9f3a90a" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1affb97882084b8783e590354f97be84"
I20260709 13:04:07.244905 12095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3df09f5b7a4b379cf42e01a9f3a90a" candidate_uuid: "a67b474ab9354f4d937a2d0cd422e5df" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ec4cb6593e3d45458f39de98c49431ba"
I20260709 13:04:07.245604 12022 raft_consensus.cc:3060] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:07.245769 12095 raft_consensus.cc:3055] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:07.246419 12095 raft_consensus.cc:740] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec4cb6593e3d45458f39de98c49431ba, State: Running, Role: LEADER
I20260709 13:04:07.247318 12095 consensus_queue.cc:260] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:07.248636 12095 raft_consensus.cc:3060] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:07.253654 12022 raft_consensus.cc:2468] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 3.
I20260709 13:04:07.255131 12136 leader_election.cc:304] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1affb97882084b8783e590354f97be84, a67b474ab9354f4d937a2d0cd422e5df; no voters: 
I20260709 13:04:07.256103 12373 raft_consensus.cc:2804] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:07.256233 12095 raft_consensus.cc:2468] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a67b474ab9354f4d937a2d0cd422e5df in term 3.
I20260709 13:04:07.256723 12373 raft_consensus.cc:697] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 3 LEADER]: Becoming Leader. State: Replica: a67b474ab9354f4d937a2d0cd422e5df, State: Running, Role: LEADER
I20260709 13:04:07.258131 12373 consensus_queue.cc:237] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } }
I20260709 13:04:07.265130 11921 catalog_manager.cc:5697] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df reported cstate change: term changed from 2 to 3, leader changed from ec4cb6593e3d45458f39de98c49431ba (127.0.107.194) to a67b474ab9354f4d937a2d0cd422e5df (127.0.107.195). New cstate: current_term: 3 leader_uuid: "a67b474ab9354f4d937a2d0cd422e5df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67b474ab9354f4d937a2d0cd422e5df" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.388232 12022 raft_consensus.cc:1275] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Refusing update from remote peer a67b474ab9354f4d937a2d0cd422e5df: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:07.389679 12373 consensus_queue.cc:1048] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:07.390944 12095 raft_consensus.cc:1275] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [term 3 FOLLOWER]: Refusing update from remote peer a67b474ab9354f4d937a2d0cd422e5df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:07.392508 12373 consensus_queue.cc:1048] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:07.405908 12095 raft_consensus.cc:1275] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Refusing update from remote peer a67b474ab9354f4d937a2d0cd422e5df: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:07.410013 12467 consensus_queue.cc:1048] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:07.410291 12022 raft_consensus.cc:1275] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 3 FOLLOWER]: Refusing update from remote peer a67b474ab9354f4d937a2d0cd422e5df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:07.412038 12467 consensus_queue.cc:1048] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:07.440752 12022 raft_consensus.cc:1275] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 3 FOLLOWER]: Refusing update from remote peer a67b474ab9354f4d937a2d0cd422e5df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:07.442194 12467 consensus_queue.cc:1048] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:07.458398 12096 raft_consensus.cc:1275] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 3 FOLLOWER]: Refusing update from remote peer a67b474ab9354f4d937a2d0cd422e5df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:07.462955 12373 consensus_queue.cc:1048] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:07.724728 12022 raft_consensus.cc:1275] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [term 3 FOLLOWER]: Refusing update from remote peer a67b474ab9354f4d937a2d0cd422e5df: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:07.725849 12096 raft_consensus.cc:1275] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 3 FOLLOWER]: Refusing update from remote peer a67b474ab9354f4d937a2d0cd422e5df: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:07.726177 12373 consensus_queue.cc:1048] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "1affb97882084b8783e590354f97be84" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:07.727341 12467 consensus_queue.cc:1048] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4cb6593e3d45458f39de98c49431ba" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:07.949038   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:04:07.957033   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:04:07.957638   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:07.964943   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:04:07.965456   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:09.006947   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:04:09.029819 12136 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:04:09.035888 12136 consensus_peers.cc:597] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df -> Peer 1affb97882084b8783e590354f97be84 (127.0.107.193:43521): Couldn't send request to peer 1affb97882084b8783e590354f97be84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.037317   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:09.038404   431 tablet_replica.cc:333] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.039758   431 raft_consensus.cc:2243] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.040499   431 raft_consensus.cc:2272] T 8b31a412cfa34a58bd8f9c3778505443 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:09.046484 12062 consensus_peers.cc:597] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba -> Peer 1affb97882084b8783e590354f97be84 (127.0.107.193:43521): Couldn't send request to peer 1affb97882084b8783e590354f97be84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.047106   431 tablet_replica.cc:333] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.047923   431 raft_consensus.cc:2243] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.048722   431 raft_consensus.cc:2272] T 4dad3ed304874728bb2fb1af7cb51866 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.051717   431 tablet_replica.cc:333] T 3995b16a40174d659fc83a6b4c085c06 P 1affb97882084b8783e590354f97be84: stopping tablet replica
W20260709 13:04:09.052769 12136 consensus_peers.cc:597] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df -> Peer 1affb97882084b8783e590354f97be84 (127.0.107.193:43521): Couldn't send request to peer 1affb97882084b8783e590354f97be84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.052889   431 raft_consensus.cc:2243] T 3995b16a40174d659fc83a6b4c085c06 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.053602   431 raft_consensus.cc:2272] T 3995b16a40174d659fc83a6b4c085c06 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.055997   431 tablet_replica.cc:333] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.056766   431 raft_consensus.cc:2243] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.057289   431 raft_consensus.cc:2272] T 8d3df09f5b7a4b379cf42e01a9f3a90a P 1affb97882084b8783e590354f97be84 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.059481   431 tablet_replica.cc:333] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.060339   431 raft_consensus.cc:2243] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.061221   431 raft_consensus.cc:2272] T a5423d1b6aa74ce7bfebc649bac20c9c P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.063719   431 tablet_replica.cc:333] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.064392   431 raft_consensus.cc:2243] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.064888   431 raft_consensus.cc:2272] T 40b2c6a620484f0fbba197f2f1395c96 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.067229   431 tablet_replica.cc:333] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.067901   431 raft_consensus.cc:2243] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.068813   431 raft_consensus.cc:2272] T 29c39c37d9904d2d90d7781489f0297d P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.071758   431 tablet_replica.cc:333] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.072688   431 raft_consensus.cc:2243] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.073247   431 raft_consensus.cc:2272] T 4154b1f61d0147ebb9b941ed1bd8058a P 1affb97882084b8783e590354f97be84 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.075649   431 tablet_replica.cc:333] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.076256   431 raft_consensus.cc:2243] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.076825   431 raft_consensus.cc:2272] T 4508e3e099fa4c3ba2701a2ed5456073 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.079136   431 tablet_replica.cc:333] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.079836   431 raft_consensus.cc:2243] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.081092   431 raft_consensus.cc:2272] T 6bfe096a4bdd4aac9bfc641d24d667d5 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.083897   431 tablet_replica.cc:333] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.084470   431 raft_consensus.cc:2243] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.085120   431 raft_consensus.cc:2272] T cbc5703b8ed84a96838349220e891c0b P 1affb97882084b8783e590354f97be84 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.087246   431 tablet_replica.cc:333] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.087816   431 raft_consensus.cc:2243] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.088364   431 raft_consensus.cc:2272] T 5d3a2f5b782946a6a17501fa72f56043 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:09.091193 12136 consensus_peers.cc:597] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df -> Peer 1affb97882084b8783e590354f97be84 (127.0.107.193:43521): Couldn't send request to peer 1affb97882084b8783e590354f97be84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.091434   431 tablet_replica.cc:333] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.092208   431 raft_consensus.cc:2243] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.093029   431 raft_consensus.cc:2272] T 84e8240166164d33af54f986dfc46774 P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.095307   431 tablet_replica.cc:333] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.095896   431 raft_consensus.cc:2243] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.096792   431 raft_consensus.cc:2272] T 83202045303b4403b8a8ba2f723bad5b P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.098965   431 tablet_replica.cc:333] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.099620   431 raft_consensus.cc:2243] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.100050   431 raft_consensus.cc:2272] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P 1affb97882084b8783e590354f97be84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.102205   431 tablet_replica.cc:333] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.102741   431 raft_consensus.cc:2243] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.103161   431 raft_consensus.cc:2272] T 2c2974b9251e4403b9b7b2169042e6ee P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.105286   431 tablet_replica.cc:333] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.105753   431 raft_consensus.cc:2243] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.106190   431 raft_consensus.cc:2272] T a8470d1f74104ccc9695026f52865eca P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.108162   431 tablet_replica.cc:333] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84: stopping tablet replica
I20260709 13:04:09.108600   431 raft_consensus.cc:2243] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.109395   431 raft_consensus.cc:2272] T 703c68323a7e41fc87b8c48189a6c563 P 1affb97882084b8783e590354f97be84 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:09.122345 12062 consensus_peers.cc:597] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba -> Peer 1affb97882084b8783e590354f97be84 (127.0.107.193:43521): Couldn't send request to peer 1affb97882084b8783e590354f97be84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.142588   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:04:09.182905   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:04:09.218796   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:09.221184   431 tablet_replica.cc:333] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.222705   431 raft_consensus.cc:2243] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.223392   431 raft_consensus.cc:2272] T 4dad3ed304874728bb2fb1af7cb51866 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.226696   431 tablet_replica.cc:333] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.227831   431 raft_consensus.cc:2243] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.229306   431 raft_consensus.cc:2272] T 40b2c6a620484f0fbba197f2f1395c96 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:09.232208 12136 consensus_peers.cc:597] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df -> Peer ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219): Couldn't send request to peer ec4cb6593e3d45458f39de98c49431ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.232530   431 tablet_replica.cc:333] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.234671   431 raft_consensus.cc:2243] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.236279   431 raft_consensus.cc:2272] T 8b31a412cfa34a58bd8f9c3778505443 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.239846   431 tablet_replica.cc:333] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.241034   431 raft_consensus.cc:2243] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.241681   431 raft_consensus.cc:2272] T 8d3df09f5b7a4b379cf42e01a9f3a90a P ec4cb6593e3d45458f39de98c49431ba [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:09.243464 12136 consensus_peers.cc:597] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df -> Peer 1affb97882084b8783e590354f97be84 (127.0.107.193:43521): Couldn't send request to peer 1affb97882084b8783e590354f97be84. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.244954   431 tablet_replica.cc:333] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.245744   431 raft_consensus.cc:2243] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.246992   431 raft_consensus.cc:2272] T 3995b16a40174d659fc83a6b4c085c06 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.250521   431 tablet_replica.cc:333] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.251271   431 raft_consensus.cc:2243] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.251827   431 raft_consensus.cc:2272] T 29c39c37d9904d2d90d7781489f0297d P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.255280   431 tablet_replica.cc:333] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.256574   431 raft_consensus.cc:2243] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.257290   431 raft_consensus.cc:2272] T a5423d1b6aa74ce7bfebc649bac20c9c P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.260808   431 tablet_replica.cc:333] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.261647   431 raft_consensus.cc:2243] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.262295   431 raft_consensus.cc:2272] T 4154b1f61d0147ebb9b941ed1bd8058a P ec4cb6593e3d45458f39de98c49431ba [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:09.262616 12062 consensus_peers.cc:597] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba -> Peer 1affb97882084b8783e590354f97be84 (127.0.107.193:43521): Couldn't send request to peer 1affb97882084b8783e590354f97be84. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.265687   431 tablet_replica.cc:333] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.266783   431 raft_consensus.cc:2243] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.267655   431 raft_consensus.cc:2272] T 4508e3e099fa4c3ba2701a2ed5456073 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.271544   431 tablet_replica.cc:333] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.272760   431 raft_consensus.cc:2243] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.273478   431 raft_consensus.cc:2272] T cbc5703b8ed84a96838349220e891c0b P ec4cb6593e3d45458f39de98c49431ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.277144   431 tablet_replica.cc:333] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.278285   431 raft_consensus.cc:2243] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.279052   431 raft_consensus.cc:2272] T 5d3a2f5b782946a6a17501fa72f56043 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.282176   431 tablet_replica.cc:333] T 6bfe096a4bdd4aac9bfc641d24d667d5 P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.282720   431 raft_consensus.cc:2243] T 6bfe096a4bdd4aac9bfc641d24d667d5 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.283108   431 raft_consensus.cc:2272] T 6bfe096a4bdd4aac9bfc641d24d667d5 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.285509   431 tablet_replica.cc:333] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.286151   431 raft_consensus.cc:2243] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.286595   431 raft_consensus.cc:2272] T 84e8240166164d33af54f986dfc46774 P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.288748   431 tablet_replica.cc:333] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.289299   431 raft_consensus.cc:2243] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.289770   431 raft_consensus.cc:2272] T 83202045303b4403b8a8ba2f723bad5b P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:09.290572 12136 consensus_peers.cc:597] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df -> Peer 1affb97882084b8783e590354f97be84 (127.0.107.193:43521): Couldn't send request to peer 1affb97882084b8783e590354f97be84. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.292028   431 tablet_replica.cc:333] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.292742   431 raft_consensus.cc:2243] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.293598   431 raft_consensus.cc:2272] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P ec4cb6593e3d45458f39de98c49431ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.295730   431 tablet_replica.cc:333] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.296304   431 raft_consensus.cc:2243] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.297212   431 raft_consensus.cc:2272] T 2c2974b9251e4403b9b7b2169042e6ee P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.299434   431 tablet_replica.cc:333] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.300035   431 raft_consensus.cc:2243] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.300923   431 raft_consensus.cc:2272] T a8470d1f74104ccc9695026f52865eca P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.303026   431 tablet_replica.cc:333] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba: stopping tablet replica
I20260709 13:04:09.303539   431 raft_consensus.cc:2243] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.303969   431 raft_consensus.cc:2272] T 703c68323a7e41fc87b8c48189a6c563 P ec4cb6593e3d45458f39de98c49431ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:09.312161 12136 consensus_peers.cc:597] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df -> Peer 1affb97882084b8783e590354f97be84 (127.0.107.193:43521): Couldn't send request to peer 1affb97882084b8783e590354f97be84. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:09.331700 12136 consensus_peers.cc:597] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df -> Peer ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219): Couldn't send request to peer ec4cb6593e3d45458f39de98c49431ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:09.346963 12136 consensus_peers.cc:597] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df -> Peer ec4cb6593e3d45458f39de98c49431ba (127.0.107.194:33219): Couldn't send request to peer ec4cb6593e3d45458f39de98c49431ba. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:09.348780   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:04:09.387691   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:04:09.417922   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:09.418648   431 tablet_replica.cc:333] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.419338   431 raft_consensus.cc:2243] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.419844   431 raft_consensus.cc:2272] T 8b31a412cfa34a58bd8f9c3778505443 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.421970   431 tablet_replica.cc:333] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.422555   431 raft_consensus.cc:2243] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.423352   431 raft_consensus.cc:2272] T 4dad3ed304874728bb2fb1af7cb51866 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.425462   431 tablet_replica.cc:333] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.426036   431 raft_consensus.cc:2243] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.426502   431 raft_consensus.cc:2272] T 40b2c6a620484f0fbba197f2f1395c96 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.428629   431 tablet_replica.cc:333] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.429221   431 raft_consensus.cc:2243] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.430212   431 raft_consensus.cc:2272] T 8d3df09f5b7a4b379cf42e01a9f3a90a P a67b474ab9354f4d937a2d0cd422e5df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.432396   431 tablet_replica.cc:333] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.433022   431 raft_consensus.cc:2243] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.433513   431 raft_consensus.cc:2272] T 3995b16a40174d659fc83a6b4c085c06 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.435524   431 tablet_replica.cc:333] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.436089   431 raft_consensus.cc:2243] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.436551   431 raft_consensus.cc:2272] T a5423d1b6aa74ce7bfebc649bac20c9c P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.438495   431 tablet_replica.cc:333] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.439096   431 raft_consensus.cc:2243] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.439563   431 raft_consensus.cc:2272] T 29c39c37d9904d2d90d7781489f0297d P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.441553   431 tablet_replica.cc:333] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.442114   431 raft_consensus.cc:2243] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.442879   431 raft_consensus.cc:2272] T 4154b1f61d0147ebb9b941ed1bd8058a P a67b474ab9354f4d937a2d0cd422e5df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.445281   431 tablet_replica.cc:333] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.445978   431 raft_consensus.cc:2243] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.446969   431 raft_consensus.cc:2272] T 4508e3e099fa4c3ba2701a2ed5456073 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.449574   431 tablet_replica.cc:333] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.450316   431 raft_consensus.cc:2243] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.450846   431 raft_consensus.cc:2272] T 6bfe096a4bdd4aac9bfc641d24d667d5 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.453648   431 tablet_replica.cc:333] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.454406   431 raft_consensus.cc:2243] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.455518   431 raft_consensus.cc:2272] T cbc5703b8ed84a96838349220e891c0b P a67b474ab9354f4d937a2d0cd422e5df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.458578   431 tablet_replica.cc:333] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.459379   431 raft_consensus.cc:2243] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.460310   431 raft_consensus.cc:2272] T 5d3a2f5b782946a6a17501fa72f56043 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.462528   431 tablet_replica.cc:333] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.463076   431 raft_consensus.cc:2243] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.463521   431 raft_consensus.cc:2272] T 84e8240166164d33af54f986dfc46774 P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.465528   431 tablet_replica.cc:333] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.466032   431 raft_consensus.cc:2243] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.466454   431 raft_consensus.cc:2272] T 83202045303b4403b8a8ba2f723bad5b P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.468464   431 tablet_replica.cc:333] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.469027   431 raft_consensus.cc:2243] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.469542   431 raft_consensus.cc:2272] T a3b7d4c4a66b4fbf9963fddef0ec2cdf P a67b474ab9354f4d937a2d0cd422e5df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.471614   431 tablet_replica.cc:333] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.472103   431 raft_consensus.cc:2243] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.472558   431 raft_consensus.cc:2272] T a8470d1f74104ccc9695026f52865eca P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.474699   431 tablet_replica.cc:333] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.475195   431 raft_consensus.cc:2243] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.475637   431 raft_consensus.cc:2272] T 703c68323a7e41fc87b8c48189a6c563 P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.477756   431 tablet_replica.cc:333] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df: stopping tablet replica
I20260709 13:04:09.478209   431 raft_consensus.cc:2243] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.478631   431 raft_consensus.cc:2272] T 2c2974b9251e4403b9b7b2169042e6ee P a67b474ab9354f4d937a2d0cd422e5df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.521350   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:09.560892   431 master.cc:562] Master@127.0.107.254:38137 shutting down...
I20260709 13:04:09.591391   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.592010   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.592382   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 88480e052ad14f86ad88829cb5cd25c9: stopping tablet replica
I20260709 13:04:09.614743   431 master.cc:584] Master@127.0.107.254:38137 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (15013 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:04:09.670140   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:41207
I20260709 13:04:09.671471   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:09.678181 12521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:09.678287 12519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:09.678275 12518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:09.679747   431 server_base.cc:1061] running on GCE node
I20260709 13:04:09.680797   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:09.681082   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:09.681200   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602249681189 us; error 0 us; skew 500 ppm
I20260709 13:04:09.681672   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:09.684334   431 webserver.cc:533] Webserver started at http://127.0.107.254:36959/ using document root <none> and password file <none>
I20260709 13:04:09.685194   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:09.685370   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:09.685598   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:09.686712   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/master-0-root/instance:
uuid: "4cf676cca17d466287655c57f5efb93c"
format_stamp: "Formatted at 2026-07-09 13:04:09 on dist-test-slave-c08m"
I20260709 13:04:09.691553   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:09.695273 12526 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:09.696084   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:04:09.696378   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/master-0-root
uuid: "4cf676cca17d466287655c57f5efb93c"
format_stamp: "Formatted at 2026-07-09 13:04:09 on dist-test-slave-c08m"
I20260709 13:04:09.696730   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:09.719717   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:09.720986   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:09.764276   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:41207
I20260709 13:04:09.764384 12577 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:41207 every 8 connection(s)
I20260709 13:04:09.768498 12578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:09.779881 12578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c: Bootstrap starting.
I20260709 13:04:09.785063 12578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.789742 12578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c: No bootstrap required, opened a new log
I20260709 13:04:09.792083 12578 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf676cca17d466287655c57f5efb93c" member_type: VOTER }
I20260709 13:04:09.792505 12578 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.792784 12578 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf676cca17d466287655c57f5efb93c, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.793334 12578 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf676cca17d466287655c57f5efb93c" member_type: VOTER }
I20260709 13:04:09.793751 12578 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:09.793949 12578 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:09.794160 12578 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.799559 12578 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf676cca17d466287655c57f5efb93c" member_type: VOTER }
I20260709 13:04:09.800094 12578 leader_election.cc:304] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4cf676cca17d466287655c57f5efb93c; no voters: 
I20260709 13:04:09.801203 12578 leader_election.cc:290] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:09.801586 12581 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.802997 12581 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [term 1 LEADER]: Becoming Leader. State: Replica: 4cf676cca17d466287655c57f5efb93c, State: Running, Role: LEADER
I20260709 13:04:09.803803 12581 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf676cca17d466287655c57f5efb93c" member_type: VOTER }
I20260709 13:04:09.804301 12578 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:09.809008 12582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4cf676cca17d466287655c57f5efb93c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf676cca17d466287655c57f5efb93c" member_type: VOTER } }
I20260709 13:04:09.810050 12582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:09.810087 12583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cf676cca17d466287655c57f5efb93c. Latest consensus state: current_term: 1 leader_uuid: "4cf676cca17d466287655c57f5efb93c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf676cca17d466287655c57f5efb93c" member_type: VOTER } }
I20260709 13:04:09.811358 12583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:09.814347 12591 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:09.819344 12591 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:09.820541   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:09.828608 12591 catalog_manager.cc:1383] Generated new cluster ID: 342b59d2f9ed45c9a7d359211ea14c0e
I20260709 13:04:09.828948 12591 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:09.850417 12591 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:09.851804 12591 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:09.865643 12591 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c: Generated new TSK 0
I20260709 13:04:09.866353 12591 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:09.887823   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:09.894253 12599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:09.895537 12600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:09.897815   431 server_base.cc:1061] running on GCE node
W20260709 13:04:09.897809 12602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:09.899245   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:09.899471   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:09.899667   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602249899646 us; error 0 us; skew 500 ppm
I20260709 13:04:09.900302   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:09.903100   431 webserver.cc:533] Webserver started at http://127.0.107.193:34167/ using document root <none> and password file <none>
I20260709 13:04:09.903658   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:09.903859   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:09.904146   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:09.905375   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-0-root/instance:
uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
format_stamp: "Formatted at 2026-07-09 13:04:09 on dist-test-slave-c08m"
I20260709 13:04:09.910629   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:09.914573 12607 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:09.915398   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:04:09.915711   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-0-root
uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
format_stamp: "Formatted at 2026-07-09 13:04:09 on dist-test-slave-c08m"
I20260709 13:04:09.916013   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:09.942226   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:09.943544   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:09.945150   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:09.947531   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:09.947769   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:09.948040   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:09.948242   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:09.992522   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:41221
I20260709 13:04:09.992751 12669 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:41221 every 8 connection(s)
I20260709 13:04:09.998445   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:10.007275 12674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:10.008406 12675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:10.010668 12677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:10.011762   431 server_base.cc:1061] running on GCE node
I20260709 13:04:10.013674   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:10.014012 12670 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41207
W20260709 13:04:10.014048   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:10.014389   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602250014372 us; error 0 us; skew 500 ppm
I20260709 13:04:10.014412 12670 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:10.014981   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:10.015179 12670 heartbeater.cc:507] Master 127.0.107.254:41207 requested a full tablet report, sending...
I20260709 13:04:10.018478   431 webserver.cc:533] Webserver started at http://127.0.107.194:34467/ using document root <none> and password file <none>
I20260709 13:04:10.018537 12543 ts_manager.cc:194] Registered new tserver with Master: b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221)
I20260709 13:04:10.019249   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:10.019604   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:10.019969   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:10.021255   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-1-root/instance:
uuid: "8a517ba6254c4619a53d8a220316793e"
format_stamp: "Formatted at 2026-07-09 13:04:10 on dist-test-slave-c08m"
I20260709 13:04:10.021329 12543 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35704
I20260709 13:04:10.027844   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:10.031840 12682 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.033257   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:10.033707   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-1-root
uuid: "8a517ba6254c4619a53d8a220316793e"
format_stamp: "Formatted at 2026-07-09 13:04:10 on dist-test-slave-c08m"
I20260709 13:04:10.034029   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:10.054287   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:10.055861   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:10.057686   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:10.060288   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:10.060549   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.060895   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:10.061074   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.106575   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:41275
I20260709 13:04:10.106681 12744 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:41275 every 8 connection(s)
I20260709 13:04:10.111698   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:10.119813 12748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:10.120155 12749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:10.123421   431 server_base.cc:1061] running on GCE node
W20260709 13:04:10.124676 12752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:10.125433 12745 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41207
I20260709 13:04:10.125952 12745 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:10.126106   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:10.126396   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:10.126621   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602250126600 us; error 0 us; skew 500 ppm
I20260709 13:04:10.126915 12745 heartbeater.cc:507] Master 127.0.107.254:41207 requested a full tablet report, sending...
I20260709 13:04:10.127435   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:10.129776 12543 ts_manager.cc:194] Registered new tserver with Master: 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:10.130960   431 webserver.cc:533] Webserver started at http://127.0.107.195:32931/ using document root <none> and password file <none>
I20260709 13:04:10.131414 12543 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35712
I20260709 13:04:10.131580   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:10.131942   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:10.132220   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:10.133919   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-2-root/instance:
uuid: "989e9a004b914452b13703cdfc705a2a"
format_stamp: "Formatted at 2026-07-09 13:04:10 on dist-test-slave-c08m"
I20260709 13:04:10.139581   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:10.143267 12756 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.144158   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:10.144502   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-2-root
uuid: "989e9a004b914452b13703cdfc705a2a"
format_stamp: "Formatted at 2026-07-09 13:04:10 on dist-test-slave-c08m"
I20260709 13:04:10.144896   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkXcLqT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601889622018-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:10.188349   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:10.189723   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:10.191334   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:10.193895   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:10.194151   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.194413   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:10.194612   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.243022   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:33369
I20260709 13:04:10.243119 12818 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:33369 every 8 connection(s)
I20260709 13:04:10.261005 12819 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41207
I20260709 13:04:10.261392 12819 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:10.262089 12819 heartbeater.cc:507] Master 127.0.107.254:41207 requested a full tablet report, sending...
I20260709 13:04:10.264031 12543 ts_manager.cc:194] Registered new tserver with Master: 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:10.264542   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016652582s
I20260709 13:04:10.265555 12543 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35714
I20260709 13:04:10.292739 12543 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35726:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:10.295398 12543 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:10.376061 12783 tablet_service.cc:1511] Processing CreateTablet for tablet 74e0edbc4dc04ed8a79a914e02caf263 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:10.377228 12781 tablet_service.cc:1511] Processing CreateTablet for tablet 9073139f562f4aabb2d9b7dffd47f6ec (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:10.379496 12782 tablet_service.cc:1511] Processing CreateTablet for tablet f43cd671499b4d4d8be09a7cc55b66de (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:10.381668 12635 tablet_service.cc:1511] Processing CreateTablet for tablet cfd32413649e46b884db77340c4aff7d (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:10.383153 12635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd32413649e46b884db77340c4aff7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.385214 12710 tablet_service.cc:1511] Processing CreateTablet for tablet cfd32413649e46b884db77340c4aff7d (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:10.385844 12633 tablet_service.cc:1511] Processing CreateTablet for tablet f43cd671499b4d4d8be09a7cc55b66de (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:10.386706 12710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd32413649e46b884db77340c4aff7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.387181 12633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43cd671499b4d4d8be09a7cc55b66de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.386924 12705 tablet_service.cc:1511] Processing CreateTablet for tablet f1f31759f39a4c65a7ae9217aaa2355f (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:10.388293 12705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f31759f39a4c65a7ae9217aaa2355f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.389746 12632 tablet_service.cc:1511] Processing CreateTablet for tablet 9073139f562f4aabb2d9b7dffd47f6ec (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:10.390097 12780 tablet_service.cc:1511] Processing CreateTablet for tablet 333f6ad50d5d4cd9a9aa980c1cbc8f53 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:10.391211 12632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9073139f562f4aabb2d9b7dffd47f6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.392868 12779 tablet_service.cc:1511] Processing CreateTablet for tablet f1f31759f39a4c65a7ae9217aaa2355f (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:10.393810 12631 tablet_service.cc:1511] Processing CreateTablet for tablet 333f6ad50d5d4cd9a9aa980c1cbc8f53 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:10.395176 12631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333f6ad50d5d4cd9a9aa980c1cbc8f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.395958 12629 tablet_service.cc:1511] Processing CreateTablet for tablet 6e8f5a8003ef4d81b9f1ab02263de490 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:10.397372 12629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e8f5a8003ef4d81b9f1ab02263de490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.397704 12707 tablet_service.cc:1511] Processing CreateTablet for tablet 9073139f562f4aabb2d9b7dffd47f6ec (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:10.399076 12707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9073139f562f4aabb2d9b7dffd47f6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.401717 12706 tablet_service.cc:1511] Processing CreateTablet for tablet 333f6ad50d5d4cd9a9aa980c1cbc8f53 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:10.405148 12627 tablet_service.cc:1511] Processing CreateTablet for tablet e97bba1f73154672819b263e307c69d3 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:10.405612 12702 tablet_service.cc:1511] Processing CreateTablet for tablet e97bba1f73154672819b263e307c69d3 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:10.406916 12627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97bba1f73154672819b263e307c69d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.407094 12702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97bba1f73154672819b263e307c69d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.402482 12628 tablet_service.cc:1511] Processing CreateTablet for tablet 47760b9cf0d9421e92b08e9364e5c010 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:10.409708 12704 tablet_service.cc:1511] Processing CreateTablet for tablet 6e8f5a8003ef4d81b9f1ab02263de490 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:10.411609 12778 tablet_service.cc:1511] Processing CreateTablet for tablet 6e8f5a8003ef4d81b9f1ab02263de490 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:10.413795 12708 tablet_service.cc:1511] Processing CreateTablet for tablet f43cd671499b4d4d8be09a7cc55b66de (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:10.414644 12777 tablet_service.cc:1511] Processing CreateTablet for tablet 47760b9cf0d9421e92b08e9364e5c010 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:10.415784 12634 tablet_service.cc:1511] Processing CreateTablet for tablet 74e0edbc4dc04ed8a79a914e02caf263 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:10.417833 12784 tablet_service.cc:1511] Processing CreateTablet for tablet cfd32413649e46b884db77340c4aff7d (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:10.418720 12776 tablet_service.cc:1511] Processing CreateTablet for tablet e97bba1f73154672819b263e307c69d3 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:10.419697 12703 tablet_service.cc:1511] Processing CreateTablet for tablet 47760b9cf0d9421e92b08e9364e5c010 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:10.389747 12709 tablet_service.cc:1511] Processing CreateTablet for tablet 74e0edbc4dc04ed8a79a914e02caf263 (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:10.411967 12630 tablet_service.cc:1511] Processing CreateTablet for tablet f1f31759f39a4c65a7ae9217aaa2355f (DEFAULT_TABLE table=test-workload [id=5d8b77767ae44753a15056f79458c7fc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:10.409767 12628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47760b9cf0d9421e92b08e9364e5c010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.426765 12630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f31759f39a4c65a7ae9217aaa2355f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.377720 12783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e0edbc4dc04ed8a79a914e02caf263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.428002 12634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e0edbc4dc04ed8a79a914e02caf263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.428258 12780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333f6ad50d5d4cd9a9aa980c1cbc8f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.428994 12781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9073139f562f4aabb2d9b7dffd47f6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.429616 12777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47760b9cf0d9421e92b08e9364e5c010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.434893 12704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e8f5a8003ef4d81b9f1ab02263de490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.436174 12776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97bba1f73154672819b263e307c69d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.436308 12703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47760b9cf0d9421e92b08e9364e5c010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.440788 12708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43cd671499b4d4d8be09a7cc55b66de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.444362 12706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333f6ad50d5d4cd9a9aa980c1cbc8f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.452993 12709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e0edbc4dc04ed8a79a914e02caf263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.453972 12782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43cd671499b4d4d8be09a7cc55b66de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.456976 12784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd32413649e46b884db77340c4aff7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.466025 12779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f31759f39a4c65a7ae9217aaa2355f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.469004 12778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e8f5a8003ef4d81b9f1ab02263de490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.469611 12834 tablet_bootstrap.cc:492] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:10.489429 12835 tablet_bootstrap.cc:492] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:10.476456 12834 tablet_bootstrap.cc:654] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.562017 12836 tablet_bootstrap.cc:492] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:10.609195 12835 tablet_bootstrap.cc:654] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.617343 12836 tablet_bootstrap.cc:654] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.636803 12834 tablet_bootstrap.cc:492] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:10.637346 12834 ts_tablet_manager.cc:1403] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.168s	user 0.026s	sys 0.000s
I20260709 13:04:10.640828 12835 tablet_bootstrap.cc:492] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:10.641417 12835 ts_tablet_manager.cc:1403] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.152s	user 0.011s	sys 0.009s
I20260709 13:04:10.643081 12836 tablet_bootstrap.cc:492] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:10.643747 12836 ts_tablet_manager.cc:1403] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.004s
I20260709 13:04:10.644642 12834 raft_consensus.cc:359] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.645008 12835 raft_consensus.cc:359] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.645756 12834 raft_consensus.cc:385] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.645980 12835 raft_consensus.cc:385] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.646628 12835 raft_consensus.cc:740] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.647280 12836 raft_consensus.cc:359] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.648176 12836 raft_consensus.cc:385] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.647680 12835 consensus_queue.cc:260] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.648515 12836 raft_consensus.cc:740] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.646116 12834 raft_consensus.cc:740] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.649544 12836 consensus_queue.cc:260] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.650449 12670 heartbeater.cc:499] Master 127.0.107.254:41207 was elected leader, sending a full tablet report...
I20260709 13:04:10.650964 12835 ts_tablet_manager.cc:1434] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:04:10.652160 12835 tablet_bootstrap.cc:492] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:10.653025 12836 ts_tablet_manager.cc:1434] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:04:10.653985 12819 heartbeater.cc:499] Master 127.0.107.254:41207 was elected leader, sending a full tablet report...
I20260709 13:04:10.656052 12836 tablet_bootstrap.cc:492] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:10.659340 12835 tablet_bootstrap.cc:654] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.663033 12836 tablet_bootstrap.cc:654] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.668869 12834 consensus_queue.cc:260] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.677934 12834 ts_tablet_manager.cc:1434] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 13:04:10.680812 12840 raft_consensus.cc:493] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.681622 12840 raft_consensus.cc:515] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.688181 12840 leader_election.cc:290] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:10.694542 12745 heartbeater.cc:499] Master 127.0.107.254:41207 was elected leader, sending a full tablet report...
I20260709 13:04:10.713737 12834 tablet_bootstrap.cc:492] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:10.736542 12835 tablet_bootstrap.cc:492] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:10.737484 12835 ts_tablet_manager.cc:1403] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.086s	user 0.029s	sys 0.054s
I20260709 13:04:10.738917 12836 tablet_bootstrap.cc:492] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:10.739598 12836 ts_tablet_manager.cc:1403] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.084s	user 0.026s	sys 0.049s
I20260709 13:04:10.743230 12835 raft_consensus.cc:359] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.744302 12835 raft_consensus.cc:385] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.744704 12835 raft_consensus.cc:740] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.744899 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97bba1f73154672819b263e307c69d3" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:10.745857 12835 consensus_queue.cc:260] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
W20260709 13:04:10.746776 12608 leader_election.cc:343] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:10.747833 12671 tablet.cc:2406] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:10.748278 12835 ts_tablet_manager.cc:1434] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:04:10.748112 12836 raft_consensus.cc:359] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.749500 12835 tablet_bootstrap.cc:492] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:10.749032 12836 raft_consensus.cc:385] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.750231 12836 raft_consensus.cc:740] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.751579 12836 consensus_queue.cc:260] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.753930 12836 ts_tablet_manager.cc:1434] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:04:10.755072 12836 tablet_bootstrap.cc:492] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:10.758389 12835 tablet_bootstrap.cc:654] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.765043 12836 tablet_bootstrap.cc:654] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.770424 12834 tablet_bootstrap.cc:654] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.776700 12841 raft_consensus.cc:493] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.777531 12841 raft_consensus.cc:515] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.787626 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97bba1f73154672819b263e307c69d3" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
W20260709 13:04:10.789381 12608 leader_election.cc:343] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.789868 12608 leader_election.cc:304] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a
I20260709 13:04:10.791095 12840 raft_consensus.cc:2749] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:10.797546 12835 tablet_bootstrap.cc:492] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:10.798331 12835 ts_tablet_manager.cc:1403] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.004s
I20260709 13:04:10.797940 12645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43cd671499b4d4d8be09a7cc55b66de" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
W20260709 13:04:10.800650 12759 leader_election.cc:343] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.801479 12841 leader_election.cc:290] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:10.801980 12835 raft_consensus.cc:359] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.802968 12835 raft_consensus.cc:385] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.803326 12835 raft_consensus.cc:740] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.804286 12835 consensus_queue.cc:260] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.807443 12835 ts_tablet_manager.cc:1434] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:10.808712 12835 tablet_bootstrap.cc:492] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
W20260709 13:04:10.814795 12590 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:10.816192 12835 tablet_bootstrap.cc:654] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.822018 12835 tablet_bootstrap.cc:492] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:10.822628 12835 ts_tablet_manager.cc:1403] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:04:10.825373 12836 tablet_bootstrap.cc:492] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:10.825984 12836 ts_tablet_manager.cc:1403] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.041s
I20260709 13:04:10.825951 12835 raft_consensus.cc:359] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.826757 12834 tablet_bootstrap.cc:492] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:10.827108 12835 raft_consensus.cc:385] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.827492 12835 raft_consensus.cc:740] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.828603 12835 consensus_queue.cc:260] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.829902 12836 raft_consensus.cc:359] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.830686 12836 raft_consensus.cc:385] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.831117 12836 raft_consensus.cc:740] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.831264 12835 ts_tablet_manager.cc:1434] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:04:10.832486 12835 tablet_bootstrap.cc:492] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:10.832322 12836 consensus_queue.cc:260] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.841850 12835 tablet_bootstrap.cc:654] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.842761 12836 ts_tablet_manager.cc:1434] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:04:10.827512 12834 ts_tablet_manager.cc:1403] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.114s	user 0.018s	sys 0.000s
I20260709 13:04:10.848806 12835 tablet_bootstrap.cc:492] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:10.849375 12835 ts_tablet_manager.cc:1403] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:04:10.849592 12836 tablet_bootstrap.cc:492] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:10.849210 12834 raft_consensus.cc:359] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } }
I20260709 13:04:10.850067 12834 raft_consensus.cc:385] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.850426 12834 raft_consensus.cc:740] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.851255 12834 consensus_queue.cc:260] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } }
I20260709 13:04:10.852093 12835 raft_consensus.cc:359] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.852991 12835 raft_consensus.cc:385] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.853291 12835 raft_consensus.cc:740] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.853636 12834 ts_tablet_manager.cc:1434] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:10.854197 12835 consensus_queue.cc:260] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.854857 12834 tablet_bootstrap.cc:492] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:10.859387 12835 ts_tablet_manager.cc:1434] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:04:10.860389 12836 tablet_bootstrap.cc:654] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.860522 12835 tablet_bootstrap.cc:492] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:10.861176 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43cd671499b4d4d8be09a7cc55b66de" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
W20260709 13:04:10.865620 12757 leader_election.cc:343] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.866385 12757 leader_election.cc:304] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a; no voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:10.868270 12841 raft_consensus.cc:2749] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:10.869720 12835 tablet_bootstrap.cc:654] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.874058 12836 tablet_bootstrap.cc:492] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:10.874624 12836 ts_tablet_manager.cc:1403] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.010s
I20260709 13:04:10.874871 12834 tablet_bootstrap.cc:654] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.878319 12836 raft_consensus.cc:359] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.879590 12836 raft_consensus.cc:385] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.880200 12836 raft_consensus.cc:740] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.881783 12836 consensus_queue.cc:260] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.888078 12834 tablet_bootstrap.cc:492] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:10.888433 12836 ts_tablet_manager.cc:1434] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:04:10.888805 12834 ts_tablet_manager.cc:1403] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.010s
I20260709 13:04:10.889128 12835 tablet_bootstrap.cc:492] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:10.889575 12836 tablet_bootstrap.cc:492] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:10.889686 12835 ts_tablet_manager.cc:1403] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.016s
I20260709 13:04:10.891999 12834 raft_consensus.cc:359] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.892851 12834 raft_consensus.cc:385] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.893217 12834 raft_consensus.cc:740] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.892925 12835 raft_consensus.cc:359] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.894075 12835 raft_consensus.cc:385] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.894456 12835 raft_consensus.cc:740] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.894178 12834 consensus_queue.cc:260] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.895408 12835 consensus_queue.cc:260] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.897017 12836 tablet_bootstrap.cc:654] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.900291 12835 ts_tablet_manager.cc:1434] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:10.901373 12835 tablet_bootstrap.cc:492] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:10.905673 12834 ts_tablet_manager.cc:1434] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:04:10.907668 12835 tablet_bootstrap.cc:654] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.916390 12834 tablet_bootstrap.cc:492] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:10.918398 12835 tablet_bootstrap.cc:492] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:10.918972 12835 ts_tablet_manager.cc:1403] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 13:04:10.921718 12835 raft_consensus.cc:359] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.922327 12835 raft_consensus.cc:385] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.922644 12835 raft_consensus.cc:740] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.923286 12835 consensus_queue.cc:260] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.923604 12836 tablet_bootstrap.cc:492] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:10.924292 12836 ts_tablet_manager.cc:1403] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.023s
I20260709 13:04:10.925542 12835 ts_tablet_manager.cc:1434] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:10.926013 12834 tablet_bootstrap.cc:654] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.926705 12835 tablet_bootstrap.cc:492] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:10.927551 12836 raft_consensus.cc:359] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.928364 12836 raft_consensus.cc:385] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.928694 12836 raft_consensus.cc:740] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.929905 12836 consensus_queue.cc:260] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.934412 12835 tablet_bootstrap.cc:654] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.936992 12836 ts_tablet_manager.cc:1434] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:04:10.938199 12836 tablet_bootstrap.cc:492] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:10.939910 12835 tablet_bootstrap.cc:492] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:10.940519 12835 ts_tablet_manager.cc:1403] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:04:10.943399 12835 raft_consensus.cc:359] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.944223 12835 raft_consensus.cc:385] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.944384 12834 tablet_bootstrap.cc:492] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:10.944622 12835 raft_consensus.cc:740] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.945120 12834 ts_tablet_manager.cc:1403] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.000s
I20260709 13:04:10.945129 12836 tablet_bootstrap.cc:654] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.945920 12835 consensus_queue.cc:260] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.948110 12835 ts_tablet_manager.cc:1434] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:10.949167 12835 tablet_bootstrap.cc:492] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:10.948746 12834 raft_consensus.cc:359] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.949872 12834 raft_consensus.cc:385] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.950907 12840 raft_consensus.cc:493] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.951664 12840 raft_consensus.cc:515] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.956130 12835 tablet_bootstrap.cc:654] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.958751 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333f6ad50d5d4cd9a9aa980c1cbc8f53" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
W20260709 13:04:10.960913 12608 leader_election.cc:343] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.962075 12835 tablet_bootstrap.cc:492] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:10.962564 12835 ts_tablet_manager.cc:1403] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:04:10.955780 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333f6ad50d5d4cd9a9aa980c1cbc8f53" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
I20260709 13:04:10.964843 12840 leader_election.cc:290] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:10.964556 12835 raft_consensus.cc:359] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } }
I20260709 13:04:10.965487 12835 raft_consensus.cc:385] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.950317 12834 raft_consensus.cc:740] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.965994 12835 raft_consensus.cc:740] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
W20260709 13:04:10.966483 12608 leader_election.cc:343] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.966733 12835 consensus_queue.cc:260] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } }
I20260709 13:04:10.966733 12834 consensus_queue.cc:260] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.967211 12608 leader_election.cc:304] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a
I20260709 13:04:10.968521 12840 raft_consensus.cc:2749] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:10.969388 12835 ts_tablet_manager.cc:1434] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:04:10.972851 12834 ts_tablet_manager.cc:1434] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:04:10.973830 12834 tablet_bootstrap.cc:492] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:10.982673 12836 tablet_bootstrap.cc:492] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:10.983422 12836 ts_tablet_manager.cc:1403] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.018s
I20260709 13:04:10.986967 12836 raft_consensus.cc:359] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.987778 12836 raft_consensus.cc:385] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.988106 12836 raft_consensus.cc:740] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.989370 12834 tablet_bootstrap.cc:654] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.988974 12836 consensus_queue.cc:260] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:10.991863 12836 ts_tablet_manager.cc:1434] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:10.993034 12836 tablet_bootstrap.cc:492] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:10.995177 12834 tablet_bootstrap.cc:492] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:10.995942 12834 ts_tablet_manager.cc:1403] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.003s
I20260709 13:04:10.998485 12836 tablet_bootstrap.cc:654] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.999285 12834 raft_consensus.cc:359] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.000448 12834 raft_consensus.cc:385] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.000977 12834 raft_consensus.cc:740] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.001938 12834 consensus_queue.cc:260] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.010092 12834 ts_tablet_manager.cc:1434] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:04:11.011078 12834 tablet_bootstrap.cc:492] T 9073139f562f4aabb2d9b7dffd47f6ec P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:11.012406 12836 tablet_bootstrap.cc:492] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:11.013054 12836 ts_tablet_manager.cc:1403] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:04:11.014552 12862 raft_consensus.cc:493] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.015174 12862 raft_consensus.cc:515] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.016825 12836 raft_consensus.cc:359] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.017645 12862 leader_election.cc:290] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.018342 12844 raft_consensus.cc:493] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.017728 12836 raft_consensus.cc:385] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.018950 12836 raft_consensus.cc:740] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.018810 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9073139f562f4aabb2d9b7dffd47f6ec" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:11.017753 12834 tablet_bootstrap.cc:654] T 9073139f562f4aabb2d9b7dffd47f6ec P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.018849 12844 raft_consensus.cc:515] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.019932 12836 consensus_queue.cc:260] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.023931 12836 ts_tablet_manager.cc:1434] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:04:11.025483 12836 tablet_bootstrap.cc:492] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:11.019663 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9073139f562f4aabb2d9b7dffd47f6ec" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
W20260709 13:04:11.027842 12608 leader_election.cc:343] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.018854 12841 raft_consensus.cc:493] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.028869 12841 raft_consensus.cc:515] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.031558 12794 raft_consensus.cc:2468] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 0.
I20260709 13:04:11.032824 12836 tablet_bootstrap.cc:654] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.035939 12645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9073139f562f4aabb2d9b7dffd47f6ec" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:11.036958 12645 raft_consensus.cc:2468] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 0.
I20260709 13:04:11.038851 12608 leader_election.cc:304] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:11.041428 12759 leader_election.cc:304] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:11.045666 12865 raft_consensus.cc:2804] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.046684 12865 raft_consensus.cc:493] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.048010 12865 raft_consensus.cc:3060] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.054906 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9073139f562f4aabb2d9b7dffd47f6ec" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
I20260709 13:04:11.059285 12844 leader_election.cc:290] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.058802 12841 leader_election.cc:290] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:11.059710 12862 raft_consensus.cc:2804] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:11.062889 12757 leader_election.cc:343] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.064325 12836 tablet_bootstrap.cc:492] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:11.064921 12836 ts_tablet_manager.cc:1403] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.023s
I20260709 13:04:11.063894 12862 raft_consensus.cc:493] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.065990 12862 raft_consensus.cc:3060] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.068523 12865 raft_consensus.cc:515] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.071012 12836 raft_consensus.cc:359] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } }
I20260709 13:04:11.071795 12844 raft_consensus.cc:493] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.071925 12645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9073139f562f4aabb2d9b7dffd47f6ec" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:11.072679 12844 raft_consensus.cc:515] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } }
I20260709 13:04:11.074450 12834 tablet_bootstrap.cc:492] T 9073139f562f4aabb2d9b7dffd47f6ec P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:11.074747 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9073139f562f4aabb2d9b7dffd47f6ec" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:11.075021 12834 ts_tablet_manager.cc:1403] T 9073139f562f4aabb2d9b7dffd47f6ec P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.030s
I20260709 13:04:11.075109 12862 raft_consensus.cc:515] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
W20260709 13:04:11.076254 12757 leader_election.cc:343] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.075162 12844 leader_election.cc:290] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369), b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221)
I20260709 13:04:11.077210 12865 leader_election.cc:290] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:11.077595 12645 raft_consensus.cc:2393] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 989e9a004b914452b13703cdfc705a2a in current term 1: Already voted for candidate b6eb7b81fa3f4375a84d1c4a972df45c in this term.
I20260709 13:04:11.078305 12834 raft_consensus.cc:359] T 9073139f562f4aabb2d9b7dffd47f6ec P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.078966 12834 raft_consensus.cc:385] T 9073139f562f4aabb2d9b7dffd47f6ec P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.079396 12834 raft_consensus.cc:740] T 9073139f562f4aabb2d9b7dffd47f6ec P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.071797 12836 raft_consensus.cc:385] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.080832 12836 raft_consensus.cc:740] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.080615 12759 leader_election.cc:304] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a; no voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:11.080367 12834 consensus_queue.cc:260] T 9073139f562f4aabb2d9b7dffd47f6ec P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.081678 12836 consensus_queue.cc:260] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } }
I20260709 13:04:11.083222 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd32413649e46b884db77340c4aff7d" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:11.084172 12644 raft_consensus.cc:2468] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 0.
I20260709 13:04:11.084973 12834 ts_tablet_manager.cc:1434] T 9073139f562f4aabb2d9b7dffd47f6ec P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:04:11.085498 12685 leader_election.cc:304] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:11.086302 12834 tablet_bootstrap.cc:492] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:11.080613 12844 raft_consensus.cc:493] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.088997 12844 raft_consensus.cc:515] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.085058 12645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47760b9cf0d9421e92b08e9364e5c010" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:11.091718 12645 raft_consensus.cc:2468] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 0.
I20260709 13:04:11.091840 12844 leader_election.cc:290] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.095427 12834 tablet_bootstrap.cc:654] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.095222 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9073139f562f4aabb2d9b7dffd47f6ec" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:11.096150 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9073139f562f4aabb2d9b7dffd47f6ec" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:11.097007 12720 raft_consensus.cc:3060] T 9073139f562f4aabb2d9b7dffd47f6ec P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.097035 12794 raft_consensus.cc:2393] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b6eb7b81fa3f4375a84d1c4a972df45c in current term 1: Already voted for candidate 989e9a004b914452b13703cdfc705a2a in this term.
I20260709 13:04:11.095332 12862 leader_election.cc:290] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Requested vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.092550 12844 raft_consensus.cc:2804] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.100441 12844 raft_consensus.cc:493] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.100859 12844 raft_consensus.cc:3060] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.103302 12793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd32413649e46b884db77340c4aff7d" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:11.104130 12793 raft_consensus.cc:2468] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 0.
I20260709 13:04:11.105266 12792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f31759f39a4c65a7ae9217aaa2355f" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:11.106071 12792 raft_consensus.cc:2468] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 0.
I20260709 13:04:11.107919 12683 leader_election.cc:304] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a; no voters: 
I20260709 13:04:11.109174 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47760b9cf0d9421e92b08e9364e5c010" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:11.109866 12836 ts_tablet_manager.cc:1434] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:04:11.109405 12844 raft_consensus.cc:515] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } }
I20260709 13:04:11.110074 12794 raft_consensus.cc:2468] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 0.
I20260709 13:04:11.111068 12836 tablet_bootstrap.cc:492] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:11.111687 12683 leader_election.cc:304] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a; no voters: 
I20260709 13:04:11.111869 12844 leader_election.cc:290] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 election: Requested vote from peers 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369), b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221)
I20260709 13:04:11.112517 12844 raft_consensus.cc:2804] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.112903 12844 raft_consensus.cc:493] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.113245 12844 raft_consensus.cc:3060] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.113799 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd32413649e46b884db77340c4aff7d" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:11.114490 12794 raft_consensus.cc:3060] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.118206 12836 tablet_bootstrap.cc:654] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.118911 12645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f31759f39a4c65a7ae9217aaa2355f" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:11.118440 12865 raft_consensus.cc:2749] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.120702 12645 raft_consensus.cc:2468] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 0.
I20260709 13:04:11.118810 12871 raft_consensus.cc:2804] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.121284 12844 raft_consensus.cc:515] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.122937 12645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd32413649e46b884db77340c4aff7d" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:11.123467 12844 leader_election.cc:290] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.123587 12645 raft_consensus.cc:3060] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.121606 12871 raft_consensus.cc:493] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.124301 12871 raft_consensus.cc:3060] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.125986 12792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f31759f39a4c65a7ae9217aaa2355f" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:11.126641 12792 raft_consensus.cc:3060] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.131458 12794 raft_consensus.cc:2468] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 1.
I20260709 13:04:11.134506 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f31759f39a4c65a7ae9217aaa2355f" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:11.135255 12644 raft_consensus.cc:3060] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.134195 12720 raft_consensus.cc:2468] T 9073139f562f4aabb2d9b7dffd47f6ec P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 1.
I20260709 13:04:11.137034 12683 leader_election.cc:304] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a; no voters: 
I20260709 13:04:11.139529 12872 raft_consensus.cc:2804] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.140324 12872 raft_consensus.cc:697] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Becoming Leader. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:11.141311 12872 consensus_queue.cc:237] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } }
I20260709 13:04:11.147424 12844 raft_consensus.cc:493] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.147959 12844 raft_consensus.cc:515] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.150202 12844 leader_election.cc:290] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.152524 12643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e0edbc4dc04ed8a79a914e02caf263" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:11.153409 12643 raft_consensus.cc:2468] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 0.
I20260709 13:04:11.153931 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e0edbc4dc04ed8a79a914e02caf263" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:11.154812 12685 leader_election.cc:304] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:11.154949 12794 raft_consensus.cc:2468] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 0.
I20260709 13:04:11.155754 12645 raft_consensus.cc:2468] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 1.
I20260709 13:04:11.155922 12844 raft_consensus.cc:2804] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.157215 12792 raft_consensus.cc:2468] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 1.
I20260709 13:04:11.156420 12844 raft_consensus.cc:493] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.157996 12844 raft_consensus.cc:3060] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.158814 12683 leader_election.cc:304] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a; no voters: 
I20260709 13:04:11.159559 12836 tablet_bootstrap.cc:492] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:11.160115 12836 ts_tablet_manager.cc:1403] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.001s
I20260709 13:04:11.163054 12836 raft_consensus.cc:359] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.169872 12608 leader_election.cc:304] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 989e9a004b914452b13703cdfc705a2a
I20260709 13:04:11.170281 12836 raft_consensus.cc:385] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.170570 12836 raft_consensus.cc:740] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.171279 12840 raft_consensus.cc:2804] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.163445 12862 raft_consensus.cc:493] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.171279 12836 consensus_queue.cc:260] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.172861 12862 raft_consensus.cc:515] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.174960 12836 ts_tablet_manager.cc:1434] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:04:11.169127 12644 raft_consensus.cc:2468] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 1.
I20260709 13:04:11.165273 12871 raft_consensus.cc:515] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.180852 12862 leader_election.cc:290] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.181071 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f5a8003ef4d81b9f1ab02263de490" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
I20260709 13:04:11.181911 12792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f5a8003ef4d81b9f1ab02263de490" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:11.187338 12792 raft_consensus.cc:2468] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 0.
I20260709 13:04:11.188455 12871 leader_election.cc:290] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
W20260709 13:04:11.189106 12608 leader_election.cc:343] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.190145 12792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47760b9cf0d9421e92b08e9364e5c010" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:11.190762 12608 leader_election.cc:304] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:11.190820 12792 raft_consensus.cc:3060] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.191088 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47760b9cf0d9421e92b08e9364e5c010" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:11.166136 12844 raft_consensus.cc:515] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.192545 12644 raft_consensus.cc:3060] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.194408 12844 leader_election.cc:290] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.186398 12834 tablet_bootstrap.cc:492] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:11.195318 12834 ts_tablet_manager.cc:1403] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.109s	user 0.022s	sys 0.056s
I20260709 13:04:11.195140 12645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e0edbc4dc04ed8a79a914e02caf263" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:11.195921 12645 raft_consensus.cc:3060] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.198624 12834 raft_consensus.cc:359] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.199355 12792 raft_consensus.cc:2468] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 1.
I20260709 13:04:11.191040 12540 catalog_manager.cc:5697] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a517ba6254c4619a53d8a220316793e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8a517ba6254c4619a53d8a220316793e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.199492 12834 raft_consensus.cc:385] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.200667 12834 raft_consensus.cc:740] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.201489 12792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e0edbc4dc04ed8a79a914e02caf263" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:11.192028 12862 raft_consensus.cc:2804] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.201627 12834 consensus_queue.cc:260] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.202545 12792 raft_consensus.cc:3060] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.204281 12834 ts_tablet_manager.cc:1434] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:11.202548 12862 raft_consensus.cc:493] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.205205 12862 raft_consensus.cc:3060] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.205664 12834 tablet_bootstrap.cc:492] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:11.209314 12683 leader_election.cc:304] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a; no voters: 
I20260709 13:04:11.210757 12871 raft_consensus.cc:2804] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.184847 12876 raft_consensus.cc:2804] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.213600 12876 raft_consensus.cc:697] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Becoming Leader. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:11.215180 12645 raft_consensus.cc:2468] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 1.
I20260709 13:04:11.215049 12876 consensus_queue.cc:237] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.214464 12871 raft_consensus.cc:697] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Becoming Leader. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:11.216410 12685 leader_election.cc:304] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:11.217694 12844 raft_consensus.cc:2804] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.220955 12862 raft_consensus.cc:515] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.222213 12844 raft_consensus.cc:697] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Becoming Leader. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:11.223483 12862 leader_election.cc:290] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Requested vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.223284 12844 consensus_queue.cc:237] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.225136 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f5a8003ef4d81b9f1ab02263de490" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:11.225137 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f5a8003ef4d81b9f1ab02263de490" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:11.226186 12794 raft_consensus.cc:3060] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:11.227160 12608 leader_election.cc:343] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.218564 12871 consensus_queue.cc:237] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.230079 12644 raft_consensus.cc:2468] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 1.
I20260709 13:04:11.230576 12792 raft_consensus.cc:2468] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 1.
I20260709 13:04:11.234364 12834 tablet_bootstrap.cc:654] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.241794 12794 raft_consensus.cc:2468] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 1.
I20260709 13:04:11.235366 12840 raft_consensus.cc:697] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Becoming Leader. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:11.249922 12608 leader_election.cc:304] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:11.249912 12840 consensus_queue.cc:237] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.251947 12877 raft_consensus.cc:2804] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.252795 12877 raft_consensus.cc:697] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Becoming Leader. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:11.254392 12877 consensus_queue.cc:237] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.257422 12834 tablet_bootstrap.cc:492] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:11.258402 12834 ts_tablet_manager.cc:1403] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.009s
I20260709 13:04:11.262735 12834 raft_consensus.cc:359] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.263727 12834 raft_consensus.cc:385] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.264091 12834 raft_consensus.cc:740] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.265102 12834 consensus_queue.cc:260] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.269647 12834 ts_tablet_manager.cc:1434] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:11.270680 12834 tablet_bootstrap.cc:492] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:11.274211 12539 catalog_manager.cc:5697] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c reported cstate change: term changed from 0 to 1, leader changed from <none> to b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.274786 12540 catalog_manager.cc:5697] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a517ba6254c4619a53d8a220316793e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8a517ba6254c4619a53d8a220316793e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.276497 12834 tablet_bootstrap.cc:654] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.279542 12540 catalog_manager.cc:5697] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a517ba6254c4619a53d8a220316793e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8a517ba6254c4619a53d8a220316793e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.282078 12834 tablet_bootstrap.cc:492] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:11.281438 12540 catalog_manager.cc:5697] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a517ba6254c4619a53d8a220316793e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8a517ba6254c4619a53d8a220316793e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.282238 12840 raft_consensus.cc:493] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.282917 12840 raft_consensus.cc:515] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.284307 12834 ts_tablet_manager.cc:1403] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:04:11.286448 12840 leader_election.cc:290] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.287777 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43cd671499b4d4d8be09a7cc55b66de" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
I20260709 13:04:11.288152 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43cd671499b4d4d8be09a7cc55b66de" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:11.288893 12794 raft_consensus.cc:2468] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 0.
W20260709 13:04:11.289466 12608 leader_election.cc:343] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.290249 12608 leader_election.cc:304] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:11.291455 12840 raft_consensus.cc:2804] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.291365 12834 raft_consensus.cc:359] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.292052 12840 raft_consensus.cc:493] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.292274 12834 raft_consensus.cc:385] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.292661 12840 raft_consensus.cc:3060] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.292632 12834 raft_consensus.cc:740] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.291740 12539 catalog_manager.cc:5697] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c reported cstate change: term changed from 0 to 1, leader changed from <none> to b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.294004 12834 consensus_queue.cc:260] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.294848 12871 raft_consensus.cc:493] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.295401 12871 raft_consensus.cc:515] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.296285 12834 ts_tablet_manager.cc:1434] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:04:11.297645 12871 leader_election.cc:290] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.300357 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f5a8003ef4d81b9f1ab02263de490" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:11.300408 12840 raft_consensus.cc:515] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.301357 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f5a8003ef4d81b9f1ab02263de490" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:11.302182 12794 raft_consensus.cc:2393] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a517ba6254c4619a53d8a220316793e in current term 1: Already voted for candidate b6eb7b81fa3f4375a84d1c4a972df45c in this term.
I20260709 13:04:11.303372 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43cd671499b4d4d8be09a7cc55b66de" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:11.303364 12683 leader_election.cc:304] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e; no voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:11.304221 12720 raft_consensus.cc:3060] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.304491 12871 raft_consensus.cc:3060] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.310220 12840 leader_election.cc:290] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Requested vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.311347 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43cd671499b4d4d8be09a7cc55b66de" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:11.312011 12794 raft_consensus.cc:3060] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.313799 12720 raft_consensus.cc:2468] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 1.
I20260709 13:04:11.313910 12871 raft_consensus.cc:2749] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.314990 12608 leader_election.cc:304] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:11.315690 12840 raft_consensus.cc:2804] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.316187 12840 raft_consensus.cc:697] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Becoming Leader. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:11.317050 12840 consensus_queue.cc:237] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.319142 12794 raft_consensus.cc:2468] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 1.
I20260709 13:04:11.325181 12540 catalog_manager.cc:5697] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c reported cstate change: term changed from 0 to 1, leader changed from <none> to b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.390359 12871 raft_consensus.cc:493] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.390923 12871 raft_consensus.cc:515] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.392571 12871 leader_election.cc:290] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.393410 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97bba1f73154672819b263e307c69d3" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:11.393621 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97bba1f73154672819b263e307c69d3" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:11.394016 12644 raft_consensus.cc:2468] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 0.
I20260709 13:04:11.394289 12794 raft_consensus.cc:2468] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 0.
I20260709 13:04:11.395051 12685 leader_election.cc:304] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:11.395750 12871 raft_consensus.cc:2804] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.396144 12871 raft_consensus.cc:493] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.396426 12871 raft_consensus.cc:3060] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.401705 12871 raft_consensus.cc:515] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.403532 12871 leader_election.cc:290] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.404366 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97bba1f73154672819b263e307c69d3" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:11.404565 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97bba1f73154672819b263e307c69d3" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:11.405031 12644 raft_consensus.cc:3060] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.405180 12794 raft_consensus.cc:3060] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.411299 12794 raft_consensus.cc:2468] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 1.
I20260709 13:04:11.411293 12644 raft_consensus.cc:2468] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 1.
I20260709 13:04:11.412616 12683 leader_election.cc:304] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a; no voters: 
I20260709 13:04:11.413444 12871 raft_consensus.cc:2804] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.413956 12871 raft_consensus.cc:697] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Becoming Leader. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:11.414659 12871 consensus_queue.cc:237] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.422593 12540 catalog_manager.cc:5697] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a517ba6254c4619a53d8a220316793e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8a517ba6254c4619a53d8a220316793e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.577920 12871 raft_consensus.cc:493] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.578502 12871 raft_consensus.cc:515] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.581014 12871 leader_election.cc:290] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.581759 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333f6ad50d5d4cd9a9aa980c1cbc8f53" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:11.582065 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333f6ad50d5d4cd9a9aa980c1cbc8f53" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:11.582410 12644 raft_consensus.cc:2468] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 0.
I20260709 13:04:11.582864 12794 raft_consensus.cc:2468] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 0.
I20260709 13:04:11.583588 12685 leader_election.cc:304] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:11.584506 12871 raft_consensus.cc:2804] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.584895 12871 raft_consensus.cc:493] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.585165 12871 raft_consensus.cc:3060] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.590466 12871 raft_consensus.cc:515] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.592272 12871 leader_election.cc:290] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:11.593068 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333f6ad50d5d4cd9a9aa980c1cbc8f53" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:11.593737 12644 raft_consensus.cc:3060] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.593654 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333f6ad50d5d4cd9a9aa980c1cbc8f53" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:11.594460 12794 raft_consensus.cc:3060] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.601558 12794 raft_consensus.cc:2468] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 1.
I20260709 13:04:11.601558 12644 raft_consensus.cc:2468] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 1.
I20260709 13:04:11.602988 12685 leader_election.cc:304] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:11.603716 12871 raft_consensus.cc:2804] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.604266 12871 raft_consensus.cc:697] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Becoming Leader. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:11.605427 12871 consensus_queue.cc:237] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:11.613480 12540 catalog_manager.cc:5697] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a517ba6254c4619a53d8a220316793e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8a517ba6254c4619a53d8a220316793e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.614874 12871 consensus_queue.cc:1048] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.629106 12872 consensus_queue.cc:1048] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.634702 12871 consensus_queue.cc:1048] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.649252 12872 consensus_queue.cc:1048] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.701860 12844 consensus_queue.cc:1048] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.712402 12872 consensus_queue.cc:1048] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.713214 12876 consensus_queue.cc:1048] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.731458 12876 consensus_queue.cc:1048] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.778348 12840 consensus_queue.cc:1048] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.791872 12840 consensus_queue.cc:1048] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.814872 12876 consensus_queue.cc:1048] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.820571 12720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfd32413649e46b884db77340c4aff7d"
dest_uuid: "8a517ba6254c4619a53d8a220316793e"
mode: GRACEFUL
new_leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
 from {username='slave'} at 127.0.0.1:44164
I20260709 13:04:11.821265 12720 raft_consensus.cc:606] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Received request to transfer leadership to TS b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:11.825165 12840 consensus_queue.cc:1048] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.827872 12720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74e0edbc4dc04ed8a79a914e02caf263"
dest_uuid: "8a517ba6254c4619a53d8a220316793e"
mode: GRACEFUL
new_leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
 from {username='slave'} at 127.0.0.1:44164
I20260709 13:04:11.828510 12720 raft_consensus.cc:606] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Received request to transfer leadership to TS b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:11.832358 12871 consensus_queue.cc:1048] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.856071 12903 consensus_queue.cc:1048] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.877907 12644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e8f5a8003ef4d81b9f1ab02263de490"
dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
mode: GRACEFUL
new_leader_uuid: "8a517ba6254c4619a53d8a220316793e"
 from {username='slave'} at 127.0.0.1:41408
I20260709 13:04:11.878576 12644 raft_consensus.cc:606] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Received request to transfer leadership to TS 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:11.887511 12720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e97bba1f73154672819b263e307c69d3"
dest_uuid: "8a517ba6254c4619a53d8a220316793e"
mode: GRACEFUL
new_leader_uuid: "989e9a004b914452b13703cdfc705a2a"
 from {username='slave'} at 127.0.0.1:44164
I20260709 13:04:11.888092 12720 raft_consensus.cc:606] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Received request to transfer leadership to TS 989e9a004b914452b13703cdfc705a2a
I20260709 13:04:11.914242 12903 consensus_queue.cc:1048] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.926416 12840 consensus_queue.cc:1048] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.019845 12871 consensus_queue.cc:1048] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.032696 12844 consensus_queue.cc:1048] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.169917 12876 raft_consensus.cc:993] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e: : Instructing follower b6eb7b81fa3f4375a84d1c4a972df45c to start an election
I20260709 13:04:12.170428 12844 raft_consensus.cc:1081] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Signalling peer b6eb7b81fa3f4375a84d1c4a972df45c to start an election
I20260709 13:04:12.172056 12644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74e0edbc4dc04ed8a79a914e02caf263"
dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
 from {username='slave'} at 127.0.0.1:41404
I20260709 13:04:12.172544 12644 raft_consensus.cc:493] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.172845 12644 raft_consensus.cc:3060] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.180393 12644 raft_consensus.cc:515] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:12.183328 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e0edbc4dc04ed8a79a914e02caf263" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:12.183993 12720 raft_consensus.cc:3055] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:12.184219 12792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e0edbc4dc04ed8a79a914e02caf263" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:12.184845 12644 leader_election.cc:290] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 2 election: Requested vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:12.184984 12792 raft_consensus.cc:3060] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.184381 12720 raft_consensus.cc:740] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:12.186643 12720 consensus_queue.cc:260] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:12.188036 12720 raft_consensus.cc:3060] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.193347 12792 raft_consensus.cc:2468] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 2.
I20260709 13:04:12.194864 12608 leader_election.cc:304] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:12.195837 12840 raft_consensus.cc:2804] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.195914 12720 raft_consensus.cc:2468] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 2.
I20260709 13:04:12.196409 12840 raft_consensus.cc:697] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 LEADER]: Becoming Leader. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:12.197547 12840 consensus_queue.cc:237] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:12.200026 12872 raft_consensus.cc:993] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e: : Instructing follower b6eb7b81fa3f4375a84d1c4a972df45c to start an election
I20260709 13:04:12.200855 12844 raft_consensus.cc:1081] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Signalling peer b6eb7b81fa3f4375a84d1c4a972df45c to start an election
I20260709 13:04:12.202674 12644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfd32413649e46b884db77340c4aff7d"
dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
 from {username='slave'} at 127.0.0.1:41404
I20260709 13:04:12.203302 12644 raft_consensus.cc:493] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.203758 12644 raft_consensus.cc:3060] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.206485 12540 catalog_manager.cc:5697] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c reported cstate change: term changed from 1 to 2, leader changed from 8a517ba6254c4619a53d8a220316793e (127.0.107.194) to b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.211241 12644 raft_consensus.cc:515] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } }
I20260709 13:04:12.213459 12644 leader_election.cc:290] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 2 election: Requested vote from peers 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:12.214414 12792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd32413649e46b884db77340c4aff7d" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:12.215099 12792 raft_consensus.cc:3060] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.215170 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd32413649e46b884db77340c4aff7d" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:12.216140 12720 raft_consensus.cc:3055] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:12.216621 12720 raft_consensus.cc:740] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:12.218168 12720 consensus_queue.cc:260] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } }
I20260709 13:04:12.219871 12720 raft_consensus.cc:3060] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.225586 12844 raft_consensus.cc:993] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e: : Instructing follower 989e9a004b914452b13703cdfc705a2a to start an election
I20260709 13:04:12.226413 12844 raft_consensus.cc:1081] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Signalling peer 989e9a004b914452b13703cdfc705a2a to start an election
I20260709 13:04:12.228027 12792 raft_consensus.cc:2468] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 2.
I20260709 13:04:12.229503 12608 leader_election.cc:304] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:12.229652 12794 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e97bba1f73154672819b263e307c69d3"
dest_uuid: "989e9a004b914452b13703cdfc705a2a"
 from {username='slave'} at 127.0.0.1:60468
I20260709 13:04:12.230310 12794 raft_consensus.cc:493] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.230482 12840 raft_consensus.cc:2804] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.230132 12720 raft_consensus.cc:2468] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 2.
I20260709 13:04:12.230858 12794 raft_consensus.cc:3060] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.231325 12840 raft_consensus.cc:697] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 LEADER]: Becoming Leader. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:12.232205 12840 consensus_queue.cc:237] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } }
I20260709 13:04:12.239648 12794 raft_consensus.cc:515] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:12.242130 12794 leader_election.cc:290] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 2 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:12.242482 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97bba1f73154672819b263e307c69d3" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:12.242779 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97bba1f73154672819b263e307c69d3" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:12.243196 12644 raft_consensus.cc:3060] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.243485 12720 raft_consensus.cc:3055] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:12.243876 12720 raft_consensus.cc:740] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:12.244899 12720 consensus_queue.cc:260] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:12.245308 12540 catalog_manager.cc:5697] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c reported cstate change: term changed from 1 to 2, leader changed from 8a517ba6254c4619a53d8a220316793e (127.0.107.194) to b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.246313 12720 raft_consensus.cc:3060] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.250795 12644 raft_consensus.cc:2468] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 2.
I20260709 13:04:12.252135 12759 leader_election.cc:304] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:12.252640 12720 raft_consensus.cc:2468] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 2.
I20260709 13:04:12.253130 12865 raft_consensus.cc:2804] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.254688 12865 raft_consensus.cc:697] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [term 2 LEADER]: Becoming Leader. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Running, Role: LEADER
I20260709 13:04:12.255584 12865 consensus_queue.cc:237] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:12.262670 12540 catalog_manager.cc:5697] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a reported cstate change: term changed from 1 to 2, leader changed from 8a517ba6254c4619a53d8a220316793e (127.0.107.194) to 989e9a004b914452b13703cdfc705a2a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "989e9a004b914452b13703cdfc705a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.364825 12913 raft_consensus.cc:993] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c: : Instructing follower 8a517ba6254c4619a53d8a220316793e to start an election
I20260709 13:04:12.365360 12840 raft_consensus.cc:1081] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Signalling peer 8a517ba6254c4619a53d8a220316793e to start an election
I20260709 13:04:12.366976 12720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e8f5a8003ef4d81b9f1ab02263de490"
dest_uuid: "8a517ba6254c4619a53d8a220316793e"
 from {username='slave'} at 127.0.0.1:44144
I20260709 13:04:12.367568 12720 raft_consensus.cc:493] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.367969 12720 raft_consensus.cc:3060] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.373428 12720 raft_consensus.cc:515] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:12.375087 12720 leader_election.cc:290] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 2 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:12.376045 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f5a8003ef4d81b9f1ab02263de490" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:12.376225 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8f5a8003ef4d81b9f1ab02263de490" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:12.376897 12644 raft_consensus.cc:3055] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:12.376983 12794 raft_consensus.cc:3060] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.377307 12644 raft_consensus.cc:740] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:12.378834 12644 consensus_queue.cc:260] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:12.380338 12644 raft_consensus.cc:3060] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.386477 12794 raft_consensus.cc:2468] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 2.
I20260709 13:04:12.386477 12644 raft_consensus.cc:2468] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 2.
I20260709 13:04:12.388257 12683 leader_election.cc:304] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a; no voters: 
I20260709 13:04:12.389669 12876 raft_consensus.cc:2804] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.390153 12876 raft_consensus.cc:697] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [term 2 LEADER]: Becoming Leader. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:12.391016 12876 consensus_queue.cc:237] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:12.397567 12540 catalog_manager.cc:5697] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e reported cstate change: term changed from 1 to 2, leader changed from b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193) to 8a517ba6254c4619a53d8a220316793e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8a517ba6254c4619a53d8a220316793e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.643646 12720 raft_consensus.cc:1275] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Refusing update from remote peer b6eb7b81fa3f4375a84d1c4a972df45c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.645241 12903 consensus_queue.cc:1048] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.656845 12794 raft_consensus.cc:1275] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Refusing update from remote peer b6eb7b81fa3f4375a84d1c4a972df45c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.658648 12840 consensus_queue.cc:1048] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.686879 12720 raft_consensus.cc:1275] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Refusing update from remote peer b6eb7b81fa3f4375a84d1c4a972df45c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.688265 12840 consensus_queue.cc:1048] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.698832 12794 raft_consensus.cc:1275] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Refusing update from remote peer b6eb7b81fa3f4375a84d1c4a972df45c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.701143 12840 consensus_queue.cc:1048] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.808005 12794 raft_consensus.cc:1275] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Refusing update from remote peer 8a517ba6254c4619a53d8a220316793e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.809535 12876 consensus_queue.cc:1048] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.817795 12644 raft_consensus.cc:1275] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Refusing update from remote peer 8a517ba6254c4619a53d8a220316793e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.819787 12872 consensus_queue.cc:1048] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.838176 12720 raft_consensus.cc:1275] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Refusing update from remote peer 989e9a004b914452b13703cdfc705a2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.839470 12865 consensus_queue.cc:1048] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.855662 12644 raft_consensus.cc:1275] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Refusing update from remote peer 989e9a004b914452b13703cdfc705a2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.857874 12929 consensus_queue.cc:1048] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.927114 12542 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35742:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:14.929917 12542 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:14.990276 12635 tablet_service.cc:1511] Processing CreateTablet for tablet e1a44b2941fb42b1a0a11fe23a8fbabe (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:14.992690 12635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a44b2941fb42b1a0a11fe23a8fbabe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.992198 12708 tablet_service.cc:1511] Processing CreateTablet for tablet e1a44b2941fb42b1a0a11fe23a8fbabe (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:14.994261 12708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a44b2941fb42b1a0a11fe23a8fbabe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.994783 12784 tablet_service.cc:1511] Processing CreateTablet for tablet e1a44b2941fb42b1a0a11fe23a8fbabe (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:14.996919 12632 tablet_service.cc:1511] Processing CreateTablet for tablet 9cab43c1c3dd49c1af93eacec08cbaab (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:14.998435 12632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cab43c1c3dd49c1af93eacec08cbaab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.999397 12784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a44b2941fb42b1a0a11fe23a8fbabe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.000402 12704 tablet_service.cc:1511] Processing CreateTablet for tablet 9cab43c1c3dd49c1af93eacec08cbaab (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:15.002031 12704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cab43c1c3dd49c1af93eacec08cbaab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.006476 12780 tablet_service.cc:1511] Processing CreateTablet for tablet 9cab43c1c3dd49c1af93eacec08cbaab (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:15.006749 12706 tablet_service.cc:1511] Processing CreateTablet for tablet ecda7567336a4617b80b0940c167785e (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:15.008249 12780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cab43c1c3dd49c1af93eacec08cbaab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.003925 12628 tablet_service.cc:1511] Processing CreateTablet for tablet ecda7567336a4617b80b0940c167785e (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:15.009752 12628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecda7567336a4617b80b0940c167785e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.009392 12783 tablet_service.cc:1511] Processing CreateTablet for tablet ecda7567336a4617b80b0940c167785e (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:15.011476 12630 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce8fa32acc0413d9353843a446a75b1 (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:15.013019 12630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce8fa32acc0413d9353843a446a75b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.015398 12707 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce8fa32acc0413d9353843a446a75b1 (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:15.017933 12779 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce8fa32acc0413d9353843a446a75b1 (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:15.018447 12631 tablet_service.cc:1511] Processing CreateTablet for tablet 5d282fc2f5934847b9551935e80c14fe (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:15.019475 12779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce8fa32acc0413d9353843a446a75b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.020248 12631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d282fc2f5934847b9551935e80c14fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.022018 12702 tablet_service.cc:1511] Processing CreateTablet for tablet 5d282fc2f5934847b9551935e80c14fe (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:15.024696 12782 tablet_service.cc:1511] Processing CreateTablet for tablet 5d282fc2f5934847b9551935e80c14fe (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:15.024737 12633 tablet_service.cc:1511] Processing CreateTablet for tablet f49501cf037c42b5ad72361058c8ec05 (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:15.027179 12703 tablet_service.cc:1511] Processing CreateTablet for tablet f49501cf037c42b5ad72361058c8ec05 (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:15.027894 12633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49501cf037c42b5ad72361058c8ec05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.013895 12706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecda7567336a4617b80b0940c167785e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.029407 12703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49501cf037c42b5ad72361058c8ec05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.029301 12777 tablet_service.cc:1511] Processing CreateTablet for tablet f49501cf037c42b5ad72361058c8ec05 (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:15.030284 12783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecda7567336a4617b80b0940c167785e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.031077 12777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49501cf037c42b5ad72361058c8ec05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.031839 12707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce8fa32acc0413d9353843a446a75b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.037101 12702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d282fc2f5934847b9551935e80c14fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.040140 12629 tablet_service.cc:1511] Processing CreateTablet for tablet 945e1c78f8d04abfb344751415d9b3fc (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:15.041109 12782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d282fc2f5934847b9551935e80c14fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.041826 12629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945e1c78f8d04abfb344751415d9b3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.053269 12709 tablet_service.cc:1511] Processing CreateTablet for tablet 945e1c78f8d04abfb344751415d9b3fc (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:15.054277 12776 tablet_service.cc:1511] Processing CreateTablet for tablet 945e1c78f8d04abfb344751415d9b3fc (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:15.055040 12709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945e1c78f8d04abfb344751415d9b3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.055677 12776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945e1c78f8d04abfb344751415d9b3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.099385 12634 tablet_service.cc:1511] Processing CreateTablet for tablet 8a62e396fd38482bb1b1cb3afaa83f87 (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:15.102404 12634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a62e396fd38482bb1b1cb3afaa83f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.127096 12710 tablet_service.cc:1511] Processing CreateTablet for tablet 8a62e396fd38482bb1b1cb3afaa83f87 (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:15.129125 12710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a62e396fd38482bb1b1cb3afaa83f87. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:15.137334 12685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41221, user_credentials={real_user=slave}} blocked reactor thread for 60340.4us
I20260709 13:04:15.165007 12778 tablet_service.cc:1511] Processing CreateTablet for tablet 8a62e396fd38482bb1b1cb3afaa83f87 (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:15.166579 12778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a62e396fd38482bb1b1cb3afaa83f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.169314 12627 tablet_service.cc:1511] Processing CreateTablet for tablet ac33a19a9bc34c04a1a4391bc80402dd (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:15.184319 12707 tablet_service.cc:1511] Processing CreateTablet for tablet ac33a19a9bc34c04a1a4391bc80402dd (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:15.185945 12707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac33a19a9bc34c04a1a4391bc80402dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.189973 12627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac33a19a9bc34c04a1a4391bc80402dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.185443 12777 tablet_service.cc:1511] Processing CreateTablet for tablet ac33a19a9bc34c04a1a4391bc80402dd (DEFAULT_TABLE table=soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:15.196842 12777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac33a19a9bc34c04a1a4391bc80402dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.197783 12950 tablet_bootstrap.cc:492] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:15.221962 12952 tablet_bootstrap.cc:492] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:15.233258 12952 tablet_bootstrap.cc:654] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.234283 12951 tablet_bootstrap.cc:492] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:15.240200 12950 tablet_bootstrap.cc:654] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.261135 12952 tablet_bootstrap.cc:492] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:15.261982 12952 ts_tablet_manager.cc:1403] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.011s
I20260709 13:04:15.263892 12951 tablet_bootstrap.cc:654] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.265816 12952 raft_consensus.cc:359] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.266928 12952 raft_consensus.cc:385] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.267307 12952 raft_consensus.cc:740] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.268206 12952 consensus_queue.cc:260] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.271564 12952 ts_tablet_manager.cc:1434] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:15.272814 12952 tablet_bootstrap.cc:492] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:15.276178 12950 tablet_bootstrap.cc:492] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:15.276856 12950 ts_tablet_manager.cc:1403] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.014s
I20260709 13:04:15.278525 12951 tablet_bootstrap.cc:492] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:15.279152 12951 ts_tablet_manager.cc:1403] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.000s
I20260709 13:04:15.281760 12952 tablet_bootstrap.cc:654] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.282752 12951 raft_consensus.cc:359] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.283617 12951 raft_consensus.cc:385] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.283944 12951 raft_consensus.cc:740] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.284912 12951 consensus_queue.cc:260] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.285161 12950 raft_consensus.cc:359] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.286511 12950 raft_consensus.cc:385] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.286883 12950 raft_consensus.cc:740] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.287685 12950 consensus_queue.cc:260] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.290659 12950 ts_tablet_manager.cc:1434] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:15.291757 12950 tablet_bootstrap.cc:492] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:15.295672 12951 ts_tablet_manager.cc:1434] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:04:15.297150 12951 tablet_bootstrap.cc:492] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:15.300961 12949 raft_consensus.cc:493] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.301709 12949 raft_consensus.cc:515] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.305159 12951 tablet_bootstrap.cc:654] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.305394 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d282fc2f5934847b9551935e80c14fe" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
W20260709 13:04:15.310207 12608 leader_election.cc:343] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.313993 12949 leader_election.cc:290] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:15.316809 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d282fc2f5934847b9551935e80c14fe" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:15.317935 12794 raft_consensus.cc:2468] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 0.
I20260709 13:04:15.320310 12608 leader_election.cc:304] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:15.322273 12949 raft_consensus.cc:2804] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.322908 12949 raft_consensus.cc:493] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.323465 12949 raft_consensus.cc:3060] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.336843 12950 tablet_bootstrap.cc:654] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.344020 12949 raft_consensus.cc:515] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.350174 12949 leader_election.cc:290] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Requested vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:15.352121 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d282fc2f5934847b9551935e80c14fe" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:15.353609 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d282fc2f5934847b9551935e80c14fe" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:15.354259 12794 raft_consensus.cc:3060] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.354486 12950 tablet_bootstrap.cc:492] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:15.355034 12950 ts_tablet_manager.cc:1403] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.004s
W20260709 13:04:15.359158 12608 leader_election.cc:343] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.362077 12951 tablet_bootstrap.cc:492] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:15.362319 12952 tablet_bootstrap.cc:492] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:15.362884 12951 ts_tablet_manager.cc:1403] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.031s
I20260709 13:04:15.362993 12952 ts_tablet_manager.cc:1403] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.090s	user 0.032s	sys 0.045s
I20260709 13:04:15.358901 12950 raft_consensus.cc:359] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.364774 12950 raft_consensus.cc:385] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.365095 12950 raft_consensus.cc:740] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.365831 12950 consensus_queue.cc:260] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.366535 12794 raft_consensus.cc:2468] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 1.
I20260709 13:04:15.366633 12952 raft_consensus.cc:359] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.367710 12952 raft_consensus.cc:385] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.368007 12952 raft_consensus.cc:740] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.368196 12608 leader_election.cc:304] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:15.368853 12952 consensus_queue.cc:260] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.369545 12949 raft_consensus.cc:2804] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.371610 12952 ts_tablet_manager.cc:1434] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:15.372465 12949 raft_consensus.cc:697] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Becoming Leader. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:15.373525 12952 tablet_bootstrap.cc:492] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:15.373957 12949 consensus_queue.cc:237] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.380450 12952 tablet_bootstrap.cc:654] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.381384 12951 raft_consensus.cc:359] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.384315 12951 raft_consensus.cc:385] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.384792 12951 raft_consensus.cc:740] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.383864 12950 ts_tablet_manager.cc:1434] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.002s
I20260709 13:04:15.386646 12950 tablet_bootstrap.cc:492] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:15.391523 12952 tablet_bootstrap.cc:492] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:15.387253 12951 consensus_queue.cc:260] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.390520 12543 catalog_manager.cc:5697] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c reported cstate change: term changed from 0 to 1, leader changed from <none> to b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.392112 12952 ts_tablet_manager.cc:1403] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:04:15.394102 12951 ts_tablet_manager.cc:1434] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 13:04:15.395608 12951 tablet_bootstrap.cc:492] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:15.395802 12952 raft_consensus.cc:359] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.396631 12952 raft_consensus.cc:385] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.396936 12952 raft_consensus.cc:740] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.397718 12952 consensus_queue.cc:260] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.400087 12952 ts_tablet_manager.cc:1434] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:15.401571 12952 tablet_bootstrap.cc:492] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:15.403769 12951 tablet_bootstrap.cc:654] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.411361 12950 tablet_bootstrap.cc:654] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.413705 12952 tablet_bootstrap.cc:654] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.423237 12934 raft_consensus.cc:493] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.424765 12951 tablet_bootstrap.cc:492] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:15.424335 12934 raft_consensus.cc:515] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.425338 12951 ts_tablet_manager.cc:1403] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.007s
I20260709 13:04:15.427811 12934 leader_election.cc:290] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:15.428828 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8fa32acc0413d9353843a446a75b1" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:15.429469 12951 raft_consensus.cc:359] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.430343 12951 raft_consensus.cc:385] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.430697 12951 raft_consensus.cc:740] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.431558 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8fa32acc0413d9353843a446a75b1" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
I20260709 13:04:15.431643 12951 consensus_queue.cc:260] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
W20260709 13:04:15.433571 12759 leader_election.cc:343] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.437491 12951 ts_tablet_manager.cc:1434] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
W20260709 13:04:15.438146 12757 leader_election.cc:343] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.440220 12952 tablet_bootstrap.cc:492] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:15.440485 12757 leader_election.cc:304] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a; no voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:15.439719 12950 tablet_bootstrap.cc:492] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:15.440831 12952 ts_tablet_manager.cc:1403] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.004s
I20260709 13:04:15.441385 12950 ts_tablet_manager.cc:1403] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.011s
I20260709 13:04:15.441951 12934 raft_consensus.cc:2749] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:15.444700 12952 raft_consensus.cc:359] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.444965 12950 raft_consensus.cc:359] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.445502 12952 raft_consensus.cc:385] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.445693 12950 raft_consensus.cc:385] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.445835 12952 raft_consensus.cc:740] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.446034 12950 raft_consensus.cc:740] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.440958 12951 tablet_bootstrap.cc:492] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:15.446862 12952 consensus_queue.cc:260] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.449826 12952 ts_tablet_manager.cc:1434] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:15.451310 12952 tablet_bootstrap.cc:492] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:15.454715 12951 tablet_bootstrap.cc:654] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.446862 12950 consensus_queue.cc:260] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.459609 12950 ts_tablet_manager.cc:1434] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:04:15.461127 12950 tablet_bootstrap.cc:492] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:15.462355 12952 tablet_bootstrap.cc:654] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.469138 12950 tablet_bootstrap.cc:654] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.479795 12934 raft_consensus.cc:493] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.480445 12934 raft_consensus.cc:515] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.482714 12934 leader_election.cc:290] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:15.486919 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49501cf037c42b5ad72361058c8ec05" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:15.487618 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49501cf037c42b5ad72361058c8ec05" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
I20260709 13:04:15.487749 12644 raft_consensus.cc:2468] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 0.
I20260709 13:04:15.489746 12759 leader_election.cc:304] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
W20260709 13:04:15.491221 12757 leader_election.cc:343] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.492524 12934 raft_consensus.cc:2804] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.493156 12934 raft_consensus.cc:493] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.493494 12934 raft_consensus.cc:3060] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.495811 12950 tablet_bootstrap.cc:492] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:15.496795 12950 ts_tablet_manager.cc:1403] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.015s
I20260709 13:04:15.500530 12934 raft_consensus.cc:515] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.501466 12950 raft_consensus.cc:359] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.502566 12950 raft_consensus.cc:385] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.502969 12950 raft_consensus.cc:740] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.503815 12951 tablet_bootstrap.cc:492] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:15.504230 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49501cf037c42b5ad72361058c8ec05" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:15.504953 12644 raft_consensus.cc:3060] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.503965 12950 consensus_queue.cc:260] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.505043 12951 ts_tablet_manager.cc:1403] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.016s
I20260709 13:04:15.507952 12950 ts_tablet_manager.cc:1434] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:04:15.509174 12950 tablet_bootstrap.cc:492] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:15.511354 12951 raft_consensus.cc:359] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.512241 12951 raft_consensus.cc:385] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.512645 12951 raft_consensus.cc:740] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.513501 12951 consensus_queue.cc:260] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.517863 12950 tablet_bootstrap.cc:654] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.517863 12952 tablet_bootstrap.cc:492] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:15.518798 12952 ts_tablet_manager.cc:1403] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.013s
I20260709 13:04:15.519164 12951 ts_tablet_manager.cc:1434] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:04:15.520452 12951 tablet_bootstrap.cc:492] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:15.523861 12949 raft_consensus.cc:493] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.524441 12949 raft_consensus.cc:515] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.526650 12949 leader_election.cc:290] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:15.527809 12951 tablet_bootstrap.cc:654] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.530169 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e1c78f8d04abfb344751415d9b3fc" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
I20260709 13:04:15.531169 12719 raft_consensus.cc:2468] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 0.
I20260709 13:04:15.532338 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e1c78f8d04abfb344751415d9b3fc" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:15.534557 12950 tablet_bootstrap.cc:492] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
W20260709 13:04:15.534797 12608 leader_election.cc:343] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.535238 12950 ts_tablet_manager.cc:1403] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.013s
I20260709 13:04:15.535667 12608 leader_election.cc:304] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 989e9a004b914452b13703cdfc705a2a
I20260709 13:04:15.537451 12949 raft_consensus.cc:2804] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.537948 12949 raft_consensus.cc:493] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.538419 12949 raft_consensus.cc:3060] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.542207 12872 raft_consensus.cc:493] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.542459 12934 leader_election.cc:290] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:15.542872 12872 raft_consensus.cc:515] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.546084 12644 raft_consensus.cc:2468] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 1.
I20260709 13:04:15.548363 12759 leader_election.cc:304] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:15.522944 12952 raft_consensus.cc:359] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.549252 12952 raft_consensus.cc:385] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.538834 12950 raft_consensus.cc:359] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.549656 12934 raft_consensus.cc:2804] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.549850 12950 raft_consensus.cc:385] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.550587 12950 raft_consensus.cc:740] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.551540 12950 consensus_queue.cc:260] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.549661 12952 raft_consensus.cc:740] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.553620 12952 consensus_queue.cc:260] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.555613 12949 raft_consensus.cc:515] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.555929 12934 raft_consensus.cc:697] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Becoming Leader. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Running, Role: LEADER
I20260709 13:04:15.557526 12934 consensus_queue.cc:237] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.560526 12950 ts_tablet_manager.cc:1434] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.003s
I20260709 13:04:15.562055 12950 tablet_bootstrap.cc:492] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:15.564770 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e1c78f8d04abfb344751415d9b3fc" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:15.565526 12720 raft_consensus.cc:3060] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.566434 12952 ts_tablet_manager.cc:1434] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.001s
I20260709 13:04:15.567749 12952 tablet_bootstrap.cc:492] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:15.574218 12949 leader_election.cc:290] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Requested vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:15.574082 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49501cf037c42b5ad72361058c8ec05" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e"
W20260709 13:04:15.576397 12757 leader_election.cc:343] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.579943 12951 tablet_bootstrap.cc:492] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:15.580345 12952 tablet_bootstrap.cc:654] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.580746 12951 ts_tablet_manager.cc:1403] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.061s	user 0.035s	sys 0.024s
I20260709 13:04:15.582103 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a44b2941fb42b1a0a11fe23a8fbabe" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
W20260709 13:04:15.585178 12685 leader_election.cc:343] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.587420 12792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a44b2941fb42b1a0a11fe23a8fbabe" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
W20260709 13:04:15.590003 12683 leader_election.cc:343] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.590618 12683 leader_election.cc:304] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e; no voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:15.591856 12948 raft_consensus.cc:2749] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:15.591897 12951 raft_consensus.cc:359] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.592931 12951 raft_consensus.cc:385] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.593236 12951 raft_consensus.cc:740] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.593425 12872 leader_election.cc:290] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:15.594352 12950 tablet_bootstrap.cc:654] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.593151 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e1c78f8d04abfb344751415d9b3fc" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
W20260709 13:04:15.596339 12608 leader_election.cc:343] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.599670 12951 consensus_queue.cc:260] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.603379 12951 ts_tablet_manager.cc:1434] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:04:15.604607 12951 tablet_bootstrap.cc:492] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:15.607981 12903 raft_consensus.cc:493] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.608671 12903 raft_consensus.cc:515] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.610565 12950 tablet_bootstrap.cc:492] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:15.611361 12950 ts_tablet_manager.cc:1403] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.008s
I20260709 13:04:15.613585 12720 raft_consensus.cc:2468] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 1.
I20260709 13:04:15.615201 12608 leader_election.cc:304] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 989e9a004b914452b13703cdfc705a2a
I20260709 13:04:15.616560 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a62e396fd38482bb1b1cb3afaa83f87" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
I20260709 13:04:15.613847 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a62e396fd38482bb1b1cb3afaa83f87" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:15.618683 12903 leader_election.cc:290] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:15.619289 12949 raft_consensus.cc:2804] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.619828 12949 raft_consensus.cc:697] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Becoming Leader. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:15.620826 12949 consensus_queue.cc:237] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.624616 12951 tablet_bootstrap.cc:654] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:15.626489 12608 leader_election.cc:343] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:15.632472 12608 leader_election.cc:343] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.633255 12608 leader_election.cc:304] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a
I20260709 13:04:15.634572 12949 raft_consensus.cc:2749] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:15.631600 12952 tablet_bootstrap.cc:492] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:15.640218 12543 catalog_manager.cc:5697] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c reported cstate change: term changed from 0 to 1, leader changed from <none> to b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.641645 12952 ts_tablet_manager.cc:1403] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.001s
I20260709 13:04:15.645108 12952 raft_consensus.cc:359] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.645961 12952 raft_consensus.cc:385] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.646248 12952 raft_consensus.cc:740] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.644856 12542 catalog_manager.cc:5697] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 989e9a004b914452b13703cdfc705a2a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "989e9a004b914452b13703cdfc705a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.647058 12952 consensus_queue.cc:260] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.652395 12952 ts_tablet_manager.cc:1434] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:04:15.653946 12952 tablet_bootstrap.cc:492] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:15.631506 12950 raft_consensus.cc:359] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.661461 12950 raft_consensus.cc:385] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.661836 12950 raft_consensus.cc:740] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.662740 12950 consensus_queue.cc:260] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.664413 12951 tablet_bootstrap.cc:492] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:15.665014 12951 ts_tablet_manager.cc:1403] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.029s
I20260709 13:04:15.665336 12950 ts_tablet_manager.cc:1434] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.007s
I20260709 13:04:15.663709 12952 tablet_bootstrap.cc:654] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.666585 12950 tablet_bootstrap.cc:492] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:15.668253 12951 raft_consensus.cc:359] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.669107 12951 raft_consensus.cc:385] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.669400 12951 raft_consensus.cc:740] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.670316 12951 consensus_queue.cc:260] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.672911 12951 ts_tablet_manager.cc:1434] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:15.673971 12951 tablet_bootstrap.cc:492] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:15.674517 12950 tablet_bootstrap.cc:654] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.688134 12951 tablet_bootstrap.cc:654] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.695218 12952 tablet_bootstrap.cc:492] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:15.695753 12952 ts_tablet_manager.cc:1403] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.013s
I20260709 13:04:15.696157 12950 tablet_bootstrap.cc:492] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:15.696837 12950 ts_tablet_manager.cc:1403] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.004s
I20260709 13:04:15.698027 12951 tablet_bootstrap.cc:492] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:15.698593 12951 ts_tablet_manager.cc:1403] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.003s
I20260709 13:04:15.699062 12952 raft_consensus.cc:359] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.699838 12952 raft_consensus.cc:385] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.700264 12952 raft_consensus.cc:740] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.699875 12950 raft_consensus.cc:359] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.700748 12950 raft_consensus.cc:385] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.701174 12950 raft_consensus.cc:740] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.701076 12952 consensus_queue.cc:260] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.701790 12951 raft_consensus.cc:359] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.702590 12951 raft_consensus.cc:385] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.702840 12951 raft_consensus.cc:740] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.703600 12952 ts_tablet_manager.cc:1434] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:15.703485 12951 consensus_queue.cc:260] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.704676 12952 tablet_bootstrap.cc:492] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:15.705806 12951 ts_tablet_manager.cc:1434] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:04:15.706861 12951 tablet_bootstrap.cc:492] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:15.711943 12952 tablet_bootstrap.cc:654] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.702019 12950 consensus_queue.cc:260] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.713833 12951 tablet_bootstrap.cc:654] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.715819 12950 ts_tablet_manager.cc:1434] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:04:15.716187 12872 raft_consensus.cc:493] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.716807 12872 raft_consensus.cc:515] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.717543 12950 tablet_bootstrap.cc:492] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:15.720839 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda7567336a4617b80b0940c167785e" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:15.721743 12644 raft_consensus.cc:2468] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 0.
I20260709 13:04:15.721899 12934 raft_consensus.cc:493] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.722548 12934 raft_consensus.cc:515] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.723635 12903 raft_consensus.cc:493] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.724103 12952 tablet_bootstrap.cc:492] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:15.724687 12952 ts_tablet_manager.cc:1403] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.003s
I20260709 13:04:15.724812 12934 leader_election.cc:290] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:15.724421 12903 raft_consensus.cc:515] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.727360 12903 leader_election.cc:290] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:15.728756 12952 raft_consensus.cc:359] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.729540 12952 raft_consensus.cc:385] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.729807 12952 raft_consensus.cc:740] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.730544 12952 consensus_queue.cc:260] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.731524 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda7567336a4617b80b0940c167785e" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:15.737429 12950 tablet_bootstrap.cc:654] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.732400 12685 leader_election.cc:304] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:15.737543 12794 raft_consensus.cc:2468] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 0.
I20260709 13:04:15.739167 12948 raft_consensus.cc:2804] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.739676 12948 raft_consensus.cc:493] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.740201 12948 raft_consensus.cc:3060] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.744140 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda7567336a4617b80b0940c167785e" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
I20260709 13:04:15.745114 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a44b2941fb42b1a0a11fe23a8fbabe" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
I20260709 13:04:15.748903 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda7567336a4617b80b0940c167785e" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:15.749874 12644 raft_consensus.cc:2468] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 0.
I20260709 13:04:15.755766 12872 leader_election.cc:290] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:15.764948 12759 leader_election.cc:304] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:15.766135 12949 raft_consensus.cc:493] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.766541 12934 raft_consensus.cc:2804] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.767355 12934 raft_consensus.cc:493] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.766934 12949 raft_consensus.cc:515] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.767910 12934 raft_consensus.cc:3060] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.769176 12970 raft_consensus.cc:493] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.769996 12970 raft_consensus.cc:515] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.772970 12719 raft_consensus.cc:2468] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 0.
I20260709 13:04:15.773578 12970 leader_election.cc:290] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:15.733992 12952 ts_tablet_manager.cc:1434] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:15.776691 12952 tablet_bootstrap.cc:492] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a: Bootstrap starting.
I20260709 13:04:15.734835 12792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a44b2941fb42b1a0a11fe23a8fbabe" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:15.777585 12792 raft_consensus.cc:2468] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 0.
I20260709 13:04:15.779208 12608 leader_election.cc:304] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:15.782948 12718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a62e396fd38482bb1b1cb3afaa83f87" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
W20260709 13:04:15.785012 12757 leader_election.cc:343] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.785013 12792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8fa32acc0413d9353843a446a75b1" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:15.787451 12792 raft_consensus.cc:2468] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 0.
I20260709 13:04:15.789330 12608 leader_election.cc:304] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:15.794750 12949 leader_election.cc:290] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:15.795717 12949 raft_consensus.cc:2804] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.796134 12949 raft_consensus.cc:493] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.796453 12949 raft_consensus.cc:3060] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.798889 12872 raft_consensus.cc:493] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.799755 12872 raft_consensus.cc:515] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.805248 12645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49501cf037c42b5ad72361058c8ec05" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:15.806459 12645 raft_consensus.cc:2393] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a517ba6254c4619a53d8a220316793e in current term 1: Already voted for candidate 989e9a004b914452b13703cdfc705a2a in this term.
I20260709 13:04:15.807278 12983 consensus_queue.cc:1048] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:04:15.809489 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49501cf037c42b5ad72361058c8ec05" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:15.820679 12683 leader_election.cc:304] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e; no voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:15.810773 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a62e396fd38482bb1b1cb3afaa83f87" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:15.823472 12952 tablet_bootstrap.cc:654] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.823793 12644 raft_consensus.cc:2468] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 0.
I20260709 13:04:15.825820 12759 leader_election.cc:304] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:15.826926 12970 raft_consensus.cc:2804] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.827366 12970 raft_consensus.cc:493] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.827801 12970 raft_consensus.cc:3060] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.811419 12903 raft_consensus.cc:2804] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.829632 12903 raft_consensus.cc:493] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.830824 12903 raft_consensus.cc:3060] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.832716 12872 leader_election.cc:290] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:15.833654 12951 tablet_bootstrap.cc:492] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:15.834270 12951 ts_tablet_manager.cc:1403] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.128s	user 0.043s	sys 0.066s
I20260709 13:04:15.834744 12872 raft_consensus.cc:3060] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.812114 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8fa32acc0413d9353843a446a75b1" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
I20260709 13:04:15.837337 12719 raft_consensus.cc:2468] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 0.
I20260709 13:04:15.840782 12970 raft_consensus.cc:515] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.842972 12970 leader_election.cc:290] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:15.844172 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a62e396fd38482bb1b1cb3afaa83f87" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:15.846084 12645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a62e396fd38482bb1b1cb3afaa83f87" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:15.846789 12645 raft_consensus.cc:3060] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.855692 12934 raft_consensus.cc:515] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
W20260709 13:04:15.856865 12757 leader_election.cc:343] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.859361 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda7567336a4617b80b0940c167785e" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:15.860442 12644 raft_consensus.cc:3060] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.848912 12951 raft_consensus.cc:359] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.862730 12951 raft_consensus.cc:385] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.864665 12951 raft_consensus.cc:740] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.870874 12951 consensus_queue.cc:260] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.843001 12949 raft_consensus.cc:515] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.879966 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda7567336a4617b80b0940c167785e" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:15.880746 12949 leader_election.cc:290] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Requested vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:15.881307 12950 tablet_bootstrap.cc:492] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:15.875924 12644 raft_consensus.cc:2468] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 1.
I20260709 13:04:15.877115 12948 raft_consensus.cc:515] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.882947 12720 raft_consensus.cc:2393] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 989e9a004b914452b13703cdfc705a2a in current term 1: Already voted for candidate 8a517ba6254c4619a53d8a220316793e in this term.
I20260709 13:04:15.883780 12948 leader_election.cc:290] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:15.878284 12934 leader_election.cc:290] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:15.879017 12952 tablet_bootstrap.cc:492] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a: No bootstrap required, opened a new log
I20260709 13:04:15.885214 12952 ts_tablet_manager.cc:1403] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a: Time spent bootstrapping tablet: real 0.109s	user 0.015s	sys 0.000s
W20260709 13:04:15.870669 12683 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:33369, user_credentials={real_user=slave}} blocked reactor thread for 49679.4us
I20260709 13:04:15.886493 12643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda7567336a4617b80b0940c167785e" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:15.887423 12643 raft_consensus.cc:2393] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a517ba6254c4619a53d8a220316793e in current term 1: Already voted for candidate 989e9a004b914452b13703cdfc705a2a in this term.
I20260709 13:04:15.888096 12952 raft_consensus.cc:359] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.888911 12952 raft_consensus.cc:385] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.889207 12952 raft_consensus.cc:740] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.889972 12952 consensus_queue.cc:260] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.892199 12793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda7567336a4617b80b0940c167785e" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:15.881830 12950 ts_tablet_manager.cc:1403] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.165s	user 0.049s	sys 0.048s
I20260709 13:04:15.893208 12793 raft_consensus.cc:2393] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8a517ba6254c4619a53d8a220316793e in current term 1: Already voted for candidate 989e9a004b914452b13703cdfc705a2a in this term.
I20260709 13:04:15.892870 12903 raft_consensus.cc:515] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.894361 12759 leader_election.cc:304] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:15.892269 12952 ts_tablet_manager.cc:1434] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:15.897652 12934 raft_consensus.cc:493] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.896746 12683 leader_election.cc:304] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e; no voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:15.898058 12969 raft_consensus.cc:2804] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.896471 12950 raft_consensus.cc:359] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.898919 12969 raft_consensus.cc:697] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Becoming Leader. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Running, Role: LEADER
I20260709 13:04:15.898846 12950 raft_consensus.cc:385] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.899528 12950 raft_consensus.cc:740] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.899416 12948 raft_consensus.cc:2749] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:15.900348 12950 consensus_queue.cc:260] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
W20260709 13:04:15.898053 12590 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:15.902173 12969 consensus_queue.cc:237] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.903170 12951 ts_tablet_manager.cc:1434] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.069s	user 0.010s	sys 0.000s
I20260709 13:04:15.904206 12951 tablet_bootstrap.cc:492] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e: Bootstrap starting.
I20260709 13:04:15.907542 12645 raft_consensus.cc:2468] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 1.
I20260709 13:04:15.911024 12950 ts_tablet_manager.cc:1434] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:04:15.912235 12950 tablet_bootstrap.cc:492] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c: Bootstrap starting.
I20260709 13:04:15.912321 12872 raft_consensus.cc:2749] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:15.915488 12951 tablet_bootstrap.cc:654] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.915699 12903 leader_election.cc:290] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Requested vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:15.898576 12934 raft_consensus.cc:515] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.929514 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cab43c1c3dd49c1af93eacec08cbaab" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:15.929894 12720 raft_consensus.cc:3060] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.930301 12644 raft_consensus.cc:2468] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 0.
I20260709 13:04:15.931828 12759 leader_election.cc:304] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:15.932789 12970 raft_consensus.cc:2804] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.934160 12970 raft_consensus.cc:493] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.934499 12970 raft_consensus.cc:3060] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.929512 12543 catalog_manager.cc:5697] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 989e9a004b914452b13703cdfc705a2a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "989e9a004b914452b13703cdfc705a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.940907 12872 raft_consensus.cc:493] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.945902 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a44b2941fb42b1a0a11fe23a8fbabe" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:15.942327 12759 leader_election.cc:304] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:15.949833 12718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8fa32acc0413d9353843a446a75b1" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:15.947952 12792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a44b2941fb42b1a0a11fe23a8fbabe" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:15.954454 12792 raft_consensus.cc:3060] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.953644 12793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8fa32acc0413d9353843a446a75b1" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:15.953938 12719 raft_consensus.cc:3060] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.955869 12793 raft_consensus.cc:3060] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.954217 12718 raft_consensus.cc:3060] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.965093 12950 tablet_bootstrap.cc:654] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.964236 12719 raft_consensus.cc:2468] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 1.
I20260709 13:04:15.948091 12872 raft_consensus.cc:515] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.966567 12969 raft_consensus.cc:2804] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.968854 12970 raft_consensus.cc:515] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.976076 12949 consensus_queue.cc:1048] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:15.970530 12988 raft_consensus.cc:493] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.977419 12988 raft_consensus.cc:515] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.978600 12608 leader_election.cc:304] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:15.964236 12792 raft_consensus.cc:2468] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 1.
I20260709 13:04:15.976290 12645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a62e396fd38482bb1b1cb3afaa83f87" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:15.980176 12949 raft_consensus.cc:2804] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.980382 12645 raft_consensus.cc:2393] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a517ba6254c4619a53d8a220316793e in current term 1: Already voted for candidate 989e9a004b914452b13703cdfc705a2a in this term.
I20260709 13:04:15.980720 12970 leader_election.cc:290] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:15.982213 12718 raft_consensus.cc:2468] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 1.
I20260709 13:04:15.982815 12645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cab43c1c3dd49c1af93eacec08cbaab" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:15.983073 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a62e396fd38482bb1b1cb3afaa83f87" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:15.983747 12645 raft_consensus.cc:3060] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.970489 12951 tablet_bootstrap.cc:492] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e: No bootstrap required, opened a new log
I20260709 13:04:15.987277 12951 ts_tablet_manager.cc:1403] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e: Time spent bootstrapping tablet: real 0.083s	user 0.024s	sys 0.021s
I20260709 13:04:15.980716 12949 raft_consensus.cc:697] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Becoming Leader. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:15.987658 12872 leader_election.cc:290] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:15.990499 12948 raft_consensus.cc:493] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.993503 12948 raft_consensus.cc:515] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:15.997356 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cab43c1c3dd49c1af93eacec08cbaab" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:15.974510 12934 leader_election.cc:290] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:15.974255 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cab43c1c3dd49c1af93eacec08cbaab" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
I20260709 13:04:15.997393 12792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cab43c1c3dd49c1af93eacec08cbaab" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:16.000764 12970 consensus_queue.cc:1048] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.003296 12969 raft_consensus.cc:697] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Becoming Leader. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Running, Role: LEADER
I20260709 13:04:16.003623 12792 raft_consensus.cc:2393] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a517ba6254c4619a53d8a220316793e in current term 1: Already voted for candidate 989e9a004b914452b13703cdfc705a2a in this term.
I20260709 13:04:15.999931 12608 leader_election.cc:304] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:16.004808 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cab43c1c3dd49c1af93eacec08cbaab" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:16.009756 12986 raft_consensus.cc:2804] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:16.010300 12986 raft_consensus.cc:697] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Becoming Leader. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:16.011166 12986 consensus_queue.cc:237] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.014119 12683 leader_election.cc:304] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e; no voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:15.995831 12948 leader_election.cc:290] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:16.018738 12951 raft_consensus.cc:359] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.020108 12951 raft_consensus.cc:385] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.020102 12949 consensus_queue.cc:237] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.020773 12951 raft_consensus.cc:740] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.021795 12951 consensus_queue.cc:260] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.023211 12643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d282fc2f5934847b9551935e80c14fe" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:16.025040 12903 consensus_queue.cc:1048] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:16.027105 12791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d282fc2f5934847b9551935e80c14fe" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:16.029071 12685 leader_election.cc:304] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e; no voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:16.030254 12791 raft_consensus.cc:3060] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.032466 12645 raft_consensus.cc:2468] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 1.
I20260709 13:04:16.024056 12988 leader_election.cc:290] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:16.017145 12719 raft_consensus.cc:2468] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 0.
I20260709 13:04:16.047734 12948 raft_consensus.cc:2749] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:16.048631 12950 tablet_bootstrap.cc:492] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c: No bootstrap required, opened a new log
I20260709 13:04:16.049476 12950 ts_tablet_manager.cc:1403] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent bootstrapping tablet: real 0.137s	user 0.016s	sys 0.022s
I20260709 13:04:16.052384 12759 leader_election.cc:304] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:16.054639 12950 raft_consensus.cc:359] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.055437 12950 raft_consensus.cc:385] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.055706 12950 raft_consensus.cc:740] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.061542 12951 ts_tablet_manager.cc:1434] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.001s
I20260709 13:04:16.056572 12950 consensus_queue.cc:260] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.069253 12903 consensus_queue.cc:1048] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.073494 12950 ts_tablet_manager.cc:1434] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:04:16.057242 12872 raft_consensus.cc:3060] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.075568 12934 raft_consensus.cc:2804] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:16.076146 12934 raft_consensus.cc:697] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Becoming Leader. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Running, Role: LEADER
I20260709 13:04:16.057091 12793 raft_consensus.cc:2468] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 1.
I20260709 13:04:16.077097 12934 consensus_queue.cc:237] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.081643 12993 raft_consensus.cc:493] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.082481 12993 raft_consensus.cc:515] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.042589 12969 consensus_queue.cc:237] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.087255 12543 catalog_manager.cc:5697] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c reported cstate change: term changed from 0 to 1, leader changed from <none> to b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.109448 12872 raft_consensus.cc:2749] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:16.147295 12934 consensus_queue.cc:1048] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:16.154870 12759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41221, user_credentials={real_user=slave}} blocked reactor thread for 57468.6us
I20260709 13:04:16.161175 12993 leader_election.cc:290] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:16.164302 12717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e1c78f8d04abfb344751415d9b3fc" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
I20260709 13:04:16.175068 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e1c78f8d04abfb344751415d9b3fc" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" is_pre_election: true
I20260709 13:04:16.177642 12542 catalog_manager.cc:5697] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c reported cstate change: term changed from 0 to 1, leader changed from <none> to b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.180274 12986 raft_consensus.cc:493] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.177641 12759 leader_election.cc:304] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 989e9a004b914452b13703cdfc705a2a; no voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:16.181098 12986 raft_consensus.cc:515] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.184602 12993 raft_consensus.cc:2749] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:16.185709 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac33a19a9bc34c04a1a4391bc80402dd" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e" is_pre_election: true
I20260709 13:04:16.186787 12720 raft_consensus.cc:2468] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 0.
I20260709 13:04:16.188511 12608 leader_election.cc:304] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:16.190035 12903 raft_consensus.cc:2804] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:16.190601 12903 raft_consensus.cc:493] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.191030 12903 raft_consensus.cc:3060] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.196908 12986 leader_election.cc:290] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:16.199880 12683 leader_election.cc:304] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e; no voters: 989e9a004b914452b13703cdfc705a2a, b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:16.200941 12903 raft_consensus.cc:515] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.201682 12948 raft_consensus.cc:3060] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.203697 12903 leader_election.cc:290] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Requested vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:16.205163 12790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac33a19a9bc34c04a1a4391bc80402dd" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a" is_pre_election: true
I20260709 13:04:16.206164 12790 raft_consensus.cc:2468] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 0.
I20260709 13:04:16.206408 12720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac33a19a9bc34c04a1a4391bc80402dd" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:16.207075 12720 raft_consensus.cc:3060] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.211387 12543 catalog_manager.cc:5697] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 989e9a004b914452b13703cdfc705a2a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "989e9a004b914452b13703cdfc705a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.213647 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac33a19a9bc34c04a1a4391bc80402dd" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:16.214474 12794 raft_consensus.cc:3060] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.215590 12948 raft_consensus.cc:2749] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:16.216249 12720 raft_consensus.cc:2468] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 1.
I20260709 13:04:16.219825 12608 leader_election.cc:304] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:16.221469 12903 raft_consensus.cc:2804] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:16.222235 12903 raft_consensus.cc:697] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Becoming Leader. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:16.223142 12903 consensus_queue.cc:237] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.224225 12794 raft_consensus.cc:2468] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 1.
I20260709 13:04:16.235042 12542 catalog_manager.cc:5697] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c reported cstate change: term changed from 0 to 1, leader changed from <none> to b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.235309 12543 catalog_manager.cc:5697] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 989e9a004b914452b13703cdfc705a2a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "989e9a004b914452b13703cdfc705a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.434024 12994 consensus_queue.cc:1048] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.449678 12969 consensus_queue.cc:1048] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.466226 12986 consensus_queue.cc:1048] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.470475 12986 consensus_queue.cc:1048] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.470845 12790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cab43c1c3dd49c1af93eacec08cbaab"
dest_uuid: "989e9a004b914452b13703cdfc705a2a"
mode: GRACEFUL
new_leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
 from {username='slave'} at 127.0.0.1:60470
I20260709 13:04:16.471690 12790 raft_consensus.cc:606] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Received request to transfer leadership to TS b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:16.481550 12794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecda7567336a4617b80b0940c167785e"
dest_uuid: "989e9a004b914452b13703cdfc705a2a"
mode: GRACEFUL
new_leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
 from {username='slave'} at 127.0.0.1:60470
I20260709 13:04:16.482964 12949 consensus_queue.cc:1048] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.485675 12794 raft_consensus.cc:606] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Received request to transfer leadership to TS b6eb7b81fa3f4375a84d1c4a972df45c
I20260709 13:04:16.497493 12986 consensus_queue.cc:1048] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.507606 12644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d282fc2f5934847b9551935e80c14fe"
dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
mode: GRACEFUL
new_leader_uuid: "8a517ba6254c4619a53d8a220316793e"
 from {username='slave'} at 127.0.0.1:41408
I20260709 13:04:16.508534 12644 raft_consensus.cc:606] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Received request to transfer leadership to TS 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:16.519212 12794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f49501cf037c42b5ad72361058c8ec05"
dest_uuid: "989e9a004b914452b13703cdfc705a2a"
mode: GRACEFUL
new_leader_uuid: "8a517ba6254c4619a53d8a220316793e"
 from {username='slave'} at 127.0.0.1:60470
I20260709 13:04:16.519881 12794 raft_consensus.cc:606] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Received request to transfer leadership to TS 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:16.526811 12644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "945e1c78f8d04abfb344751415d9b3fc"
dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
mode: GRACEFUL
new_leader_uuid: "8a517ba6254c4619a53d8a220316793e"
 from {username='slave'} at 127.0.0.1:41408
I20260709 13:04:16.527500 12644 raft_consensus.cc:606] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Received request to transfer leadership to TS 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:16.534641 12790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a62e396fd38482bb1b1cb3afaa83f87"
dest_uuid: "989e9a004b914452b13703cdfc705a2a"
mode: GRACEFUL
new_leader_uuid: "8a517ba6254c4619a53d8a220316793e"
 from {username='slave'} at 127.0.0.1:60470
I20260709 13:04:16.535281 12790 raft_consensus.cc:606] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Received request to transfer leadership to TS 8a517ba6254c4619a53d8a220316793e
I20260709 13:04:16.541093 12644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac33a19a9bc34c04a1a4391bc80402dd"
dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
mode: GRACEFUL
new_leader_uuid: "989e9a004b914452b13703cdfc705a2a"
 from {username='slave'} at 127.0.0.1:41408
I20260709 13:04:16.541637 12644 raft_consensus.cc:606] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Received request to transfer leadership to TS 989e9a004b914452b13703cdfc705a2a
I20260709 13:04:16.588645 12970 raft_consensus.cc:993] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a: : Instructing follower 8a517ba6254c4619a53d8a220316793e to start an election
I20260709 13:04:16.589239 12970 raft_consensus.cc:1081] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Signalling peer 8a517ba6254c4619a53d8a220316793e to start an election
I20260709 13:04:16.591041 12717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f49501cf037c42b5ad72361058c8ec05"
dest_uuid: "8a517ba6254c4619a53d8a220316793e"
 from {username='slave'} at 127.0.0.1:44154
I20260709 13:04:16.591683 12717 raft_consensus.cc:493] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.592047 12717 raft_consensus.cc:3060] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.598742 12717 raft_consensus.cc:515] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.599903 12970 consensus_queue.cc:1048] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.600840 12717 leader_election.cc:290] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 2 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:16.601748 12643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49501cf037c42b5ad72361058c8ec05" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:16.602062 12790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49501cf037c42b5ad72361058c8ec05" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:16.602348 12643 raft_consensus.cc:3060] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.602747 12790 raft_consensus.cc:3055] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:16.603139 12790 raft_consensus.cc:740] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Running, Role: LEADER
I20260709 13:04:16.604017 12790 consensus_queue.cc:260] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.605546 12790 raft_consensus.cc:3060] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.611634 12969 consensus_queue.cc:1048] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.614012 12790 raft_consensus.cc:2468] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 2.
I20260709 13:04:16.616881 12683 leader_election.cc:304] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a; no voters: 
I20260709 13:04:16.618126 12948 raft_consensus.cc:2804] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.618731 12948 raft_consensus.cc:697] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [term 2 LEADER]: Becoming Leader. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:16.619457 12643 raft_consensus.cc:2468] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 2.
I20260709 13:04:16.619592 12948 consensus_queue.cc:237] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.624212 12970 raft_consensus.cc:993] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a: : Instructing follower 8a517ba6254c4619a53d8a220316793e to start an election
I20260709 13:04:16.624773 12970 raft_consensus.cc:1081] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Signalling peer 8a517ba6254c4619a53d8a220316793e to start an election
I20260709 13:04:16.626762 12717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a62e396fd38482bb1b1cb3afaa83f87"
dest_uuid: "8a517ba6254c4619a53d8a220316793e"
 from {username='slave'} at 127.0.0.1:44154
I20260709 13:04:16.627354 12717 raft_consensus.cc:493] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.627753 12717 raft_consensus.cc:3060] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.634811 12717 raft_consensus.cc:515] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.637005 12717 leader_election.cc:290] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 2 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:16.637802 12643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a62e396fd38482bb1b1cb3afaa83f87" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:16.638561 12643 raft_consensus.cc:3060] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.638387 12790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a62e396fd38482bb1b1cb3afaa83f87" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:16.639251 12790 raft_consensus.cc:3055] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:16.639631 12790 raft_consensus.cc:740] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Running, Role: LEADER
I20260709 13:04:16.640569 12790 consensus_queue.cc:260] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.641903 12790 raft_consensus.cc:3060] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.641561 12540 catalog_manager.cc:5697] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e reported cstate change: term changed from 1 to 2, leader changed from 989e9a004b914452b13703cdfc705a2a (127.0.107.195) to 8a517ba6254c4619a53d8a220316793e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8a517ba6254c4619a53d8a220316793e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.646538 12643 raft_consensus.cc:2468] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 2.
I20260709 13:04:16.647923 12685 leader_election.cc:304] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:16.648799 12948 raft_consensus.cc:2804] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.649600 12948 raft_consensus.cc:697] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [term 2 LEADER]: Becoming Leader. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:16.650352 12948 consensus_queue.cc:237] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.650556 12790 raft_consensus.cc:2468] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 2.
I20260709 13:04:16.656909 12540 catalog_manager.cc:5697] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e reported cstate change: term changed from 1 to 2, leader changed from 989e9a004b914452b13703cdfc705a2a (127.0.107.195) to 8a517ba6254c4619a53d8a220316793e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8a517ba6254c4619a53d8a220316793e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.668992 12986 consensus_queue.cc:1048] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.671618 12986 consensus_queue.cc:1048] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.682921 12982 raft_consensus.cc:993] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c: : Instructing follower 989e9a004b914452b13703cdfc705a2a to start an election
I20260709 13:04:16.683425 12982 raft_consensus.cc:1081] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Signalling peer 989e9a004b914452b13703cdfc705a2a to start an election
I20260709 13:04:16.685879 12790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac33a19a9bc34c04a1a4391bc80402dd"
dest_uuid: "989e9a004b914452b13703cdfc705a2a"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:04:16.686695 12790 raft_consensus.cc:493] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.687077 12790 raft_consensus.cc:3060] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.697548 12790 raft_consensus.cc:515] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.698459 12794 raft_consensus.cc:1240] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Rejecting Update request from peer b6eb7b81fa3f4375a84d1c4a972df45c for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:16.699486 12790 leader_election.cc:290] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 2 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:16.700764 12643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac33a19a9bc34c04a1a4391bc80402dd" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:16.700680 12982 consensus_queue.cc:1059] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.701115 12717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac33a19a9bc34c04a1a4391bc80402dd" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:16.701704 12717 raft_consensus.cc:3060] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.702167 12643 raft_consensus.cc:3055] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:16.702596 12643 raft_consensus.cc:740] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:16.703419 12643 consensus_queue.cc:260] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.704753 12643 raft_consensus.cc:3060] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.704818 12970 consensus_queue.cc:1048] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.710206 12970 consensus_queue.cc:1048] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.716475 12643 raft_consensus.cc:2468] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 2.
W20260709 13:04:16.717298 12949 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:04:16.716255 12717 raft_consensus.cc:2468] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 2.
I20260709 13:04:16.721112 12994 raft_consensus.cc:993] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a: : Instructing follower b6eb7b81fa3f4375a84d1c4a972df45c to start an election
I20260709 13:04:16.721112 12757 leader_election.cc:304] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a; no voters: 
I20260709 13:04:16.722307 12969 raft_consensus.cc:1081] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Signalling peer b6eb7b81fa3f4375a84d1c4a972df45c to start an election
I20260709 13:04:16.723819 13005 raft_consensus.cc:2804] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.724436 13005 raft_consensus.cc:697] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [term 2 LEADER]: Becoming Leader. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Running, Role: LEADER
I20260709 13:04:16.725368 13005 consensus_queue.cc:237] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.733986 12644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cab43c1c3dd49c1af93eacec08cbaab"
dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
 from {username='slave'} at 127.0.0.1:41394
I20260709 13:04:16.734804 12644 raft_consensus.cc:493] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.736016 12539 catalog_manager.cc:5697] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a reported cstate change: term changed from 1 to 2, leader changed from b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193) to 989e9a004b914452b13703cdfc705a2a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "989e9a004b914452b13703cdfc705a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.736917 12644 raft_consensus.cc:3060] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.747188 12644 raft_consensus.cc:515] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.749528 12644 leader_election.cc:290] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 2 election: Requested vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:16.750802 12790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cab43c1c3dd49c1af93eacec08cbaab" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:16.751538 12790 raft_consensus.cc:3055] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:16.751886 12790 raft_consensus.cc:740] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Running, Role: LEADER
I20260709 13:04:16.751986 12717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cab43c1c3dd49c1af93eacec08cbaab" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:16.752691 12717 raft_consensus.cc:3060] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.752813 12790 consensus_queue.cc:260] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.754405 12790 raft_consensus.cc:3060] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.760232 12717 raft_consensus.cc:2468] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 2.
I20260709 13:04:16.761255 12790 raft_consensus.cc:2468] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 2.
I20260709 13:04:16.761914 12608 leader_election.cc:304] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:16.762765 12949 raft_consensus.cc:2804] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.763302 12949 raft_consensus.cc:697] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 LEADER]: Becoming Leader. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:16.764120 12949 consensus_queue.cc:237] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.771014 12540 catalog_manager.cc:5697] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c reported cstate change: term changed from 1 to 2, leader changed from 989e9a004b914452b13703cdfc705a2a (127.0.107.195) to b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.916034 12982 raft_consensus.cc:993] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c: : Instructing follower 8a517ba6254c4619a53d8a220316793e to start an election
I20260709 13:04:16.916530 12949 raft_consensus.cc:1081] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Signalling peer 8a517ba6254c4619a53d8a220316793e to start an election
I20260709 13:04:16.918560 12717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d282fc2f5934847b9551935e80c14fe"
dest_uuid: "8a517ba6254c4619a53d8a220316793e"
 from {username='slave'} at 127.0.0.1:44144
I20260709 13:04:16.919209 12717 raft_consensus.cc:493] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.919590 12717 raft_consensus.cc:3060] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.929432 12717 raft_consensus.cc:515] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.931905 12717 leader_election.cc:290] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 2 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:16.933161 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d282fc2f5934847b9551935e80c14fe" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:16.933367 12790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d282fc2f5934847b9551935e80c14fe" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:16.934123 12644 raft_consensus.cc:3055] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:16.934367 12790 raft_consensus.cc:3060] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.934515 12644 raft_consensus.cc:740] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:16.935499 12644 consensus_queue.cc:260] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.936725 12644 raft_consensus.cc:3060] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.942811 12790 raft_consensus.cc:2468] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 2.
I20260709 13:04:16.944101 12644 raft_consensus.cc:2468] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 2.
I20260709 13:04:16.944170 12683 leader_election.cc:304] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a; no voters: 
I20260709 13:04:16.945346 12988 raft_consensus.cc:2804] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.945797 12988 raft_consensus.cc:697] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [term 2 LEADER]: Becoming Leader. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:16.946696 12988 consensus_queue.cc:237] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:16.953848 12540 catalog_manager.cc:5697] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e reported cstate change: term changed from 1 to 2, leader changed from b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193) to 8a517ba6254c4619a53d8a220316793e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8a517ba6254c4619a53d8a220316793e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.007165 12790 raft_consensus.cc:1275] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Refusing update from remote peer 8a517ba6254c4619a53d8a220316793e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.008685 12988 consensus_queue.cc:1048] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.017820 12644 raft_consensus.cc:1275] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Refusing update from remote peer 8a517ba6254c4619a53d8a220316793e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.019742 13026 consensus_queue.cc:1048] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.029867 12994 raft_consensus.cc:993] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a: : Instructing follower b6eb7b81fa3f4375a84d1c4a972df45c to start an election
I20260709 13:04:17.030436 13005 raft_consensus.cc:1081] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Signalling peer b6eb7b81fa3f4375a84d1c4a972df45c to start an election
I20260709 13:04:17.032230 12644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecda7567336a4617b80b0940c167785e"
dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
 from {username='slave'} at 127.0.0.1:41394
I20260709 13:04:17.032833 12644 raft_consensus.cc:493] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.033186 12644 raft_consensus.cc:3060] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.039901 12644 raft_consensus.cc:515] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:17.041433 12644 leader_election.cc:290] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 2 election: Requested vote from peers 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:17.042622 12717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda7567336a4617b80b0940c167785e" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:17.042920 12790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecda7567336a4617b80b0940c167785e" candidate_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:17.043367 12717 raft_consensus.cc:3060] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.043556 12790 raft_consensus.cc:3055] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:17.044016 12790 raft_consensus.cc:740] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Running, Role: LEADER
I20260709 13:04:17.044924 12790 consensus_queue.cc:260] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:17.046257 12790 raft_consensus.cc:3060] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.051543 12717 raft_consensus.cc:2468] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 2.
I20260709 13:04:17.052811 12608 leader_election.cc:304] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:17.053700 12949 raft_consensus.cc:2804] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:17.054301 12949 raft_consensus.cc:697] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 LEADER]: Becoming Leader. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:17.054663 12982 raft_consensus.cc:993] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c: : Instructing follower 8a517ba6254c4619a53d8a220316793e to start an election
I20260709 13:04:17.055223 12903 raft_consensus.cc:1081] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Signalling peer 8a517ba6254c4619a53d8a220316793e to start an election
I20260709 13:04:17.055153 12949 consensus_queue.cc:237] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:17.055871 12790 raft_consensus.cc:2468] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6eb7b81fa3f4375a84d1c4a972df45c in term 2.
I20260709 13:04:17.057412 12720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "945e1c78f8d04abfb344751415d9b3fc"
dest_uuid: "8a517ba6254c4619a53d8a220316793e"
 from {username='slave'} at 127.0.0.1:44144
I20260709 13:04:17.058218 12720 raft_consensus.cc:493] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.058557 12720 raft_consensus.cc:3060] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.065639 12720 raft_consensus.cc:515] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:17.065459 12540 catalog_manager.cc:5697] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c reported cstate change: term changed from 1 to 2, leader changed from 989e9a004b914452b13703cdfc705a2a (127.0.107.195) to b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.068276 12720 leader_election.cc:290] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 2 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 989e9a004b914452b13703cdfc705a2a (127.0.107.195:33369)
I20260709 13:04:17.068301 12644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e1c78f8d04abfb344751415d9b3fc" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:17.069190 12644 raft_consensus.cc:3055] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:17.069531 12644 raft_consensus.cc:740] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:17.070251 12644 consensus_queue.cc:260] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:17.071053 12644 raft_consensus.cc:3060] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.073118 12790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e1c78f8d04abfb344751415d9b3fc" candidate_uuid: "8a517ba6254c4619a53d8a220316793e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "989e9a004b914452b13703cdfc705a2a"
I20260709 13:04:17.074020 12790 raft_consensus.cc:3060] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.077270 12644 raft_consensus.cc:2468] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 2.
I20260709 13:04:17.078931 12685 leader_election.cc:304] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, b6eb7b81fa3f4375a84d1c4a972df45c; no voters: 
I20260709 13:04:17.080559 13026 raft_consensus.cc:2804] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:17.081244 13026 raft_consensus.cc:697] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [term 2 LEADER]: Becoming Leader. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:17.081655 12790 raft_consensus.cc:2468] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a517ba6254c4619a53d8a220316793e in term 2.
I20260709 13:04:17.082407 13026 consensus_queue.cc:237] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:17.091202 12540 catalog_manager.cc:5697] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e reported cstate change: term changed from 1 to 2, leader changed from b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193) to 8a517ba6254c4619a53d8a220316793e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8a517ba6254c4619a53d8a220316793e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.112864 12790 raft_consensus.cc:1275] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Refusing update from remote peer 8a517ba6254c4619a53d8a220316793e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.114450 13026 consensus_queue.cc:1048] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.122677 12644 raft_consensus.cc:1275] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Refusing update from remote peer 8a517ba6254c4619a53d8a220316793e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.124558 12948 consensus_queue.cc:1048] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.213019 12790 raft_consensus.cc:1275] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Refusing update from remote peer b6eb7b81fa3f4375a84d1c4a972df45c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.214679 12949 consensus_queue.cc:1048] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.223645 12720 raft_consensus.cc:1275] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Refusing update from remote peer b6eb7b81fa3f4375a84d1c4a972df45c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.225611 12949 consensus_queue.cc:1048] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.227260 12717 raft_consensus.cc:1275] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Refusing update from remote peer 989e9a004b914452b13703cdfc705a2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.229176 13005 consensus_queue.cc:1048] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:17.239931 12644 raft_consensus.cc:1275] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Refusing update from remote peer 989e9a004b914452b13703cdfc705a2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.242074 13005 consensus_queue.cc:1048] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:17.356046 12644 raft_consensus.cc:1275] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Refusing update from remote peer 8a517ba6254c4619a53d8a220316793e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.357434 12948 consensus_queue.cc:1048] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.366972 12790 raft_consensus.cc:1275] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Refusing update from remote peer 8a517ba6254c4619a53d8a220316793e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.369282 12988 consensus_queue.cc:1048] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:17.492452 12790 raft_consensus.cc:1275] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Refusing update from remote peer b6eb7b81fa3f4375a84d1c4a972df45c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.493959 12949 consensus_queue.cc:1048] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:17.504212 12720 raft_consensus.cc:1275] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Refusing update from remote peer b6eb7b81fa3f4375a84d1c4a972df45c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.506651 12903 consensus_queue.cc:1048] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:17.706833 12644 raft_consensus.cc:1275] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Refusing update from remote peer 8a517ba6254c4619a53d8a220316793e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.708334 12988 consensus_queue.cc:1048] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.713208 12790 raft_consensus.cc:1275] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Refusing update from remote peer 8a517ba6254c4619a53d8a220316793e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.721863 12988 consensus_queue.cc:1048] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [LEADER]: Connected to new peer: Peer: permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:19.544871 12539 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35742:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:04:19.565688 12539 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35742:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:04:19.633750   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:19.809122 13060 log.cc:927] Time spent T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:04:19.811136 13061 log.cc:927] Time spent T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:04:19.804847 13064 tablet.cc:1724] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:19.805420 13049 log.cc:927] Time spent T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:04:19.916082 13080 log.cc:927] Time spent T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:04:19.927039 13082 tablet.cc:1724] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.971026 13087 tablet.cc:1724] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:19.972093 13062 log.cc:927] Time spent T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e: Append to log took a long time: real 0.188s	user 0.005s	sys 0.000s
W20260709 13:04:19.995277 13063 log.cc:927] Time spent T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a: Append to log took a long time: real 0.195s	user 0.000s	sys 0.003s
I20260709 13:04:20.091391 13064 tablet.cc:1724] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.030620 13090 tablet.cc:1724] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.004843 13086 tablet.cc:1724] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.132682 13082 tablet.cc:1724] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.137008 12720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47760b9cf0d9421e92b08e9364e5c010"
dest_uuid: "8a517ba6254c4619a53d8a220316793e"
mode: GRACEFUL
new_leader_uuid: "989e9a004b914452b13703cdfc705a2a"
 from {username='slave'} at 127.0.0.1:50438
I20260709 13:04:20.137725 12720 raft_consensus.cc:606] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Received request to transfer leadership to TS 989e9a004b914452b13703cdfc705a2a
I20260709 13:04:20.153885 13104 tablet.cc:1724] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.157544 13105 tablet.cc:1724] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.161808 13100 tablet.cc:1724] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.162540 13106 tablet.cc:1724] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.143791 13087 tablet.cc:1724] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.173591 13099 tablet.cc:1724] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.146627 13101 tablet.cc:1724] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.183665 13104 tablet.cc:1724] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.191358 13105 tablet.cc:1724] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.194191 13107 tablet.cc:1724] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.209312 13064 tablet.cc:1724] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.220440 13026 raft_consensus.cc:993] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e: : Instructing follower 989e9a004b914452b13703cdfc705a2a to start an election
I20260709 13:04:20.221540 13071 raft_consensus.cc:1081] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Signalling peer 989e9a004b914452b13703cdfc705a2a to start an election
I20260709 13:04:20.224874 12792 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47760b9cf0d9421e92b08e9364e5c010"
dest_uuid: "989e9a004b914452b13703cdfc705a2a"
 from {username='slave'} at 127.0.0.1:60468
I20260709 13:04:20.226166 12792 raft_consensus.cc:493] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.226835 12792 raft_consensus.cc:3060] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.240702 13104 tablet.cc:1724] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.265662 13105 tablet.cc:1724] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.268056 13082 tablet.cc:1724] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.260264 13064 tablet.cc:1724] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.279496 13086 tablet.cc:1724] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.288913 13090 tablet.cc:1724] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.289489 12792 raft_consensus.cc:515] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:20.293155 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47760b9cf0d9421e92b08e9364e5c010" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:20.293817 12719 raft_consensus.cc:3055] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:20.294154 12719 raft_consensus.cc:740] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a517ba6254c4619a53d8a220316793e, State: Running, Role: LEADER
I20260709 13:04:20.295044 12719 consensus_queue.cc:260] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:20.296569 12719 raft_consensus.cc:3060] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.303110 12645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47760b9cf0d9421e92b08e9364e5c010" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:20.304421 12645 raft_consensus.cc:3060] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.307412 13101 tablet.cc:1724] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.308020 13100 tablet.cc:1724] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.276300 13099 tablet.cc:1724] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:20.310714 12719 raft_consensus.cc:2468] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 2.
I20260709 13:04:20.312228 12757 leader_election.cc:304] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a; no voters: 
I20260709 13:04:20.313755 13081 raft_consensus.cc:2804] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.314256 13081 raft_consensus.cc:697] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [term 2 LEADER]: Becoming Leader. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Running, Role: LEADER
I20260709 13:04:20.315086 13081 consensus_queue.cc:237] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:20.317520 12792 leader_election.cc:290] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 2 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:20.337757 12641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f43cd671499b4d4d8be09a7cc55b66de"
dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
mode: GRACEFUL
new_leader_uuid: "989e9a004b914452b13703cdfc705a2a"
 from {username='slave'} at 127.0.0.1:41074
I20260709 13:04:20.338474 12641 raft_consensus.cc:606] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Received request to transfer leadership to TS 989e9a004b914452b13703cdfc705a2a
I20260709 13:04:20.340168   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:20.340878   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:20.345216 12645 raft_consensus.cc:2468] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 2.
I20260709 13:04:20.368227 12539 catalog_manager.cc:5697] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a reported cstate change: term changed from 1 to 2, leader changed from 8a517ba6254c4619a53d8a220316793e (127.0.107.194) to 989e9a004b914452b13703cdfc705a2a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "989e9a004b914452b13703cdfc705a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.369972 12540 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c: soft_deleted_table [id=61a8bb2ac9c84e818d118355eedfc755] alter complete (version 1)
I20260709 13:04:20.713722 12719 raft_consensus.cc:1275] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Refusing update from remote peer 989e9a004b914452b13703cdfc705a2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.715185 13081 consensus_queue.cc:1048] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.727545 12645 raft_consensus.cc:1275] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Refusing update from remote peer 989e9a004b914452b13703cdfc705a2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:20.732061 13083 consensus_queue.cc:1048] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.877480 13118 raft_consensus.cc:993] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c: : Instructing follower 989e9a004b914452b13703cdfc705a2a to start an election
I20260709 13:04:20.877965 13067 raft_consensus.cc:1081] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Signalling peer 989e9a004b914452b13703cdfc705a2a to start an election
I20260709 13:04:20.879578 12792 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f43cd671499b4d4d8be09a7cc55b66de"
dest_uuid: "989e9a004b914452b13703cdfc705a2a"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:04:20.880077 12792 raft_consensus.cc:493] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.880340 12792 raft_consensus.cc:3060] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.885751 12792 raft_consensus.cc:515] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:20.887826 12792 leader_election.cc:290] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 2 election: Requested vote from peers b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221), 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275)
I20260709 13:04:20.888885 12645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43cd671499b4d4d8be09a7cc55b66de" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c"
I20260709 13:04:20.888885 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43cd671499b4d4d8be09a7cc55b66de" candidate_uuid: "989e9a004b914452b13703cdfc705a2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a517ba6254c4619a53d8a220316793e"
I20260709 13:04:20.889662 12645 raft_consensus.cc:3055] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:20.890255 12719 raft_consensus.cc:3060] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.890404 12645 raft_consensus.cc:740] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6eb7b81fa3f4375a84d1c4a972df45c, State: Running, Role: LEADER
I20260709 13:04:20.891404 12645 consensus_queue.cc:260] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:20.892815 12645 raft_consensus.cc:3060] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.898851 12719 raft_consensus.cc:2468] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 2.
I20260709 13:04:20.900321 12757 leader_election.cc:304] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a517ba6254c4619a53d8a220316793e, 989e9a004b914452b13703cdfc705a2a; no voters: 
I20260709 13:04:20.900647 12645 raft_consensus.cc:2468] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 989e9a004b914452b13703cdfc705a2a in term 2.
I20260709 13:04:20.901348 13081 raft_consensus.cc:2804] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.901962 13081 raft_consensus.cc:697] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 2 LEADER]: Becoming Leader. State: Replica: 989e9a004b914452b13703cdfc705a2a, State: Running, Role: LEADER
I20260709 13:04:20.902825 13081 consensus_queue.cc:237] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } }
I20260709 13:04:20.911615 12539 catalog_manager.cc:5697] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a reported cstate change: term changed from 1 to 2, leader changed from b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193) to 989e9a004b914452b13703cdfc705a2a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "989e9a004b914452b13703cdfc705a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "989e9a004b914452b13703cdfc705a2a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33369 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:21.363823 12719 raft_consensus.cc:1275] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Refusing update from remote peer 989e9a004b914452b13703cdfc705a2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:21.365362 13123 consensus_queue.cc:1048] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a517ba6254c4619a53d8a220316793e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:21.375654 12645 raft_consensus.cc:1275] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Refusing update from remote peer 989e9a004b914452b13703cdfc705a2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:21.377218 13081 consensus_queue.cc:1048] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6eb7b81fa3f4375a84d1c4a972df45c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:21.419832   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:04:21.457971   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:21.459064   431 tablet_replica.cc:333] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
W20260709 13:04:21.459182 12759 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
I20260709 13:04:21.460237   431 raft_consensus.cc:2243] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.460988   431 raft_consensus.cc:2272] T ac33a19a9bc34c04a1a4391bc80402dd P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:21.462647 12759 consensus_peers.cc:597] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a -> Peer b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221): Couldn't send request to peer b6eb7b81fa3f4375a84d1c4a972df45c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.463416   431 tablet_replica.cc:333] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.464449   431 raft_consensus.cc:2243] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.465459   431 raft_consensus.cc:2272] T 3ce8fa32acc0413d9353843a446a75b1 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.467528   431 tablet_replica.cc:333] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.468150   431 raft_consensus.cc:2243] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.469046   431 raft_consensus.cc:2272] T 9cab43c1c3dd49c1af93eacec08cbaab P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.471565   431 tablet_replica.cc:333] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.472182   431 raft_consensus.cc:2243] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.472775   431 raft_consensus.cc:2272] T 8a62e396fd38482bb1b1cb3afaa83f87 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.474759   431 tablet_replica.cc:333] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.475591   431 raft_consensus.cc:2243] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.476404   431 raft_consensus.cc:2272] T ecda7567336a4617b80b0940c167785e P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.478433   431 tablet_replica.cc:333] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.478976   431 raft_consensus.cc:2243] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.479384   431 raft_consensus.cc:2272] T 945e1c78f8d04abfb344751415d9b3fc P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.481351   431 tablet_replica.cc:333] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.481884   431 raft_consensus.cc:2243] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.482286   431 raft_consensus.cc:2272] T 5d282fc2f5934847b9551935e80c14fe P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.484095   431 tablet_replica.cc:333] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.484789   431 raft_consensus.cc:2243] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.485924   431 raft_consensus.cc:2272] T e1a44b2941fb42b1a0a11fe23a8fbabe P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.487730   431 tablet_replica.cc:333] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.488231   431 raft_consensus.cc:2243] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.488708   431 raft_consensus.cc:2272] T f49501cf037c42b5ad72361058c8ec05 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.490955   431 tablet_replica.cc:333] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.491668   431 raft_consensus.cc:2243] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.492734   431 raft_consensus.cc:2272] T cfd32413649e46b884db77340c4aff7d P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.496138   431 tablet_replica.cc:333] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
W20260709 13:04:21.496192 12685 consensus_peers.cc:597] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e -> Peer b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221): Couldn't send request to peer b6eb7b81fa3f4375a84d1c4a972df45c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.496824   431 raft_consensus.cc:2243] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.497860   431 raft_consensus.cc:2272] T 74e0edbc4dc04ed8a79a914e02caf263 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.500950   431 tablet_replica.cc:333] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.501603   431 raft_consensus.cc:2243] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:21.501740 12685 consensus_peers.cc:597] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e -> Peer b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221): Couldn't send request to peer b6eb7b81fa3f4375a84d1c4a972df45c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.502549   431 raft_consensus.cc:2272] T 9073139f562f4aabb2d9b7dffd47f6ec P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.504958   431 tablet_replica.cc:333] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.505587   431 raft_consensus.cc:2243] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.506038   431 raft_consensus.cc:2272] T f43cd671499b4d4d8be09a7cc55b66de P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.509315   431 tablet_replica.cc:333] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.509934   431 raft_consensus.cc:2243] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.510407   431 raft_consensus.cc:2272] T 47760b9cf0d9421e92b08e9364e5c010 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.513260   431 tablet_replica.cc:333] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.513983   431 raft_consensus.cc:2243] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.514495   431 raft_consensus.cc:2272] T 6e8f5a8003ef4d81b9f1ab02263de490 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.516891   431 tablet_replica.cc:333] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.517513   431 raft_consensus.cc:2243] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.518195   431 raft_consensus.cc:2272] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.520623   431 tablet_replica.cc:333] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.521287   431 raft_consensus.cc:2243] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.521775   431 raft_consensus.cc:2272] T f1f31759f39a4c65a7ae9217aaa2355f P b6eb7b81fa3f4375a84d1c4a972df45c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.524335   431 tablet_replica.cc:333] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c: stopping tablet replica
I20260709 13:04:21.524935   431 raft_consensus.cc:2243] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.525564   431 raft_consensus.cc:2272] T e97bba1f73154672819b263e307c69d3 P b6eb7b81fa3f4375a84d1c4a972df45c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:21.540063 12685 consensus_peers.cc:597] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e -> Peer b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221): Couldn't send request to peer b6eb7b81fa3f4375a84d1c4a972df45c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.569558   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:04:21.589444 12685 consensus_peers.cc:597] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e -> Peer b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221): Couldn't send request to peer b6eb7b81fa3f4375a84d1c4a972df45c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.605558   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:04:21.616636 12757 consensus_peers.cc:597] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a -> Peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Couldn't send request to peer 8a517ba6254c4619a53d8a220316793e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.640369   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:21.641333   431 tablet_replica.cc:333] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.642045   431 raft_consensus.cc:2243] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.642493   431 raft_consensus.cc:2272] T ac33a19a9bc34c04a1a4391bc80402dd P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.644412   431 tablet_replica.cc:333] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.645049   431 raft_consensus.cc:2243] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.645807   431 raft_consensus.cc:2272] T 5d282fc2f5934847b9551935e80c14fe P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.648202   431 tablet_replica.cc:333] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.648900   431 raft_consensus.cc:2243] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.649669   431 raft_consensus.cc:2272] T 8a62e396fd38482bb1b1cb3afaa83f87 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.651548   431 tablet_replica.cc:333] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.652036   431 raft_consensus.cc:2243] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.652424   431 raft_consensus.cc:2272] T 9cab43c1c3dd49c1af93eacec08cbaab P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.654220   431 tablet_replica.cc:333] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.654717   431 raft_consensus.cc:2243] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.655095   431 raft_consensus.cc:2272] T 3ce8fa32acc0413d9353843a446a75b1 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.657222   431 tablet_replica.cc:333] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.657747   431 raft_consensus.cc:2243] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.658215   431 raft_consensus.cc:2272] T ecda7567336a4617b80b0940c167785e P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.660678   431 tablet_replica.cc:333] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.661376   431 raft_consensus.cc:2243] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.661908   431 raft_consensus.cc:2272] T 47760b9cf0d9421e92b08e9364e5c010 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:21.662675 12685 consensus_peers.cc:597] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e -> Peer b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221): Couldn't send request to peer b6eb7b81fa3f4375a84d1c4a972df45c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.665004   431 tablet_replica.cc:333] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.665957   431 raft_consensus.cc:2243] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.666460   431 raft_consensus.cc:2272] T f43cd671499b4d4d8be09a7cc55b66de P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:21.669034 12759 consensus_peers.cc:597] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a -> Peer b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221): Couldn't send request to peer b6eb7b81fa3f4375a84d1c4a972df45c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.669698   431 tablet_replica.cc:333] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.670336   431 raft_consensus.cc:2243] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.671101   431 raft_consensus.cc:2272] T 945e1c78f8d04abfb344751415d9b3fc P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.673076   431 tablet_replica.cc:333] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.673643   431 raft_consensus.cc:2243] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.674065   431 raft_consensus.cc:2272] T 74e0edbc4dc04ed8a79a914e02caf263 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.676033   431 tablet_replica.cc:333] T 9073139f562f4aabb2d9b7dffd47f6ec P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.676573   431 raft_consensus.cc:2243] T 9073139f562f4aabb2d9b7dffd47f6ec P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.677032   431 raft_consensus.cc:2272] T 9073139f562f4aabb2d9b7dffd47f6ec P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.679056   431 tablet_replica.cc:333] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.679642   431 raft_consensus.cc:2243] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.680430   431 raft_consensus.cc:2272] T 6e8f5a8003ef4d81b9f1ab02263de490 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.682529   431 tablet_replica.cc:333] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.683080   431 raft_consensus.cc:2243] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.683892   431 raft_consensus.cc:2272] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.686133   431 tablet_replica.cc:333] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.686738   431 raft_consensus.cc:2243] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.687175   431 raft_consensus.cc:2272] T cfd32413649e46b884db77340c4aff7d P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.689888   431 tablet_replica.cc:333] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.690630   431 raft_consensus.cc:2243] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.691406   431 raft_consensus.cc:2272] T f49501cf037c42b5ad72361058c8ec05 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.693910   431 tablet_replica.cc:333] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.694603   431 raft_consensus.cc:2243] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.695102   431 raft_consensus.cc:2272] T e1a44b2941fb42b1a0a11fe23a8fbabe P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.697111   431 tablet_replica.cc:333] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.697572   431 raft_consensus.cc:2243] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.698081   431 raft_consensus.cc:2272] T e97bba1f73154672819b263e307c69d3 P 8a517ba6254c4619a53d8a220316793e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.700228   431 tablet_replica.cc:333] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e: stopping tablet replica
I20260709 13:04:21.700839   431 raft_consensus.cc:2243] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.701864   431 raft_consensus.cc:2272] T f1f31759f39a4c65a7ae9217aaa2355f P 8a517ba6254c4619a53d8a220316793e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.745770   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:04:21.778810   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:04:21.811331   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:04:21.812283 12759 consensus_peers.cc:597] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a -> Peer b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221): Couldn't send request to peer b6eb7b81fa3f4375a84d1c4a972df45c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.813952   431 tablet_replica.cc:333] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.814900   431 raft_consensus.cc:2243] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.815752   431 raft_consensus.cc:2272] T ac33a19a9bc34c04a1a4391bc80402dd P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.818282   431 tablet_replica.cc:333] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
W20260709 13:04:21.818282 12757 consensus_peers.cc:597] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a -> Peer 8a517ba6254c4619a53d8a220316793e (127.0.107.194:41275): Couldn't send request to peer 8a517ba6254c4619a53d8a220316793e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.819219   431 raft_consensus.cc:2243] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.819720   431 raft_consensus.cc:2272] T 945e1c78f8d04abfb344751415d9b3fc P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:21.819865 12759 consensus_peers.cc:597] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a -> Peer b6eb7b81fa3f4375a84d1c4a972df45c (127.0.107.193:41221): Couldn't send request to peer b6eb7b81fa3f4375a84d1c4a972df45c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.821993   431 tablet_replica.cc:333] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.822849   431 raft_consensus.cc:2243] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.823232   431 raft_consensus.cc:2272] T 8a62e396fd38482bb1b1cb3afaa83f87 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.825043   431 tablet_replica.cc:333] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.825528   431 raft_consensus.cc:2243] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.825912   431 raft_consensus.cc:2272] T 9cab43c1c3dd49c1af93eacec08cbaab P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.827641   431 tablet_replica.cc:333] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.828145   431 raft_consensus.cc:2243] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.828509   431 raft_consensus.cc:2272] T ecda7567336a4617b80b0940c167785e P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.830331   431 tablet_replica.cc:333] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.830847   431 raft_consensus.cc:2243] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.831197   431 raft_consensus.cc:2272] T 3ce8fa32acc0413d9353843a446a75b1 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.832976   431 tablet_replica.cc:333] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.833461   431 raft_consensus.cc:2243] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.833824   431 raft_consensus.cc:2272] T 5d282fc2f5934847b9551935e80c14fe P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.835507   431 tablet_replica.cc:333] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.836025   431 raft_consensus.cc:2243] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.836385   431 raft_consensus.cc:2272] T e1a44b2941fb42b1a0a11fe23a8fbabe P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.838227   431 tablet_replica.cc:333] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.838725   431 raft_consensus.cc:2243] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.839119   431 raft_consensus.cc:2272] T f49501cf037c42b5ad72361058c8ec05 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.840984   431 tablet_replica.cc:333] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.841588   431 raft_consensus.cc:2243] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.842054   431 raft_consensus.cc:2272] T cfd32413649e46b884db77340c4aff7d P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.844125   431 tablet_replica.cc:333] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.844761   431 raft_consensus.cc:2243] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.845224   431 raft_consensus.cc:2272] T 6e8f5a8003ef4d81b9f1ab02263de490 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.847313   431 tablet_replica.cc:333] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.847855   431 raft_consensus.cc:2243] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.848277   431 raft_consensus.cc:2272] T 333f6ad50d5d4cd9a9aa980c1cbc8f53 P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.850308   431 tablet_replica.cc:333] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.850859   431 raft_consensus.cc:2243] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.851263   431 raft_consensus.cc:2272] T 9073139f562f4aabb2d9b7dffd47f6ec P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.853304   431 tablet_replica.cc:333] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.853857   431 raft_consensus.cc:2243] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.854290   431 raft_consensus.cc:2272] T 74e0edbc4dc04ed8a79a914e02caf263 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.856316   431 tablet_replica.cc:333] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.856889   431 raft_consensus.cc:2243] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.857690   431 raft_consensus.cc:2272] T f43cd671499b4d4d8be09a7cc55b66de P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.859979   431 tablet_replica.cc:333] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.860514   431 raft_consensus.cc:2243] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.861301   431 raft_consensus.cc:2272] T 47760b9cf0d9421e92b08e9364e5c010 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.863230   431 tablet_replica.cc:333] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.863709   431 raft_consensus.cc:2243] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.864501   431 raft_consensus.cc:2272] T e97bba1f73154672819b263e307c69d3 P 989e9a004b914452b13703cdfc705a2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.866562   431 tablet_replica.cc:333] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a: stopping tablet replica
I20260709 13:04:21.867046   431 raft_consensus.cc:2243] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:21.867468   431 raft_consensus.cc:2272] T f1f31759f39a4c65a7ae9217aaa2355f P 989e9a004b914452b13703cdfc705a2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.907658   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:21.939730   431 master.cc:562] Master@127.0.107.254:41207 shutting down...
I20260709 13:04:21.965184   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:21.965909   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:21.966360   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4cf676cca17d466287655c57f5efb93c: stopping tablet replica
I20260709 13:04:21.996793   431 master.cc:584] Master@127.0.107.254:41207 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12382 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (27396 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (372253 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:04:22.056950   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 416 messages since previous log ~584 seconds ago
I20260709 13:04:22.057235   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 416 messages since previous log ~584 seconds ago
I20260709 13:04:22.057435   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 412 messages since previous log ~584 seconds ago
I20260709 13:04:22.057646   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:04:22.057839   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:04:22.058068   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~117 seconds ago
I20260709 13:04:22.058279   431 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~270 seconds ago
I20260709 13:04:22.058563   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 11 messages since previous log ~0 seconds ago
I20260709 13:04:22.058863   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~11 seconds ago
